SpahQL - A query language for Javascript objects

http://angryamoeba.co.uk/spahql-announce/

by raystar • 14 years ago

83 34 14 years ago

angryamoeba.co.uk

have you considered adopting the jsonpath syntax?

it would be more javascripty and would be another implementation (or a superset) of jsonpath

http://goessner.net/articles/JsonPath/ http://code.google.com/p/jsonpath/ https://github.com/joshbuddy/jsonpath https://github.com/marianoguerra/jsonpath-scala

angryamoeba8• 14 years ago

Author here. I wanted to try something a little lighter than jsonpath and with a specific mode of (node collection|descent) that allowed set arithmetic to be the primary means of comparisons and assertions. This allowed me to obviate the need for scoped AND/OR structures and instead provide a broad range of assertion options using superset, subset, disjoint and joint set operations.

It's most certainly not perfect, but I had fun experimenting with it.

marianoguerra2• 14 years ago

it's a nice project, and if it adds something extra then go for it :)

but sometimes I think jsonpath should be more visible and it's not, that's why I was trying to avoid fragmentation for the same solution. But as you said, it tries a different approach so it makes sense to use a different syntax.

pygy_2• 14 years ago

Interresting.

SQlike is another effort in the same direction. It provides a wide range of SQL features including joins. JavaScript tables are used as query language.

See http://www.thomasfrank.se/sqlike.html for an overview and http://www.thomasfrank.se/SQLike/ for examples.

    dataArray = [
    {firstName: "Paul", lastName: "Stele", age:35, salary:35000},
    ...
    ]

    dataArray2 = [
    {firstName: "Paul", lastName: "Stele", favColor:"green"},
    ...
    ]

    SQLike.q(
       {
           Select: ['*'],
           From: dataArray,
           Where: function(){return this.salary>50000},
           OrderBy: ['salary','|desc|']
       }
    )


    SQLike.q(
       {
           Select: ['*'],
           From: {t1:dataArray},
           NaturalJoin: {t2:dataArray2},
           Where:function(){return this.t1.firstName!='Vicki'}
       }
    )

angryamoeba8• 14 years ago

This looks pretty handy for large datasets, to be sure.

SpahQL is definitely much lighter than that - the API is intended to be more jquery-like with a specific selector language, each selection returning a resultset object which then provides methods for subselections and modifications.

Nemmie• 14 years ago

I have used linq.js in the past to query my JSON: http://linqjs.codeplex.com/

ZenPsycho5• 14 years ago

I wish developers would stop copying SQL. It's like making fancy new languages, and then adding libraries that help you emulate COBOL. SQL is not the first, the last, or the best query language ever created, it's just the best marketed. It's not even properly relational, it's based on a series of shell scripts on multics for crying out loud!

alexchamberlain4• 14 years ago

Is this not more similar to XPath?

delinka• 14 years ago

Please provide some substance to your post. What other options exist? What are some references you've used to work with those options?

ZenPsycho5• 14 years ago

Well back when SQL was first created, there was a superior alternative named QUEL. Fast forward to today, and with the proliferation of programming languages that easily support high level concepts, it doesn't take that much imagination to think of better ways of dealing with large relation-values. linq for example. Going along a different direction, the language Prolog, and its much improved derivative Mercury take the concept of query languages to really amazingly awesome places. The quite well done software package PrinceXML was written in Mercury.

Edit: I also want to add Datalog http://en.wikipedia.org/wiki/Datalog

and list comprehensions http://en.wikipedia.org/wiki/List_comprehensions

arethuza3• 14 years ago

"I wish developers would stop copying SQL"

This really doesn't look much like SQL to me - much more like an interesting variation on XPath...

Why do you think it is a copy of SQL?

ZenPsycho5• 14 years ago

Sorry, my comment really should have been a reply to the SQL-Like post.

dagw• 14 years ago

Cool. This plus xml2js should make the whole process of extracting data from a bunch of 3rd-party xml files I'm currently dealing with a lot easier.

angryamoeba8• 14 years ago

Hope you get some use out of it - don't forget to let me know any issues you have. Also there's some other neat JS-querying systems linked in these comments, so check those out and see which meets your needs!

zdwalter• 14 years ago

shall we add SpahQL to MongoDB?

alexchamberlain4• 14 years ago

This looks interesting, I wonder whether the path syntax would work in URLs.

angryamoeba8• 14 years ago

Can you unpack that question a little for me? As in, could you use a spahql selection as the path component of some request? I don't see why not, but the escaping will probably look a little ugly.

alexchamberlain4• 14 years ago

Given a url that returns JSON:

  www.example.com/data.json,

one could append SparQL to select a subset

  www.example.com/data.json/user

  www.example.com/data.json/categories/*

  www.example.com/data.json/categories/0/products

  www.example.com/data.json//avatar

46Bit• 14 years ago

Looks far too similarly pronounced to SPARQL (http://www.w3.org/TR/rdf-sparql-query/). Or is that deliberate?

angryamoeba8• 14 years ago

Nope it's completely my fault. SpahQL is so named because it was primarily developed for Spah, another project I'm working on.

I hope I don't cause too much confusion!

DonnyV• 14 years ago

linq.js has been doing this for years now. Its a mature library, flexible and light. I use it for every web project, wouldn't know what to do with out it. http://linqjs.codeplex.com/ Examples: http://neue.cc/reference.htm

  Features
  --------------------------------------  
  implement all .NET 4.0 methods and many extra methods
  (inspiration from Rx, Achiral, Haskell, Ruby, etc...)
  complete lazy evaluation
  full IntelliSense support for VisualStudio
  two versions - linq.js and jquery.linq.js (jQuery plugin)
  support Windows Script Host
  binding for Reactive Extensions for JavaScript(RxJS) and   
  IntelliSense Generator -> see documentation
  NuGet install support(linq.js, linq.js-jQuery, linq.js-Bindings)

  90 Methods
  ----------------------------------------
  Aggregate, All, Alternate, Any, Average, BufferWithCount,   
  CascadeBreadthFirst, CascadeDepthFirst, Catch, Choice,  
  Concat,Contains, Count, Cycle, DefaultIfEmpty, Distinct, Do,   
  ElementAt, ElementAtOrDefault, Empty, Except, Finally, First,  
  FirstOrDefault, Flatten, ForEach, Force, From, Generate,  
  GetEnumerator, GroupBy, GroupJoin, IndexOf, Insert, Intersect, 
  Join, Last, LastIndexOf,
  LastOrDefault, Let, Matches, Max, MaxBy, MemoizeAll, Min,  
  MinBy, OfType, OrderBy, OrderByDescending, Pairwise,  
  PartitionBy, Range, RangeDown, RangeTo, Repeat,  
  RepeatWithFinalize, Return, Reverse, Scan, Select, SelectMany,  
  SequenceEqual, Share, Shuffle,
  Single, SingleOrDefault, Skip, SkipWhile, Sum, Take,  
  TakeExceptLast, TakeFromLast, TakeWhile, ThenBy,  
  ThenByDescending, ToArray,
  ToDictionary, ToInfinity,ToJSON, ToLookup, ToNegativeInfinity,  
  ToObject, ToString, Trace, Unfold, Union, Where, Write,  
  WriteLine, Zip

angryamoeba8• 14 years ago

Good utility, but I had a few specific itches to scratch with SpahQL:

* Declarative syntax for selections, such that selection queries may be handed between implementations in other languages

* Imperative syntax for updates, such that updates may be idiomatic to the language in which the spahql library has been ported (linq meets this criteria)

In essence all SpahQL is, is a shorthand syntax for generating traversal and descent functions, which output a proxy object for reading to and writing from the selected nodes.

mratzloff• 14 years ago

So, what does performance look like for complex data sets? Any benchmarks?

angryamoeba8• 14 years ago

None whatsoever apart from to say that it's acceptably fast for whatever data set I happen to throw at it. Another poster here mentioned in an email that he'd tried it against arrays of ~50000 object structures and it was fine.

willlll• 14 years ago

Also check out json:select http://jsonselect.org/#overview It's more like css selectors than xpath

quile• 14 years ago

Nice.

Along these lines, by the way, is my Javascript port of Apple's "key-value coding":

http://quile.github.com/keyvaluecoding-js

which allows you to traverse object graphs without all the null-check nonsense. Admittedly the purpose is slightly different, but they seem related.

NHQ• 14 years ago

bookmarking this.

SpahQL - A query language for Javascript objects

Related Stories