EJDB: Embedded JSON Database for C/C++, .Net, NodeJS, Python, Lua, Java, Ruby

by andrewstuart • 13 years ago

119 55 13 years ago

pvnick4• 13 years ago

I love things like this. I generally work with JSON anyway when I'm doing one-off things like cron jobs, and I usually just keep my data in JSON flat files, so to have options like these really makes my life easier. Great job!

meowface• 13 years ago

I fully agree; databases that store JSON (or something close to it) natively are really useful when your application mostly inputs and outputs JSON.

I feel there are too many JSON-store databases, though. Competition is good but it's been getting kind of ridiculous.

zekenie2• 13 years ago

(Maybe silly) question: if we're talking about the node implementation, why use this over mongodb?

cheald• 13 years ago

Embeddable databases are nice and portable. It's like Sqlite versus Postgres - the latter may be more robust, but requiring it as a dependency greatly increases the effort needed to deploy your software. If an embedded database can do the job, it may be worth it as a matter of convenience.

zekenie2• 13 years ago

Thanks!

Moto74512• 13 years ago

Same reason why one might use SQLite over MySQL. Ease of configuration, no need to have a full blown DB server, lighter weight which makes it great for things like Raspberry Pi type hardware. For hackathons I've found it simpler to just use SQLite so I don't have to deal with MySQL configuration headaches that come up when IP addresses inevitably change.

Outside of NodeJS, I can see this being pretty handy for iOS development. I'm not a huge fan of taking JSON from an API, converting it into an NSDictionary, and then placing it into Core Data and RESTKit doesn't always fit my needs. I think this might work well for local persistence of API data for an offline mode.

andrewstuart9• 13 years ago

Are there issues with concurrency though when used in a web application?

arms• 13 years ago

Very nice. I'm writing a Python app where this would come in very handy. Can't wait to try it out.

maratd2• 13 years ago

So you've got C/C++, .Net, NodeJS, Python, Lua, Java, and Ruby covered ... but PHP is a no go?

Why not change it to we're on everything but PHP? Seems more succinct.

oinksoft• 13 years ago

I'm not sure how to say this without being inflammatory ... there is a universe outside of PHP, and PHP is not at the center of that universe.

maratd2• 13 years ago

there is a universe outside of PHP, and PHP is not at the center of that universe.

There is only one universe and PHP is a part of it. A big part. That's the reality.

Some of us have to work on multiple platforms with multiple languages and it's truly a disappointment when the authors clearly put in an effort to cater to the community where multiple platform support is prioritized ... but then exclude a platform due to personal bias.

That makes this project a no-go for me.

andrewstuart9• 13 years ago

It's just nice to see a project where they put the effort into driver development. Even without PHP it's an impressive list of drivers.

andrewstuart9• 13 years ago

It seems there is more demand from Lua developers.

zura• 13 years ago

And Pike! :)

I really wish this little language had more publicity.

pekk• 13 years ago

So write it yourself if it's so important to you.

Can't please everyone.

gaara87• 13 years ago

Would be pretty cool if replication can be achieved

andrewstuart9• 13 years ago

The disappointing thing about Tokyo Cabinet is that an empty database is six megabytes in size. Not good for embedded systems where space it short.

ra2• 13 years ago

Presumably that was one of the motives behind this rewrite for embedded?

skrebbel• 13 years ago

I don't think this targets embedded systems. I believe the term "embedded" is used to signal that the db is embedded inside your app, and not an external server daemon that you need to talk to over some protocol.

tericho• 13 years ago

This is awesome, I'm wondering how it performs for the average web app. Are there benchmarks load tests anywhere?

pvnick4• 13 years ago

Just off my basic understanding of how the database works, I don't believe a production web app would be a very appropriate use-case, since considering it's an embeddable database you'll be bound by the slow filesystem. Mysql/postgres or mongodb would be better options. This is more for self-contained applications such as cron jobs or utilities.

andrewstuart9• 13 years ago

Really? I'd be interested to hear why it can't be used as a web server database.

hendzen2• 13 years ago

Since the underlying storage system is based on a modified version of Tokyo Cabinet [0], I don't see why it wouldn't be appropriate for small apps where a discrete DB would be overkill.

[0] http://fallabs.com/tokyocabinet/spex-en.html

programminggeek• 13 years ago

This looks awesome, but I find it odd how similar things on HN seem to pop up in bunches. It's as if once one thing hits HN, a very similar thing is automatically submitted and promoted to front page. It's a fairly strange social dynamic to be sure.

melling• 13 years ago

People want karma points so if they see something is of interest to the crowd, you get more of it.

andrewstuart9• 13 years ago

If only karma was cash. I'd be a hundredairre.

zerr• 13 years ago

Why would anyone want karma? Really interesting.

andrewstuart9• 13 years ago

I posted this link because I saw the post on the HN front page to unQlite and I thought I saw an embedded JSON database recently that's more interesting, so I posted a link to it. Whoever decides what goes on the front page of HN likes open source stuff with no commercial agenda with buzzwords around recent and interesting tech, so they bumped it to front page.

dspillett2• 13 years ago

A lot of that is one post starting a train of thought in others. "Oh, I saw something like that recently" or "I think I know a better whatever" and so forth - that train of thought either is or leads them to something on the subject that they feel worth posting. Sometimes this happens repeatedly.

Sometimes it is blatant "karma whoring" (check parts of reddit for many examples of this getting out of hand), but usually (here at least) it is genuine people thinking that if you were interested in X, you might find Y informative/useful/amusing too.

dangayle2• 13 years ago

I was just asking the other day on #python if there was a nosql embedded DB like sqlite. I will definitely be checking this out. Might make things like my one-off test web scraping much easier.

tuzemec• 13 years ago

Exactly my case. I have this web scraping based on scrapy and I was dealing with some big json files. I'll try it for sure.

ddorian43• 13 years ago

http://www.reddit.com/r/Python/comments/1bap6u/embedded_docu...

dangayle2• 13 years ago

Lots of good links in there. Thanks!

arethuza• 13 years ago

Couldn't you layer a nosql engine on top of sqlite?

ra2• 13 years ago

There's Berkelydb, that's a KV store.

albertzeyer• 13 years ago

It is based on Tokyo Cabinet (which is under LGPL).

On the homepage of Tokyo Cabinet, it says:

"BTW, do you know Kyoto Cabinet? Actually, it is more powerful and convenient library than Tokyo Cabinet. At this distance of time, Kyoto Cabinet surpasses Tokyo Cabinet in every aspects. I strongly recommend you to use Kyoto Cabinet."

I wonder why that isn't used. Maybe because Kyoto Cabinet is under GPL.

chmodd3• 13 years ago

Indeed, this is probably the reason. The company that developed ejdb (Softmotions) apparently uses ejdb in their own proprietary software, and they wouldn't be able to if it contained any GPL components.

munimkazia• 13 years ago

This looks interesting.. I have used nedb on a small project, That is another file based database, uses the same API as mongoDB. nedb is just an npm, so its only nodejs supported right now, and the feature list of EJDB looks more impressive anyway.

pixelmonkey• 13 years ago

I discovered this a few weeks ago and realized it might be a great fit as a data store for a 'local, self-contained' web application. That is, a web app that is meant to run locally & in the browser (like IPython Notebook) but needs a database for local persistence, without the complexity of using the filesystem for storage. It's basically the benefits of SQLite with a simpler, NoSQL interface/design.

wslh• 13 years ago

I think one of the key points is being able to run the "same" lib in different programming languages. This is a model of thinking that need to be followed as much as possible. If not, we are rounding in circles with zillions of libraries created for Javascript that already are present in other programming languages the energies end up unfocused. At the same time we need tools that help us in this approach, like HaXe or SWIG.

One lib that I love is NetworkX, If you look at the source code it can be easily ported to more programming languages. At the same time it is impressive what Cocos2D achieved with their Javascript bindings and HTML5 native support.

EJDB: Embedded JSON Database for C/C++, .Net, NodeJS, Python, Lua, Java, Ruby

Related Stories