TokuDB open sourced

http://www.tokutek.com/2013/04/announcing-tokudb-v7-open-source-and-more/

by porker • 13 years ago

89 52 13 years ago

tokutek.com

schleppy_oc• 13 years ago

LOL "Error establishing a database connection"

bsg75• 13 years ago

"Error establishing a database connection" - Irony.

tachion• 13 years ago

Shit happens - to everyone, even DB guys. Even with DB's. And I'd say more often with DB's to DB guys than with DB's to anyone else ;)

txsl• 13 years ago

Was quite looking forward to reading this, but when I clicked the link, I was faced with: http://imgur.com/wwEogpx I think there's a certain irony seeing as this is a database related announcement!

jemfinch• 13 years ago

You took a screenshot of plain text. Did "Error establishing database connection" not suffice?

mjs• 13 years ago

Well ... I think it's actually pretty good bug reporting habit. Was it text/plain or unstyled text/html? Was the body an error message but a styled header and footer present? You might want to copy and paste the text as well, to aid future copy and paste efforts, but it's surprisingly frequently useful to have a screenshot.

misframer• 13 years ago

Anyone have a cached page?

jheino• 13 years ago

https://webcache.googleusercontent.com/search?hl=fi&q=ca...

mrjbq7• 13 years ago

TokuDB is great technology, glad to see them embracing open source. Too bad their wordpress installation needs some tuning!

ritonlajoie• 13 years ago

The site is down. What is great in this technology ?

cpleppert• 13 years ago

For starters, it totally changes the database performance paradigm for managing tables with many indexes.

mjn3• 13 years ago

The main technical underpinning (though note this isn't my area) seems to be basing indices on a particular improvement to B-trees, Cache-Oblivious Streaming B-Trees, which have some nice performance characteristics. I think what TokuDB calls "fractal trees" are just a catchier synonym.

Here's an academic paper from a few years ago from some of the people involved: http://supertech.csail.mit.edu/papers/sbtree.pdf

And a more recent talk focused on TokuDB: http://www.bnl.gov/csc/seminars/abstracts/Bender_Presentatio...

leif6• 13 years ago

We're trying to contact the website folk but they're mighty busy announcing things right now. I'll let you all know what happened soon. In the meantime, here's a press release you can read: http://www.marketwire.com/press-release/tokutek-meets-big-da...

Also, we're on github: http://github.com/Tokutek and on IRC at #tokutek on irc.freenode.net, so come hang out!

zardosht4• 13 years ago

And our google groups: - tokudb-dev - tokudb-user

plasma• 13 years ago

Cache: http://webcache.googleusercontent.com/search?q=cache%3Ahttp%...

zardosht4• 13 years ago

Link to source code: https://github.com/tokutek

brass9• 13 years ago

> Tokutek, a leader in high-performance and agile database storage engines....

"Database Error: Error establishing a database connection"

Ouch!

muyuu• 13 years ago

Heh

http://i.imgur.com/2WhDwFI.png

bradleykuszmaul2• 13 years ago

Sadly, we don't use TokuDB to run our web site. It's some relatively inexpensive service.

trs80coco• 13 years ago

OK, we are all learning first hand here about the "slashdot" effect http://en.wikipedia.org/wiki/Slashdot_effect (now Hacker news effect).

We are working to get the site back up (a simple Wordpress site set up by the marketing department that does not use our database). In the meantime, please take a look at http://mwne.ws/124r2GL

Thanks for all the comments. We clearly didn't anticipate this level of excitement, but are grateful for the interest.

ShiningRay• 13 years ago

Is there any testimonial using TokuDB?

zardosht4• 13 years ago

Hope this helps, from Tokutek's website: http://www.tokutek.com/solutions/

btb• 13 years ago

Edit, oops followed parents link to this: http://www.tokutek.com/products/tokudb-for-mysql/:

"Tools such as Hot Backup (coming soon) allow a backup to be completed while database is running."

- Does that mean that someone using the opensource version would be unable to take a backup of a running database?

carterschonwald4• 13 years ago

Does this mean that it's now safe for folks to write their own versions of the data structures that tokutek has patents on? They hold patents on some of the more natural choices In cache oblivious b trees (admittedly they also invented those retrospectively natural choices).

SwellJoe2• 13 years ago

I'm unfamiliar with this particular implementation, but it sounds (from your one sentence description) kinda like Dancing Trees, created by Hans Reiser, for ReiserFS. Would this be prior art, or would this be different approaches to similar problems?

http://en.wikipedia.org/wiki/Dancing_tree

carterschonwald4• 13 years ago

Yes and no. I think they're doing a variant of cache oblivious buffered B epsilon trees. Ill have to go code spelunking (now that the source is available. Boy am I glad it's gplv2 and not some (a)gplv3 variant).

Thanks for the interesting reference!

leif6• 13 years ago

Fractal Tree indexes are very different from Dancing Trees. See http://tokutek.com/what-is-a-fractal-tree for an overview, and I'd be happy to answer questions if you have them.

andrewljohnson2• 13 years ago

Oh what a world. A data structure should never be patentable - what's the difference between a data structure and a math formula? Both are just notations for reality, and can spring up in the minds of many disparate inventors.

I'd really like to see TokuDB discuss its patents, why they have them, and what they intend to do with them. I'd like to see a page like that from every corporation on their website actually.

leif6• 13 years ago

IANAL, but the patents are owned by the universities where the founders work, not by the company. I don't know if this makes you feel any better though.

reinhardt3• 13 years ago

"A data structure should never be patentable - what's the difference between a data structure and a math formula? Both are just notations for reality, and can spring up in the minds of many disparate inventors."

Can we please let this disingenuous argument die already? Yes, in theory they can spring up in many minds independently. In practice they rarely do unless they are trivial. If the alleged disparate inventors can prove they came up with it independently, fine; the onus is on them.

sakai• 13 years ago

Can someone in the know elaborate on the current state of US patent law here? And what exactly TokuDB / the universities hold a patent on?

Curious outsider here, and understand that all IANAL caveats apply.

continuations• 13 years ago

I can't help but think that this announcement is 5 years too late. 5 years ago the field for write-optimized database was wide open and obviously there was a lot of demand for such a product or otherwise companies like facebook and Powerset wouldn't have had to write their own versions.

But since there was no open source software available for this usecase back then, they did write their own, which became Cassandra and HBase. And now these SSTable type of solutions have become the de facto standard for write-optimized databases.

If Tokutek had open sourced TokuDB from the very beginning things could have turned out very differently. TofuDB had an huge advantage over Cassandra/HBase in being SQL-oriented and based on MySQL, whereas Cassandra/HBase required a much steeper learning curve. But since TokuDB was proprietary, it never really gained much traction.

zardosht4• 13 years ago

One big differentiating feature between TokuDB and other write optimized databases is that TokuDB is fully transactional, it is ACID compliant. There is a demand for this.

AFAIK, TokuDB is the only write-optimized transactional data store. We (I work at Tokutek) are working on integrating with MongoDB as we speak, and when we do, we will bring transactional semantics to MongoDB in addition to improved performance.

So, I think there is still a big demand out there that TokuDB will be able to meet

tveita• 13 years ago

My impression was that TokuDB is a single-server database, as a backend for MySQL. In that case it wouldn't be a direct competitor to HBase and Cassandra, both of which you normally wouldn't even consider unless you expect to have a cluster of machines.

You'd arguably be taking a risk by choosing a centralized database for write-heavy applications, which are the hardest to scale, but I could see it as a good fit for the applications where people currently use sharded MySQL.

brianatdts• 13 years ago

Cassandra and HBase Shard, they just shard differently since the shard is baked into the system while in MySQL its not. If you get right down do it, When you Shard on Toku, it will simply be more efficient at a storage level.

Tokutek• 13 years ago

Ok, the website is starting to come back online after our huge spike in traffic.

Thanks for all the interest and for your patience...

-Tokutek

acjohnson55• 13 years ago

Any plans to have this as an indexing option for PostgreSQL?

TokuDB open sourced

Related Stories