TAO: The power of the graph

https://www.facebook.com/notes/facebook-engineering/tao-the-power-of-the-graph/10151525983993920

by pagade • 13 years ago

113 6 13 years ago

hga• 13 years ago

After a history of performance improvements starting with Mark Zuckerberg putting memcache on Facebook's Apache servers in 2005:

"In early 2009, a team of Facebook infrastructure engineers started to work on TAO (“The Associations and Objects”). TAO has now been in production for several years. It runs on a large collection of geographically distributed server clusters. TAO serves thousands of data types and handles over a billion read requests and millions of write requests every second."

It is solving some impressive problems, and kudos to Facebook for continuing to share neat bits of engineering with us.

currywurst• 13 years ago

The interesting part is that they have not gone for a custom graph representation on disk like neo4j et al, but are persisting the graph data as MySQL records itself.

3pt14159• 13 years ago

Reminds me kinda of what Reddit does where attrs are stored as records.

th0ma5• 13 years ago

There has been some precedent with this... Oracle Spatial does this, and wrappers for SemWeb projects like d2rq do this.

espeed• 13 years ago

Titan (https://github.com/thinkaurelius/titan/wiki) persists its graph as records in a distributed Cassandra or HBase cluster.

mianosm• 13 years ago

Some interesting files that go along with the talk/presentation:

https://www.usenix.org/sites/default/files/conference/protec...

https://www.usenix.org/system/files/conference/nsdi13/nsdi13...

TAO: The power of the graph

Related Stories