How to scale your rails app, by Scribd (a YC startup)

http://www.scribd.com/doc/49575/Scaling-Rails-Presentation

by michelson01 • 19 years ago

26 13 19 years ago

scribd.com

michelson01• 19 years ago

this talk was given at the silicon valley rails meetup a couple days ago.

staunch3• 19 years ago

Very nice. It definitely looks like the scribd guys have a clue.

Scribd is still still running on just one web server. That means they're not at the stage yet where they can just throw machines in to handle growth. That's a pretty significant step. Their one web server just happens to be so damn beefy that it can handle a lot of traffic. It will max out at some point though.

phil• 19 years ago

That means they're not at the stage yet where they can just throw machines in to handle growth.

Hmm, why do you say that? They've already got the DB off on other machines, and it sounds very much like they are doing all the things you do to a rails site so that you can scale it by plugging in more app servers. I.e. they already put everything shared into the DB or memcached.

staunch3• 19 years ago

Most people discover fun problems when they split their web servers, no matter how prepared they thought they were. I'm sure they'll handle it well, but it's a significant step.

tx2• 19 years ago

Presentation is nice, but I would like to suggest a feature for you guys. Instead of that terrible flashy frame, why don't you by default show documents in HTML? Browser handles scrolling, selecting and picking font size much better.

If I want to print or store PDF, I see "download as PDF" button already.

Also, what's with the popups? I have not seen them because my browser blocked them, but there appears to be some critical functionality that relies on popups being allowed.

toisanji• 19 years ago

how did they just launch and already get 1 million hits a month?

nostrademons2• 19 years ago

They're one of the most popular sites on Digg - not the site itself, but individual pieces of content hosted on the site. It's the YouTube effect - if you build a site that's viral, you grow exponentially, but if you build a site that hosts viral content, your growth rate is exponential.

tx2• 19 years ago

Hm... I don't understand why did they opt to go with TWO(!) SQL servers so early. If your DB is designed well and your queries are written well, you should max out on HTTP side first.

Even on super-fast ASP.NET, we started with two HTTP servers plus only one single SQL server behind and it worked very well...

nostrademons2• 19 years ago

Scribd is pretty write-heavy - between traffic analytics, hit counts, votes, comments, favorites, and submissions, they're looking at several DB writes per page view. Good indexing and DB design can make your reads really fast, but your writes are still limited by the speed at which the disk rotates. And if you have a lot of indexes to support fast queries, they'll slow down your writes by some (fairly small) percentage.

You're right though - most of the sites I've been involved with have been heavier on the webserver than the DB. It depends on the application...

especkman• 19 years ago

According to the presentation deck, they have 3 DB servers. It's not clear to me what each of them do, but one of them apparently gets activity logging writes, and the other is a slave that they use to do analysis queries on that data.

hello_moto• 19 years ago

I would like to know more about the overall architecture especially with their backend written in C# rather than Ruby.

How to scale your rails app, by Scribd (a YC startup)

Related Stories