Scaling Disqus (YC S07)

http://www.slideshare.net/zeeg/djangocon-2010-scaling-disqus

by riffer • 16 years ago

140 22 16 years ago

xtacy2• 16 years ago

For such web services, what is the average/peak load on the network? Is it a bottleneck at all? Are the networks over provisioned?

riffer• 16 years ago

The article says peak is 17k req/sec ... (I'm impressed)

xtacy2• 16 years ago

Yes, I presume that's incoming 17k req/sec. Each incoming request can then lead to many database queries/memcached queries/etc. It would be more insightful if request/response sizes were also known.

kingkilr• 16 years ago

The talk was recorded, and the video will be made available (once it's ready).

orlandu63• 16 years ago

Can we get a direct link to the PDF?

ronnier• 16 years ago

This pulls out the notes: http://viewtext.org/?url=http://www.slideshare.net/zeeg/djan...

kfool• 16 years ago

How do you deal with schema changes? Do they force you to switch into a read-only mode?

endlessvoid94• 16 years ago

This is invaluable, thanks for sharing. We're running into some really interesting problems building Djangy.com - this slideshow is a goldmine.

siculars• 16 years ago

nice starcraft2 pitch at the end ;)

technoweenie• 16 years ago

I see someone playing Starcraft most of the time while I pass by their office (ours is right above theirs).

thedz• 16 years ago

It's true :/

ohashi• 16 years ago

Strategical Thinking Practice.

amccloud• 16 years ago

Probably dcramer

patrickaljord• 16 years ago

I thought they were using mongodb, any idea why they switched to pgsql?

bdr• 16 years ago

Disqus has used Postgres since the beginning. They also use mongodb.

michaelfairley• 16 years ago

There was no mention of MongoDB in this presentation, but Disqus is listed on the MongoDB Production Deployments page: http://www.mongodb.org/display/DOCS/Production+Deployments

okeumeni• 16 years ago

I guess it’s nice to mention Disqus a using for MongoDb folks. They are not the first company to mislead on the internet.

danielha• 16 years ago

Disqus also uses MongoDB amongst many other tools not mentioned. Those fine folks aren't misleading anyone.

sr3d• 16 years ago

How many HAProxy server is being used? Just a main one with heartbeat for failover?

_3ex7• 16 years ago

Why is emailing an exception bad (Slide 48)? Can a small site get away with it ?

simonw• 16 years ago

It's fine for small sites. You'll know when your site is too big for that feature from the pain in your inbox.

tkaemming• 16 years ago

A possible disaster scenario: connection issues with the SMTP server are causing the initial exception, resulting in webserver connections that are open for excessively long periods of time (unless you're sending the emails asynchronously), since the process is blocked first on the failed SMTP connection, then again on the exception email attempt (and you're still not getting any notification that something is broken, unless you're doing some other kind of monitoring!)

Scaling Disqus (YC S07)

Related Stories