Ask HN: Early Preparation for Scaling?

From Todd Hoff's comments on the Tim Bray / Casey Forbes interview about Ravelry: "Going from one server to many servers is the hardest transition to make. Everything changes and becomes more difficult. Have this transition in mind when you are planning your architecture." How do you build a small-scale site to minimize later scaling issues? Where are the "gotchas" lurking?