Estimating PaLM's Training Cost 4 years ago
The fact that there are 67 people on the paper doesn’t mean they all worked on it full time. In fact, I suppose less than 5 did. I am quite certain most people only spent a tiny fraction of their time on this project. (Not saying the outcome isn’t impressive, it’s just how these projects tend to go.)