“Broken Neural Scaling Laws”; New Scaling Law; SotA Extrapolation of All Things

paper: https://arxiv.org/abs/2210.14891

tweet thread: https://twitter.com/ethanCaballero/status/1587502829580820481