The Scaling Hypothesis

Gwern's comprehensive exploration of the idea that intelligence emerges from scale alone — and what that implies for the future of AI research. Written in 2020, reads like prophecy now.

“Gwern was right when almost nobody else was. Reading this after GPT-4 exists is eerie — the predictions hold up better than most academic papers from the same period.”