The Brute-Force Era of AI (and What Comes After)

I think we are in the brute-force era of AI.By that I mean that progress is coming less from fundamentally new ideas and more from applying massive amounts of data and compute to existing architectures. Larger pretraining corpora, longer context windows, more GPUs — more of everything.And

This is a limited feed-provided excerpt, not the full original work.