[ldjkfkdsjnv]

Cannot understand people claiming we are in a local maxima, when we literally had an ai scientific breakthrough only in the last two years.

[xanderlewis]

Which breakthrough in the last two years are you referring to?

[6gvONxR4sf7o]

If you had to reduce it to one thing, it's probably that language models are capable few shot and zero shot learners. In other words, training a model to simply predict the next word on naturally occurring text, you end up with an tool you can use for generic tasks, roughly speaking.

[xyzzy_plugh]

It turns out a lot of tasks are predictable. Go figure.

[ldjkfkdsjnv]

the LLM scaling law