[joe_the_user]

It occurs to me that the bitter lesson is so often repeated because it involves a slippery slope or moot-and-castle argument. IE, the meaning people assign to the bitter lesson ranges between all the following:

General-purpose-algorithms-that-scale will beat algorithms that aren't those

The most simple general purpose, scaling algorithm will win, at least over time

Neural networks will win

LLMs will reach AGI with just more resources

[arrowsmith]

motte and bailey*