[j2kun]

I don't see how "they improved the models" is related to the bitter lesson. You are still injecting human-level expertise (whether it is by prompts or a structured API) to compensate for the model's failures. A "bitter lesson" would be that the model can do better without any injection, but more compute power, than it could with human interference.

[idle_zealot]

> A "bitter lesson" would be that the model can do better without any injection, but more compute power, than it could with human interference.

This is what I expected the post to be about before clicking.

[marshall300791]

The bitter lesson here is that it all goes back to natural language rather than lower level of abstractions

[j2kun]

I would contest that this is not a "bitter lesson" in the sense that it has not been demonstrated repeatedly over decades as a truism of computer science.