[samatman]

LLMs aren't improving at things they're unable to do at all. An example being reasoning.

[olalonde]

LLMs can reason. You can verify this empirically by asking questions which require reasoning to e.g. GPT-4.

[lossolo]

There is evidence that they actually can't reason:

https://arxiv.org/abs/2311.00871

https://arxiv.org/abs/2309.13638

https://arxiv.org/abs/2311.09247

https://arxiv.org/abs/2305.18654

https://arxiv.org/abs/2309.01809

[samatman]

False. https://arxiv.org/abs/2308.03762

[olalonde]

This is not peer reviewed research and has some serious issues: https://news.ycombinator.com/item?id=37051450