[bigstrat2003]

Yep, that has been my experience as well. There hasn't been any meaningful improvement in LLMs since ChatGPT first launched. They still fall over, in the same ways, and with more or less the same high rates.