[rsynnott]

> But in general, a frontier LLMs like the ones trained by Open AI would not make such silly mistakes in their output.

This is beginning to wear a bit thin. Every public application of AI produces obvious nonsense, and this doesn’t appear to be changing. The inevitable defence is “oh, they used GPT3.5 instead of GPT4/oh, they used GPT4, but not the version that was only publicly available for three weeks in 2023/oh, they used precisely the right GPT4 but, when sacrificing the goat while petitioning Roko’s Basilisk for useful output, they used the wrong sort of knife”.

Apparently, literally no-one can use these things properly, at least for publicly visible applications. Either that, or they’re just a bit shit.