[bravura]

LLMs are trained with the objective: “no matter what, always have at least three paragraphs of response”. and that response is always preferred to silence or “unfriendly” responses like: “what are you talking about?”

Then yes, it is being taught to bullshit.

Similar to how an improv class teaches you to keep a conversation interesting and “never to say no” to your acting partner.