Once I started thinking of LLMs as a form of lossy compressed storage for their training information… I started having more reasonable expectations for these tools.
It could also be fairy dust, no proof that it isn't that either.
As you can clearly see with this exaggerated example: that's not how proving stuff works. The burden of proof is on the one claiming that X or Y exist.