[fragmede]

It's the Einstein question. Given an LLM trained on all written word up until right before Einstein's work, could the current SOTA in LLM architecture rediscover relativity? The jury is out on that, but until someone runs that experiment and proves otherwise, we have to assume LLMs simply aren't capable of that kind of brilliance. They're still impressive and useful and also stupid at times, but at the end of the day, no LLM has a gut to make a gut decision with. Unlike us.