Frontier labs have had multiple major announcements in the past about supposedly novel LLM generated theorems that turned out to be vastly overstating what actually happened. That's part of why they were so (appropriately) cautious with the unit distance proof.
This is spot on. And yet, when I try to publish my papers on P = NP with the proof reducing to "trust me bro, I checked this out carefully" I get shot down by irrate reviewers who demand to see my work. Why can't those people just believe what I say?
Why wouldn't they verify it, knowing that any shenanigans would certainly come to light?