While that is true, the overarching point is that it fundamentally still is, just a story.
You're just describing real world consequences, precisely because humans/societies believe in that story and enforce it.
By that logic, most everything other than a club to the head is "just stories". Hume points out in a Treatise on Human Nature that most of how we interact with the world is through a coherent hallucination provided by sense organs that tell very narrow stories, but when stitched together form a cohesive whole. You're almost doing the equivalent of saying that gravity is "just a theory".