Hacker News new | ask | show | jobs
by fitzgera1d 749 days ago
What's the hallucination rate of human lawyers? Spent $1,400/hour on a series of unusable drafts just the other day.
4 comments

In the sense of just completely making up references out of nowhere? Very low. Humans make mistakes, of course, but they tend not to be so egregious. Grounding a submission on a made up reference is quite likely to be fatal to your case in a way that most human errors aren't.
This is the important bit that's always missing in discussions about LLM/AI applications to existing industries - what is the rate of mistakes for a human worker?
Pretty low if they want to pass bar exams.
Hence the excitement behind investing in AI legal tools.
Further, I now get emails from legal that regularly seem drafted by ChatGPT.