Hacker News new | ask | show | jobs
by kevingadd 776 days ago
Don't sections of regulations reference each other, and reference other regulations? This article says they only insert snippets of the section they believe to be directly relevant to the legal question. It seems to me that this automatically puts the bot in a position where it lacks all the information it needs to construct an informed answer. Or are the laws in some regions drafted in a "stand-alone" way where each section is fully independent by restating everything?

This feels like they've built an ai that justifies itself with shallow quotes instead of a deep understanding of what the law means in context.

1 comments

You're right that sections reference each other, and sometimes reference other regulations. By creating the "plan for the junior lawyer", the LLM can reference multiple related sections at the same time. In the second step of the example plan in the post there's a reference to "Articles 8-15", meaning 7 articles that should be analyzed together.

The system is indeed limited in the way that it cannot reference other regulations. We've heard it's a problem from users too.