[lolinder]

Obligatory warning: a lot of what seems like bloat in legal documents is there for a reason and has a specific purpose that your LLM isn't guaranteed to be able to handle. Sure, some lawyers add bloat just for the sake of it, but in many cases the text is there because it changes or clarifies the meaning of the surrounding document in a way that matters in court.

An LLM can probably help you understand the document if you're using it side by side with the real thing, but in this context it sounds more like you're using it to summarize.

[DanielHB]

I have been using it to ask questions about the document. For example I throw the document at the LLM and ask something and ask it to quote the original text. Then I ctrl+f the original text for the quote just to make sure the LLM is right.

[chaosite]

And in other cases the text is there because it has been used in other legal documents, and might not be needed for this document, but those documents were good and it doesn't cost anything to put that text in so we should keep using it.

In other words it's a cargo cult.

[lolinder]

The question is, do you trust an LLM to distinguish the cargo cult from the actually necessary text?