[jruohonen]

I beg to disagree. There are already hundreds of real-world examples whereby these models are doing terrible jobs with anything related to jurisprudence.

[jruohonen]

If you want proof, it is enough to point to the following recent paper from Microsoft people:

https://arxiv.org/abs/2303.12712

All things mentioned in Section 10.2 are extremely worrying in a context of lawmaking and jurisprudence in general.