The fun part here is that most humans in the legal profession carry pretty extreme biases, judges included... The hope for legal ai is that you could progressively improve the biases, instead of waiting for N years for a bad judge to retire same maaaaybe get replaced by someone better.
who though, who has access to the resources to push the boundaries of next-gen AI except the rich who already have their own biases? The AI that the public will get will be just as useful as the tech that public get now: limited, isolating, and designed to restrict their freedoms I exchange for easy entertainment
I'm confident that these things will get easier. It is approximately ten thousand times easier to train a decent classifier in 2023 than it was in 2013... We're also now living in a world with foundation models and fine tuning, which makes it /very/ possible to improve and specialize publicly released models. We see a lot of that with stable diffusion already.
This is what I found immediately interesting about ChatGPT.
I asked about controversial topics. Its answers didn’t seem like biases that were programmed in, but rather it took traditional media and gave it more weight than what turned out to be the truth only accepted much later on and still against a media retelling.
I lost a lot of faith in it knowing it was more CNN than careful deliberating AI.
It's well documented that controversial topics are subject to varying degrees of censorship and prompt editing/modification/appending. What you think may be a response in alignment with corporate media may in fact be corporations disallowing you from obtaining actual responses through various means that are being tested now. We can't know unless we have open source access to the unmodified model.
I tested this by asking GPT to create an imaginary country and government. I prompted it to create it's laws and constitution. In some cases cultral beliefs too. There where many cases where it outright refused to come up with hypothetical laws or cultral stances on certain issues. I eventually accused it of creating a straw man when it didn't want to give a solid answer (it would always weasel around it). It apologised and essentially shrugged.