Thankfully the EU is ahead of the game on this, and the AI Act mandates that any highly impactful decisions taken by AI/algorithms have to be explainable and audited (you need to be able to prove why the computer made that decision). Penalties are 5% of global turnover, so a decent incentive to have some guardrails and avoid companies hiding behind "computer says no".
AI will just generate an explanation in 1000 pages. Or 10000. Generation is cheap anyway. You like reading generated stuff? Good luck with this imitation of regulation.
For the most critical decisions you need to be able to explain it and reproduce it. If they can't sufficiently explain it, 5% of global turnout is a nice fine to ensure they really try.