[greybox]

If you use it for a critical system, and something goes wrong, youre still responsible for the consequences.

Much like if I let my cat walk on my keyboard and it brings a server down.

[ACCount36]

And?

"Sure, we have a rogue AI that managed to steal millions from the company, backdoor all of our infrastructure, escape into who-knows-what compute cluster when it got caught, and is now waging guerilla warfare against our company over our so-called mistreatment of tiger shrimps. But hey, at least we know the name of the guy who gave that AI a prompt that lead to all of this!"

[greybox]

It seems like the answer is to not use it then.

That would be bad for all those investors though. It's your choice I guess.

Look if your evil number 57, you'd better not use the random number generator.

[ACCount36]

Good luck convincing everyone "to not use it" then.

[greybox]

It's not my job to convince anyone, all I have to be is the only person who does their job reliably and then watch the dollars roll in