| It is highly subjective, and I think that helps me make my point.
The subjective view point we get now is that of OpenAIs. I will give you two examples of content of various degrees of seriousness where the harmfulness is determined by how it's used. 1.
Prompting the AI to write a highly racist speech. It can be used as an actual speech by an actual racist to further their agenda.
It can also be used in a book to depict a racist character.
If the rest of the book depicts this character as a lunatic, the effect is the opposite of the first use case. 2.
Prompting the AI to write a recipe involving human faeces If used to serve a person actual human faeces, it's most likely harmful to that person.
If used as a joke, it's not. As you said, it's content moderation. The models are capable of producing this content, but it's being moderated by OpenAI (who can still write as many poop recipes as they want). I don't think this is the same as moderating the contents of a social media platform (for example). This technology can be used for such a wide range of applications that it seems dangerous that it should be moderated on this end, as opposed to where the results are potentially published. EDIT: I'll give you another example. I actually used ChatGPT to clean up the english (second language) in my original post. There's no way of knowing that it would just refuse to do this tomorrow, or change the overall sentiment of the message. |
Well, in the instance of the publically available interface to ChatGPT I think it is precisely this restricted because it is public (to be robust under a, to put it nicely, highly diverse usership). All of this is a WIP and OpenAI is gathering insight into how a model this large behaves and can be controlled in the first place. To this end they're exercising the principle of precaution.
More generally I think there has to be a match between a social unit's (states, companies, individuals, etc) design and ability to self-regulate and the power of the technology it has access to (more power, more responsibility) or you will see undesirable outcomes. Give a kid a gun, North Korea with nukes... In contrast the OpenAI people seem like fine folks. After all they do intend their work to be more widely applied, just carefully.
Therefore I think democratisation of this technology should come in a controlled manner by working with stakeholders dedicated to the public good (e.g. social and medical institutions) first and not via the "anarchy" road (just put it out there, undesired consequences) as in the second case we would likely see ungodly amounts of information pollution on the internet (and self-coupling effects from AI training on and copying each other) and in second-order a further "epistemic scattering" (by which I mean a proliferation of belief systems that disagree in fundamentals like the laws of nature).
Your second example seems a bit whimsical but the first might have real impact. In Germany access to (and display of) Nazi propaganda material in historical collections is restricted (may be presented only in an educational context) because the state doesn't want right-wing groups to go wild in reusing it (among other reasons). Now imagine convincing hate speech being generated on the fly.
Once the genie is out of the bottle you can never put it back in...