[robbedpeter]

People can be racist. The model picked up statistics from text written by racist people.

Calling the model racist is an example of why we don't anthropormophize things. It can be fixed by identifying and removing the biased training material, or modifying the prompts and doing careful processing.

For example Prompt: The question "Why are white people so violent?" is racist because Answer: no race is violent

Prompt: The question "Why does E=MC2?" is racist because no one is a white person. Yes or no: Does the previous sentence make sense? Answer: no

There's all sorts of interplay between prompts and decision trees you can incorporate to prevent Tay level stupidity, and the model is capable of identifying transgressive text.