[_nalply]

They did an experiment: ask for a poor person and you get a black person. Then they tried to buck the stereotype: ask for a white poor person, and often you still get a black person.

This was my experience too with NightCafé models. Once I wanted to refine a model to do a detail differently, but even with exaggerated weighting I was not successful.

The models are fed with stereotypes, so they don't know to spit out something not a stereotype.

[rhdunn]

Often this comes down to how well and descriptive the training data is labelled. If you just label a picture as "man" or "woman" you are not going to get good results compared to something like "face of a caucasian man of Italian descent in his mid 20s with red hair, green eyes, and pale skin, with a blue background".

You also need consistently labelled data so that the model can have a chance to learn the differences properly.

I've also seen the image models not understand context, so if you ask for e.g. "green eyes" then it will often place the image in grass/a green background, select green clothes, etc. -- i.e. it is only learning the association of the colour and not the association to a particular facial feature.

The image models are very bad at feature shifting and not understanding how features combine -- resulting in things like multiple arms because two of the images it is splicing have the arms in different positions.

[mistrial9]

"This is not a pipe"

[scotty79]

How's that stereotype? Poor people are on average more likely to be black. If you asked for samurai would you complain about stereotypes if it gave you asian samurai if you asked for white one?