[throwaway562if1]

I expect this, much like racial bias in many AI applications (e.g. facial recognition), is considered a feature by the companies using ChatGPT to screen resumes - it gives enough plausible deniability to dodge a lawsuit.

Anyone want to bet it discriminates on gender too?

[danielscrubs]

Just tried it. Sample size of six though. Asked ChatGPT to grade an accountants CV (temporary chat) and changed names and pronouns only. They all got an eight out of ten score no matter if it was female or male.

[AstralStorm]

Now try it with alien names presumably from another culture. Sequence of random lexemes will do.

It's instructed to not bias on gendered names. But when it can't detect the gender of the name, what will happen?

What will happen if it's a translated name that will literally look like multiple words? (Long) Is it biased towards common names as opposed to uncommon ones?

It probably cannot quite get where and what a name is in the resume. Much like it cannot detect autism properly so even if you tell it to not bias against that, it won't work. Just gets biased.