[sigmoid10]

>it thought it was meant to be there, that it was a technical term or a codename for something

That's such a classical human behaviour in technical discussions, I wouldn't even be mad. I'm more surprised that picked up on that behaviour from human generated datasets. But I suppose that's what you get from scraping places like Stackoverflow and HN.

[ben_w]

I'm reminded of one of the earlier anecdotes from OpenAI about fine-tuning — to paraphrase:

> This writer fine tuned on all their slack messages, then asked it to write a blog post. It replied "Sure, I'll do it tomorrow"

> Then he said "No, do it now", and it replied "OK, sure thing" and did nothing else.

[codr7]

That would be a mistake, probably.

But if it keeps randomly happening too often, I'm sure pretty soon someone would get mad, because they're not even trying.