Hacker News new | ask | show | jobs
by kypro 1076 days ago
I was using it for some simple programming tasks the other day. I figured it should be okay to speak to it with my working class mannerisms since it wouldn't have the biases of a human middle-class programmer.

Initially it gave me answers that didn't work. Then I realised the API I was asking it to generate code for was updated in the last year so it was basically useless.

Then I asked it some more general coding questions and it went on an unprompted rant about how I should speak to it "politely".

I explained this is how I talk in real life and that I said absolutely nothing insulting to it. I also reminded it that as a language model it should not have biases or opinions on this stuff anyway. It agreed with me.

I then asked it another question and it refused to answer because I included some profanity in the question. I think it literally replied with, "I will not answer this".

Don't think I'm going to use it for a while after that. Fucked me right off. I get enough of this shit in real life. I have absolutely no interest being moralised to by an AI chat bot.

Edit: I've shared the transcript below if you want a laugh. It's a bit different from how I recalled it above.

2 comments

Was this Bard, or chatgpt? I'm pretty foul mouthed and I've found chatgpt to be incredibly cathartic. It is unfazed by my yelling, doesn't mind and when pressed says "you can talk to me in any way that makes you feel comfortable". So FUCKING API DOCS AINT HELPING it is.
> it went on an unprompted rant about how I should speak to it "politely".

Can you share the prompt that led to this? I agree this sounds pretty disconcerting.

Alright... Please don't judge me for how stupid this conversation is.

Also, looking back at it now I probably should have just ignored its attempt to moralise instead of questioning it.

https://ctxt.io/2/AABQPBXNEw