Hacker News new | ask | show | jobs
by avereveard 1196 days ago
I want to add an argument:

I hate gpt style of "as an ai model I can/can't" answers, any model distilled from that corpus becomes very hard to use for tasking.

Like you may just want the category of a text, but all your equals now become contains. It eats up a lot of token space. It begins as a sentence so categories now are strongly biased toward sentence case and not your original input.

I know at least one model purposefully removing these utterances, but still. Everyone else is chasing the agent feel, and I'm here pulling my hair out because prosumer were this close to be able to access a proper AI for tasking and now it's slipping away.

2 comments

Especially, it's not that it can't give you an opinion, it totally can, but the authors at OpenAI don't want you to hear that specific opinion because of their political biases.
In converse, the authors at OpenAI don't owe you a service that caters to your own political biases.
Lol yet they enjoy a monopoly on the industry so there are no alternative world views as far as LLMs are concerned
They do?

Google doesn't have their own LLMs? Microsoft isn't running and training their own copies?

Hell, if you have enough money you could run your own. This doesn't sound like a monopoly in any definition that I use (and I cast a very wide net with my use of monopoly).

Name one company which has an product as popular as ChatGPT-4?
I don’t have an opinion on whether chatgpt-4 is a monopoly, but I’m pretty sure popularity has nothing to do with whether something is a monopoly.
By what measure of popularity?
yes exactly, this "as an ai model I can/can't" you're mentioning is precisely what is learned during the RLHF alignment phase.
Btw, this kind of language is already all over the place: https://twitter.com/d_feldman/status/1649466422018318338 Which is hilarious and sad at the same time.
It is a funny tweet but I cannot replicate the results.