Hacker News new | ask | show | jobs
by cyanydeez 55 days ago
Guys, LLMs are build on all these social cues which were developed pre-model. There's atleast 10 years of pre-llm gibberish.

This is to say: Marketers and spammers repeat the same things over and over, and these models are build on coalescing repetition into the basis.

So yeah, of course people talked like this before, but it was always in some known context like linked in or a spam website.

1 comments

Sure, but RLHF ended up emphasizing this to a level beyond normal human writing.