Hacker News new | ask | show | jobs
by fromMars 773 days ago
From what I can tell, all the GPT team did was scale up ideas already there invented elsewhere in previous large language models.

I am not sure that is a reason to bet on them making any breakthroughs needed for AGI.

1 comments

OpenAI also pioneered reinforcement learning from human feedback (RLHF) to make LLMs output completions that are valuable/relevant.

I agree that OpenAI has provided no evidence they are anywhere close to AGI (and I don't think LLMs are sufficient) but also I think OpenAI should get a ton of credit for being the first party to make LLMs that actually useful.