[pdx6]

Excellent news. I’ve been worried that Sam moving to Microsoft would stall out possible future engineering efforts like GPT-5 in IP court.

As an example of how much faster GPT-4 has made my workflow was the outage this evening — I tried Anthropic, openchat, Bard, and a few others and they were between not useful and worse than just looking at forums and discord it’s 2022.

[badcoderman]

GPT-5 is kinda pointless until they make some type of improvement on the data and research side. From what I’ve read it’s not really what OpenAI has been pursuing it

[Zolde]

One big improvement is in synthetic data (data generated by LLMs).

GPT can "clone" the "semantic essence" of everyone who converses with it, generating new questions with prompts like "What interesting questions could this user also have asked, but didn't?" and then have an LLM answer it. This generates high-quality, novel, human-like, data.

For instance, cloning Paul Graham's essence, the LLM came up with "SubSimplify": A service that combines subscriptions to all the different streaming services into one customizable package, using a chat agent as a recommendation engine.

[blovescoffee]

Are you just blindly deciding what will make “gpt-5” more capable? I guess “data and research” is practically so open ended as to encompass the majority of any possible advancement.

[astrange]

The next improvement will be more modalities (images, sound, etc.)

GPT4 in image viewing mode doesn't seem to be nearly as smart as text mode, and image generation IME barely works.

[Davidzheng]

Maybe but I think the next big one will be reasoning.

[astrange]

I think "reasoning" is a descriptive term like "AI" and it's hard to know what people would accept as reasoning.

Explicit planning with discrete knowledge is GOFAI and I think isn't workable.

There is whatever's going on here: https://x.com/natolambert/status/1727476436838265324?s=46

[sidcool]

I still feel Microsoft will have a bigger influence on OpenAI after this drama is over.