[cosgrove]

But if you're a paid subscriber you can access GPT4 through ChatGPT's interface. Are you saying there's a difference between using the GPT4 model alone vs. the GPT4 model in the ChatGPT interface? If so, could you please clarify with an example?

[mazzystar]

That's right. I just went to look and it looks like ChatGPT has been updated to the May version. But in terms of previous experience: ChatGPT's code is almost unusable, it always ignores the most basic logic, and I only use it to write short scripts. But GPT-4, even if it contains multiple files referencing each other, it gives code that I don't even need to do Code review.

[arielweisberg]

I have had the opposite experience. Many domains where it can’t produce correct code (counting BitSet, WatchOS apps), or doesn’t even begin to understand (distributed consensus).

When it works it is great. When it doesn’t gap can be large.

When you ask it to correct itself it will make new mistakes and keep alternating between different mistakes and omissions.

I haven’t tried it yet on a real codebase like say a database. Is it even possible to give it that context?

[simonw]

My understanding is that the author was talking about using GPT-4 via the ChatGPT interface. That's where the 25 messages every 3 hours limit comes from.

When they compare it to regular ChatGPT they are comparing GPT-4 to GPT-3.5 turbo.