[mazzystar]

That's right. I just went to look and it looks like ChatGPT has been updated to the May version. But in terms of previous experience: ChatGPT's code is almost unusable, it always ignores the most basic logic, and I only use it to write short scripts. But GPT-4, even if it contains multiple files referencing each other, it gives code that I don't even need to do Code review.

[arielweisberg]

I have had the opposite experience. Many domains where it can’t produce correct code (counting BitSet, WatchOS apps), or doesn’t even begin to understand (distributed consensus).

When it works it is great. When it doesn’t gap can be large.

When you ask it to correct itself it will make new mistakes and keep alternating between different mistakes and omissions.

I haven’t tried it yet on a real codebase like say a database. Is it even possible to give it that context?