Hacker News new | ask | show | jobs
OpenAI Models Dominate Structured Code Edit Benchmark (blog.mentat.ai)
5 points by biobootloader 880 days ago
1 comments

I saw the same thing with Mailogy.

I only tested variants of gpt-3.5 and -4 but got ~50% invalid syntax errors with 3.5, and virtually none with 4.