Hacker News new | ask | show | jobs
by shynrou 1200 days ago
Exactly. When the first news came out about it's ability to "understand" code, find bugs and improve uppon it, I tested it with some snippets of mine. It just gave boilerplate best practices you find on 100 of blogs, but was not able to make meaningful contribution. It claimed to have introduced a feature while only having found another way to write the same snippet. On other things it straight up invented variables & functions that didn't exist.

As long as the task is in it's training set, it can give you a decent answer, but it can't code it just mimics doing so...

2 comments

ChatGPT would be so amazing as a pair programmer if it didn't invent functions.

It's perfect for what is a python function for doing X. But it's honestly 50/50 whether that function even exists.

There are tons of examples from the training set that are awful. Most people will just eat them.