Suppose you are just learning C++ language. There is a syntax error or type mismatch. The error message is 50 lines long and it does not make any sense to you. You already spent 10 minutes on it. What do you do now?
If there is an experienced C++ developer around who is happy to answer questions, great. Otherwise you are stuck with having to figure it out by using trial and errors and Google-fu. If you post it to a forum, it could take a while for anyone to respond. If you post it to stackoverflow, very likely nobody wants to look at your horrible code (natural for a beginner, you know), and your question gets downvoted.
By contrast, ChatGPT can look at your code and explain very clearly what is wrong with it within seconds.
This is just one example. And it's not only for beginners. I have found that ChatGPT can answer high-level questions in programming very well. The alternative would be searching for the Internet and sift through all the noise to find the answers as well.
Isn’t it worth considering that the reason ChatGPT can do those things is that it was trained on data from platforms like Stack Overflow? This is hard to quantify but my guess would be that without the SO data it wouldn’t be as useful.
This is why reddit and twitter both locked down their APIs, due to the data being very high quality and immensely valuable for training.
Too bad they all did it too late, no one saw ChatGPT coming. And since all the data was already scraped from Stackoverflow, it no longer has any value for OpenAI. Stackoverflow is rapidly declining in volume, so future data from it is irrelevant.
Oh wow that's interesting, thanks for sharing! I thought that the value in today's LLMs comes from the wealth of "free" crowd-sourced answers online. It seems like OpenAI is trying to create more source material specifically for "basic coding", though I wonder how cost-effective that is in practice. Or effective in general, for that matter.
If there is an experienced C++ developer around who is happy to answer questions, great. Otherwise you are stuck with having to figure it out by using trial and errors and Google-fu. If you post it to a forum, it could take a while for anyone to respond. If you post it to stackoverflow, very likely nobody wants to look at your horrible code (natural for a beginner, you know), and your question gets downvoted.
By contrast, ChatGPT can look at your code and explain very clearly what is wrong with it within seconds.
This is just one example. And it's not only for beginners. I have found that ChatGPT can answer high-level questions in programming very well. The alternative would be searching for the Internet and sift through all the noise to find the answers as well.