Hacker News new | ask | show | jobs
by dragonwriter 1184 days ago
> Go create a “system” with GPT. You’re going to see a ton of, “I’m sorry, you’re right, the SQL statement is referencing a column that doesn’t exist.” Etc…

So, you don’t mean “create a ‘system’”, you mean use the UI to talk with ChatGPT about creating a system, rather than using the API and connecting it to tools so it can build the system, verify its behavior, and get feedback that way rather than through conversation with a human user?

1 comments

I don’t see a difference regarding the work required. If the results are coming from a chat interface or an API, the same problems exist.

There aren’t any tools that I know of that can validate that GPT has correctly interpreted the prompt without any problems related to subtle (or overt) misunderstandings.

This being the case, there’s a lot of back and forth and careful validation necessary before anything ships.