A more interesting question is should we use an LLM here.
There's undeniably a lot of work being done in this area, but so much of it is just ill conceived shovelware in an attempt to make it big in the gold rush.
We get like a dozen "Show HN" posts a day where there's a service that basically prefixes an input with a prompt and bounces it off ChatGPT and returns the response.
There's also no doubt interesting products to be built using this new technology. But I don't think it's going to be made by just gluing 2-3 APIs together. If you can do that, someone else can do it too. That's not a business model. Being the first to do something means very little.
"Can you do this without an LLM, using just regular coding?"
LLM to solve math problems, implement API requests, etc. = hard no
LLM to solve challenging constraint problems or statistical problems where we already have a good solution (A*, heuristics, really clever algorithms) = no
LLM to solve challenging problems where we don't have a good solution (medical diagnostics, legalese, manual translation of badly-formatted data) = yes... (people will disagree but if the LLM does these better than a human, it does these better than a human - and if not, the humans will almost definitely benefit from using an LLM)
LLM to do something with natural language, like implement a chatbot, explain something, cheap therapy = hard yes
The problem, however, is that your third point is where the vast majority of the potential usefulness of LLM lies, but simultaneously where integration with other systems is highly non-trivial, hence my "calm your proverbial tits" position on the issue.
The vast majority of market value maybe, mass adoptability perhaps. But the biggest value is in the fourth point because it doesn't improve a product, these things were basically unavailable until now!
There's undeniably a lot of work being done in this area, but so much of it is just ill conceived shovelware in an attempt to make it big in the gold rush.
We get like a dozen "Show HN" posts a day where there's a service that basically prefixes an input with a prompt and bounces it off ChatGPT and returns the response.
There's also no doubt interesting products to be built using this new technology. But I don't think it's going to be made by just gluing 2-3 APIs together. If you can do that, someone else can do it too. That's not a business model. Being the first to do something means very little.