[marginalia_nu]

A more interesting question is should we use an LLM here.

There's undeniably a lot of work being done in this area, but so much of it is just ill conceived shovelware in an attempt to make it big in the gold rush.

We get like a dozen "Show HN" posts a day where there's a service that basically prefixes an input with a prompt and bounces it off ChatGPT and returns the response.

There's also no doubt interesting products to be built using this new technology. But I don't think it's going to be made by just gluing 2-3 APIs together. If you can do that, someone else can do it too. That's not a business model. Being the first to do something means very little.