Hacker News new | ask | show | jobs
by iLoveOncall 750 days ago
The main blocker for this is that LLMs are slow. Imagine waiting 3 seconds for your output in a pretty happy case, only for it to be invalid and have to wait an extra 3 seconds, with again non negligible chances of being wrong.

We envisioned doing this for an SQL query generator at work but with our constraints a single query already takes 15 seconds.