Hacker News new | ask | show | jobs
by meekaaku 47 days ago
This looks great. The demo is very fast. Is it static generated or is it reading the sql db?
1 comments

Thanks. The demo itself is prerecorded - so no LLM calls. It's just replaying from the sql db. In an actual request it isn't much slower though in finding what tools to use, etc. You can test it btw. I've allocated an hourly budget - anything that you query after the demo goes to an actual LLM.