[aurareturn]

Agreed. I think many businesses are finding use cases like ours. They're just not on HN disclosing it all.

I've said this many times but the only thing stopping me from using GPT4 API for everything in my life is inference cost - both context window limitations and cost per token. I would try to feed everything into GPT4 if I could.

Inference will be solved one day.

The cost to serve a website today is probably millions of times cheaper than in 1998. Heck, Cloudflare literally gives you unlimited bandwidth for your website for free. It's that cheap today.

When inference cost is much higher today and the cost to do inference is as cheap as loading a website today, I think the world will be profoundly different.