[hank2000]

Yall want to see instant? Check out chatjimmy.ai blow your mind. I’m not affiliated.

But the things it unlocks in a product I’m building are mind blowing. Millisecond inference even on much older models will change the whole game. Enough to run inference on every. Single. API call. Without notable disruption. This sh*t is wild.

[sunnybeetroot]

Do you have more information on this? I thought groq was fast but this is insane.

EDIT: it’s this company https://taalas.com/products/

[Rapzid]

Yeah, if I could get double digit ms latency out of gpt-4.1 that would be game changing.

[bean469]

That for sure is instant