[bikelang]

Wow - actually pretty astonishing how fast their inference is. So fast it feels fake?

[qingcharles]

Yeah, when you find fast inference like that it almost feels like the answer arrives before you hit return. Now imagine it running locally with no server round-trip.