[boulos]

Disclosure: I work on Google Cloud.

Local inference can be important and even a requirement, so at NEXT we announced our intent to start shipping our Edge TPUs: https://cloud.google.com/edge-tpu/

[perrohunter]

I’m still waiting patiently for those to arrive so I can order a couple