[embedding-shape]

> I have never had a problem running any model, for image or text or voice, the community has done great work in making things work

There is a whole world of other tooling and stuff that isn't just for hobbyists to run inference with ML models, but also how to do profiling, debugging and gathering data when you run distributed workloads, and so on. The nsight toolkit seems miles ahead of the competition on other platforms, as just one example.

[mycall]

Also, you can use handheld PC 395+ 128GB with battery for (semi-){0,1}offline use cases, works great for C2 of cognitive SDR radio (among plenty of other use cases).