Hacker News new | ask | show | jobs
by m0zg 2703 days ago
Have you actually used TFLite? It's slow as molasses. Deploying on mobile is a bit of a shitshow across the board right now, from what I undertand. Not all models are supported out of the box (especially with ONNX), and the ones that are supported aren't guaranteed to have acceptable performance with off-the-shelf frameworks. Documentation is very sparse as well, especially for the quantized stuff.