Hacker News new | ask | show | jobs
by robrenaud 117 days ago
Please serve well quantized models.

If you can get 99 percent of the quality for 50 percent of the cost, that is most times a good tradeoff.