Hacker News new | ask | show | jobs
by febed 21 days ago
Apart from maximizing compatibility, is there a technical reason why GPU is not used if available?
1 comments

mainly this is a portability and compatibility solution.. I think with GPU available deployments, it wouldn't benefit from ternary distillation. It would be a different problem domain.