Hacker News new | ask | show | jobs
by Marat_Dukhan 1734 days ago
TensorFlow doesn't support quantized inference (it supports only mimicking quantization in floating-point for quantization-aware training), so it can't immediately benefit from these optimizations.