[elephantum]

Do the same optimizations apply to tensorflow/tensorflow serving?

[Marat_Dukhan]

TensorFlow doesn't support quantized inference (it supports only mimicking quantization in floating-point for quantization-aware training), so it can't immediately benefit from these optimizations.