You still need tensor cores for inference. But they don't do weight updates. Learning/training is all about updating the weights (through backpropagation or whatever).
So another way to put it: its tensor cores do feed-forward calculations, but no backpropagation, and no weight updates.