If errors in any subsystem surface out to the car, well then okay. But it's not unlikely that the overall system would deal with an error in the image classifier.