I don't think ideally is the right mindset to have here. So long as it does better than a human driver and/or better than the current status quo, it's already a great improvement. Of course things can always be better, but just because it isn't ideal doesn't mean it's bad.