If elected to do so, yes. I'd like to reverse the question on you though: Should what he said in private make him legally ineligible to hold office or even any job?
Of course not - the election should be cancelled, the votes should be thrown into a garbage can and it should just be you who picks the best candidate.