People choose to commit atrocities in the name of the famous holy books - you either support banning them as well or concede there's something more to it.
... Wait, are you claiming that people are, having not previously been exposed to Nazism, reading it, and going "well, this seems like a pretty good idea really"? I'm fairly sure that's not a thing. No-one's being radicalised by it; rather the only people who really read it are already radicalised, because, otherwise, why would you bother?
There may be books which radicalise people. But I'm fairly sure Mein Kampf is not one of them.