To an extent left and right are asymmetrical---leftist groups tend to be groups organized around being leftist as their main purpose, while "rightist" groups (churches, police unions, gun enthusiasts) tend to be rightist incidentally. Neo Nazis feel like the exception that proves the rule.
The quakers are today so small as to be completely irrelevant. And the existence of the quakers proves the commenters points that right wing groups tend to be right wing only incidentally. They have another main purpose. He gives churches as an example. People go to church for religion. Coincidentally, many of them also happen to be conservative. That there are churches where this is not true only emphasizes this point that right wing groups tend to form incidentally.