Considering the KKK were using torches before nazis existed the relationship goes the other way if anything: https://depts.washington.edu/civilr/kkk_rallies.htm
The torch has been used for thousands of years in many contexts (https://en.wikipedia.org/wiki/Torch#Symbolism), quite often as a form of intimidation but not always.
Is the Statue of Liberty a nazi symbol because she holds a torch?