No, you have to have enough members in your party to surround him before speaking to him and then remove them from your party. So neutral NPCs are surrounding him. He will just kill skeletons. But you deserve whatever is coming to you if you kill Drizzt just for some swords.