You're right, I admit I had a long-standing misunderstanding about this - I had always assumed the word was referring to semitic people in general, but have decided to look this up (unfortunately after posting the above) and realized that's not the case...