In Brandenburg v Ohio, Supreme court stated that only speech that is "directed to inciting or producing imminent lawless action and is likely to incite or produce such action" should be punished. This is called Brandenburg paradigm and it's currently a legal standard for what's considered hate speech in US.
See more: https://en.wikipedia.org/wiki/Brandenburg_v._Ohio