[rwmj]

If you want the academic answer, here's a survey of the literature that I wrote on this topic back in 1996. (Section 3 is where it starts to talk about hardware).

http://oirase.annexia.org/multithreading.ps