We looked into this [1] and conclude:
- throttling is a non-issue on Xeon Gold/Platinum;
- AVX-512 startup overhead can hurt on Skylake, but AVX-512 is still a net win for data sizes >= 100 KiB.
- Startup overhead is a non-issue on Icelake and AMD Zen4.
1: https://github.com/google/highway/blob/master/hwy/contrib/so...