Yeah, but that's a lot of us. Obviously there are some programmers out there doing computation-bound work, but an awful lot of us aren't. If you're doing web stuff or making apps, then basically any computer manufactured in the last 5-8 years is going to be fine. I do iOS side work on a 2012 quad-core Mac Mini. It's totally fine.
It's OK to geek out about hardware, if that's your thing. But it's not really necessary for most people -- even programmers.