Yeah I'm not worried about my ability, but the perceived value from employers. We're probably in the sweet spot where we're still "young" but also very experienced.
That would be quite ridiculous in my opinion. Most of my peers hardly stay in one job for more than 2-3 years anyway, so unless you're retiring in the next two years I don't see why they would have a problem with it.
Of course I live in a country where retirement savings isn't your employer's responsibility. I think the US has some ridiculous retirement practices that may make older employees a bit of a hot potato situation?