I didn't hire or vote for any central banker, and neither did you. We were born into the fiat system, the rules already written and specifically made to exploit us.
And I completely agree with your second paragraph.
I did vote for my president, who hired the central bankers, and senators, who confirmed them. They also built the entire structure of the current fiat system over time.