Taxes are what give the rest of your money value by giving USD an inherent demand. Thinking you're losing out is bad economics because you're forgetting everyone else also pays.
We know some roads would be built without a tax. The issue is that only roads that benefited the wealthy would get built. Taxes are required for equitable access to public infrastructure.