There were of course lots of other taxes being levied in the USA, poll taxes, property taxes, but the money went to state government rather than federal.