Even if tariffs are refunded at some point, the cost of implementing and managing the tariffs, list sales, lost opportunities and so on are not. Nor is the cost of recovering the tariffs from the government.
Credit card and banks should be able to manage the transactions, they keep records for years. If they were smart, they'd be pushing to get the deal and a massive fee
Neither bank nor credit card companies can possibly manage the tariff question for any party. Tariffs get charged on the goods that you import and depend on what specifically you import. Banks manage the financial transaction, but have no specific knowledge what goods you're paying for and at what rate they are subject to tariffs or taxes.