Right, but we've already got limits on individual contributions, so even if you have a bunch of money, you can't have outsized influence through your individual contributions.
Individual campaign contributions are limited but wealthy individuals can still exercise outsized influence through other means such as unlimited donations to Super PACs.
https://www.opensecrets.org/political-action-committees-pacs...