SVB was a major bank and most businesses in the USA only have one bank. Once you have an established relationship it’s just easier to do all of your banking with that bank.
That doesn't answer the question. Why does the government need to underwrite the risk you assume for convenience? And "everybody does it" isn't an excuse, it just makes the prospect of the government doing so all the more expensive to the taxpayer.