What's more remarkable is the number of services and integrations that are necessary to keep a SaaS product running. Even on a shoestring budget, that's a lot of complexity to manage.
More than the cost, the micro-integration hell that you start to get into and out of (when swapping out) can be a real slow down to building and shipping features