If you can tolerate risk of data loss, VPS or even physical hosts are likely to be far cheaper than any cloud. Look at OVH, Hetzner, Linode, DigitalOcean.
According to Wikipédia, OVH is the third largest hosting company in the world based on physical services and the largest hosting company in Europe. They are not a fly by night operation.
And IMHO Hetzner is by far the best service provider there is for bare metal and plain old VM services.
Didn't know about OVH, thanks. A long time ago, I was advised to always first look at the age of the company when choosing a web host. (And then their financials and client base). I've found this advise to be a solid one. A lot of web hosting companies fold up ...
The risk profile of storing something in S3, where your data is stored in at least three different Availability Zones is completely different than a Managed Server or VPS where, if you so chose, it might be stored without any redundancy at all.