VPS is usually significantly more expensive (hostings that offer xmr payment are also not the cheapest ones), and less flexible (you can't choose your exit point country). And your anonymity set is... one.
VPS have their uses and VPNs have theirs, they are used for different things.
At that point, why not just buy a vps with crypto? Then you would at least be in control of the logging.