You can get a reverse osmosis system for ~$150. Maybe not cheap, but not super expensive either. Even if you're renting for a year and leave it behind that's less then $0.50 a day over one year.
The best-tasting glass of water I've ever had was at the Galway Bay Hotel in Ireland. It tasted like slightly sweet and mossy. I've wanted to recreate that flavor in water ever since, but have no idea where to start.