[hvidgaard]

You don't need to store the data locally, you can just store indexes and filters. Keep them up to date in an online fashion and the cost is a fraction of the storage space required, and some extra CPU time spend locally.