[bschwindHN]

> It requires some data on disk, which is about 100GB

As someone who develops on a Macbook with a 128 GB drive, this is completely crazy to me. How is it taking up 100 GB? I use Docker for Mac for most of my day-to-day development, mostly for running docker-compose environments so I have separated Redis/Postgres environments for each app. They take up nowhere near 100 GB. Something sounds very wrong, but I can't imagine how it would be caused by the JVM running Clojure.

[chrisseaton]

> Something sounds very wrong

How can it be wrong to simply have 100 GB of data that you need to operate on? If that's how much data you have then that's how much you have.

[tokenizerrr]

Sometimes applications have to read and process data from the filesystem. I have several ~100gb datasets 9f large amounts of sensor data.

[yjgyhj]

> How is it taking up 100 GB?

A couple of blockchains. As said, it's the data of my app, not Clojure or Docker.

[bschwindHN]

Oh, I read it as "Yeah it takes up some space on my drive, like 100 GB". Having it as actual data the program is processing makes way more sense, sorry about that.

[kbar13]

it sounds like OP's program reads some dataset, and it is 100GB in size.