Hacker News new | ask | show | jobs
by wdobbels 2310 days ago
No mention of dask? So far I haven't really had a need for larger-than-memory arrays, but dask would be my go-to choice.
1 comments

Dask, while great, doesn't solve this problem at all. You still need some way to load the data.

And for that Dask supports Zarr, and HDF5, and pre-existing arrays (where mmap() comes in), and a few other formats: https://docs.dask.org/en/latest/array-creation.html#