Hacker News new | ask | show | jobs
by lenticular 2591 days ago
I'm eagerly awaiting their sparse matrix support. It's unbelievable that the entire JVM doesn't have a single comprehensive, production quality sparse matrix library [0]. This is one of the big things keeping my machine learning in Python.
3 comments

Check out Neanderthal[0], it seems to have support for some subset of sparse matrices and it's faster than ND4J[1] to boot.

[0]: https://neanderthal.uncomplicate.org [1]: https://dragan.rocks/articles/18/Neanderthal-vs-ND4J-vol1

Yeah, Neanderthal is great (I'm a Clojure a user). It's got support for structured sparse matrices (like Toeplitz) the last I checked, but not general CSC/CSR matrices.
Can't you use JNI with the usual C/FORTRAN-libs? That's AFIAK what python does [1]. Or are you asking for a nicer wrapper?

[1] https://markus-beuckelmann.de/blog/boosting-numpy-blas.html

Sure, but there's not a single mature library that's done so.
I'm by no means a expert in the field, but I've used https://github.com/scalanlp/breeze for this....
Breeze runs out of memory for even surprisingly small arrays.