Hacker News new | ask | show | jobs
by echelon 2502 days ago
I think this project has immediate merits when it comes to productionizing small, sparse networks for running on the CPU.

I do research and prototyping in Python, but I have to deploy on mobile devices. I was going to roll my own implementation, but now that this exists, it's something I'm going to look into.

1 comments

Load the model from torch script? In C++?

Don't see why Rust made this possible.

Ideally we'd have native Rust loading of tensorflow, pytorch, etc. models. I've hand-coded a few, but it was pretty monotonous.