Hacker News new | ask | show | jobs
by isaacimagine 1619 days ago
Maybe a cross-language library that takes a binary weights file (with embedded model information) and exposes an interface similar to that of the web API? Or a local lightweight version of Nyckel that one can run on their own infrastructure (that exposes the same REST API)?

Just spitballing here; these two would be the most convinent for the use-cases I have in mind.
1 comments
saintarian 1619 days ago
Agreed that they would be convenient. We are looking at both those options. There are devils in the details like seamlessly taking advantage of available hardware acceleration.

Would love to talk more about your use case so we prioritize the right things for model export. Drop me a line (george at nyckel dot com).

link