Hacker News new | ask | show | jobs
by siraben 1166 days ago
Have you been successful in getting the LLM playground up with Nix?
1 comments
sterlind 1166 days ago
yes, almost! I used poetry2nix and grafted a bunch of overrides to fix the torch-2.0 build, and I just got cuda working with it. I'm testing triton now. I'll submit my PR to poetry2nix so watch that space if you want it.
link