|
Yes, NixOS on the Strix Halo system. I am using nixos unstable pkgs. The published rocmPackages were recently updated and now include kernels for gfx1151, which I surprisingly found out this morning. Before, you would have to set a flag to use the older kernels because they were not available. My flake modules with rocm config are a bit messy, but maybe I can find time to throw a repo up with it. It contains all necessary packages, flags, boot options, llamacpp patches, and some hacks to get pytorch working smoothly with rocm. What this means: no, I do not need containers anymore for replicating working configs. The flake configures the system with appropriate libs. I build llamacpp with patches for rocm, and I can run comfyui for generative processes. I have generative image and video working as of today, and next I will get generative 3d modeling working. I'd like to have Trellis2 running this week. None of this would be possible for me without NixOS, as an aside. It keeps track of configuration for me so I do not have scatter shell scripts and unpredictable deps anymore. I used to build Zed from source with scripts, for example. Now it is a module with patches. Llamacpp is the same. Very clean and requires no working memory, when something needs adjusting I just go refresh myself with the module in one place. |