[mrbuttons454]

I haven’t had much time with it, but I’ve had to set the split in the BIOS. There’s probably a way to do it from within Linux though. Also hoping some progress is made on using the AMD NPU in Linux. I know it only recently got kernel level support.

[hedora]

I thought I had to split it in the BIOS, but then I just didn't (this is on a 2025 machine), and llama ended up with the same available "GPU" ram either way (confirmed by running inference on it).

[mrbuttons454]

Oh that's fantastic, I'll give it a try. thank you!

[pstuart]

Finally there's good news for Linux users: https://github.com/FastFlowLM/FastFlowLM

[mrbuttons454]

Amazing, thank you!