[kuczmama]

That's a good point. Are you referring to the out of date cuda libraries?

[eurekin]

I don't remember exactly (either cuda directly or the cudnn version used by the flashattention)... Anyway, /r/localLlama has few instances of such builds. Might be really worthwhile looking that up before buying