[leach]

Ah I see interesting, I'll have to play around with this more. I switched from Nvidia to AMD and have found AMD support to still be rolling out for these new cards. I could only get LM studio working so far but I'd like to try out more front ends.

Not a major setback because for long context I'd just use GPT or claude, but it would be cool to have 128k context locally on my machine. When I get a new CPU I'll upgrade RAM to 64, my GPU is more than capable of what I need for a while and a 5090 or 4090 is the next step up in VRAM but I don't want to shell out 2k for a card.