[strangecasts]

A small part of me is considering going from a 4070 to a 16GB 5060 Ti just to avoid having to futz with offloading

I'd go for an ..80 card but I can't find any that fit in a mini-ITX case :(

[SV_BubbleTime]

I wouldn’t stop at 16GB right now.

24 is the lowest I would go. Buy a used 3090. Picked one up for $700 a few months back, but I think they were on the rise then.

The 3000 series can’t do FP8fast, but meh. It’s the OOM that’s tough, not the speed so much.

[strangecasts]

Are there any 24GB cards/3090s which fit in ~300mm without an angle grinder?

[zigzag312]

https://skinflint.co.uk/?cat=gra16_512&hloc=uk&v=e&hloc=at&h...

5070 Ti Super will also have 24GB.

[strangecasts]

Oh nice, thank you :)

Admittedly a little tempting to see how the 5070 Ti Super shakes out!

[zigzag312]

I'm waiting too :)

50xx series supports MXFP4 format, but I'm not sure about 3090.

[metalliqaz]

if you're going to get that kind of hardware, you need a larger case. IMHO this is not an unreasonable thing if you are doing heavy computing

[strangecasts]

Noted for my next build - I am aware this is a problem I've made for myself, otherwise I like the mini-ITX form factor a lot

[SV_BubbleTime]

Which do you like more OOM for local AI, or an itty bit case?