Hacker News new | ask | show | jobs
by airgapstopgap 1062 days ago
> The same goes for using T5-XXL

Is this still true in 2023? Sure, back in the dark ages it seemed like a 860M model is just about the limit for a regular consumer, but I don't see why we wouldn't be able to use quantized encoders; and even 30B LLMs run okay on Macbooks now.

1 comments

That’s a fair point and I’m not sure actually. I bet you’re right though.