Hacker News new | ask | show | jobs
by SamDc73 133 days ago
Yes!

I tried to go as far as 32k on the context window but beyond that it won't be usable on my laptop (Ryzen AI 365, 32gb RAM and 6gb of VRAM)

1 comments

You need minimum ie. 2x 24G GPUs for this model (you need 46GB minimum).