Hacker News new | ask | show | jobs
by nake13 375 days ago
The Magistral Small can fit within a single RTX 4090 or a 32GB RAM MacBook once quantized.
2 comments

Excellent news for me.

How does one figure this out? As in I want to know the comparable Deepseek or Llama equivalent (size-wise) and don't want to figure it out by trial and error.

Is it indeed the plan of Apple to eventually run such kind of models direcly inside a iPhone? Or are the specs of any stateOfTheArt smartphone well below the minimum requirements of such "lightweight" models?