Hacker News new | ask | show | jobs
by _0xdd 500 days ago
14B model runs pretty quickly on an MacBook Pro with and M1 Max and 64 GB of RAM.
2 comments

It is so exciting to see that we are once again in a position where hardware is the main bottleneck for new Computing/Software technologies.

I remember back in late 80s (I was a kid) when we had MSDOS and Windows was just starting. We had all kinds of crazy stuff like Quattro Pro, and later in early 90s we had Wolf3D and all sort of software that was limited due to hardware advances.

With the current state of LLMs... imagine how it is going to look like in 10/15 years when the hardware race goes raging again.

It is also very interesting the position of the different countries: China is in a great position economically and with the amount of talent it has; in addition to its culture and political direction (centralized government that finds it easy to direct policies quickly). Meanwhile, the US is in a more fragile stance, with lots of internal fighting and even pushing [intelligent] people out of the country.

The previous race was to get to the moon (US vs Russia), it seems we now are watching a race to AGI.

> Meanwhile, the US is in a more fragile stance, with lots of internal fighting and even pushing [intelligent] people out of the country.

Oh, good grief. Amazing how people find ways of squeezing Orange Man Bad into anything and everything.

PS - I am not going to stay awake at night worrying that ICE will be deporting hordes of illegal aliens working at US AI companies.

It also runs quite well on a 24GB MacBook, which is nowadays more or less the base configuration unless you go out of your way to buy a suffixless-CPU MacBook Pro.