Hacker News new | ask | show | jobs
by Tepix 1231 days ago
Some people will have the necessary hardware, others will be able to run it in the cloud.

I'm curious how they will get these LLM to work with consumer hardware myself. Is FP8 is the way to get them small?