Hacker News new | ask | show | jobs
I want run open source LLMs on this prebuilt AI. Anyone tested this before? (autonomous.ai)
16 points by kayduyenma 547 days ago
4 comments

It reminds me of a similar product [0] from George Hotz

[0] https://tinygrad.org/#tinybox

good point is that this integrates some existing models for you to use. You can test different models with this. But still need to upgrade if you wanna try larger models. The more Vram the better
cool case, i'll go for opt 2 as they have Threadripper.
seems a tad expensive for (nerfed) consumer-grade GPUs IMO