Y
Hacker News
new
|
ask
|
show
|
jobs
I want run open source LLMs on this prebuilt AI. Anyone tested this before?
(
autonomous.ai
)
16 points
by
kayduyenma
547 days ago
4 comments
KTibow
546 days ago
It reminds me of a similar product [0] from George Hotz
[0]
https://tinygrad.org/#tinybox
link
average_joey
547 days ago
good point is that this integrates some existing models for you to use. You can test different models with this. But still need to upgrade if you wanna try larger models. The more Vram the better
link
tech_no_logic
547 days ago
cool case, i'll go for opt 2 as they have Threadripper.
link
rar00
547 days ago
seems a tad expensive for (nerfed) consumer-grade GPUs IMO
link
[0] https://tinygrad.org/#tinybox