Hacker News new | ask | show | jobs
by Weryj 189 days ago
Just keep going! 2TB of swap disk for 0.0000001 t/sec
1 comments
kergonath 189 days ago
Hang on, starting benchmarks on my Raspberry Pi.
link
euroderf 189 days ago
By the year 2035, toasters will run LLMs.
link
pickle-wizard 189 days ago
On a lark a friend setup Ollama on a 8GB Raspberry Pi with one of the smaller models. It worked by it was very slow. IIRC it did 1 token/second.
link