Hacker News new | ask | show | jobs
by EGreg 1202 days ago
Yet another open source LLM with tens of billions of parameters? Hmm, I guess maybe I'll install it and play around. But how does this compare to let's say Bloom: https://multilingual.com/bloom-large-language-model/

That was released last year, has more parameters, and is available to everyone, not just researchers.

1 comments

AFAIK you need a high specs computer to run it.
According to:

https://towardsdatascience.com/run-bloom-the-largest-open-ac...

You only need 16Gb of RAM:

"A BLOOM checkpoint takes 330 GB of disk space, so it seems unfeasible to run this model on a desktop computer. However, you just need enough disk space, at least 16GB of RAM, and some patience (you don’t even need a GPU), to run this model on your computer."