|
|
|
|
|
|
by mrbnprck
44 days ago
|
|
|
> open-source models with up to 120 billion parameters Sad, 120b models are definetely feasible to self-host. I'd be more interested in cloud providers (especially one with computational resources like the Schwartz group) hosting the larger 500B+ models. Probably just too expensive/unsustainable if one could 5x fold the cost by serving smaller models solving the needs of the 90% customer. |
|
|