|
|
|
|
|
|
by lowbloodsugar
22 days ago
|
|
|
The current “big GPU” has 96gb of memory, but that’s not a “consumer GPU” apparently, while a $5000 Spark is a “consumer PC” I guess. In any case you’re probably better off running a large open weights model on the cloud. |
|
|