|
|
|
|
|
|
by dcminter
506 days ago
|
|
|
I'd think in terms of running this on a PC in my spare room if I was trying to keep costs down and the usage wasn't going to be all that high. Depending on how many concurrent users you're expecting, and if you do something with open source models, then Ollama running on a very not-top-tier GPU is likely to be a good bet. |
|
|