Hacker News new | ask | show | jobs
by TZubiri 322 days ago
>Download ollama and mess with a model locally,

Ollama locally is very slow (or low quality). I feel a good middle ground is renting GPU or TPU per minute and running a local model there.

1 comments

Not if you have a gaming GPU or a recent Mac.