|
|
|
|
|
|
by 2ndorderthought
31 days ago
|
|
|
Correct they aren't opus. They are sonnet with a little hand holding. They also run on a single GPU at 40 tps. No one is saying a local model will give you anthropics business in a 5min download. People are saying, "hmm, maybe I should do this one locally". People are also saying "this is surprisingly good enough for me given the trade offs" |
|
|
If your time is worth nothing to even triage that question.
Unless you have fanatic needs for data privacy or really don't have Internet, running local models almost certainly results in negative ROI overall.
Not to mention that you need to have decent hardware (that is getting expensive by the day) to even have this conversation in the first place.
People in this post talk as if everyone has a Mac with 24GB or 32GB RAM. When the reality is that most people use a Windows laptop with crappy integrated GPU.