|
|
|
|
|
by grafmax
45 days ago
|
|
IMO US vs Chinese data vacuuming is a false choice. One of the main benefits of these open weights models is that you can get the privacy and cost savings by hosting your own model in cloud infrastructure. Open weights models are only 4.5 months behind closed weight ones. The fact that US considers propping its flagship technology by blacklisting competitors demonstrates how small the US competitive advantage really is. |
|
You have a wide choice of providers available, so if you can find one you trust you can get inference without data harvesting and it's still very cheap. But dedicated HW is insanely inefficient.
Opus estimates you can do it for $13k/month if you get committed pricing on the HW.