|
|
|
|
|
|
by oleg_kabanov
14 days ago
|
|
|
The main trend is that models are moving out of cloud to local setup to avoid paying for tokens. This becomes possible due to free open-source models like Kimi K3 that already reached level of the best commercial models. The second trend is that AI is not mature enough to be used as a human replacement. Maybe as a helper, but even then they need close guidance and check. All these talks about autonomous agents, AI employees. etc - this is all hype that current level of AI technology cannot deliver. Realization of this fact will cause bubble deflation. |
|
|
Who on earth is running a 1.8T parameter model locally? The hardware to do that with a usable token/s rate for a single person is (at least) well into 5 figure territory.