[szmarczak]

I wouldn't argue that it doesn't give any benefits. However, it's not worth the current cost unless you already own RTX PRO 6000 to run any reasonable LLM. I'm using Claude Free and I'm happy with what I get, especially for the cost of $0.

I'm eagerly waiting for the prices to come down so I can upgrade my PC to AM5 and run Gemma 4.

[j2jj]

Its quite possible that LLMs become housed units like the next PC. Initially it starts off as being a large thing in data centers (like computers did) until they got smaller and smaller. Except I expect the time it takes to get smaller and smaller to compress much more - given that we live in a world with far more resources and risk-taking.