[teleforce]

>I'm not convinced, mostly because things like crypto, which I believe went into ASICs, were based on very slowly moving and mostly understood algorithms.

Yesterday there's a news on a breakthrough for probabilistic computer with 1 million p-bits [1].

Since LLM is stochastic in nature, this type of new computer can be much better than ASIC for processing LLM data.

[1] Biggest Probabilistic Computer Turns Noise into Answers:

https://news.ycombinator.com/item?id=48971938

[nightski]

Except LLMs are not stochastic in nature. Correct me if I am wrong, but it's just the final layer which outputs a distribution across the output tokens. In reality, the rest of the model is deterministic.

This is not like a bayes model or something were it's distributions all the way down.