[akrymski]

Forget bytes, go for bits. Vocab of size 2. At a theoretical level all of AI comes down to a classifier that is able to predict the next bit given a string of bits. Check out Tsetlin Machines. At some point we will be doing it in hardware.

https://byte-gpt.github.io/

[kulikalov]

Sounds inefficient. It’s like predicting the boiling point of a kettle by measuring the speed of individual molecules of water.

[BizarroLand]

That would be surprisingly easy with 1st year calculus as long as you were willing to accept a small degree of inaccuracy.