|
|
|
|
|
by spyder
825 days ago
|
|
I think it could also have a connection with symbolic AI: The discrete tokens could be the symbols that many believe is useful or necessary for reasoning.
It is also useful for compression, reducing memory requirements by the quantization and small integer representations. https://en.wikipedia.org/wiki/Neuro-symbolic_AI |
|