|
|
|
|
|
by bitmagier
268 days ago
|
|
Summary from my side: Outstanding features: - way better representation (very information-dense) of different basic language properties directly as a storage layout property (which seems absolutely possible to me to achieve) - attention (signal) as resonance: analog wave signal processing methods can be used -> way less computation power needed Analysis:
It will have the same fundamental limitations in terms of "understanding" and "thinking" as traditional LLMs, as its "knowledge" is still based on language itself. I believe it would be implemented in combination with other models, which supply nuances of actual content – namely traditional LLMs, which are focussed on written text as it appears.
Nevertheless, it should add a high-quality and high-efficient building block for language processing to the landscape of LLMs. Furthermore it may also be a nice starting point for a general development towards rethinking architecture patterns in favor of lower resource consumption and fine quality of any kind of information. |
|