Hacker News new | ask | show | jobs
by bitmagier 268 days ago
Summary from my side:

Outstanding features:

- way better representation (very information-dense) of different basic language properties directly as a storage layout property (which seems absolutely possible to me to achieve)

- attention (signal) as resonance: analog wave signal processing methods can be used -> way less computation power needed

Analysis: It will have the same fundamental limitations in terms of "understanding" and "thinking" as traditional LLMs, as its "knowledge" is still based on language itself. I believe it would be implemented in combination with other models, which supply nuances of actual content – namely traditional LLMs, which are focussed on written text as it appears. Nevertheless, it should add a high-quality and high-efficient building block for language processing to the landscape of LLMs. Furthermore it may also be a nice starting point for a general development towards rethinking architecture patterns in favor of lower resource consumption and fine quality of any kind of information.