Hacker News new | ask | show | jobs
by skissane 1084 days ago
From what I understand, there are two different processes – a continuous process which runs while we are awake, building new connections between neurons (acquiring new "weights"); and a pruning process which runs while we are sleep, sorting through those new connections and deciding which to keep and which to discard. That's very different from an AI that occasionally retrains.
1 comments

But what if you could run a new acquired neuron "wight" trough another LLM that would based on its provided context (guidelines) be able to determine the importance of this new neuron. That loop could create more accurrate and higher quality data that could be used to re-train (fine-tune) new version of LLM.