Hacker News new | ask | show | jobs
by amai 526 days ago
I believe it is not only garbage collecting. It is also doing backpropagation on the memories of the day before. After 8 hours you get an updated, more optimized service.
1 comments

This is the insight missing from everyone comparing LLM parameter counts to human neurons or synapses. The human model gets a new version every day, and the digital one costs $5B of energy and a year to do the same.
I think this is the first time I've seen someone say something correct about AI on HN in years!