Hacker News new | ask | show | jobs
by talldayo 620 days ago
I consider aggregate routing to be distinct from moving data. If the context is temporary then the "data" (weights and tokenizer) stays in place. LLMs are static, they do not move data so much as they infer from it.