Hacker News new | ask | show | jobs
by drob518 400 days ago
Just add one more level of indirection, I always say.
1 comments

But seriously… the solution is often to cache / shard to a halfway point — the LLM model weights for instance — and then store that to give you a nice approximation of the real problem space! That’s basically what many AI algorithms do, including MCTS and LLMs etc.