Hacker News new | ask | show | jobs
by hathawsh 901 days ago
I like to think we could quickly create a next-level AI (maybe AGI?) if we simply model it on the Pixar movie "Inside Out". The little characters inside the girl's brain are different LLMs with different biases. They follow a kind of script that adapts to the current environment. They converse with each other and suggest to the girl what she should do or say.

I'd try the idea myself, but I have a job. :-)

1 comments

This sounds a lot like the mixture-of-experts architecture, and the current best-performing language models (GPT-4, mixtral-8x7b) already use this architecture.

So congratulations, you win!

That's not really how MoEs work. They never directly interact with eachother. There is one manager type model that takes a prompt, directs token inference to 1 or more models, chooses the best response, and continues. The analogy would be closer to a "swarm of agents". (There are a handful of names for this approach, I think swarm is catching on the most)