[danenania]

Yeah, I'm still wondering if MCP will be the solution that sticks in the long run.

It has momentum and clearly a lot of folks are working on these shortcomings, so I could certainly see it becoming the de facto standard. But the issues we're talking about are pretty major ones that might need a more fundamental reimagining to address. Although it could also theoretically all be resolved by the models improving sufficiently, so who knows.

Also, cool to hear that you came across Plandex. Lmk what you think if you try it out!

[wirehack]

Yes I agree with you. What are the major shortcomings that you can think of right now (especially the ones that we have not solved)?

[danenania]

I think the two biggest issues are probably:

1. Giving the model too many choices. If you have a lot of options (like a bunch of MCP servers) what you often see in practice is that it's like a dice roll which option is chosen, even if the best choice is pretty obvious to a human. This is even tough when you just have a single branch in the prompt where the model has to choose path A or B. It's hard to get it to choose intelligently vs. randomly.

2. Global scope. The prompts related to each MCP all get mixed together in the system prompt, along with the prompting for the tool that's integrating them. They can easily be modifying each other's behavior in unpredictable ways.

[wirehack]

Makes sense. Both are hard problems I agree.