For Ai, I'm using ADK. It's my "kubernetes for agents" from this perspective of abstractions and common task management handled by the system.
https://google.github.io/adk-docs/get-started/about/