Some lessons on architecting, organizing, and deploying LLM driven AI agents at scale after 2+ years of engineering work.