Agentic Systems Without Chaos: Architecting & Operating at Scale

The "Chatbot" era is over. The "Agentic" era is here - and it’s non-deterministic. In this episode of the Next Generation Playbook, Shweta Vohra sits down with Joseph Stein to demystify the shift from simple automation to autonomous agentic systems. Moving beyond the hype of "vibe coding," Joseph Stein shares his experience managing a platform that supports thousands of use cases and billions of tokens. They delve deep into the architectural boundaries necessary to prevent autonomy from devolving into enterprise chaos, the reality of "Agent-to-Agent" (A2A) communication, and why your token bill is the new cloud bill. ⏱️ Video Timestamps (For Navigation) 00:00 – Introduction: The Next Gen Playbook 01:27 – Defining Agentic Systems (Without the Chaos) 04:13 – Evolution or Shift? Why this feels different from classic ML 05:30 – Use Case Deep Dive: Incident response vs. simple Chatbots 08:21 – The Open Source Explosion: From OpenClaw to Raspberry Pi 11:43 – New Responsibilities for Architects: Boundaries & Orchestration 16:12 – Security & Risks: Prompt Hijacking and Token-based DDoS 20:39 – Explainability vs. Noise: What do we actually need to observe? 24:47 – The "Command Center" Shift: Why work is increasing, not decreasing 27:41 – Platform Thinking: Centralizing AI for 350+ Products 36:39 – Should you wait for standards? (Spoiler: No) 42:54 – The Token Reckoning: Cost, Sustainability, and GPU TCO 48:19 – Hard Lessons: When success creates a "firefighting" nightmare 51:58 – 2026 Predictions: The rise of A2A (Agent-to-Agent) communication #NextGenArchitecture #AgenticAI #AIArchitecture #AutonomousSystems #AIPlatforms 🔗 Transcript available on InfoQ: https://bit.ly/3NoeSKo ****************************************** Subscribe to the Software Architects’ Newsletter for your monthly guide to the essential news and experience from industry peers on emerging patterns and technologies: https://www.infoq.com/software-architects-newsletter ****************************************** Next events: QCon AI Boston 2026 (June 1-2, 2026) Learn how real teams are accelerating the entire software lifecycle with AI. https://boston.qcon.ai QCon San Francisco 2026 (November 16-20, 2026) https://qconsf.com/ ****************************************** The InfoQ Podcasts: Weekly inspiration to drive innovation and build great teams from senior software leaders. Listen to all our podcasts and read interview transcripts: - The InfoQ Podcast https://www.infoq.com/podcasts/ - Engineering Culture Podcast by InfoQ https://www.infoq.com/podcasts/#engineering_culture - Generally AI: https://www.infoq.com/generally-ai-podcast/ ****************************************** Follow InfoQ: - Mastodon: https://techhub.social/@infoq - X: https://x.com/InfoQ?from=@ - LinkedIn: https://www.linkedin.com/company/infoq/ - Facebook: https://www.facebook.com/InfoQdotcom# - Instagram: https://www.instagram.com/infoqdotcom/?hl=en - Youtube: https://www.youtube.com/infoq - Bluesky: https://bsky.app/profile/infoq.com ****************************************** Write for InfoQ: Learn and share the changes and innovations in professional software development. - Join a community of experts. - Increase your visibility. - Grow your career. https://www.infoq.com/write-for