Ep183: Agentic AI - From hype to business impact
Four enterprise AI leaders from Box, Snorkel AI, Sumo Logic, and Talkdesk peel away the hype and share battle-tested strategies for implementing agentic AI at scale.Topics Include:Carol Potts introduces panel featuring AI leaders from Box, Snorkel AI, Sumo Logic, and TalkdeskDiego Dugatkin explains Box serves 120,000 enterprise customers with 1.5 exabytes of secure cloud contentKui Jia shares Sumo Logic processes petabytes daily across 10 AWS regions for intelligent operationsYunjing Ma describes Talkdesk's evolution from contact center to customer experience automation through agentic AIDennis Panos positions Snorkel AI as leader in embedding human knowledge into data-centric applicationsDiego reveals Box uses AI internally for faster development and externally for metadata extraction automationKui explains security teams face overwhelming volumes, sometimes 1,000 signals daily, many AI-generated attacksSumo Logic announces SOC analyst agent in customer beta and query agent in general availabilityYunjing details Talkdesk's multi-agent hierarchy architecture powered by unified TalkDesk Data Cloud platformFour key areas identified: discovery of opportunities, building knowledge-powered agents, optimization, and measurementDennis emphasizes starting with trusted data foundation before adding generative AI capabilities to avoid hallucinationsDiego stresses governance importance: AI guardrails plus traditional data security create comprehensive protection frameworkKui warns POC-to-production gap requires intentional design: different latency, accuracy, and security requirements at scaleYunjing shares customer success: 80,000 daily calls, 11,000 documents, 97% accuracy despite complex compliance rulesKey success factors include prompt engineering optimization and real-time data processing mechanism improvementsDiego advises learning AI tools end-to-end: from ideation through functional demos without traditional prototyping delaysDennis recommends robust evaluation frameworks across system components, similar to software unit testing approachesYunjing reinforces data processing optimization and governance remain essential alongside exciting agentic AI capabilitiesKui urges immediate action: technology evolves rapidly, perfect solutions don't exist, customer focus builds trustFinal advice centers on treating AI as digital teammate, not replacement, enhancing productivity and creativityPlatform partnerships like AWS Bedrock solve heavy lifting, allowing teams to focus on core differentiatorsParticipants:Diego Dugatkin - Chief Product Officer, BoxDennis Panos - Head of Enterprise AI, SnorkelAIKui Jia - VP AI Engineering, Sumo LogicYunjing Ma - VP of Engineering, AI, TalkdeskModerator: Carol Potts - General Manager, ISV Sales Segment, North America, Amazon Web ServicesSee how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon.com/isv/