autocon/22

How can autonomous improve cost, availability and productivity? Experiences from RingCentral, Uber, Cato, fabric, Belcorp, Freshworks, and Norwest Venture Partners are brought together here in this panel discussion from autocon/22.Panelists:Kira Makagon, Chief Innovation Officer, RingCentralMatt Howard, General Partner, Norwest Venture PartnersSuresh Mathew, Founder & CEO, SedaiDean Nelson. CEO, Cato and Ex-Head Uber Compute (Moderator)Key moments:00:00: Why automation is no longer enough01:47: Autonomy negates the tradeoffs of the past between quality, speed and cost03:51: RingCentral's need to innovate drives Autonomous adoption05:56: Autonomous is helping RingCentral improve productivity, cost and reliability07:30: RingCentral's team saw opportunity to reduce toil08:06: How Autonomous impacts RingCentral Dev & SRE productivity09:22: Why Norwest has made multiple investments in autonomous11:51: Great technologies elevate people's careers15:04: The Enterprise Business Case for Autonomous17:52: fabric has 180,000 autonomous operations a year18:51: Belcorp saw 75% reduction in latency20:39: Autonomous improved fabric performance21:22: Humans can pass boring tasks to autonomous systems22:30: How does Sedai avoid errors?23:34: Microservice complexity is beyond human scale24:37: Augment people & help them scale25:38: RingCentral's POV on Performance29:40: Slow is the new down31:09: Progress from automation to autonomous32:17: Time to value is fast vs general purpose technologies35:38: RingCentral's POV on the full value of autonomous36:26: Do No Harm & Practical Autonomy37:25: Autonomous started in 2003, but adoption was slow38:40: Wrapup on the value of autonomyTo learn more about Sedai visit https://bit.ly/3e3Cqlv#autonomouscloud #lambda #kubernetes #eks #ecs #sre #devops #aws #serverless #a8s4k8s #sedai #autocon22, #kiramakagon, #ringcentral, #matthoward, #norwestventurepartners, #nvp, #deannelson, #cato

Prakash Muppirala, EVP Platform at fabric, explains how fabric achieved a 48% reduction in latency and a 6.7x gain in their customers/SRE ratio by implementing an autonomous cloud platform. Prakash explains the importance of latency in ecommerce, fabric's unique challenges, and their path to autonomous cloud management with Sedai.Key chapters:01:31: Why latency is critical in e-commerce04:01: Need for trust and scalability for fabric's headless commerce service04:49: fabric's environment has 10,000 services, uses Lambda, ECS, EKS05:23: Key challenges at fabric09:11:Three key challenges: cost vs latency, matching supply to demand and availability12:05: Evaluating solutions from manual through autonomous13:38: Autonomous was faster, better, cheaper than manual or semi-automated solutions14:16: fabric's journey to autonomous15:48: QoQ growth in autonomous and improvements in latency, cost16:42: Scaling up & down autonomously17:50: Preventing availability issues18:57: Creating a feedback loop with developers19:37: Improving SRE productivity with a hybrid model (people and systems)20:25: Step-by-step phases to be 100% autonomous21:05: fabric's experience with autonomous22:17: Q&A: What was the hard ROI?24:09: Q&A: What is the role of the SRE with autonomous systems?To learn more about Sedai visit https://bit.ly/3e3Cqlv#autonomouscloud #lambda #kubernetes #eks #ecs #sre #devops #aws #serverless #a8s4k8s #sedai #autocon22

Most serverless functions are unoptimized resulting in unnecessary latency and/or cost. Serverless functions can be optimized for performance, cost or a balanced strategy without human effort using autonomous systems. Nikhil Gopinath, VP ML at Sedai, outlines these challenges and the autonomous solution, and also reviews key results from fabric which cut latency by 48% using an autonomous system.Key moments:01:53: Optimization Challenges for Serverless03:36: Memory Settings09:36: Optimize for Performance & Cost11:18: The default for most Lambdas12:20: The best of both worlds13:06: Real time use cases15:47: Batch & backend use cases17:51: Challenges for backend optimization20:32: Under the hood of autonomous system22:24: How fabric reduced latency by 50%25:15: fabric's challenges for managing serverless27:02: fabric application architecture27:59: fabric uses 10,000 services30:11: Scaling up & down autonomously in production32:03: Optimizing for latency vs cost32:45: Matching supply to demand34:43: Will autonomous cause downtime?36:08: Does duration always go down when you incTo learn more about Sedai visit https://bit.ly/3e3Cqlv#autonomouscloud #lambda #sre #devops #aws #serverless #fabric #sedai #autocon22

Cold starts are the #1 performance problem for Lambda users. Autonomous concurrency provides a solution with fewer cold starts than warmup strategies, and lower cost than provisioned concurrency. Sedai VP of ML, Nikhil Gopinath explains the underlying challenge of cold starts and presents the autonomous concurrency solution and compares it to traditional solutions.Key moments:00:49: Understanding concurrency and cold starts04:20: Cold starts by the numbers05:56: Concurrent requests and cold starts08:02: Provisioned concurrency09:41: Introducing autonomous concurrency11:53: Difference from warmup plugins14:39: Difference from provisioned concurrency16:25: Comparing Cost of Different Approaches18:00: How Autonomous Concurrency Works19:19: How Autonomous Concurrency Looks20:14: Component Details21:32: Q&A: Working alongside other optimizations22:17: Q&A: Interference with other extensions?To learn more about Sedai visit https://bit.ly/3e3Cqlv#coldstarts #lambda #autonomouscloud #sre #devops #aws #serverless #sedai #autocon22

Managing Kubernetes with current automated approaches makes it almost impossible to achieve optimal cost, performance and availability. Autonomous offers a path out of this complexity. Autonomous optimization and availability are outlined, the architecture used by Sedai to provide this capability, and how safety is addressed.Key moments:00:20: Why autonomous when we can automate everything?03:10: Automation for Kubernetes04:00: Elements to manage availability & optimization08:14: Constraints & variables to manage13:21: Complexity of k8s: 18,000 variables to optimize 100 microservices14:58: Autonomous Approach15:24: Autonomous vs Automation17:35: Core Tenets of an Autonomous System20:05: Autonomous Availability Management22:36: Autonomous Optimization23:43: A Better Way to Manage Kubernetes27:31: Sedai Architecture28:26: How does Sedai ensure safety before taking action? 29:30: How do you identify & populate metrics in Sedai?To learn more about Sedai visit https://bit.ly/3e3Cqlv#autonomouscloud #kubernetes #sre #devops #aws #a8s4k8s #sedai #autocon22