TMI - Testing and Management Insights

In this episode, explore the Agile philosophy in software development. Learn about using story points and “Ideal Days” for estimation, and the importance of communication and trust in Agile teams. Discover how to choose optimal sprint durations, understand velocity, and use burn-down charts to spot risks. Dive into Scrum as a framework, including the role of the Scrum Master, sprint planning, daily meetings, and retrospectives. Understand continuous integration’s impact on quality and the significance of visualization with diagrams. Learn how Google fosters a testing culture and why automation doesn't replace human tester's, but rather enhances their productivity. Finally, get tips for distributed teams and effective backlog prioritization by the product owner.More Resources:More Agile Testing: Learning Journeys for the Whole TeamAgile Estimating and PlanningSucceeding with Agile: Software Development Using ScrumHow Google Tests SoftwareThe Feiner Points of Leadership: The 50 Basic Laws that Will Make People Want to Perform Better for YouThe A WordExploratory Software TestingThe One Thing: The Surprisingly Simple Truth Behind Extraordinary Result

In this episode, we dive into exploratory testing, a dynamic technique where tests are designed and executed simultaneously, using insights from previous experiments to guide future ones. We explore various exploratory testing tours, including: The Guide Book Tour: Following the user manual step by step. The Money Tour: Prioritizing features most essential to users. The Saboteur Tour: Intentionally introducing problems like network errors and corrupted files. The Anti-Social Tour: Doing the opposite of expected user actions.We also discuss testing in the small versus testing in the large, scenario testing, and designing tests using states and events. Finally, we share thoughts on the future of testing.Other Resources: Exploratory Software Testing Explore it? Explore it! (YouTube Video)

In this episode of the TMI Podcast, we dive into the intriguing world of Testing in Production and how it allows you to observe your software in real-world conditions. Join us as we discuss key techniques to minimize risks while testing in production: Feature Flags: Deploy code to production servers without immediate exposure to users. Feature flags allow you to unveil new features only when you’re confident they will function seamlessly. Shadowing: Safely test new code by sending a copy of live traffic without impacting the customer experience. Staged Rollouts and Canarying: Gradually introduce new code to a small percentage of users, increasing exposure as confidence grows.A/B Testing: Compare different versions of features to determine the most effective approach.We also discuss the innovative practice of chaos engineering, where intentionally causing disruptions builds system resilience and confidence.Discover why a corporate culture that embraces risk is essential for successful Testing in Production. Tune in for insights on how to leverage these strategies to enhance your software’s performance and reliability in the real world.More Resources: https://www.youtube.com/watch?v=n2iE0wUt3bc https://medium.com/life-at-apollo-division/testing-in-production-339dc58dd8cd https://copyconstruct.medium.com/testing-in-production-the-safe-way-18ca102d0ef1 https://copyconstruct.medium.com/testing-in-production-the-hard-parts-3f06cefaf592

Are you ready to navigate the AI revolution and elevate your career? Dive into our latest episode, where AI and testing experts share the must-have skills to thrive in the age of artificial intelligence.🔍 Key Highlights:Essential AI Literacy: Discover why understanding AI is vital for everyone in tech, no matter your role.Transforming Testing: Learn how AI is reshaping the testing landscape and what this means for you.Human Skills Matter: Explore the crucial role of critical thinking, context understanding, and ethical judgment in an AI-driven world.Prompt Engineering Insights: Uncover the skills that truly matter when working with AI.New Opportunities: Find out how AI is creating job prospects and the importance of continuous learning.Building AI Literacy: Get practical steps to enhance your AI knowledge and stay ahead, featuring resources like Deepseek and Testers.ai.AI Assurance and Ethics: Understand the growing importance of responsible AI use and the human element in tech.Don’t get left behind! Learn to collaborate with AI and position yourself for success in the tech landscape of 2025 and beyond. Tune in for actionable insights and a reassuring perspective on the future of work in the age of AI.Resources:https://www.youtube.com/watch?v=FHS6hlDko4Ehttps://www.youtube.com/watch?v=oX625Lm1QoM

In this episode, we explore the four essential metrics that define high-performing teams: Delivery Lead Time: The speed of transitioning code from a developer’s machine to production. Deployment Frequency: The regularity of deployments to production. Resilience: Mean time to restore service Change Fail Rate: The percentage of releases that encounter issues in production.We challenge the notion that developers shouldn’t be highly engaged in testing. We also delve into the critical role of fast feedback loops.Other Resources: Accelerate: Building and Scaling High Performing Technology Organizations The Weasel Speaks Blog

In this episode, we dive into the Agile Manifesto, emphasizing individuals and interactions over processes and tools. We explain why quality isn't something you can tack on at the end. We discuss fostering a culture where everyone feels empowered to speak up. Explore iterative development and user stories, along with the agile testing quadrants. Learn about test-driven development (TDD), acceptance testing, exploratory testing, and usability testing. We also cover performance, scalability, load, and stress testing. Communication is key, with daily standups, retrospectives, and sprint reviews. Discover the test automation pyramid and strategies for overcoming team resistance during the transition to Agile.References: Agile Testing: A Practical Guide for Testers and Agile Teams More Agile Testing: Learning Journeys for the Whole Team Agile Estimating and Planning Coaching Agile Teams: A Companion for ScrumMasters, Agile Coaches, and Project Managers in Transition Succeeding with Agile: Software Development Using Scrum

In this episode, we dive deep into integrating testing throughout the entire development process. Discover the nuances of equivalence class testing and embark on exploratory testing tours like The Back Alley Tour and the Rained Out Tour. We discuss striking the right balance between manual and automated testing and explore how tech giants like Google categorize their test cases. Learn about the concept of test independence at Microsoft and the significance of building testability into your software. We’ll tackle the dangers of code complexity and how to measure it effectively. Embrace holistic testing and understand why quality goes beyond just functional bugs. Discover the practice of dogfooding, where employees use products before public release, and the strategic use of “User Personas” in planning your testing. Tune in for a comprehensive guide to enhancing your testing strategy!References: A Practitioners Guide to Software Test Design How Google Tests Software Exploratory Software Testing How We Test at Microsoft Holistic Testing: Weave Quality into your Product The A Word

Is AI about to revolutionize software testing? This episode dives deep into the future of QA, exploring how AI is changing the game.We tackle the big questions: Will robots take our jobs? How do we test AI? Can we trust AI systems?AI-first testing and what it means for efficiency.The rise of the "hybrid tester" and the evolving role of human expertise.Autonomous testing and the crucial role of human oversight.The challenges of ensuring AI-generated code quality.Tool fatigue and how to choose the right AI-powered testing solutions.The growing importance of compliance and safety in AI.Shift left testing and integrating AI into every stage of development.Low code and no code testing solutions.Agentic testing and AI as a partner.AI-powered analytics and predictive testing.Learn what skills you need to stay ahead and thrive in the AI-powered future. Adaptability and continuous learning are key.Tune in to discover how to embrace the possibilities of AI and shape the future of software testing!Resources:https://www.youtube.com/watch?v=FHS6hlDko4Ehttps://www.youtube.com/watch?v=oX625Lm1QoMhttps://www.t-plan.com/navigating-software-testing-in-2025-the-predicted-top-10-trends/https://kishor-munot.medium.com/predictions-in-2025-testing-and-qa-with-ai-in-next-365-days-f9b150fc0e7fhttps://www.itsutra.com/blog/qa-automation-2025

Join us as we uncover the secrets to creating high-performing teams. Discover how to cultivate a culture where everyone feels empowered to share their ideas and take risks.🌟 Key Insights:Leadership Essentials: Learn about “The Law of the Tombstone,” reflecting on how you want to be remembered, and explore the balance between loyalty and constructive insubordination—knowing when to support your manager and when to respectfully disagree.Empowering Your Team: Delve into “The Law of Make Your Own Bed,” which emphasizes the importance of giving your team ownership and trusting their decision-making abilities.Comprehensive Testing Strategies: Embrace a whole-team approach to testing and learn strategies to scale agile in large organizations like Zebra. Discover effective methods for agile estimating and planning, including Planning Poker.Customer-Centric Development: Understand the importance of early and frequent customer feedback, A/B testing, sprint retrospectives, and the critical role of test automation in your CI chain.Celebrating Success: Recognize the value of celebrating successes and acknowledging wins to boost team morale and motivation.References:Accelerate: Building and Scaling High Performing Technology OrganizationsAgile Estimating and PlanningSucceeding with Agile: Software Development Using ScrumCoaching Agile Teams: A Companion for ScrumMasters, Agile Coaches, and Project Managers in TransitionHolistic Testing: Weave Quality into your ProductHow Google Tests SoftwareThe Feiner Points of Leadership: The 50 Basic Laws that Will Make People Want to Perform Better for YouAgile Testing: A Practical Guide for Testers and Agile TeamsMore Agile Testing: Learning Journeys for the Whole Team

In this episode of the TMI Podcast, we delveinto the transformative impact of artificial intelligence on the testing landscape. As AI-generated code becomes more prevalent—already accounting for 25% at tech giants like Google—the pace of development is accelerating. Testersare now challenged to keep up. Discover how AI is revolutionizing bug detection, test plan creation, and even test automation, enabling testers to become quality champions throughout the development lifecycle. We explore the evolving role of manual testers in an AI-driven world, emphasizing the importance of human skills to complement AI capabilities. Learn practical tips for integrating AI into your testing workflow and acquire the skills needed to thrive in this new era. This episode underscores that AI isn’t here to replace human testers, but to augment their abilities. Resources: ⁠https://www.youtube.com/watch?v=tAj3rIxzz5E⁠⁠ https://www.linkedin.com/posts/jasonarbon_manual-testers-adoptingai-testers-have-activity-7266828049029959681-fOc0/?utm_source=share&utm_medium=member_desktop⁠⁠ https://www.linkedin.com/pulse/ai-replacement-game-tariq-king-ciade/⁠

In this episode, we revisit “How Google Tests Software,” published in 2012, to evaluate its relevance today. We examine the roles of Software Engineers in Test (SETs) and Test Engineers (TEs), highlighting their responsibilities, tools, and the challenges they face. We explore the Test Certified system, a tiered framework that encourages developers to sharpen their testing skills. We also discuss Google’s test classifications—ranging from small to enormous—and the use of their internal bug database, Buginizer, to prioritize testing through risk-based assessments.Discover how Google’s automated bots crawl millions of websites to evaluate web page appearances in Chrome. We also delve into their testing of Chrome OS and the continuous monitoring strategies employed for Gmail. Finally, we spotlight Google’s method for gathering user feedback on Chrome bugs via the “Report an Issue” menu, which captures screenshots, OS information, browser details, and more.More Resources: How Google Tests Software

In this episode, we reviewHow Microsoft Tests Software,published in 2008.We explore which methodologies have stood the test of time and which haven’t. Discover Microsoft’s 1:1 developer-to-tester ratio (didn't) and their collaborative approach throughout the development cycle (did).Learn about the hidden costs oftechnical debt and the importance of Quality Milestones dedicated to addressing it. Understand Microsoft’s “dogfooding” strategy, which involves using pre-release software internally.We discuss War Room meetings for critical software decisions, the role of the Release Manager, and various testing methods like functional,structural, andmodel-based testing. Explore their bug tracking system, test automation frameworks, and the code churn metric, which highlights potential issues from frequent code changes. Finally, we cover static analysis tools and how Microsoft collects user data and feedback.More Resources:How We Test at Microsoft

In this episode, we delve into the principles of Agile and lean software development, focusing on streamlining processes and eliminating bottlenecks to achieve faster delivery and improved stability. We explore Agile estimating and planning techniques, such as Planning Poker, and discuss how to foster a healthy team dynamic by embracing open disagreement.We also examine Google’s whole-team approach to testing, including how they categorize test cases and the internal tools and processes they use to maintain high-quality standards. Additionally, we offer practical tips on prioritizing your daily work to maximize productivity, including "time blocking".Join us for a comprehensive guide to optimizing your Agile and lean development practices.References: A Practitioner's Guide to Software Test Design Agile Testing: A Practical Guide for Testers and Agile Teams The Feiner Points of Leadership: The 50 Basic Laws that Will Make People Want to Perform Better for You The One Thing The Surprisingly Simple Truth Behind Extraordinary Results Accelerate: Building and Scaling High Performing Technology Organizations

In this episode, we dive deeper into the Agile Testing Quadrants and the testing pyramid, exploring how these frameworks guide effective testing strategies. We’ll discuss the value of using real customer examples when designing tests and the importance of developing and testing “thin slices” or “steel threads” to ensure end-to-end functionality. We also cover the benefits of testing with mocks and the efficiency of small pull requests in maintaining code quality. Additionally, we address the potential pitfalls of overemphasizing consensus, which can hinder progress, and highlight the importance of fostering an environment that encourages risk-taking and continuous learning. Finally, we provide insights on managing your relationship with your manager to ensure a productive and supportive work environment. Join us for expert tips on refining your agile testing approach and enhancing team dynamics. References: Agile Testing: A Practical Guide for Testers and Agile Teams The 5 Dysfunctions of a Team Notes to a Software Team Leader: Growing Self-Organizing Teams The Weasel Speaks Blog The Feiner Points of Leadership: The 50 Basic Laws that Will Make People Want to Perform Better for You How Google Tests Software

In this episode, we explore the nuances of effective leadership and decision-making within the realm of software testing and management. We discuss the holistic approach to testing, emphasizing the importance of involving the entire team, including developers testing their own code, and adopting the shift-left philosophy to catch issues early. The episode delves into the complexities of project timeline estimation, acknowledging the inherent challenges in predicting the future accurately. We highlight strategies for improving employee engagement and underscore the critical role of customer feedback and maintaining short feedback loops to drive continuous improvement. Additionally, we provide insights on how to encourage your team to embrace change and navigate conflicts constructively. We also tackle the reality of making tough decisions with incomplete information, offering practical advice for leaders in these situations. Tune in for a comprehensive guide to enhancing your leadership skills and fostering a proactive, engaged, and adaptable team. More Resources: The Weasel Speaks Blog The Feiner Points of Leadership: The 50 Basic Laws that Will Make People Want to Perform Better for You Leadership on the Line: Staying Alive through the Dangers of Leading Holistic Testing: Weave Quality into your Product

In this episode, we delve into structured and exploratory software testing techniques. Discover how equivalence class and pairwise testing can reduce test cases and save time. Learn about boundary value analysis for edge cases, decision table testing for input-output mapping, and state transition diagrams for planning. Explore domain analysis and use case testing from a user’s perspective. Understand control flow testing to ensure all code paths are covered and measure code complexity with the Cyclomatic complexity metric. We also cover data flow testing to track variable use. Finally, our AI hosts debate whether AI will eventually replace human testers.More Resources:Exploratory Software TestingA Practitioners Guide to Software Test Design

In this episode, we explore the concept of the 10-Minute Test Plan and why “failing fast” is beneficial for agile development. We’ll discuss the ongoing importance of manual testers in the software development lifecycle and delve into the unique culture of “Googliness” at Google. We also discuss the benefits of Story Mapping.We’ll emphasize the importance of empowering your team to make decisions and why allowing them to make mistakes can lead to growth and innovation. We also cover the significance of measuring what matters and adopting a holistic approach to software engineering.Additionally, we highlight Google’s Auto-Test system and the practice of dogfooding, as well as the value of fast feedback loops. Finally, we examine the key characteristics that define a good leader in the tech industry.Join us for a deep dive into effective testing strategies and leadership principles.References: The Weasel Speaks Blog How Google Tests Software Holistic Testing: Weave Quality into Your Product

In this episode, we delve into the principles of holistic testing and the whole-team approach, emphasizing the importance of creating an environment where every team member feels empowered and takes ownership of their work. We discuss strategies for accurately estimating project timelines and explore how Google employs “dogfooding” — testing products internally before releasing them to external customers.We also highlight the significance of fostering a continuous-learning mindset within your team. Finally, we explore how the “Goal-Question-Metric” approach can be used to identify the metrics that genuinely matter for your projects.Join us to learn how to build a culture of empowerment, continuous improvement, and effective measurement in your software development and testing processes.References: The Weasel Speaks Blog⁠ ⁠The Feiner Points of Leadership: The 50 Basic Laws that Will Make People Want to Perform Better for You⁠ Leadership on the Line: Staying Alive through the Dangers of Leading Holistic Testing: Weave Quality into Your Product⁠⁠How Google Tests Software

In this episode, we delve into the world of Prompt Engineering, specifically tailored for software testers. Discover how to extract the most precise information from Large Language Models (LLMs) using three distinctive frameworks:  • RACE: Role, Action, Context, Expectation • COAST: Context, Objective, Actions, Scenario, Task • APE: Action, Purpose, Expectation Learn why it’s crucial to define the AI’s role and provide ample context to ensure accurate responses. Find out how to refine your queries if you’re unsatisfied with the answers, and explore techniques like asking for more details or inquiring about the AI’s confidence in its response.   We also explore innovative ways to enhance your testing processes, such as uploading UI screenshots to generate test cases or even having the AI produce test cases in CSV format for seamless integration with your test case management system.   Additionally, we discuss the intriguing decline in Stack Overflow traffic due to the rise of AI, and the potential long-term impact on AI quality as these models rely on platforms like Stack Overflow for training data.   Tune in to gain valuable insights and elevate your software testing with the power of AI!   More Resources: https://www.linkedin.com/pulse/prompting-testers-jason-arbon/ https://testsigma.com/blog/prompt-engineering-for-testers/ https://www.linkedin.com/feed/update/urn:li:activity:7256493948087476224/

In this episode of Testing and Management Insights, we debunk two common myths of agile testing: the belief that agile means no documentation and that testers aren't needed. We explore the concept of shifting left and the importance of integrating quality into every step of development. We delve into the Agile Testing Quadrants and discuss the different types of tests that support the engineering team versus those that support the customer.  This episode emphasizes the importance of continual collaboration with your customer and introduces practical tools like Story Checklists for capturing easy-to-miss requirements and Mind Maps for brainstorming test scenarios and seeing the big picture. We also discuss the Power of Three rule, the balance of how much to automate, and the test automation pyramid. More Resources: Agile Testing: A Practical Guide for Testers and Agile Teams More Agile Testing: Learning Journeys for the Whole Team Holistic Testing: Weave Quality into Your Product