Agile Testing Days
How to Change a System — Elisabeth Hendrickson & Joel Tosi
To shift a system, you have to learn how to read the signals that tell you what’s really going on, then find the right points of leverage. This is harder than it sounds. The signals that are easy to see, like metrics dashboards, are usually convenient proxies, unreliable and full of noise. The most obvious levers are often local optimizations that are likely to backfire. In this masterclass, you’ll learn how to read signals, especially the less obvious ones. You’ll use foundational system thinking tools, especially causal models, to understand and reason about the system as a whole. Finally, you’ll learn how to find the right levers: the interventions that can shift the system while avoiding unintended consequences. Along the way you’ll discover why decisions made with the best of intentions all too often backfire, how to break out of doom loops, and how even the smallest actions can have the biggest impact.
That Wasn’t Supposed to Happen — Elisabeth Hendrickson & Joel Tosi
Have you ever seen an attempt at process improvement backfire? If so, you’re not alone. Back in 2001 Elisabeth wrote about a case where better testing led to worse quality but that example is hardly unique. Examples abound. An organization trying to tighten up release timelines ended up with ever-increasing planning horizons. Yet another organization that rolled AI tooling to speed up development ended up slowing down. Best intentions go astray because software development organizations are non-linear adaptive systems. Attempting to control outcomes as a straightforward chain of cause and effect doesn’t work. When you face a big challenge—poor quality releases, slow delivery, or missed commitments—there is no single dial to turn. You can influence the system, but first you have to understand how it works. In this talk we show you how to see your context as a system, and reason about it so you can find the possibly counter-intuitive approaches to solve hard problems.