Can you use Plan-Do-Study-Act (PDSA) during the information-gathering phase of an improvement project? Yes! Join John Dues and host Andrew Stotz as they discuss how John's team used PDSA to learn more about chronic absenteeism, their surprising findings, and what they'll do next.

TRANSCRIPT

0:00:02 .8 Andrew Stotz: My name is Andrew Stotz, and I'll be your host as we dive deeper into the teachings of Dr. W. Edwards Deming. Today, I'm continuing my discussion with John Dues, who is part of the new generation of educators striving to apply Dr. Deming's principles to unleash student joy in learning. The topic for today is powerful learning with the PDSA cycle. John, take it away.

 

0:00:25 .5 John Dues: Yeah, Andrew. It's good to be back. For the past two episodes or so, we've been working towards defining the problem of our chronic absenteeism issue, of course, we have a problem with chronic absenteeism, but we're trying to narrow that down and get a more specific problem statement. Last time we talked about how our improvement team, basically, had come to the conclusion after a few weeks of study that we didn't have enough information to write that specific, precise problem statement. So what we decided to do, and we started looking at this last time, was we started to gather additional information through a Plan-Do-Study-Act cycle. So that's what we'll focus on today, is this first PDSA cycle, and I think it's good to know that you can use PDSAs to run an experiment to test a new idea, but you can also run a PDSA to gather more information. Those are both very worthwhile uses of the PDSA cycle. So I go to share my screen just so I have that model up so that people who can see it, for those that are viewing. Can you see that now?

 

0:01:33 .8 Andrew Stotz: Coming up. Okay, we can see it.

 

0:01:36 .6 John Dues: All right, great. So you remember, we've been working through this four-step process for those who are hopping in for the first time or as a review for those that have been following along. So we have these four steps: set the challenge or direction, grasp the current condition, establish your next target condition, and then an experiment to overcome obstacles. And remember, we've been working through this team, that's a combination of people working in the system, people who have the authority to actually change the system, and then the System of Profound Knowledge coach. So I think that's a pretty powerful combination of people, and that's our team here working on this chronic absenteeism problem. You also remember that we have this long-range goal that this challenge that is to improve our chronic absenteeism from right around 50% to down closer to 5%, and I don't know if you remember this, but a number of episodes ago, I showed you the data we had over time, and we just had three years of data. Since that time I showed you that first run chart, I've actually gone back and added chronic absenteeism rates for our schools going all the way back to the 2016 - '17 year, and I think it's worth it to just take another quick look at those rates over time in a process behavior chart.

 

0:03:00 .2 Andrew Stotz: Exciting.

 

0:03:01 .5 John Dues: So, yeah. This is our chart. So we add more days so why not display it in this way. So what this chart is, is again a process behavior chart, we have school years going back to the 2016-'17 school year, and then through last school year. And we have the blue dots displaying the chronic absenteeism rate for each of those school years across our school system, and then the green is... The green line is that central line, it's the average of all years, the red lines are those natural process limits that sort of tell us where we can expect our data to fall given that this is a predictable system. So you can see right off the bat, something that's pretty obvious is that the first four years of data are below that central line, and then the last four years of data are above that central line. And of course, it's not too hard to sort of recognize that the pandemic happened towards the end of the 2019-'20 school year, and then sort of... We were all remote heading into that 2021 school year, and then for a number of years after we were in remote or hybrid, and so you can see very clearly that while there was chronic absenteeism in our system prior to the pandemic, after the pandemic, it exploded and it has not subsided.

 

0:04:28 .7 John Dues: So in a typical year prior to the pandemic, we were somewhere around that 25, about a quarter of the kids give or take, depending on the year, of the kids were chronically absent, and then after the pandemic, we can see it sort of... Or at the begining of the pandemic, explodes up and then has settled around this, right about 50% average.

 

0:04:51 .1 Andrew Stotz: And the fact that it's remained at this much higher level of, let's say 50-55% tells you that there's like... It has had somewhat of a permanent impact, whereas some people may think that the COVID situation caused a spike in chronic absenteeism up to 70% or whatever that number was, and then it came back to normal. But it's far away from normal.

 

0:05:26 .4 John Dues: Yeah, and I haven't done a deep analysis. But in addition to the chronic absenteeism, the National Assessment of Educational Progress, which is like the gold standard, the report card for the nation, a nationally known test given every couple of years, that data shows that the 4th and 8th graders that take that test across the country in ELA and math, the scores are down coming out of the pandemic as well and have not rebounded. So I think that data is important. I'm not necessarily saying one way or the other, what we should have done, but what I am saying is like when we make decisions like shutting down schools, it's not just a decision that has an impact in the moment, there are ramifications on an ongoing basis. And we should sort of take that calculus into consideration when we're deciding what to do in a situation like that.

 

0:06:20 .0 Andrew Stotz: And this also shows that you're taking on a pretty serious challenge because...

 

0:06:23 .8 John Dues: Very serious. Yeah.

 

0:06:25 .0 Andrew Stotz: Yeah, it's serious for the students, but it's also serious in the sense that it's been lingering at this very high level of chronic absenteeism, so, okay.

 

0:06:37 .0 John Dues: Yeah.

 

0:06:37 .5 Andrew Stotz: Shocking.

 

0:06:38 .1 John Dues: Yeah, it is pretty shocking.

 

0:06:38 .7 Andrew Stotz: That's not happening in Asia.

 

0:06:40 .6 John Dues: No, and it's... I think a number of places in the United States, the learning chronic absenteeism has bounced back, but in the places where you expect where there's, especially high concentrations of poverty and things like that. It's sort of remained a serious issue even depending how you mark the end of the pandemic, two or three years after the primary part of the pandemic anyway. The height of the pandemic, if you will. So, ongoing challenges for sure. So what I said was that the team was going to run this initial PDSA cycle to gather more information, of course, there were some initial thoughts on why kids were missing so much school. We've talked about these transportation, different expectations that have been set for when to stay home, family and instability, those types of things. But again, we want to further test those assumptions early on in the project. So the key question that we were looking at is, for this first PDSA cycle, at least was will the combination of a what we call an empathy interview, which is just like where we sit down with a student or the family and try to better understand what's going on, and then daily attendance tracking was the other part of this, will that lead to a modest increase in the students average daily attendance rate during the period of the intervention.

 

0:08:11 .9 John Dues: So even though we weren't necessarily testing a change idea, there was this sort of like... We framed it as a modest intervention in terms of sitting down with the kids and then doing this daily tracking and showing them the data. And a key part of this plan phase is we had all of our team members predict what they thought would happen with the four students that we chose to have those interviews with and track the daily attendance of during Cycle 1. So we had everybody really think through, "Okay, what do we think will happen when we put this plan in place?" And that's going to be really important because when we actually run the test, we want to compare the predictions to what actually happens, and that's where a lot of the lea