Insights
Use Evaluation to Guide PDSAs Rather Than Derail Them
A key to making sure that teams are testing changes on the road to improvement is to avoid getting stuck mistaking an evaluation activity for a test of change. This mistake falls under a common pitfall of mistaking a task for a test. That isn’t to say that you should avoid evaluation activities at all costs. Evaluation activities—surveys, interviews, focus groups—can be important steps in formulating a test of change.
Evaluation activities can help you identify the first change you want to test during the “Do” stage of the Plan-Do-Study-Act (PDSA) cycle. For example, let’s say you team is trying to increase referral uptake for children who screen positive for developmental concerns. For an evaluation activity, you might survey families to find out why they didn’t follow up to schedule their referrals. This step helps teams better understand and respond to the most likely problems affecting the ability to schedule referrals in your clinic. Or, put another way, it provides information to help you plan a small test of change to implement.
With that task, let’s say your team discovers families primarily delayed scheduling a referral because they forgot or were unable to call back on their own and schedule. Using this information, the team can test a method that removes the need for families to call on their own. For example: they might have front desk staff coordinate and book referrals during the same appointment that the child screened positive for a potential developmental delay. Here, evaluation as an early step in your “Planning” stage (the survey) informs the next steps in the "Planning" stage, ultimately preparing your team to be able to move forward and run your test.
In the “Study” stage, evaluation can help you identify what modifications should be made to the test during your “Act” stage. Continuing with the developmental screening example, after one week, the team discovers that referral rates have increased by 50 percent. However, the team is worried that this change may have a negative impact on the front desk staff managing the referrals. To find out more, a small focus group is conducted with the front desk staff to get a sense of their experience with the change. This focus group is an evaluation activity (a task). In it, several staff share concerns about longer wait times because they have an additional task to coordinate. In response, your team decides to track and measure wait time during the next round of your PDSA. Depending on the results of this new measure, you may decide to add an extra staff person. Here, evaluation in your “Study” stage (the focus group) informs the actions you will take in your next series of tests.
Evaluation is a powerful tool that can and should transform improvement work. It only becomes risky when it keeps you from jumping into your test of change. Just remember, with quality improvement work, the focus is to learn from doing, not get stuck evaluating the problem.
Looking for more examples on using PDSA cycles to drive improvement? Click here to access our free e-course, Quality Improvement 102, and uncover best practices for moving from one PDSA cycle to the next.
