POOGI for ABA

Every reasonable behavior analyst has a lot of “stories.” A story will typically go something like this: When we started with Johnny, he wasn’t toilet trained, had no language, and engaged in severe aggression, self-injury, and tantrums. Now, after an intensive two years of intervention, Johnny is toilet trained, he says 30 words, and problem behaviors only occur rarely.

What’s wrong with that story?

The problem with stories like this is we have no way to know if Johnny did well in the intervention. Maybe this program was fantastic and a lower quality program would have achieved much less. But maybe this program sucked and even a reasonably high quality program could have achieved 10X as much.

Unfortunately, there is only a small amount of research on predictors of progress. Which means right now, no one can conduct an assessment and tell us what we should reasonably expect from a high-quality service. There are no standards for results. Instead, standards tend to focus on process. That involves things like “Is the curriculum science based? Are the staff trained well?” That’s good, but not good enough.

Behavior analysts tell their “stories” and think everything is great! They don’t have any reason to think they need to improve urgently. I can tell you from hard experience that many of us definitely do. The lack of standards for results is the enemy of the POOGI.

The long-term solution is to determine measurements of what “appropriate” or “reasonable” progress looks like. We need clear standards. Without them there is simply no way to do thorough quality control as a field.

But while we are waiting for the long-term solution, there is a LOT we can do in the short-term. Always be skeptical of your stories. Constantly seek additional opinions. Look at research on how others implement the same interventions. Is there something we can learn? Measure the rate of progress. Is it improving over time?

Constantly ask-What have we done to POOGI today?

About 20 years ago I was working with two new referrals for children with autism. The students were about 8- or 9- years old at the time. They both had significant problem behaviors, but nothing that was very extreme or that I hadn’t seen a thousand times before.

One thing was very different though. These two children had been previously treated by two different internationally known behavior analysts. The parents had shown me videos of the treatment, which was both impressive and clearly effective. It was great to see videos of people I had only read about performing treatment and I was sure I could learn a lot from them. Still, the children had clearly regressed after the therapy had ended.

These two children were successfully treated with great reductions in problem behavior to near zero levels and high levels of social validity from staff and parents that lasted for several years.

About 5 years later, for personal family reasons, I moved and had to transfer the cases to other professionals. I received follow-up communications from the parents of these two children. Both had serious regression and were again engaging in problem behavior. Only now, these behaviors were much more significant as they were older and bigger.

The same thing that had happened to the famous behavior analysts had happened to me. The treatments were clearly effective in the short-term, but they didn’t last in the long run. It is easy to be fooled by short-term success. Just look at any weight-loss ads with the before / after pictures. A very large portion of those people will not sustain the success. I believe the same is true with successful problem behavior treatment. Many will not sustain the success.

Yes, in order to be effective you have to reduce problem behavior now. Immediately. But if you don’t do it in a way that is sustainable in the long run, it won’t really matter much in terms of a socially significant impact on the child’s life. Now, when asked to treat problem behavior I’ll work on practical strategies to reduce problem behavior quickly. But 90% of my focus is on how to make sure the successful treatment lasts…