Differentiation: Good intentions are not enough

Embed from Getty Images

The Cambridge-Somerville Youth Study was a ground-breaking piece of research. It followed a mentoring initiative for boys from deprived suburbs of Boston that ran from 1939 to 1945. At the time, this initiative was almost unique in the field of social sciences because it also followed a matched control group of boys who did not receive the mentoring intervention. Through the efforts of researchers, the subjects were traced over a long period of time so that outcomes such as involvement in crime and stability of relationships could be compared.

The study was the subject of a recent Freakonomics podcast that serves as a warning to any of us who wish to intervene positively in the lives of young people. The boys who were given the intervention were overwhelmingly positive about it. And it’s not hard to see why. According to the criminologist, Brandon Welsh:

“The counselors would meet every couple of weeks with the boys, interact with them, help them with homework, take them to the YMCA. During the summer months, some of the treatment-group boys were able to go to summer camps and so were sent out of the city.”

Yet when the data was analysed thirty years later, the boys who received the intervention had fared significantly worse than the control group on a whole range of outcomes related to criminal behaviour, health and work.

Clearly, good intentions are not enough when it comes to social interventions. We cannot fool ourselves into thinking that the worst that can happen is that we have no effect: Sadly, it is possible to do harm. As Denise Gottfredson, professor of criminology and criminal justice at the University of Maryland, states in the podcast, “People just assume that if you do something that sounds good, that it’s going to have positive effects. But it’s actually more complicated than that.” She then goes on to explain that the somewhat counter intuitive result may be due to students in the intervention providing a form of validation for each others’ behaviour.

This is just one example of why there is a clear, ethical imperative to collect quantitative data. We cannot simply rely on our own good intentions or on interventions that are based in theory. It is quite wrong to simply dismiss calls for empirical evidence as, ‘positivism,’ while continuing to intervene with young people in ways that might actually be harmful.

This is why I am so concerned about particular models of differentiation that have become popular in schools. As I have previously written, Universal Design for Learning (UDL) is such a model that lacks evidence to support a positive effect on academic outcomes. One UDL website promotes the program with spurious images of brains. A partner website has a section on the evidence for UDL. However, this section asks visitors if they have any evidence to support these claims. Seeking confirmatory evidence is basically the opposite of science.

One of the features of these forms of differentiation is that they often allow students to present what they have learnt in a variety of different ways. This may be appropriate if a student with a disability simply cannot complete a certain type of task. However, I am deeply concerned about the practice of offering such alternatives to students who have difficulties with a particular task. If a student habitually avoids writing, for instance, then she is never likely to improve at writing and will be severely disadvantaged as a result as the gap grows ever wider between her and her peers. Instead of planning for alternative ways of demonstrating learning, we should be focusing our efforts on intensive and explicit writing instruction.

I might be quite wrong about this, but how would we know?

I have criticised forms of differentiation in the past and it has resulted in some pretty unpleasant commentary. I have been accused by Dr Linda Graham of disregarding the Australian Disabilities Discrimination Act, something I strongly dispute. This kind of authoritarian stance can only serve to silence criticism. Yet as an education community, we desperately need to think more critically. With UDL gaining in popularity to the extent of featuring in an Australian Senate report as an example of good practice, we need to ask whether it is possible, just possible, that it does more harm than good.

I was struck by a post by John Kenny who wrote about a presentation he had recently attended. Advised by the presenter that he should let students with Language Processing Disorder present their learning in the form of a video rather than in writing, he questioned this. According to Kenny, “When I raised this concern with the presenter, she simply stated that it was not fair to make students constantly do what they are not good at, that they should be given the chance to shine at things they are good at.”

It is clear that such views come from a place of deep compassion and concern for students; of this there is no dispute. But what if compassion and concern not enough? After all, they were not enough in the Cambridge-Somerville study. What if, in our rush to apply ideas that we think are sound and that suit our ideological outlook, we are actually doing harm? We will never know if we focus on silencing criticism and refuse to support the kinds of quantitative trials that could answer these questions.


14 thoughts on “Differentiation: Good intentions are not enough

  1. kesheck says:

    The Freakonomics podcast you provide the link for is quite worth listening to, so thank you for leading me to it. It’s quite sobering to think that the interventions we use in the hope of helping people can not only make no difference, they may even be harmful in the long run.

    I was standing in the copier room at school one day this year and noticed that someone had left on the counter the Individualized Education Program for one of my students. I had, of course, read it before, but the page on top dealt with this student’s inability to glean the most important information from spoken information. The IEP therefore required that all teachers provide to the student written notes on any lectures.

    That’s the sort of thing Greg Ashman and David Didau have been questioning, I said to myself. How is this student ever going to learn to discern the most important points made in a lecture if we never ask him to practice that skill? In conversations with other teachers I learned that this particular student spent every class zoned out – if asked to repeat some bit of information just stated by the teacher, the majority of the time he could not repeat any portion of it.

    I have to wonder, was that due to a disability, or had we trained him that he didn’t have to pay attention?

    Anyway, much to think about here and in that podcast.

  2. Yes! This cuts to the heart of so many issues in education – the willingness to implement ideas that sound good over and over again in the absence of any rigorous evidence. I suspect in education we suffer from an imbalance of heart over head – lots of people who are passionate and keen to help young people but not enough rational analysis going on. The profession needs more intellectual rigour – too many appeals to the heart and not enough to the head.

  3. Margaret Simkin says:

    So true Greg. By time time damage is proven it is too late for remediation to counteract the negative impacts. I wonder whether our work has been altered too much by decrees as to what we should do shutting down debate. Just because something is hard for you is no reason not to have a go. Even if a task is easy for you you can always refine and improve on what you have done. Is the focus on grades part of the issue? Giving an A+ teaches the author of the work nothing beyond that grade at that time. It is classically demonstrated when students who have reached the end of Year 10 with ease, and A’s who suddenly finds a B returned to them.

  4. My ITT was almost ruined by “differentiation” and being forced to design/deliver individually-catered worksheets according to learning style. It was stressful at the time, but in hindsight I hold the people responsible in total contempt. Anyone who fell for this stupid fad should be laughed out of the profession and banned from teaching.

  5. There should be zero tolerance for teaching practices that are proven to impede the learning of children. Any school which uses “whole language”, project-based learning, an “inquiry” curriculum etc, should be placed in special measures at once.

  6. Also, it would be nice if the government can find a way to deregister or derecognise ITT courses that have any mention at all of “learning styles”, “learning preferences”, “C. A. Tomlinson” and so on. Imagine designing a 1-year PGCE or G.Dip.Ed with barely a single lecture on explicit instruction, but forcing student-teachers to write “VAK” lesson plans???? Mobs! Pitchforks! Burning torches!

  7. Pingback: Differentiation fails another test | Filling the pail

  8. Pingback: What are you meaningfully changing in your students that cannot be measured? – Filling the pail

  9. Pingback: Backfire effects – Filling the pail

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.