Why are Australia’s NAPLAN results so resistant to change?Posted: August 2, 2017
It has been ten years since the advent of the National Assessment Program – Literacy and Numeracy (NAPLAN), a series of standardised tests taken across Australia. Today, we learn that, over this time, there have been only small improvements in students’ performance. For reading, it seems that much of the gain took place in the first few years of the program, consistent with students and teachers becoming familiar with the tests and reaping the once-only boost of practising reading comprehension strategies. For writing, the situation is grim, with a 2% decline since the format of the assessment was changed in 2011.
I have some concerns about the form of NAPLAN assessments. For instance, the reading and writing components should be set in the context of Australian Curriculum content that has been studied in the previous two years, and the numeracy assessment should abandon it’s constructivist focus on wordy problems which acts to conflate mathematical and reading ability. Nonetheless, any genuine improvements in literacy and numeracy should show up in these results and so we have largely been treading water.
The blame for this situation lies squarely with a widespread adherence to bad ideas. An interesting report by the New South Wales Centre for Education Statistics and Evaluation (CESE) recently evaluated the impact of a targeted intervention where $261 million was spent in Kindergarten to Year 2 in an attempt to improve outcomes. Some things certainly changed as a result. Assessments against a set of continua levels improved and many schools felt positive about the reforms. According to a survey of principals, the number of teachers utilising differentiated teaching and learning strategies to ‘some extent’ or a ‘great extent’ increased from 62% to 99% from 2013 to 2016. Hands-on learning went from 59% to 95% and teaching explicitly went from 70% to 99%.
Unfortunately, the Year 3 NAPLAN results showed no significant change.
Readers of this blog will note that differentiation and hands-on learning lack evidence for effectiveness (despite the Victorian government’s odd claims about differentiation that I will return to in a later post) and so we might expect an expansion of these practices to have little effect. However, we should expect a greater use of explicit teaching to be significant, give the evidence for whole-class explicit approaches.
Setting aside in-house programmes, the top three interventions used by schools in New South Wales were TEN, a numeracy intervention, and the L3/L2 and Reading Recovery literacy interventions. I don’t know much about TEN but it seems to involve short periods of explicit teaching to small groups of students. L3 is a programme that also involves teachers interacting with a small section of the class at a time and Reading Recovery is a one-to-one constructivist tutoring approach that was recently evaluated as having little impact by CESE. I was interested to find Reading Recovery in the mix because a number of NSW teachers on social media have told me that it is no longer used.
I think these interventions illustrate a morbid attachment to specific ideas about differentiation. Sure, it would be great if we could explicitly instruct all students individually or in small groups because we could then more closely match instruction to their needs. But without vastly increasing the number of teachers, the question arises as to what all of the other students are meant to be doing while the teacher teaches just a few of them. We’ve known since at least the 1970s that the answer to this question is, ‘not much of any value’. This is why whole-class approaches have proved effective and seem to represent the best trade-off between targeting and teacher input. Whole-class approaches have certainly not impaired the performance of the countries that regularly top the international PISA and TIMSS assessments.
But whole-class teaching is unconscionable in many early primary classrooms. Writing in 1987 about the early 1970s approach to primary teaching in England that was influence by the progressive Plowden report, Maurice Galton comments on the ‘fashionable rhetoric’ of the time where teachers would proclaim, “I don’t teach a class, I teach children”. This rhetoric is just as fashionable now in Australia.
In terms of writing, the ideological change that would be required in order to turn the situation around seems profound. Australia often takes its cue from the U.S. Yesterday, I wrote about the Hochman Method, an approach to writing that is also known as, “The Writing Revolution” and @BradshawEnglish on Twitter pointed me to a paper describing it’s adoption in a New York high school. It is worth quoting a section from this paper because it succinctly captures the problem in many Australian schools:
“Although research-based understanding of how writing is taught is severely limited, especially in middle and high schools (Applebee & Langer, 2009), the recommendations put forth in Writing Next (Graham & Perin, 2007) reflect known trends and tensions in writing instruction (Gilbert & Graham, 2010), specifically the shift in recent decades from a more traditional, teacher-centered model to the ‘caught, not taught’ approach thought to dominate elementary and middle school writing instruction (Graham as cited in Tyre, 2012) and to influence high school writing instruction as well. In this approach, students are immersed in rich literacy environments and expected to ‘catch’ most of what is needed to become effective writers. Most students, according to Graham, do not catch what they need – and those coming from poverty, with learning disabilities and/or limited English proficiency, and/or those with weak instruction may not catch much at all (as quoted in Tyre, 2012).”
Instead of whole-class, explicit instruction in the specifics of writing – e.g. how to use ‘because’ to connect clauses – we prefer a model where students figure this out largely for themselves with the aid of written ‘feedback’ from the teacher; a time-consuming and an inefficient use of time.
Banal NAPLAN writing prompts are also part of the problem because they encourage schools to overly rehearse by asking students to write to similar prompts, perhaps with a few hints and tips about story arcs or complex sentences, rather than focusing on building the vocabulary and world knowledge that all good writers possess.
I am not sure of the way forward here. When proponents of evidence-based education point to scientific evidence they are likely to be told that science simply does not apply to something like education because education is about people. It is as if the dominant ideology exists within a perfectly impervious sphere designed to deflect criticism and maintain orthodoxy. That is why individual teachers and parents need to start asking a few more questions. That is why it requires a grassroots movement. We will never see change emanating from the bureaucrats and academics who have bound their reputations to bad ideas.