What will we learn from the new round of international test results?Posted: November 13, 2016
At the end of this month, TIMSS and PIRLS results are released and at the start of December we will also have new PISA results. All of the assessments were sat in 2015. What will they show?
Firstly, I don’t think it is particularly useful to look at ranks of countries. These can fluctuate due to tiny changes in scores as well as changes in the list of countries participating.
There is more value in comparing general trends across countries on scores rather than ranks, particularly if we examine one subject area such as maths or reading.
Yet probably the most useful analysis is to look at how an individual country has changed relative to its previous scores and then see if this correlates to changes in demographics or education policy.
TIMSS and PIRLS will have less fanfare than PISA. TIMSS assesses maths and science in grades 4 and 8 and PIRLS is a test of reading in grade 4. East Asian countries tend to dominate TIMSS. The test questions are pretty standard when compared with PISA questions. PISA items often involve a lot more context and therefore conflate measures of science and maths with reading ability.
Finland skipped TIMSS between 1999 and 2011. In 2011 it didn’t perform particularly well so it will be interesting to see the trend from 2011 to 2015. My guess is that it will be stable or downward.
I mention Finland because its PISA results have made it the darling of worldwide education and have made a star of Pasi Sahlberg, a Finnish educationalist. For many, the attraction of Finland is that it seems to combine test success with progressive education, although this is not all that it seems. Clearly, what Finland chooses to do now cannot be the cause of past successes and some of its more recent choices – such as the new phenomenon based learning – are likely to lead to a decline in outcomes.
This is why I am predicting a PISA decline for Finland. I am also predicting a similar decline, particularly in maths, for Canadian provinces that have previously done so well. This is due to a pivot towards constructivist maths teaching in recent years. Despite getting a shock in 2012, I’m not sure that Canadian politicians have adequately addressed this or that the effects have been mitigated in schools.
As these countries exit the stage, PISA results will start to look more like TIMSS. East Asian countries will dominate even more than they do at present.
The early spin suggests that this is likely to be the case. We’ve heard a lot about East Asian countries not prioritising memorisation. This is based upon survey data in which I can find no pattern at all. So why focus on this? When the results are out we might find people arguing that anglophone countries should teach maths and science using more East Asian methods. So it may be an early attempt to control that argument.
The only very clear signal from this survey data was that strategies that PISA has clearly negative impact on outcomes. Which must cause a little cognitive conflict over at PISA headquarters where Andreas Schleicher is advocating these very same methods.defined as student-oriented – practices such as project-based learning – seemed to have a
There is an innovation to PISA this year in the form of a test of ‘collaborative problem solving’. It’s hard to tell what this will show although one thing is certain: it is not a test of collaborative problem solving because no such general skill exists. Instead, it will be a measure of how well students can complete a collaborative problem solving test as designed by PISA. It seems likely that this will correlate with the other PISA measures, adding little extra information.