Understanding the PISA 2015 findings about science teachingPosted: March 19, 2017
I have shared the following graphic a few times. It shows that frequent use of enquiry-based learning, as defined by the Organisation for Economic Cooperation and Development (OECD), is associated with worse scores on the science component of the Programme for International Student Assessment (PISA). It is based upon surveying students about their experiences in science lessons and then matching this to PISA science performance:
I often point this out to advocates of inquiry learning. Nobody likes cognitive dissonance and so the response I usually receive is, “Well yes, everything done to the extreme is a bad idea. This just tells us about those students who are exposed to inquiry learning in all or most lessons.”
So it is worth going to another chart. This chart shows how an ‘index’ of enquiry-based learning affects overall results. The index isn’t just about enquiry in all or most lessons but about the relative amount. As you can see, more ‘enquiry-based learning’ is associated with worse science PISA results.
You will note that one of the factors that is associated with better PISA science scores is the ‘index of teacher-directed instruction’. Another is the ‘index of adaptive instruction’. This latter term is explained by PISA in the following quote:
“PISA asked students how frequently (“never or almost never”, “some lessons”, “many lessons” or “every lesson or almost every lesson”) the following happens in their science lessons: “The teacher adapts the lesson to my class’s needs and knowledge”; “The teacher provides individual help when a student has difficulties understanding a topic or task”; and “The teacher changes the structure of the lesson on a topic that most students find difficult to understand”. The index of adaptive instruction combines these three questions to measure the extent to which students perceive that their science teachers adapt their instruction based on students’ needs, knowledge and abilities.”
So students seem to do best with explicit teachers who respond to feedback. This is not surprising given the wealth of research on explicit instruction that shows exactly this. And teaching is all aided by a positive discipline climate where students are not hindered by the behaviour of others. Who would have thought it?
If you want to see what the ‘index of enquiry-based learning’ pattern looks like between countries then I have created the following chart from the available data:
That’s quite a strong negative correlation.
It’s worth reminding readers that PISA is a test of application and not of simple recall. Many of the test items require students to evaluate experimental designs and so on. This is why they use the dreadful term ‘scientific literacy’ to describe it. Andreas Scheicher who heads the programme is not an educational traditionalist.
All data and graphics were obtained from Volume 1 and Volume 2 of the reports that can be found here.