Virtual reality headsets are rubbish

Embed from Getty Images

Before someone in your organisation goes blowing the budget on a set of virtual reality headsets, it might be worth having a look at the findings of a new study by Makransky, Terkildsen and Mayer. The research enthusiasts among you may recognise Mayer for his Cognitive Theory of Multimedia Learning (CTML) and this theory does play a part in the study.

The paper is a fascinating read and I can’t capture all of it but I will attempt to explain some of the main findings.

The test subjects were 52 university students who were learning about protein expression through a computer simulation of a laboratory task. In the low-immersion condition, the students viewed the simulation on a regular computer and manipulated the apparatus with a mouse. In the high-immersion condition, the students donned Virtual Reality (VR) headsets that made use of a mobile phone. These headsets provided a 3D version of the lab that the students could explore. They could select objects by clicking a button on the side of the headset.

In addition, the researchers manipulated the ‘redundancy effect’ by providing text in some simulations and text with narration in other simulations. This is an effect that is well known in Cognitive Load Theory (CLT) and CTML and it arises when subjects are asked to read information while listening to verbal narration at the same time. This causes interference because, as Mayer would argue, both sets of words need to be processed in the auditory channel of working memory. It is therefore better to have either the written words or the narration rather than both. This is the reason why you should never read-out or talk over text that you present on a PowerPoint slide.

The authors point out that there are two competing hypotheses about the effect of low immersion versus high immersion (actually, they comprehensively cover a range of ideas but I will stick to the two main ones). Firstly, arguments based on those of John Dewey would predict the high-immersion environment is more authentic, giving more of a practical experience and that this should therefore lead to more learning than low-immersion. Conversely, arguments based upon CTML or CLT would suggest that high-immersion VR would introduce more extraneous details to process, increasing overall cognitive load and degrading learning.

Students were randomly assigned to conditions, with every student attempting one low-immersion and one high-immersion activity. Interestingly, the simulations were in English but the surveys and post-tests were in Danish – I’m not sure how that would effect things although it may increase the cognitive load of the simulation, depending on how fluent the students were in English.

The researchers measured cognitive load directly using an Electroencephalograph (an EEG), a device that records electrical activity in the brain via electrodes attached to the head. The EEG was initially trained by making measures of people performing typical working memory tasks such as accurately reciting lists of digits (digit span tasks) or performing mental arithmetic, as well as looking for correlates with subjects’ own reports of cognitive load. A company has developed proprietary software to process all of this, as well as subtract effects due to people blinking or other muscle movements. I find this quite impressive.

After the simulation, students answered questions directly assessing their knowledge, as well as transfer questions that required them to apply their new knowledge in novel situations. The low-immersion condition led to higher scores on both tests but this was only statistically significant for the knowledge tests. The transfer test items had quite a low reliability and so, with a sample this size, it would have been hard to see an effect.

The main finding was that the low-immersion, computer version of the simulation was more effective than the high-immersion, VR headset version. However, the subjects did report a significantly greater ‘sense of presence’ when using the headsets, which is hardly surprising.

The EEG allowed the experimenters to calculate the proportion of time that students were cognitively overloaded. For the first simulation task, there was no significant difference but in the second task, the VR headset students spent a significantly greater amount of time overloaded. This is consistent with the predictions of CLT and CTML.

Interestingly, the redundancy effect was entirely absent. This is odd but it may be due to a combination of how it was tested and how subjects responded. Most evidence for the redundancy principle comes from comparisons of narration versus text and narration rather than text versus text and narration as used here. In addition, some subjects appeared to ignore the text and just listen to the narration. According to CLT and CTML, this should be effective because it makes use of the modality principle of mixing narration with visual images. I think this area is worth exploring further because it might hint at something we haven’t fully worked out.

So should your school go out and buy those VR headsets? The best we can say from this research is that they may be motivational. For instance, they could be used as a whole class or individual reward for effort or they might help generate excitement about a topic (although this will not necessarily persist once the headsets are taken off). However, if you are buying them because you think your students will learn more then this study suggests you are wrong.

Advertisements

Middle class media

Embed from Getty Images

In 1997, my schoolfriend and I went to London. I gained a full grant to study a one year teaching qualification and then started teaching. I earned just under £15,000 in my first year and made a loss which I covered with a graduate loan from my bank.

My friend started work in television. He came from a better off area than me and that was important because he only earned £9000. His parents had to subsidise him for a number of years. I don’t know for sure, but I expect that he now earns far more than I ever will.

Yesterday I listened to an important episode of Thinking Allowed; more important than we might at first realise. Laurie Taylor, the mellifluous host, introduced us to a working class actor and a researcher. Actors in England, it seems, are predominantly from the upper middle classes. This wasn’t always the case. In the 1980s, aspiring working class actors could live in London, claim unemployment and housing benefits and slowly make their way. These days, you need some serious funds behind you.

I have been concerned about this phenomenon throughout my teaching career. It doesn’t just apply to acting but to a host of professions. And it’s not something that can be addressed by the education system because it’s not about the quality of education. I am acutely aware that many opportunities in the media, arts, politics and a range of other prestigious professions involve starting with low paid work or unpaid internships. This is fine if Mum and Dad are behind you or you have a trust fund but it shuts doors to working class kids who need to earn in order to live.

I had always thought this unfair but I am now starting to wonder if there are wider implications.

For instance, if the media is dominated by the middle classes then is that likely to cause a disconnect between the media and ordinary people? Does this system reproduce metropolitan elites complete with an empathy gap and a bafflement at the preoccupations of working class voters? If so, does this system bear some responsibility for Brexit and the unexpected rise of Corbyn? Does a similar system in the U.S. partly explain Trump? Is increased inequality of access to desirable professions an inevitable consequence of rising economic inequality?

In a time of populism, I think we need to start finding some answers.

Four tips for department meetings

I’ve been teaching for 20 years and I’ve been a head of department for roughly half of that time. I don’t claim to be a management expert but I have developed a few views about what makes a successful department meeting. You may find some of these useful.

1. Does it need a meeting?

Teachers are busy and so if you are going to call them together then it must be in order to do something that cannot be done another way. General admin, rotas and reminders have no place in meetings. Send an email instead.

What if you want people’s opinions on something? It is important to realise that there are two kinds of people in the world, and therefore in your meetings: those who think before they talk and those who talk before they think. If you spring a contentious topic on the latter group, your decision making is likely to be derailed by them expressing opinions that they’re not even particularly committed to. So signal the discussion in advance by email. Sometimes you will get all the feedback you need and you won’t even need to address it in a meeting.

2. Be transparent

Picture a teacher who we will call Amanda. Amanda is enthusiastic and has lots of ideas to contribute. However, she therefore tends to dominate meetings. Some teachers appear a little frustrated by not having the chance to speak and others use Amanda as cover so they don’t have contribute. You don’t want to keep intervening because you don’t want to demotivate Amanda. What do you do?

You need to tell Amanda all of this. You should explain that it is your perception and not a fact. You should give her time to think about it and then you should come back to her to work out a solution.

I understand that there may be some political subtext that makes it difficult to do this but do it anyway because it is right and because nobody can knock you over if you are honest and transparent.

3. Avoid waffling around in the abstract

Imagine you are head of maths and you’ve analysed some standardised test results that show that scores in data and probability are not as strong as in other areas. This is a good issue to bring teachers together to discuss but there is a danger that you will waste people’s time.

Most of us are comfortable in the abstract, talking about teaching at a meta level. Without effort, this is where your discussion will stay. Teachers with different agendas will use the opportunity to push for more hands-on activities or more explicit teaching. But there will be as many different interpretations of what these mean as there are people in the room.

Imagine someone says, ‘We need to be clearer about how we teach scatter plots’. Firstly, that someone is probably right – the answer is usually greater clarity. I would then give them a board marker and say, ‘Show us.’ If the teacher then stayed at the meta level, I would insist, ‘No, teach it to us as if we were the students.’

I am no fan of role play in teacher professional development because it is mostly used in inane ways. However, this is an occasion where it really is useful. I have learnt so much from colleagues by simply asking them to show me how they teach something. If you’ve never done this before then you will be amazed at how diverse the approaches are towards something that you think is pretty tightly defined.

4. Give reading time

Imagine you are in a meeting, you are given a paper you have never seen before and the person who has given it to you immediately starts talking about its contents and their implications. You are now in a dilemma. Should you listen to the commentary which you can’t fully understand because you haven’t read the paper or should you try to tune out and read the paper?

Ideally, the paper would be circulated in advance. However, this is no guarantee that it will be read, particularly if it’s lengthy and given at relatively short notice.

If you want to talk about a paper or a scheme of work or a policy or any other lengthy text, you should take steps to ensure everyone has had a chance to read it before you talk about it, even if that means setting aside some of the meeting time for this.

Youth for Human Rights is linked to Scientology #aussieED

I am not claiming this as a scoop because it has been widely reported across the world (e.g. here and here), but I just thought it was worth alerting teachers that Youth for Human Rights (@YFHumanRights) is linked to the Church of Scientology. The group offers free teaching resources about human rights to teachers.

I point this out because I noticed the promoted tweet pictured above on my twitter timeline. It may be that Youth for Human Rights is making a social media push in Australia.

The Pendulum

Embed from Getty Images

Let’s do a thought experiment. Let’s assume, as people often claim, that education is a pendulum that swings from one extreme to another.

This is certainly one way of viewing what has happened in England – but definitely not Australia – over the last ten years. Back in 2007, England had a new national curriculum that was light on content and heavy on generic skills, a little like the Australian Curriculum today. Around this time, Ofsted was beginning to enforce a particular teaching style by criticising teacher-talk and promoting the idea of students working in groups, solving problems and making decisions.

Today, the climate in England is very different. The academic establishment still appears to lean towards progressive ideology under the guise of constructivism, student-centred learning or inquiry learning and by promoting generic skills. However, they no longer hold sway in the same way. Ofsted no longer attacks teacher-led approaches and the free-school and academy movement seems to have enabled schools to experiment and pursue traditional curricula and explicit teaching.

But here’s the fear: Perhaps we risk replacing a mediocre progressivism with a mediocre traditionalism. All sides of the education debate are sometimes guilty of dismissing negative evidence with the suggestion that, ‘the teachers weren’t doing it properly’. No doubt, die hard progressive educators are just as convinced as they ever were, attributing any failures to implementation issues. Will traditionalists soon find themselves in the same position? Perhaps mediocre knowledge organisers and one-way, non-interactive lectures will proliferate as people latch on to the fashion for the explicit teaching of knowledge without quite understanding it. Will traditionalism fail and will traditionalists start making excuses about implementation?

I don’t think so, for two reasons.

1. Default teacher-led instruction is better than default student-centred instruction

It seems that everyday, bog-standard explicit teaching approaches simply work better than the alternative. If all we manage to do is is shift the mass of teachers to a more explicit approach, even one that is not the optimal form, we will probably make gains.

The evidence for this sits in some of the international data collected by the PISA and TIMSS programmes. For instance, one analysis of TIMSS science and maths teaching showed that teacher who used a ‘lecture style’ were more effective than those who utilised lots of group work. This is echoed in PISA 2010 and 2015 where better maths and science scores were generally associated with greater amounts of teacher-led instruction – except for the very highest amounts of teacher direction – and the use of student-centred and inquiry methods were generally associated with worse scores.

2. Teachers have changed

The pendulum theory assumes that the power and communication structures of teaching stay stable. I sense that, in England at least, there has been a significant shift that will be hard to row back from. The researchED movement, as well as other teacher-led groups, have started to take control of the profession for themselves. Teachers no longer face being told what to do by managers and consultants without the means to question or challenge. They now have resources to draw upon. Ironically, teachers have started to educate themselves, making up for the lost opportunity of so much training and professional development.

This is speculative, but I hope and perhaps believe that this will lead to a form of self-correction. Before dodgy implementations of fashionable ideas spread like grass-fires, there will hopefully be informed teachers – people like you – who will be able to ask the right questions in order to nudge things back on track.

And this is what I hope for Australia. We may be starting a little further back but we might not need to travel the same long journey as England. Social media means that we can swap ideas across the sea. There may not be many of us, yet. But we are starting to ask questions.

BOXING DAY SALE! Ouroboros just $5 AUD

Have you read my ebook, Ouroboros yet? If not, then you should take advantage of the fact that, for a limited time, it will be available at half-price – Just $5 Australian. At the time of writing, that is equivalent to roughly £2.90 U.K. and $3.90 U.S. Buy it here:

If you want to read a sample first then read the chapter in the following link:

Sample chapter

Here is what people have said about Ouroboros:

“In short, despite being determined to find something in this book to disagree with, I found myself nodding along with tedious frequency. Although I consider myself more than a little familiar with Greg’s thinking, I still found plenty of fresh thought and experienced a couple of ‘A-ha!’ moments as concepts I’ve been mulling over for some time settled neatly into place. The point being, however much you think you know, you’ll probably learn something from this book.” David Didau

“It’s a very elegantly and sparely written account of Greg’s experiences of teaching in England and Australia, and of the education research which is relevant to his experiences… Highly recommended.” Daisy Christodoulou

“If you are a fan of his blogs and articles, Ouroboros is a must for your collection… On that same hand, however: if you are a fan of Ashman’s blogs and articles, Ouroboros may be an even bigger must for your as-yet-unfamiliar colleagues and friends.” Eric Kalenze

Merry Christmas and a Happy New Year!

God’s helicopter and computer brains

There’s a modern parable about a man whose rowing boat loses its oars and is swept out to sea. Onlookers at the shore’s edge call out to the man. He shouts back that they are not to worry because God will save him. The onlookers alert the coastguard who send a helicopter which lowers a rescuer down to the man. The man refuses to take the rescuer’s hand and reassures the rescuer that God will save him. Eventually, as the boat drifts further out into open water, a large wave causes it to capsize and the man drowns. On entering heaven, the man asks God why he didn’t save him. In frustration, God replies, “What more could I have done? I sent you a helicopter!”

In the summer of 1994, I was sent a reading list to prepare me for university life. All of the books were interesting, but two altered my view of the world more than anything I had read before or I have read since. The first of these was, “The Blind Watchmaker,” by Richard Dawkins. It is a book that explains evolution, and it explains it with the common objections of a sceptic in mind. As such, it is a act of great teaching because it anticipates its audience.

Dawkins takes apart the case made by creationists under the guise of ‘intelligent design’. He shows that organs such as the eye are not irreducibly complex, as creationists suggest, but can evolve, tiny step by tiny step, with each new move conferring an advantage on the organism that possesses it. As a rebuttal of silly, religiously motivated ideas, The Blind Watchmaker is a masterpiece. However, I also think Dawkins overreaches in this book and in his other works, when he argues that evolution demonstrates the nonexistence of God. You cannot really demonstrate such a thing. To many believers, evolution is God’s helicopter; the physical, rational manifestation of the higher truth that they believe in. God is, was and always will be unfalsifiable.

The second book that changed me was, “The Emperor’s New Mind,” by Roger Penrose. This is an argument against the idea that the brain works like a computer. Central to the case is a theorem published in 1931 by the mathematician, Kurt Godel. Godel’s theorem shows that any formal system of logic that we develop will not be able to express all mathematical truths. Penrose demonstrates that a computer is equivalent to a formal system and therefore no computer can apprehend all mathematical truths. Assuming that human mathematicians can apprehend these truths, the mind of a human mathematician cannot be a computer. Indeed, human mathematicians tend to switch between different formal systems for different purposes.

Penrose doesn’t explain exactly what he thinks the human mind is, although he does put forward a few ideas. Critics may wonder whether Penrose is indulging in a spot of mysticism because if we deny that human brains are like computers then what are they? Are we suggesting that humans have a spirit or a soul? I don’t think Penrose suggests any such thing, he merely claims that we need a better mechanism to explain human cognition than that of a computer. The fact that he could not describe this mechanism does not invalidate his criticism of the human-as-computer concept.

So Penrose popped into my mind when I read a piece by Robert Epstein, a research psychologist, for the digital magazine, Aeon. And I was reminded of this when I saw Dylan Wiliam recently return to this article on Twitter.

Epstein believes that cognitive scientists are wrong to view the human mind as an information processing system and to talk about it using terms borrowed from computer science. He suggests that every epoch has developed a model of the mind based upon their own preoccupations, from spirit to hydraulics to clockwork mechanisms to chemistry and now to computers. And the computer analogy is sticky, with cognitive scientists unable to talk about the mind without resorting to it. He rightly cautions us against the errors we will make if we start to think that brains are literally like computers.

For instance, there is no reason to believe that we will soon be able to model human minds or download our brains to the internet.

Like Penrose, Epstein doesn’t really develop an alternative model, beyond a few hints. Instead, his view strikes me as a mix of behaviourism and some of the cognitive science that he criticises. Humans, he believes, respond to external stimuli such as rewards and punishments. Specifically, their brains are changed in an orderly way by experience. To me, I can’t see how that is so much different from suggesting that they store information. I can even point to the cognitive science concept of a limited working memory as a possible mechanism for ensuring the orderliness of these changes.

I share Epstein’s scepticism about the idea that human brains literally are computers but I’m much more relaxed about using computers as a model, especially if this model makes testable predictions. That’s probably the key difference between the computer model and those of previous eras. The hydraulic model, as far as I know, did not have much predictive power. Yet the computer model does, and some of these predictions stand up. Which is the best you can hope for in science.

I am also keen to hear more about Epstein’s take on behaviourism. If this has greater predictive power in some areas then it might help us edge closer to the truth of what is actually going on in our heads.

However, I would caution against ever thinking we’ve nailed it, whatever we come up with. Some arguments are intrinsically philosophical and cannot be answered by understanding the underlying mechanisms. And these arguments are not esoteric details; they affect how we live our everyday lives and even the way we might frame education policy.

For instance, the concept of ‘free will’ is critical to how we view human behaviour. I am in favour of emphasising human choice and agency because I believe it leads to a healthier society than one where everything is pathologised. And, ironically, this is clearly a choice. Am I free to choose free will? Yes, I am free to choose free will.

Why? Well, there are those who would argue that scans of brains show us that parts of them light up when we make a decision, even before we are consciously aware of the decision we have made. But you can’t disprove my belief in free will in this way, just like you can’t disprove someone’s belief in God by pointing to the process of evolution. Just as God’s helicopter is the mechanism by which he attempts to save the man, these electrical pulses in the brain, whatever they are, represent the mechanism by which free will works. They are a description.

Instead, to challenge the existence of God or free will requires moral reasoning, something we are all capable of engaging in and something that is notably absent in the logic of computers.