Reduce maths anxiety with explicit teaching

Embed from Getty Images

A colleague is teaching Year 12 maths methods next year for the first time since the introduction of the new course. As part of the process, I sent her through the materials that we had created for the 2017 course. She spotted a potential flaw. “There needs to be more examples with literal terms in them. The sooner students see these, the better, because they find them hard.” She was right and we have added in examples of this kind.

In discussing this issue, my colleague and I both implicitly grasped an important point; early exposure to these examples would ultimately lead to a more positive emotional response to these kinds of questions. I don’t think anyone has ever articulated this reasoning to me and so I’ve probably picked it up through experience, both as a teacher and a student. It seems obvious to me that being left to struggle with a new kind of problem could lead to anxiety.

This matters because those who promote the use of inquiry-learning and problem-based learning in maths lessons, methods that leave students to struggle with new kinds of problems, have latched onto a concept known as ‘maths anxiety’; a form of stress that is so consuming that it can even harm maths performance.

Jo Boaler, advocate of problem-based maths teaching and the closest maths education has to a rock star, has suggested that maths anxiety is induced when teachers use timed tests. This certainly seems plausible and you may intuitively agree with the idea of eliminating time limits. However, timed tests also have some advantages. For instance, we really want students to just know many maths facts, rather than have to work them out, because this will then free working memory resources to focus on higher level aspects of a maths problem. By timing students’ retrieval of maths facts, we can ensure they have reached this level of automaticity. So this is a great question to test with research; where does the balance of cost and benefit lie?

In her book, Mathematical Mindsets, Boaler alludes to research that demonstrates the harm of timed tests. And yet, when reviewer Victoria Simms of Ulster University attempted to trace this claim to its source, she drew a blank.

Which brings us back to those examples. In a new Canadian study, a group of university students were surveyed on their levels of maths anxiety and their school maths experiences. They found that a greater perceived level of support from teachers was associated with lower maths anxiety and they also found that, “…there was a significant decrease in [maths anxiety] when participants reported that their teachers provided plenty of examples and practice items, and this remained after controlling for general and test anxiety.”

This is, of course, a correlation. However, in this area, correlations could be the best kind of evidence we are likely to get because, in order to do experiments, we would need to manipulate the anxiety levels of test subjects and that might be hard to get past an ethics panel.

Given that the finding is supported by common sense and a plausible mechanism – familiarity with example types reduces anxiety – then I think it perhaps provides yet more evidence for the superiority of explicit teaching.

Advertisements

Maths anxiety – a ouroboric process?

In my recent book, I discussed ‘ouroboric’ processes in education. I suggested that some relationships that people think are linear – that motivation leads to learning or that conceptual understanding must come before learning procedures – are actually cyclical.

The examples that I gave were of positive processes. However, a new paper by Cambridge University researchers suggests that the negative relationship between maths anxiety and maths achievement is also cyclical.

I have written about maths anxiety before. The model that I used would be called ‘the deficit theory’ by the Cambridge researchers. This basically posits that maths anxiety is caused by a lack of ability. The teaching implication of this is that we should teach maths in the most effective way possible in order to improve competence and reduce anxiety. We might also consider giving students experience of success with some relatively straightforward work rather than asking them to struggle for extended periods.

The alternative explanation for maths anxiety is ‘the debilitating anxiety theory’. People who worry about their maths performance have to devote some of their working memory to the worrying. They therefore have fewer working memory resources to devote to problems. Jo Boaler is a prominent populariser of the debilitating anxiety theory amongst maths teachers and she advises that we avoid timed tests because they have been shown to induce anxiety. However, she also advocates open-ended problem-solving which is likely to overload working memory and which would not provide the routine competence that the deficit theory implies students need.

There exists powerful evidence for both theories. Longitudinal studies support the idea that poor levels of achievement lead to future maths anxiety. A range of lab-based studies such as those that induce stereotype threat – reminding a group that there is a negative perception of that group’s mathematical ability – show that maths anxiety leads to poorer performance.

The Cambridge researchers propose that the interaction works both ways. They also point out that while the deficit theory is supported by long term studies, the debilitating anxiety theory is supported by short-term experiments. So the two interactions work at different scales.

An interesting ouroboric process.

Ouroboros Motif


Four tips for reducing maths anxiety

Some might argue that there should be room for a little anxiety in school life. We don’t want to wrap students up in cotton wool because the real world is not like that. Perhaps a little anxiety helps lead to better coping strategies; more resilience. Perhaps.

By GRPH3B18 (Own work) [CC BY-SA 3.0 (http://creativecommons.org/licenses/by-sa/3.0)], via Wikimedia Commons

By GRPH3B18 (Own work) [CC BY-SA 3.0 (http://creativecommons.org/licenses/by-sa/3.0)%5D, via Wikimedia Commons

However, I think it is true that anxiety can disrupt learning and so we probably want to reduce unnecessary anxiety if we want to maximise learning.

In my earlier post on Jo Boaler’s remarks about multiplication tables, I noted that improvements in competence in a subject lead to improvements in self-concept; how students feel about their academic abilities. So, if we wish to reduce student’s anxiety about mathematics it would seem reasonable to try to increase their self-concept by teaching them in such a way that they become better at maths. I have used this principle, along with others from cognitive psychology, logic and experience to suggest the following four tips to reduce maths anxiety. Please feel free to add your own in the comments.

1. Have frequent low-stakes tests

We know that retrieval practice is effective at supporting learning. However, if we test students infrequently then they are likely to see these tests as more of an event and therefore as something to worry about. Instead, we should build frequent, short-duration, low-stakes testing into our classroom routines. Not only will this make testing more familiar, it will increase competence when students tackle any high-stakes testing that is mandated by states or districts and will thus reduce anxiety on these assessments too.

2. Value routine competence in assessment

If you were to spend your time reading maths teaching blogs then you might think that they only kind of maths performance of value is when students can creatively transfer something that they have learnt to solve a novel, non-routine problem. This is not the case. Routine competence is also of great value in mathematics. There is a lot to be said for being able to reliably change the subject of equations.

If we communicate to students that it is only non-routine problem-solving that matters then we are likely to make them feel inadequate. We can send such a message explicitly or we can send it implicitly by setting large numbers of non-routine problems on and making these the focus of assessment.

Non-routine problems are great for avoiding ceiling effects on tests and enabling some of the most talented students to shine. However, assessment should also include a large amount of routine problem solving to show that this is also valued. As a general rule, I would advocate a gradual move from routine to non-routine.

3. Avoid ‘productive failure’ and problem-based learning

Similarly, some educators advocate framing lessons by setting students problems that they do not yet know how to solve in the belief that this will make them keen to develop their own solution methods or receptive to learning from the teacher. Some children might find this motivating but others – and particularly those with a low maths self-concept – are likely to feel threatened. Motivational posters will not help.

It is true that some studies seem to show that this kind of approach leads to improvements in learning. However, these are often poorly designed, with more than one factor being varied at a time (see discussion here). And it is a matter of degree. In the comments on this blog post, Barry Garelick suggested asking students to factorise quadratics with negative coefficients one they have been taught how to factorise ones with positive coefficients. This still requires a little leap but it is far less of a jump than asking students to develop their own measure of spread from scratch such as in the experiments of Manu Kapur.

Given that there is a wealth of evidence in favour of explicit instruction, where concepts and procedures are fully explained to students, it seems that productive failure is risky and could backfire through its interaction with self-concept.

4. Build robust schema

It is true that you can survive without knowing your multiplication tables. You can survive without knowing most of the things that students learn in school. If you just have a particular gap in your knowledge then you can develop workarounds.

The question is; why would you want to? Knowing common multiplications by heart makes mathematics easier to do because it is one less thing to process. Building and valuing such basic knowledge is both a way of generating little successes for students to experience and a way of aiding the process of more complex problem solving. I think that this is one of the reasons why the ‘basic skills’ models in Project Follow Through were so successful at generating gains in more complex problem-solving.

A guiding principle

In reducing maths anxiety, we should focus primarily on teaching approaches that are likely to make students better at maths. Increase maths competence to reduce maths anxiety.


Eliminating anxiety in schools

Embed from Getty Images

There are valid arguments against standardised tests. They have the potential to distort the curriculum by focusing teachers on only those subjects that are tested. And they can be unfair – reading tests and even maths tests often introduce world knowledge as a confound, discriminating against those from less advantaged backgrounds. Despite these worries, I think that standardised tests are a necessary evil. In an educational world full of bad ideas they at least provide parents with reasonably objective data.

Yet little of this plays out in popular discussions of standardised tests. Instead, the argument against them tends to be that they induce anxiety in students. I’m not even convinced that this is true because skilful teachers will prepare kids for such tests and present then in a way that should minimise any anxiety. Nevertheless, let’s take this at face value and let’s assume such tests do cause anxiety. What then?

Firstly, if education is partly preparation for life then it’s worth pointing out that life has its anxious moments. If kids have no anxious situations to overcome at school then how will they overcome them as grown-ups? In the adult world, overcoming anxiety can have positive, life-changing consequences. Think of attending a job interview, asking someone out, giving a speech or buying a car or a house. Imagine having to avoid all of these.

It is also worth noting that tests are not the only source of anxiety in schools. I asked Twitter the following question:

Bear in mind that my followers are often teachers and are perhaps a little more bookish than the general population and so the responses are going to be a little biased.

Anxiety caused by teachers being violent or hostile or racist is certainly something we should eliminate. Violence, intimidation and bullying from other students, sometimes centred around clothing and accessories, are also key sources of anxiety and I would want to eliminate these too. However, I note that teachers and schools that try to turn around such negative cultures open themselves up to public shaming as we saw last week with a school in the U.K. You would have thought that those who are most concerned about kids’ mental health would generally welcome rigorously implemented respectful behaviour policies, whatever issues they have with specific details.

I am more ambivalent about some of the other things my question suggests we would need to eliminate in order to remove all anxiety from schools. It seems that we would need to abandon all sports, from physical education to swimming. We might also want to make schools single sex because the opposite sex causes anxiety. However, girls would then presumably be in contact with more ‘mean’ girls so that wouldn’t help. We would have to get rid of public speaking and somehow remove the need for toilets, or at least surveil or patrol them constantly. Even then, there seems the possibility of anxiety in all human interaction. So perhaps kids should be homeschooled and never leave the house.

Clearly, people look back on their school days with a mix of joy, regret, fondness and shame. Sometimes there is anger. If we were serious about making schools better places to be then it would be faintly absurd to start with the issue of a few infrequent tests. There are more fundamental problems to address, ones that are too often overlooked, and we should be supporting those schools that seek to address them.

Instead, I believe the ‘tests cause anxiety’ trope is calculated to recruit parents to a cause that has deeper ideological motivations. It is far harder for educationalists to make the case that they wish to experiment with curricula and teaching methods that won’t lead to children learning much English and maths and so they want these tests removed in order to hide that fact.


What Australian parents need to know about the maths wars

Embed from Getty Images

Following my piece on the reading wars, I thought it would be worth writing a brief for parents on the maths wars. These are not as high profile as the reading wars but they have had a similar impact, especially in the area of early numeracy.

1. What is ‘constructivism’ and why does it matter?

Constructivism is a theory about how we learn. It quite reasonably claims that children are not blank slates. Instead, they relate new knowledge to things that they already know. These are organised as ‘schema’ in the mind. It is the process of ‘constructing’ these schema that gives ‘constructivism’ its name.

As far as this goes, there is little to disagree with. Effective teachers will always try to tease out what students already know and give examples and analogies that they can relate to. Learning how to do this is part of learning the craft of teaching and it is probably one of the factors that differentiates more effective teachers from less effective ones. However, some educationalists take this further. They equate the active construction of mental schema, something that can occur while listening to a teacher, with the need for children to be physically doing something. They also assume that it is preferable for students to figure out their own strategies for solving problems rather than using strategies given to them by the teacher. Some assume that children may only change their ideas through the process of cognitive conflict and that this involves sustained struggle.

The result of these fashionable beliefs is to favour a style of maths teaching where students are expected to learn key principles through engagement in various activities rather than being taught them directly by the teacher. The teacher acts as a kind of guide or facilitator. Unfortunately, we now have plenty of evidence that this is a less effective approach than explicit teaching, especially for students who struggle with maths.

2. There is nothing wrong with timed testing.

Jo Boaler, Professor of Mathematics Education at Stanford University, has a rock star status among many maths teachers. She can attract large crowds to conferences and has set-up a popular maths teaching site, YouCubed. One of Boaler’s contentions is that timed maths tests are harmful because they trigger maths anxiety, a phenomenon where children start to feel worried about maths lessons and assessments.

This is a plausible idea. We can all imagine that timed tests could be stressful for children. However, I think it is also important to point out that a skilled teacher should be able to use these kinds of teaching methods in a healthy and supportive way. In fact, it is not quite clear which research Boaler is citing when making this claim. In a review of Boaler’s “Mathematical Mindsets” book, Victoria Simms, lecturer in psychology at Ulster University, chased the contention about maths anxiety back through the references to the YouCubed website where the trail went cold.

On the other hand, the potential benefits of timed testing are clear. Essentially, we would like children to simply know plenty of basic maths facts e.g. that 7 x 7 = 49 without having to work them out. This is because they can then devote mental effort, which is relatively limited, to other aspects of solving a problem. By using timed tests of maths facts such as these, we can determine that students have learnt them to the point of automatic recall rather than that they are working them out using some kind of strategy. This is so important that I would encourage parents to supplement school maths with these kinds of timed tests at home, especially if they do not form part of the school programme.

3. There is nothing wrong with learning standard algorithms.

Another aspect of mathematics that has gone out of fashion is teaching children the standard algorithms for addition, subtraction, multiplication and division. The first three of these involve arranging the numbers above each other in columns and working from the smallest place value, such as the units, up to the largest place value which might be tens, hundreds, thousands or more. The process involves what many people refer to as ‘borrowing’ or ‘carrying’ but that experts tend to call ‘regrouping’.

Instead of teaching the standard algorithms, many educators prefer students to invent their own strategies for performing these operations. The extent to which children actually invent them is questionable because they all follow a similar pattern – they are basically variations on ways of doing mental maths. For instance, if you want to add 25 to 47 you might take 3 from the 25 and add it to the 47 first in order to make the 47 up to 50. You can then perform the relatively simply calculation of 50 + 22 = 72.

Such strategies are great and should be in the repertoire of students but not at the expense of the standard algorithms. The standard approaches are far more powerful because of the way that they work from small to large. They also require a strong understanding of place value and develop understandings that are needed for higher level maths. For instance, students of Mathematical Methods, a higher level maths course for Year 11 students in my state of Victoria, are required to do polynomial long division, something that is tricky if they have never learnt ordinary long division.

The case against the standard algorithms seems to be that they can be learnt without understanding, something we will return to below.  A paper by Kamii and Dominick is often cited as providing evidence that invented strategies are superior to standard algorithms. However, in my view it does not use the strongest experimental design. Moreover, when Australian researcher Stephen Norton completed similar research using more complex calculations, he found the reverse effect; an advantage for standard algorithms.

So children should be exposed both to mental arithmetic strategies and the standard algorithms. If they don’t get the latter at school then you should consider ways of providing this at home.

4. Understanding can develop alongside procedural knowledge.

The idea of developing an understanding of mathematics is often set in opposition to students learning procedures for solving problems. Actually, it is teachers in Western countries that tend to do this. East Asian maths teachers also want students to understand but seem more relaxed about whether this comes before or after learning a procedure.

The reality is the common sense idea that procedural fluency and understanding develop in parallel with one feeding into the other. The idea that procedural fluency can somehow be harmful to understanding is probably as absurd as it sounds and I am aware of little evidence to support it.

5. Motivation comes from a developing sense of competence

Maths is often seen as boring or hard work. Many students are turned off by the subject and there is constant commentary in the Western media about the need for more maths graduates or graduates from the numerate science, technology and engineering disciplines.

This leads to a lot of woolly thinking: We need to make maths fun! We need to make it more engaging! We need more games! We need more projects! We need more visits from real mathematicians! We need to make maths more real life! We need to make school maths more like what professional mathematicians do!

All of these approaches may lead to a passing or ‘situational’ interest. However, if we wish to build students’ long-term motivation for a subject then a better strategy might be to teach them well so that they become more competent. It seems likely that students will be turned off a subject they find frustrating and in which they have little success. On the contrary, gradually gaining mastery will make it more appealing. This is why teacher effectiveness research suggests that we ensure students obtain a high success rate and why evidence from long term studies suggests that achievement leads to later motivation.

End the war and start rebuilding

It’s time to walk away from grandiose ideologies and focus on practical strategies, based in the science of learning.

A good start for parents would be to ensure that children know their maths facts, whether they learn these at school or not.


Why the Scientific American article on maths education doesn’t add up

PISA recently released a report about the data that they have collected on maths teaching and learning strategies. I analysed some of this data and related it to the claims that PISA made. The report was quickly followed by an article in Scientific American.

The Scientific American article focused on one area of the PISA report in particular – the rate at which students report using “memorisation” strategies. In the working paper used as a basis for this report, the measure used to quantify memorisation is explained. Students were asked the following questions:

“For each group of three items, please choose the item that best describes your approach to mathematics.

Labels (not shown in the questionnaire): (m) memorisation (e) elaboration (c) control

a) Please tick only one of the following three boxes.

1 When I study for a mathematics test, I try to work out what the most important parts to learn are. (c)

2 When I study for a mathematics test, I try to understand new concepts by relating them to things I already know. (e)

3 When I study for a mathematics test, I learn as much as I can off by heart. (m)

b) Please tick only one of the following three boxes.

1 When I study mathematics, I try to figure out which concepts I still have not understood properly. (c)

2 When I study mathematics, I think of new ways to get the answer. (e)

3 When I study mathematics, I make myself check to see if I remember the work I have already done. (m)

c) Please tick only one of the following three boxes.

1 When I study mathematics, I try to relate the work to things I have learnt in other subjects. (e)

2 When I study mathematics, I start by working out exactly what I need to learn. (c)

3 When I study mathematics, I go over some problems so often that I feel as if I could solve them in my sleep. (m)

d) Please tick only one of the following three boxes.

1 In order to remember the method for solving a mathematics problem, I go through examples again and again. (m)

2 I think about how the mathematics I have learnt can be used in everyday life. (e)

3 When I cannot understand something in mathematics, I always search for more information to clarify the problem. (c)”

I am not convinced that these memorisation options represent actual memorisation strategies. Also, the questions are asked in a way that forces a discrete choice. The accepted practice in psychology is to use a scale of agreement with any given statement (e.g. a Likert scale). Without this, we have a validity and reliability problem. For instance, a student might partly agree with all three responses to question a) but when they are forced to select one response then this will be recorded as 100% agreement with that option and 0% agreement with the alternatives. This is the same reason why the Myers-Briggs personality test is invalid and unreliable.

It is therefore hardly surprising that I could find no correlation between the “index of memorisation” that PISA derive from these responses and a country’s PISA mean maths score. These questions probably do not reliably measure the use of memorisation.

Yet the Scientific American article makes a number of claims about memorisation on the basis of this data. Unfortunately, the authors provide no references and they seem to be in possession of data that is not presented in the PISA report (if either author reads this post then I would be grateful for this data). Nevertheless, I think some of these claims are highly unlikely and I wonder whether the authors may have made an error.

I will list these claims below and then comment on them.

1. In every country, the memorizers turned out to be the lowest achievers, and countries with high numbers of them—the U.S. was in the top third—also had the highest proportion of teens doing poorly on the PISA math assessment.

I cannot tell how a “memoriser” is defined from the PISA report. For instance, is it a person who answers with a class (m) response to all of the questions above, three of them, two of them? Similarly, data on the number of such memorisers in each country is not provided.

I would not be surprised to find out that, in any given country, these memorisers are the lowest achievers but I am not sure what this would tell us. As Robert Craigen points out in a comment on a previous post, memorisers might have resorted to some of these strategies due to poor teaching. They may also have less understanding of, or interest in, the survey questions.

However, I find it highly unlikely that countries with high numbers of memorisers correlate with teens doing poorly on the PISA math assessment. Presumably, countries with higher numbers of memorisers will have a higher overall index of memorisation. If not, this would require the remaining non-memorisers to use far fewer memorisation strategies than the overall mean. If you plot percentage of maths low achievers against index of memorisation then there is no correlation.

pisa-low-maths-against-memorisation-index

2. Further analysis showed that memorizers were approximately half a year behind students who used relational and self-monitoring strategies.

3. In no country were memorizers in the highest-achieving group, and in some high-achieving economies, the differences between memorizers and other students were substantial.

Again, I would like to see the data here but I can believe it.

4. In France and Japan, for example, pupils who combined self-monitoring and relational strategies outscored students using memorization by more than a year’s worth of schooling.

Why select just two countries like this? Again, I don’t have the underlying data but, if I did, it wouldn’t tell us much. It is fraught enough to try to make comparisons across many education systems of different sizes and with different cultures. At least if we include all of them then we might pick up some general trends. I’m sure it would be possible to prove almost anything with just two examples.

5. The U.S. actually had more memorizers than South Korea, long thought to be the paradigm of rote learning.

Again, we would need to know the definition of a “memoriser”.

6. Unfortunately, most elementary classrooms ask students to memorize times tables and other number facts, often under time pressure, which research shows can seed math anxiety. It can actually hinder the development of number sense.

I would love to see this research. Victoria Simms recently reviewed a book by one of the authors of the Scientific American article and found a similar claim:

“Boaler suggests that reducing timed assessment in education would increase children’s growth mindsets and in turn improve mathematical learning; she thus emphasises that education should not be focused on the fast processing of information but on conceptual understanding. In addition, she discusses a purported causal connection between drill practice and long-term mathematical anxiety, a claim for which she provides no evidence, beyond a reference to “Boaler (2014c)” (p. 38). After due investigation it appears that this reference is an online article which repeats the same claim, this time referencing “Boaler (2014)”, an article which does not appear in the reference list, or on Boaler’s website. Referencing works that are not easily accessible, or perhaps unpublished, makes investigating claims and assessing the quality of evidence very difficult.”

7. In 2005 psychologist Margarete Delazer of Medical University of Innsbruck in Austria and her colleagues took functional MRI scans of students learning math facts in two ways: some were encouraged to memorize and others to work those facts out, considering various strategies. The scans revealed that these two approaches involved completely different brain pathways. The study also found that the subjects who did not memorize learned their math facts more securely and were more adept at applying them. Memorizing some mathematics is useful, but the researchers’ conclusions were clear: an automatic command of times tables or other facts should be reached through “understanding of the underlying numerical relations.”

This claim does at least provide a clue as to where to find the evidence although it is a little odd. The neuroscience part of the claim is essentially irrelevant to teachers – why care what ‘brain pathways’ are used? Teachers generally have no opinion on this. We need to focus instead on the quality of learning.

I think I have found the paper. Unusually, it does complete both a neuroscience imaging study and a behavioural study on the quality of learning, as suggested in the Scientific American claim. The participants were 16 university students or graduates. They did a series of trials where they were given two numbers, A and B. In the ‘strategy’ condition, students were given a formula to apply such as ((B-A)+1)+B)=C in order to work out the answer, C. In drill instruction, they were given A, B and the response, C to simply memorise. Surprisingly, the memorisers did pretty well on a later test but, wholly unsurprisingly, they could not extend this to transfer tasks involving new values for A and B. This is entirely consistent with the findings of cognitive load theory were problem solving so occupies our attention that we cannot infer the underlying rule. The strategy example is much more like following a worked example.

However, none of this bears much relationship to memorisation strategies in the PISA report. Is anyone attempting to teach students all of the possible questions that they might be asked and all of the possible numerical answers to these questions? In fact, the use of formulas like in the above “strategy” condition is often criticised as the “rote” learning of formulas and I imagine that this is what maths memorisers – if well-defined – would be trying to memorise.

This research does not seem to apply to the learning of basic maths facts such as multiplication tables. Teachers attempt to teach these to the point of memorisation but the underlying rule is not withheld. Tables are built up from counting patterns, arguments about groups of the same size and so on. Patterns are highlighted like the ones in the 11 and 9 times tables and a few more facts are committed to memory through practice such as 7 x 8 = 56. But these are very simple operations and nothing like the contrivance ((B-A)+1)+B)=C. In fact, the benefit of knowing simple multiplication results ‘by heart’ is that you can then attend to the other elements of a complex operation.

8. Timed tests impair working memory in students of all backgrounds and achievement levels, and they contribute to math anxiety, especially among girls.

This is partially a repeat of claim 6 but also adds the claim that timed tests impair working memory. Again, it would be good to see the evidence to support this.


Reform mathematics gets a makeover

In 1989, the National Council of Teachers of Mathematics in the U.S. published the first version of its Principles and Standards for School Mathematics. It was a pivotal moment for mathematics education both in America and across the world. Despite the relatively poor performance of the U.S. in comparison to other countries and states in international tests such as PISA or TIMSS, people look to America for sexy new ideas.

The standards came to represent a movement known as ‘reform’ mathematics. The antecedents of this movement can be traced to the constructivism of Piaget and Vygotsky from earlier in the 20th century and further back to progressive education in general. John Dewey, for instance, promoted the idea of learning through experience and Paolo Freire opposed the ‘banking model’ of education where teachers transmit facts and procedures to their students. Reform mathematics is generally supportive of experiential learning and skeptical of transmission.

A chapter, written in 1996 by Catherine Twomey Fosnot, a professor of education and director of mathematics in New York, and Randall Stewart Perry, a polymath, describes the features of constructivist teaching. It could equally be a description of reform mathematics:

“Learning… requires invention and self-organization on the part of the learner. Thus teachers need to allow learners to raise their own questions, generate their own hypotheses and models as possibilities, test them out for viability, and defend and discuss them in communities of discourse and practice.

Disequilibrium facilitates learning. “Errors” need to be perceived as a result of learners’ conceptions, and therefore not minimized or avoided. Challenging, open-ended investigations in realistic, meaningful contexts need to be offered which allow learners to explore and generate many possibilities, both affirming and contradictory. Contradictions, in particular, need to be illuminated, explored, and discussed…

Dialogue within a community engenders further thinking. The classroom needs to be seen as a “community of discourse engaged in activity, reflection, and conversation” (Fosnot, 1989). The learners (rather than the teacher) are responsible for defending, proving, justifying, and communicating their ideas to the classroom community. Ideas are accepted as truth only in so far as they make sense to the community and thus they rise to the level of “taken-as shared.””

Despite its long history, there is little evidence to support reform (or constructivist) maths teaching. When trials are conducted, it is often quite different models that perform the best. For instance, in Project Follow Through, Engelmann and Becker’s Direct Instruction program, which breaks mathematics down into its component parts and then directly teaches and trains students in those parts before bringing them back together, outperformed other teaching methods in both students’ learning of procedural skills and in more complex problem solving. Those models most similar to reform mathematics – the ‘cognitive’ models – often under-performed control conditions.

Project Follow Through is not definitive but we don’t have to stop there. There is a wealth of evidence that demonstrates similar outcomes, some suggestive and correlational and some from well-controlled experiments.

This is what we might expect to find if we study the relevant cognitive science. Our working memories are very limited and approaches that break learning down into manageable, memorable chunks are more easily processed by learners than those that expect students to grapple with complex problems from the outset.

This raises the question: where do advocates of reform mathematics go from here? Should they… er… reform it? Perhaps. Alternatively, the time might be right for a relaunch.

This appears to be what Jo Boaler has embarked upon with her new book, “Mathematical Mindsets,” and her accompanying internet campaign. Here, reform mathematics is linked to the educational idea of the moment: Carol Dweck’s mindset theory. Mindset has good data to support it but the way that it is often operationalised in schools is deeply worrying and the link to reform maths is tenuous.

Neatly sidestepping issues of effectiveness, this link relies on the idea of maths anxiety, a well known effect where maths makes some people anxious. Boaler argues that this is a result of traditional maths teaching that emphasises performance under timed conditions.

Reform maths supposedly offers an alternative that is friendlier to students: “Let’s role some dice, form hypotheses and discuss our thinking – here’s a beanbag to sit on – watch that you don’t trip over my kaftan – we’re all learning this together.”

It is not at all clear that this works. Certainly, in the short term, diversion away from activities that students find stressful will reduce anxiety but would you suggest curing someone of a fear of mice by ensuring that they avoid mice? It is also likely that the kind of problem solving that we might find in reform maths classes might offer its own pressures.

mouse

How would you cure mouse anxiety?

Longer term interactions actually seem to show a different effect. It is a lack of mathematical achievement that leads to later maths anxiety. The logic of this should lead to us attempting to reduce maths anxiety by choosing methods that are the most effective for teaching mathematics to the greatest number of students. Those timed tests have a role in establishing the easy retrieval of math facts, leading to better problem solving. In fact, if we return to Project Follow Through, it was the Direct Instruction students who showed the greatest growth in self-esteem. So we’re back to square one.

In a new article in The Conversation, reform mathematics is referred to as a “mindset-approach”. I suppose that this was inevitable and either represents a reinvention or an attempt at a reinvention of the idea. It’s curious that flawed educational ideas have developed this habit of latching on to fashionable ones. It’s an attempt to invoke the halo effect but advocates of Mindset theories more generally should watch that they don’t start to grow horns.


5 Things to consider in Primary School Maths

Following my recent posts on questions to ask your child’s primary school teacher (here and here), I had a request to expand on my comments about the teaching of mathematics. There are a few issues surrounding maths that I believe parents should know about but before I go into that, I wish to make two points. Firstly, a fundamentally misconceived maths program taught by dedicated, evaluative teachers will always be better than one that meets the highest standards of evidence but that is taught badly. In my school we have specialist mathematics teachers and I think this is far more important than the specific details of the program. Secondly, the intention of this post is to inform parents and not to have a go at primary school teachers. Some teachers were offended at my comment that time-tables songs were not the best way to memorise tables. They thought I was suggesting that this is what many primary school teachers do. No – I was just setting up two contrasting alternatives in order to explain my point.

1. Discovery learning

Discovery learning is ineffective and most people tend to recognise this. So you don’t see many schools advertising their programs as discovery learning (apart from in AITSL’s illustrations of their teaching standards, bizarrely). Yet if it looks like a duck and quacks like a duck then it probably is a duck. And there are two powerful fallacies that drive people towards discovery learning. The first is the idea that we understand something better if we discover it for ourselves. We don’t. Secondly, we tend to assume that by asking students to emulate the behaviour of experts then our students will themselves become experts. Experts in maths are research mathematicians who make new discoveries so we should get our students doing that. Yet this is also fallacious thinking.

In primary maths, discovery learning takes on the form of ‘multiple’, ‘alternative’ or ‘invented’ strategies. Students are intended to make-up their own ways of solving problems and to solve a single problem in several different ways. Explicitly teaching a standard approach, such as the standard algorithm for addition, is discouraged. Of course, many students don’t discover much and so they pick-up these strategies from others or are led toward them by the teacher.

Standard Algorithm for Addition

Standard Algorithm for Addition

2. Big to little or little to big?

The kinds of alternative strategies that the students ‘discover’ are generally variations of strategies that we might use for mental arithmetic. Imagine I wanted to add 25 and 49. I would probably first add the 20 and the 40 to make 60. Then I can add the 5 and the 9 to get 14. Sometimes, little sub-moves will be encouraged as part of this e.g. take 1 from the 5 and add it to the 9 to get another 10 so that we have 70, then add the remaining 8.

Notice how this proceeds from big to little. We add the tens first and then the units. But when we add the units we find that we have yet another ten so we have to loop back and add this to the tens that we already had. This is inefficient when we get to larger numbers and is the reason why the standard algorithms generally start with the units first, then tens and so on. Indeed, students who use the standard approach seem to have more success, particular with larger and more complex calculations.

The objection to standard algorithms seems to be that kids can learn them as a process without understanding how they work. Presumably, they have to understand procedures they’ve invented themselves? This may be true if they really have invented them but I suspect such genuine invention is rare, with most children latching on to the ideas of others. In this case, these alternative procedures could also be replicated as a process without understanding.

In my view, students should be taught the standard approach and this approach should be explained to them. This requires the teachers to also understand how these processes work.

3. Words and pictures or actual maths?

Given that alternative strategies are meant to be ad hoc and contingent, there is no formal way for expressing them. You may see it done with pictures or even in words. Contrast this with the standard algorithms – their universality means that they follow a tightly defined set of notation. One way that alternative strategies may therefore be promoted is by insisting that students ‘explain their reasoning’ or draw diagrams when answering questions on homework or assessments. This is basically a way of marginalising the standard algorithms.

For instance, imagine the following question:

“A lottery syndicate of 13 people wins a total of $3 250 000. If the money is shared equally then how much would each member receive?”

A simple use of the long division algorithm is sufficient to explain what the student is doing, why they are doing it and to determine the right answer. If the student has gone wrong then the error will be easy to find. An insistence on words or pictures would be redundant unless you wish to privilege alternative strategies.

4. Maths anxiety and motivation

Maths anxiety is real. Some people struggle with maths – perhaps because they were not taught very well – and develop a fear of maths tests and maths more generally. It is complex and the chain of cause and effect is not entirely clear. Evidence does seem to point to timed tests as being associated with anxiety but perhaps better test preparation and framing would mitigate this. However, as well as advising us against timed tests, a whole raft of things that look and smell a lot like alternative strategies and related ideas such as the use of ‘authentic’ problems are proposed as possible solutions.

Authentic, real-world problem are considered good because the idea is that they will motivate children and so the children will learn more. In fact, a lot of discussion centres around motivating and engaging students. I am sceptical that many of the activities that are suggested as motivational are actually motivating for students and evidence suggests that motivation works the other way around. Maths achievement predicts motivation but motivation does not predict achievement. In other words, teach them maths, increase their competence and then they will start to feel more motivated about maths.

5. Cognitive load

Finally, it is worth mentioning that a lot of fashionable strategies are at odds with what we know about human cognition. Children should know their maths facts because that means that they don’t have to work out 5 x 8 whilst attending to other aspects of a complex problem. Those people who dismiss times-tables as ‘rote’ learning fail to take account of this. And so do those who propose big, messy, open-ended, real-world problems. Such problems have many facets and often contain information that is irrelevant to finding a solution. All of this needlessly increases cognitive load and makes learning less efficient.


Taking the data seriously

Embed from Getty Images

I have had some interesting discussions since my last post on the topic of classroom disruption and I have completed a little more research.

Let’s start with the research. This comes from international surveys of teachers and students and I find it interesting for two reasons. Firstly, it should represent a random sample of students of a particular age in each country (although we should perhaps bear in mind allegations that some countries manipulate the sampling). Secondly, such surveys provide a comparison so that we can make inferences about what we should expect; what is typical. It is important to note that this kind of research is descriptive and does not seek to identify cause-and-effect because it would not be an appropriate method for doing this.

The first set of data comes from the Programme for International Student Assessment (PISA) run by the OECD and it is the data that I shared in my last post. Based upon a survey of 15-year-old students, PISA have generated a worrying table using an ‘index of disciplinary climate in science classes’. The table is constructed from responses to survey questions where students have to indicate how much they agree with statements such as ‘there is noise and disorder’ in their science classes. Australia sits near the bottom:

CLICK TO ENLARGE Index of disciplinary climate with Australia highlighted

It also doesn’t seem that this ranking is based purely on low-level disruption because, in Australia, there is a clear link between the index and incidents of bullying:

CLICK TO ENLARGE Exposure to bullying and school’s disciplinary climate with Australia highlighted

Bullying is also highlighted as an issue in the 2015 Trends in International Mathematics and Science Study (TIMSS). This time, students were surveyed in Grade 4 and Grade 8. You can find the relevant charts here and here but I’m not sure about copyright so I won’t reproduce them. Instead, I have made my own graph that seems to show a greater incidence of persistent bullying in Australia than is the general trend across the TIMSS countries:

CLICK TO ENLARGE Incidence of reported bullying based on TIMSS 2015 data

It is possible that this reflects different interpretations of what constitutes bullying in different cultures. Support for this view comes from the fact that New Zealand has figures that are close to, and slightly worse than, Australia. However, culturally similar England has figures that approach the TIMSS average and so I am inclined to think that a real effect is being captured and that New Zealand and Australia have similar bullying problems. The rest of the TIMSS data on behaviour doesn’t stand out much from the TIMSS average (if I’m reading it right).

Finally, we can try to triangulate the PISA and TIMSS data with the OECD’s Teaching and Learning International Survey (TALIS), the last of which took place in 2013. The stand-out finding for Australia was that:

“Almost 10% of Australian teachers work in schools where intimidation or verbal abuse of teachers and staff by students occurs on a weekly basis, and over a quarter work at schools where verbal abuse amongst students occurs frequently. This is considerably higher than the TALIS averages of 3.4% and 16% respectively.”

The Centre for Independent Studies (CIS) referred to the PISA and TIMSS data in its recent submission to the Review to Achieve Excellent in Australian Schools, colloquially know as the ‘Gonski 2.0’ review, and they did so in order to support their call for better classroom management training for teachers. Dr Linda Graham dismissed this call, stating that, “The CIS has provided no credible evidence to support the claim that Australia has high levels of classroom misbehaviour.”

It is hard to understand why this data might not be considered credible evidence. On Twitter, Dr David Zyngier suggested that this was because this evidence is ‘anecdotal’ and based upon self-reports. Zyngier also suggested that teachers have always complained about the behaviour of students, citing a quote that turns out to have been misattributed to Plato.

Nevertheless, the objection to self-report data makes some sense. Relying on students’ and teachers’ responses to surveys is not completely valid because people are prone to bias. However, it is hard to see why Australian students and teachers would be biased to exaggerate misbehaviour in a way that students and teachers in other countries do not.

Ideally, we would objectively observe classrooms rather than rely on second hand accounts. However, once we try to arrange observations we need to select classrooms to observe. We are highly unlikely to obtain anything close to a random sample of classrooms in Australia because only some schools, teachers and the parents will be prepared to be involved in the research and the reasons for this will interact directly with some of the factors we are trying to measure. So PISA, TIMSS and TALIS data at least have the advantage of better sampling.

I’m not even sure that the objection to self-reporting is a consistent one among those who seek to dismiss this evidence. For instance, just a few days ago, David Zyngier tweeted approvingly of a piece of research based upon self-reports:

Similarly, this piece of research about inclusion is based upon a survey of families and school staff in Australia. In fact, self-reports seem to be a mainstay of such studies and this can have powerful effects. In this case, I wonder how a disabled student or his or her parent might respond to a question about whether they have experienced, “Use of restrictive practices to manage behavioural challenges”? Such a question would seem to invite quite subjective responses given that pretty much any school will impose some kind of restrictions upon students’ behaviour, and this may be especially noticeable if a child’s disability is something like Oppositional Defiant Disorder. How should we then interpret the responses to this question? How should we then make sense of a claim of a high incidence of ‘restrictive practices’ that is based, in part, upon responses to this question? I’m not sure, but at least this demonstrates that problems associated with the use of self-reports are not restricted to data from international surveys such as PISA, TIMSS and TALIS.

If students taking surveys are prone to bias then so are academics. One of these biases is confirmation bias; the tendency to quickly dismiss evidence that you don’t like and readily accept evidence that you approve of. I wonder if this is what is going on here: self-reports are bad one minute but absolutely fine the next. Perhaps the data about behaviour in Australian schools is something that many academics simply don’t want to talk about because it conflicts with their beliefs or because it draws discussion towards an agenda at odds with their own. Through no conscious intent, they may be ignoring something significant.

And I believe that it is significant because every child matters, even the quiet ones who don’t demand attention. No child deserves to have their learning disrupted by noise and disorder in the classroom. No child should have an education that is degraded because their school has a discipline problem. No child should live with the anxiety of unpredictable, dangerous or violent behaviour from their peers: children won’t learn maths very well if they’re scared. And no child should wake in the dead of night, tossing and turning about going to school the next day because of the bullies and what they might do. School should be a joyous place where learning is exhilarating, celebratory and, above all, safe. That’s why we should take this data seriously.


Why put the ‘A’ in STEAM?

Embed from Getty Images

Despite an element of moral panic, there is well-founded concern in Anglophone countries about a decline in the science and mathematics skills of students. International studies such as TIMSS and PISA bear out some of this decline, none more starkly than the PISA mean scores for Scotland and Australia:

This has prompted discussion from politicians and policymakers focused on so-called on STEM subjects – Science, Technology, Engineering and Mathematics. Such discussion betrays the instrumental view of education that many policymakers hold; a view that sees education purely as training for the workplace and meeting the demands of workplace skills shortages. Not only is this myopic, it doesn’t actually fix the problem that has been identified.

Many STEM initiatives are superficial and silly – like the Australian government’s notorious STEM apps. They operate under the assumption that provoking short-term situational interest by, for example, asking a scientist to speak about their work or showing a cool demonstration, will lead to a long-term personal interest in the subject. Such activities probably help, but they don’t really take into account the students’ self-efficacy; their feelings of competence in a subject area. Self-efficacy is associated with motivation in STEM subjects. Most people assume an ‘interest-first’ model where an interest in a particular subject provokes a desire to work hard in that subject which then develops self-efficacy. However, the reverse ‘competence-first’ process is also plausible, where increased feelings of competence lead to a greater level of motivation.

The interaction probably works both ways but there are some hints that competence-first is more important in early maths education. If true, we should focus more on effective teaching of maths and science and less on gimmickry.

In some ways, STEM is an odd basket of subjects. Engineering is barely taught in schools because the fundamentals rely on physics and mathematics. Traditionally, we teach students these fundamentals first before they develop specialisms at university. This is because we view these disciplines hierarchically. However, many initiatives seeks to involve students in solving ‘real world’ engineering problems as a way of promoting STEM. This is again based upon an interest-first view that if students see the relevance of STEM to everyday life then they will be motivated to study it.

There are many risks to adopting such an approach. Chief among these is the risk that students may not develop self-efficacy as a result and may become demotivated. We know, for instance, that problem-based teaching methods are not optimal for students learning new concepts so we either need to deliver explicit instruction prior to problem solving or reduce the complexity of the problem solving and run the risk of students concluding that this is not the real-world experience that they had been sold.

Far from being the solution to our downward trend, the narrative around STEM might actually be contributing to it. I don’t think it is a coincidence that Scotland’s Curriculum for Excellence embodies many trendy notions around real-world problem-solving and yet Scotland is seeing a decline in its STEM results.

To confound the issue further, some folks have decided to put an ‘A’ in ‘STEM’ to create ‘STEAM’. The ‘A’ stands for ‘Art’ or maybe ‘Arts’. Depending on your source, it could refer to the addition of a fairly contained set of notions around visual art and design or it could represent the arts more generally. In the case of the former, you often hear reference to ‘design thinking’ as some kind of desirable skill to develop, although I doubt it is anything like the generic skill that people imagine. In the latter case, there is very little in an academic curriculum that would not be covered by STEAM. Which takes the focus away from considering the selection curriculum content and much more towards teaching methods.

Because STEAM seems to prioritise certain styles of teaching such as Project-Based Learning. Project-based learning has been a central component of the progressive education agenda since at least as far back as William Heard Kilpatrick’s 1918 essay on The Project Method. Even so, there is little evidence for its effectiveness, despite the grandiose claims that are often made. A recent Education Endowment Foundation trial of Project-Based Learning found a potentially negative impact on literacy, although this finding was compromised by a high drop-out rate from the study. So it either doesn’t work or schools find it really hard to do. Either way, project-based learning is not promising.

STEAM’s old-fashioned progressivist agenda is only enhanced by its focus on collaboration, critical thinking and so on; the misnamed ’21st Century Skills’. Again, skills like critical thinking are not generic and there is little evidence that they can be developed through STEAM approaches. The claims made are ideological rather than based upon evidence.

So I think that STEAM is a cipher. It appeals to an anxiety about STEM education but then subverts it to call for old-fashioned progressive education. I suggest taking the ‘A’ back out of it, and maybe the ‘E’ and the ‘T’ too. That way, we may focus on the effective teaching of science and mathematics instead. This is the best way to arrest any decline.