Education Endowment Foundation:Mathematical Reasoning- first trial

Mathematical Reasoning- first trial

Oxford University and NCETM
Implementation costThe cost estimates in the Toolkits are based on the average cost of delivering the intervention.
Evidence strengthThis rating provides an overall estimate of the robustness of the evidence, to help support professional decision-making in schools.
Impact (months)The impact measure shows the number of additional months of progress made, on average, by children and young people who received the intervention, compared to similar children and young people who did not.
+1
months
Project info

Independent Evaluator

NIESR logo
NIESR
A whole class programme to teach the logical principles that form the basis of mathematical reasoning
Pupils: 7419 Schools: 160 Grant: £380,000
Key Stage: 1 Duration: 1 year(s) 9 month(s) Type of Trial: Effectiveness level evidence
Completed July 2017

The Mathematical Reasoning programme aims to improve mathematical attainment by developing pupils’ understanding of the logical principles underlying mathematics. The Literacy and Morphemes programme aims to improve pupils’ spelling and reading comprehension. Both programmes are delivered to year 2 pupils during normal lesson time

Previous studies suggested both programmes offered affordable approaches to improving pupil outcomes. Based on this, the EEF funded a trial (Improving Literacy and Numeracy in KS1) to test the impact of the two programmes under developer-led conditions. Pupils receiving Mathematical Reasoning made an additional three months’ progress in maths compared to other pupils in comparison schools. There was no evidence that Literacy and Morphemes improved spelling or reading outcomes.

The EEF then funded a follow-up evaluation which examined the impact of a scalable version of Mathematical Reasoning in a larger number of schools and with less involvement from the original developer (co-funded by the Worshipful Company of Actuaries). The National Centre for Excellence in the Teaching of Mathematics (NCETM) helped to develop the training model, and coordinated its delivery through its national network of Maths Hubs’ (partnerships of schools focused on maths education). In this second, larger trial, pupils who received Mathematical Reasoning made the equivalent of one additional month’s progress in maths, on average, compared to other children.

There are some differences between the two projects which may explain the smaller impact in the second trial. First, it used a different delivery model. Rather than doing the teaching training directly, the programme developers (the University of Oxford) trained Maths Hub teachers who then delivered the teacher training to participating schools. This may have affected how faithfully the programme was delivered in the classroom. Also, although a precise comparison is difficult, there was evidence that the comparison schools in the second trial were more likely than in the first trial to provide alternative support for children’s reasoning in maths. This may have reduced the difference seen between Mathematical Reasoning pupils and other pupils.

Together, these trials provide evidence for the effectiveness of Mathematical Reasoning. The project will remain on the EEF’s Promising Projects list and we will explore the potential for bringing it to more schools.

  1. Pupils who received Mathematical Reasoning made the equivalent of one additional month’s progress in maths, on average, compared to children who did not. This result has high security.
  2. Among pupils eligible for free school meals, those who received Mathematical Reasoning made an average of one additional month’s progress compared to those who did not. This result may have lower security than the overall finding because of the smaller number of pupils.
  3. There was some evidence that the programme also had a positive impact on mathematical reasoning.
  4. The intervention was generally well received by schools. Teachers reported positive experiences with the training and materials, and were positive about the programme’s focus on fundamental mathematical principles.
  5. The process evaluation found that there was some variation in how schools implemented aspects of the programme, particularly in relation to the use of the online games.
Outcome/​Group
ImpactThe size of the difference between pupils in this trial and other pupils
SecurityHow confident are we in this result?
Maths
+1
Months' progress
Maths (FSM)
+1
Months' progress
N/A