Education Endowment Foundation:Maths Champions – second trial

Maths Champions – second trial

National Day Nurseries Association
Implementation costThe cost estimates in the Toolkits are based on the average cost of delivering the intervention.
Evidence strengthThis rating provides an overall estimate of the robustness of the evidence, to help support professional decision-making in schools.
Impact (months)The impact measure shows the number of additional months of progress made, on average, by children and young people who received the intervention, compared to similar children and young people who did not.
+3
months
Project info

Independent Evaluator

Durham University logo
Durham University
The York Trials Unit logo
The York Trials Unit
Training senior staff in in early years settings to improve the maths skills and confidence of children
Pupils: 1400 Schools: 140 Grant: £475,284
Key Stage: EY Duration: 1 year(s) 9 month(s) Type of Trial: Effectiveness level evidence
Completed July 2021

The National Day Nurseries Association’s Maths Champions programme builds the knowledge of nursery practitioners to support children’s early mathematical development. It is an online, one-year programme delivered to both Private, Voluntary or Independent (PVI) and school-based nursery (SN) settings. 

In each setting, a Maths Champion’ is selected: a senior member of staff, who is supported to drive improvement in maths practice across the setting. The Maths Champion is supported to audit current practice and create and implement an action plan for supporting colleagues to improve maths practice throughout the year. The support includes online CPD, including e‑modules on early mathematical development, resources, and one-to-one advice. 

This project was co-funded by the EEF and the Department for Education as part of a funding round seeking Early Years professional development programmes.

Research suggests that high-quality early numeracy education in the early years can have long-lasting effects which may help close the gap in achievement throughout life. This project was co-funded by the EEF and the Department for Education as part of our Early Years professional development funding round, in which maths CPD was identified as a priority, as an area in which less evidence has been generated to date.

Maths Champions has been tested through a previous EEF trial. This found a positive impact on maths attainment, with children in settings who received Maths Champions making the equivalent of +2 months’ additional progress in maths, on average, compared to children in the comparison group. The security of the evaluation was weakened by the fact some pupils were not included in the final analysis because they were not tested when the intervention ended. This trial re-tests Maths Champions in a larger number of settings, including school-based nurseries, and put in place measures to increase the security of the evaluation.

This RCT effectiveness trial evaluation found that children in settings receiving the Maths Champions programme made an average of 3 additional months’ progress in maths compared to children in settings that did not receive the programme. These results have a very high security rating (5 padlocks, the maximum on the EEF scale).

There were also promising indicative results for pupils receiving EYPP: these pupils made on average an addition 6 month’s progress, compared to children in control settings. This finding should be taken with caution as it was based on a smaller sample, however is a very positive indication that the programme could be more effective for disadvantaged children. The evaluation found evidence that the programme improved practitioners’ confidence in teaching children maths and delivering maths activities to children, thought to be a key mechanism of impact. Furthermore, the evaluation also found a positive impact on language outcomes for children attending settings who received the programme (the equivalent of +2 months’ additional progress for children receiving the programme).

Subsequent analysis was conducted using Early Years Foundation Stage Profile (EYFSP) assessment data from the National Pupil Database (NPD), to assess the potential long-term impact of Maths Champions on children’s attainment. This exploratory analysis suggested positive impacts were maintained to the end of Reception year, with children who received Maths Champions obtaining higher EYFSP results than pupils who didn’t receive the programme, equivalent to two months additional progress for maths and language subscales of EYFSP. There is also indication that the larger impact for children eligible for EYPP maintained to end of Reception.

Overall, the results of this trial provide strong evidence for the effectiveness of the Maths

1. Children in nurseries allocated to the intervention group made, on average, the equivalent of three months’ additional progress in maths attainment compared to children in control nurseries. This result has a very high security rating.

2. Children in nurseries allocated to the intervention group made, on average, the equivalent of three months’ additional progress in language attainment compared to children in control nurseries.

3. Children eligible for Early Years Pupil Premium (EYPP) in the intervention nurseries made, on average, the equivalent of six months’ additional progress in maths attainment compared to children eligible for EYPP in control nurseries. These results, while promising, should be treated with more caution than the analysis on all pupils as fewer children were included in this analysis.

4. The results from the implementation and process evaluation support the majority of the components of the logic model, specifically the training and support, the MC and DMC roles, and the action plans, suggesting these should be maintained in the future.

5. The implementation and process evaluation found that the commitment of the MC and DMC is crucial to successful implementation and that the roles can be interpreted flexibly depending on the needs of the nursery and the choice of nominated MC and DMC.

6. Subsequent analysis was conducted using Early Years Foundation Stage Profile (EYFSP) assessment data from the National Pupil Database (NPD), to assess the potential long-term impact of Maths Champions on children’s attainment. This exploratory analysis found that children in nurseries allocated to the intervention group made, on average, the equivalent of two months’ additional progress in mathematics and language attainment compared to children in control nurseries, as well as being slightly more likely to attain a Good Level of Development (GLD) compared to children in control nurseries (equating to approximately one months’ additional progress). Children eligible for EYPP in the intervention nurseries made, on average, the equivalent of six months’ additional progress in mathematics attainment compared to children eligible for EYPP in control nurseries (however these results, while promising, should be treated with more caution than the analysis on all pupils as fewer children were included in this analysis).

Outcome/​Group
ImpactThe size of the difference between pupils in this trial and other pupils
SecurityHow confident are we in this result?
Mathematics (ASPECTS)
+3
Months' progress
(Effect size 0.25)
Mathematics (ASPECTS) (EYPP subgroup)
+6
Months' progress
(Effect size 0.47)