Education Endowment Foundation:Direct Instruction in Key Stage 3 – Connecting Maths Concepts

Direct Instruction in Key Stage 3 – Connecting Maths Concepts

National Institute for Direct Instruction
Project info

Independent Evaluator

NFER logo
NFER
This project will pilot a Direct Instruction maths programme, Connecting Maths Concepts, with Key Stage 3 students.
Pupils: 189 Schools: 8 Grant: £116,301
Key Stage: 3 Duration: 6 month(s) Type of Trial: Pilot Study
Completed March 2020

The Direct Instruction in Key Stage 3 Connecting Maths Concepts programme utilises a comprehensive mathematics programme CMC’, developed in the United States as a core-instruction programme for primary-aged pupils. The CMC programme comprises of scripted lessons and assessments designed to provide explicit and systematic instruction on fundamental concepts in mathematics. It is based on the Direct Instruction (DI) model of teaching which emphasises a sequenced curriculum, systematic teaching, and mastery.

The CMC programme aims to enable pupils to master key concepts through opportunities to practise and review their understanding. The highly manualised programme can be delivered by specialist/non-specialist mathematics teachers and learning support practitioners, who are trained as DI instructors’. The programme materials are available in several levels of difficulty and a placement test is used to try and ensure that pupils receive the right level.

This pilot of the CMC programme aimed to explore its promise and feasibility when implemented in English schools to support Year 7, 8 and 9 pupils (ages 11 – 14) with low prior attainment in mathematics. The CMC programme was delivered three to five times a week over 15 weeks in place of usual mathematics lessons. Lessons were designed to be 70 minutes long, comprising 50 minutes of teacher-led direct instruction and 20 minutes of independent working. Lessons included clear and consistent explanations, choral responding, immediate correction, feedback, independent work, and a motivation system.

There is a great deal of evidence showing that the Direct Instruction approach can increase mathematics attainment for school-age pupils, and particularly those struggling with mathematics concepts. Research specific to the CMC programme includes several small-scale randomised controlled trials and observational studies. These show positive impacts on mathematics attainment for primary-age students in the US; however, there is less evidence on the feasibility and acceptability of the programme in other contexts.

The DI KS3 CMC pilot study aimed to evaluate the promise and feasibility of the CMC programme in the specific context of mathematics teaching targeted at Key Stage 3 (Years 7, 8, and 9) pupils in English secondary schools. It also explored whether the pedagogical approaches essential to the CMC approach were acceptable to teachers and pupils.

The pilot study involved 189 pupils in KS3 across eight secondary schools and found that pupils reported increased confidence in mathematics understanding and ability, particularly in Year 7. However, the perceived effectiveness of the programme elements was mixed.

DI instructors and pupils in the pilot study viewed several of the CMC programme elements as effective. These included the sequenced structure of the programme, clear explanations of mathematics concepts, feedback, mastery, and the motivation system. However, the lack of differentiated content, choral responding, and repetition were regarded as less effective elements, and may have led to low-level behavioural challenges – although this issue was perceived to have abated over the course of the pilot. The lack of alignment to the KS3 curriculum content was also raised as a concern when replacing usual mathematics lessons.

Considered with the logistical challenges schools encountered in meeting the implementation criteria, the DI KS3 CMC programme is not ready for trial. The pilot evaluation suggests that modifying the programme to address the issues encountered by schools is not feasible as this would undermine the integrity of the programme. Suggested alternatives for further exploring the potential of the programme and DI approaches include: adjusting the target pupils to upper primary-age and Year 7; delivering a DI-based programme (such as Corrective Mathematics) as a supplementary intervention in addition to the main KS3 curriculum; or employing a different intervention that combines the effective features of the programme with the mathematics curriculum and pedagogical culture in England.

The EEF has no plans for a further trial of the CMC programme.

Question
Finding
Comment

Is there evidence of acceptability and promise?

N/A

There is preliminary evidence that the CMC programme increased students’ confidence in their mathematics understanding and ability, particularly in Year 7. However, the perceived effectiveness of the programme elements was mixed. Evidence also suggested some signs of potentially adverse impacts on students’ behaviour in mathematics lessons, although behaviour challenges were perceived to have abated over the course of the pilot. The lack of alignment to the mainstream KS3 curriculum content and lack of differentiation to students’ varying needs was also a concern for supporting students’ mathematics learning.

Is the approach feasible and scalable?

N/A

The CMC programme is feasible to deliver, however the specified lesson duration and timetabling, group size, and student selection process presented logistical challenges that suggest a risk to delivery at scale.

Which mathematics attainment outcome measure is most suitable for future trials?

N/A

Hodder Education’s Progress in Understanding Mathematics (PUMA) Year 6 spring and summer papers were tested for use in a future potential trial. These were too challenging for the target group of students and a measure that better matches student attainment will need to be identified for future trials.

Is the approach ready to be evaluated in a trial?

N/A

In its current form, the CMC programme is not ready for trial as a replacement mathematics programme for KS3 students with low prior mathematics attainment. Yet, modifying the programme to address the issues encountered in the pilot is not feasible as this would undermine the integrity of the programme.