About the Toolkit
The Sutton Trust-EEF Teaching and Learning Toolkit is an accessible summary of educational research which provides guidance for teachers and schools on how to use their resources to improve the attainment of disadvantaged pupils.
The Toolkit currently covers 30 topics, each summarised in terms of their average impact on attainment, the strength of the evidence supporting them and their cost.
The Toolkit is a live resource which will be updated on a regular basis as findings from EEF-funded projects and other high-quality research become available. In addition, we would welcome suggestions for topics to be included in future editions. If you have a topic suggestion, or any other comments or questions about the Toolkit, please contact Robbie Coleman at robbie.coleman@eefoundation.org.uk.
Why is research useful?
We know that the relationship between spending and pupil outcomes is not simple. Between 1997 and 2011 per pupil spending increased by 85% but over this period improvements in pupil outcomes were marginal on most measures. At school level, it is clear that different ways of spending school budgets can have very different impacts on pupil attainment, and choosing what to prioritise is not easy. Even once a decision to implement a particular strategy has been taken there are a wide variety of factors which determine its impact. We believe that educational research can help schools get the maximum “educational bang for their buck", both in terms of making an initial choice between strategies, and in implementing a strategy as effectively as possible.
One particular spending decision which research can inform is how to spend the Pupil Premium. Introduced in 2010, the aim of the Pupil Premium is to raise achievement among disadvantaged children. It provides additional funding to schools for disadvantaged pupils to ensure they benefit from the same educational opportunities as pupils from wealthier families. In 2012-13 the Pupil Premium is worth £623 per child, and by 2014-15 this is expected to rise to approximately £1,200 per child. If the Pupil Premium is to succeed in achieving its ambitious goals, the choices that schools make in allocating the money are of vital importance.
A range of approaches were selected for analysis and inclusion in the Toolkit, based on: i) approaches commonly mentioned in connection with education policy, ii) suggestions from schools, and iii) approaches with a strong evidence of effectiveness not covered by either previous criterion.
Average impact
Average impact is estimated in terms of additional months progress you might expect pupils to make as a result of an approach being used in school, taking average pupil progress over a year is as a benchmark.
For example, research summarised in the Toolkit shows that improving the quality feedback provided to pupils has an average impact of eight months. This means that pupils in a class where high quality feedback is provided will make on average eight months more progress over the course of a year compared to another class of pupils which were performing at the same level at the start of the year. At the end of the year the average pupil in a class of 25 pupils in the feedback group would now be equivalent to the 6th best pupil in the control class having made 20 months progress over the year, compared to an average of 12 months in the other class.
These estimations are based on ‘effect sizes’ reported in British and international comparative data (see table below). Effect sizes are quantitative measures of the impact of different approaches on learning. The Toolkit prioritises systematic reviews of research and quantitative syntheses of data such as meta-analyses of experimental studies. To be included in the analysis an approach needed to have some quantifiable evidence base for comparison.
| Months' Progress | Effective Size From... | ...to | Description |
| 0 | -0.01 | 0.01 | Very Low or no effect |
| 1 | 0.02 | 0.09 | Low |
| 2 | 0.10 | 0.18 | Low |
| 3 | 0.19 | 0.26 | Moderate |
| 4 | 0.27 | 0.35 | Moderate |
| 5 | 0.36 | 0.44 | Moderate |
| 6 | 0.45 | 0.52 | High |
| 7 | 0.53 | 0.61 | High |
| 8 | 0.62 | 0.69 | High |
| 9 | 0.70 | 0.78 | Very High |
| 10 | 0.79 | 0.87 | Very High |
| 11 | 0.88 | 0.95 | Very High |
| 12 | 0.96 | >1.0 | Very High |
Cost
Cost estimations are based on the approximate cost of implementing an approach in a class of twenty five pupils. Where the approach does not require an additional resource, estimates are based on the cost of training or professional development which may be required. Approaches marked with £££ or less could be funded from the 2012-13 pupil premium allocation of £623 per eligible pupil.
| Cost | Description |
| £ | Very low: up to about £2,000 per year per class of 25 pupils, or less than £80 per pupil per year. |
| ££ | Low: £2,001-£5,000 per year per class of 25 pupils, or up to about £170 per pupil per year. |
| £££ | Moderate: £5,001 to £18,000 per year per class of 25 pupils, or up to about £700 per pupil per year. This represents the 2012/13 Pupil Premium allocation (£623). |
| ££££ | High: £18,001 to £30,000 per year per class of 25 pupils, or up to £1,200 per pupil. |
| £££££ | Very High: over £30,000 per year per class of 25 pupils, or over £1,200 per pupil. By 2014/5, the Pupil Premium is projected to rise to approximately £1,200 per pupil. |
Evidence
Evidence estimates are based on: the availability of evidence (i.e. the number of systematic reviews or meta-analyses and the quantity of primary studies which they synthesise); the methodological quality of the primary evidence; the magnitude of the impact (in terms of effect size); and the reliability or consistency of this impact across the studies reviewed.
| Rating | Description |
| ★ | Very limited: Quantitative evidence of impact from single studies, but with effect size data reported or calculable. No systematic reviews with quantitative data or meta- analyses located. |
| ★★ | Limited: At least one meta-analysis or systematic review with quantitative evidence of impact on attainment or cognitive or curriculum outcome measures. |
| ★★★ | Moderate: Two or more rigorous meta-analyses of experimental studies of school age students with cognitive or curriculum outcome measures. |
| ★★★★ | Extensive: Three or more meta-analyses from well controlled experiments mainly undertaken in schools using pupil attainment data with some exploration of causes of any identified heterogeneity. |
| ★★★★★ | Very Extensive: Consistent high quality evidence from at least five robust and recent meta-analyses where the majority of the included studies have good ecological validity and where the outcome measures include curriculum measures or standardised tests in school subject areas. |
Notes on the January 2013 Update
Major updates made to the Toolkit in January 2013 include:
- The addition of eight new topics: Aspiration interventions, Behaviour interventions, Collaborative learning, Extended school time, Mentoring, Physical environment, Social and emotional aspects of learning, Small group tuition.
- A full update on all existing topics to incorporate the publication of new research
- The addition of video case studies and improved links to further reading and providers of professional development via the Teacher Development Trust's GoodCPDGuide.
Significant changes to existing topics include:
- An adjustment of the average impact in Feedbackfrom nine months to eight months. This adjustment was made following the publication of a new meta-analysis of Assessment for Learning. It suggests that gains from implementing more effective feedback are challenging to achieve in school contexts.
- Splitting Homework into Homework (Primary) and Homework (Secondary) to reflect the difference in impact according to stage.
- An adjustment of the average impact in Sports participationfrom three months to one month following the publication of two new meta-analyses.
- Adjustments to the average impact estimates for Ability grouping, Block scheduling and School uniform. These estimates are now given as point estimates (i.e. a single number of months progress) rather than ranges, for consistency with other summaries. Where the research shows different impacts for different groups of pupils, as in the case of Ability grouping, the average impact for disadvantaged students has been shown.
- Cost estimates for Digital technology (previously Information and computer technologies) have been reduced to moderate, based on the increasing use of cheaper laptops and tablet PCs in schools.
- Cost estimates for One to one tuition by an experienced teacher have been reduced to high, based on figures supplied by schools.
Other minor changes include:
- Cost calculations based on class sizes of 25 rather than 30 as the average class size in primary schools is about 27 and the average class size in secondary schools is about 21.
- The introduction of weighted effect sizes to improve the accuracy of average effect size calculations.
Who wrote the Toolkit?
The Toolkit was originally commissioned by the Sutton Trust and produced as the ‘Pupil Premium Toolkit’ by Durham University in May 2011. The Sutton Trust-EEF Teaching and Learning Toolkit has been developed from this initial analysis, since the Education Endowment Foundation’s launch in 2011.
The Toolkit is written by Professor Steve Higgins, Maria Katsipataki and Dr Dimitra Kokotsaki (School of Education, Durham University), Professor Rob Coe (CEM Centre, Durham University), Dr Lee Elliot Major (The Sutton Trust) and Robbie Coleman (Education Endowment Foundation). The authors thank Isabella McDonald, Laura Evans and Sarah Whiteway for their help producing the January 2013 update.
Full reference: Higgins, S., Katsipataki, M., Kokotsaki, D., Coleman, R., Major, L.E., & Coe, R. (2013). The Sutton Trust-Education Endowment Foundation Teaching and Learning Toolkit. London: Education Endowment Foundation.