Education Endowment Foundation:Texting Students and Study Supporters

Texting Students and Study Supporters

Behavioural Insights Team
Implementation cost
Evidence strength
Impact (months)
0
months
Independent Evaluator
NatCen
NatCen logo
Testing a low-cost way of engaging students at further education colleges
Pupils: 3779 Schools: 31 Grant: £205,608
Key Stage: 1 Duration: 3 year(s) 1 month(s) Type of Trial: Efficacy Trial
Completed May 2020

Texting Students and Study Supporters (Project Success) was developed by the Behavioural Insights Team (BIT) and aimed to use text messages to improve GCSE English and maths re-sit pass rates by prompting college students to attend classes and exams, engage with study materials and form better study habits, either through direct contact with the learner or through prompting a dialogue with a nominated study supporter, e.g. a family member. Over the course of the academic year, weekly text messages were sent to students (a total of 36 for English or 37 for maths) and/​or their study supporters via the BIT Promptable text messaging service.

Using text messages to improve parental engagement and increase outcomes is a well-evidenced approach. The EEF previously funded an evaluation of text messages in secondary school, which found small positive impact on GCSE maths outcomes. This evaluation explored whether the approach could successfully improve the outcomes of students re-sitting GCSE exams in further education settings.

Our trial of Project Success included 3,779 students across 31 further education settings. This independent evaluation found that students who received text messages or had study supporters that received messages did not, on average, have higher pass rates in GCSE re-sits. These results have a high security rating.

There are some important limitations to the evaluation which may explain the different results from the Texting Parents studies that have taken place with younger age groups. Firstly, the measure of impact was whether students passed or failed the GCSE resits. This binary measure means that it is harder to detect the type of small impacts seen in the Texting Parents trial. A second limitation is that students had to opt into the trial – the process evaluation found that these students were already highly motivated. Text messages were less likely to have an impact on students who were already motivated

The EEF has no further plans for a trial of Texting Study supporters

There were significant limitations to the programme’s ability to engage those who may need it the most as it was the highly motivated students that were more engaged with their studies and with college generally who were more likely to sign up to the intervention.

Scope
Project type:Efficacy Trial
Key stage:Key Stage 5
Subject:Cross curriculum
Implementation
Delivered by:Volunteers
Participant group:Individuals
Intervention length:1
Cost
Cost per pupil:£15
No. of Teachers/​TAs:English and maths tutors
Staff training duration:1