Test identification

Name of test Progress in Reading Assessment - New PiRA primary
Version New PiRA/PiRA
Previous version(s) New PiRA primary (paper or digital), PiRA (paper or digital) Key Stage 1, Key Stage 2, Key Stage 3, PiRA Scotland
Subjects Literacy
Summary Termly standardised assessments of a pupil’s reading attainment, plus a diagnostic profile of reading skills, which help you identify those pupils who may need further teaching and practice, as well as enabling you to celebrate success. New PiRA is designed for whole-class use, with pupils of all abilities.

Assessment screening

Subscales n/a
Authors Ruttle, K., Lallaway, M., Bennett, M., Pepper, L., Kilburn, V., Swift, J., . . . McCarty, C. (2020).
Publisher RS Assessment from Hodder Education
Test source https://www.risingstars-uk.com/series/assessment/rising-stars-pira-tests
Guidelines available? Yes
Norm-referenced scores. Yes
Age range 5-11 Years
Key Stage(s) applicable to KS1, KS2
UK standardisation sample Yes
Publication date 2020
Re-norming date n/a

Eligibility

Validity measures available? Yes
Reliability measures available? Yes
Reason for exclusion from shortlist shortlisted

Evaluation and Appraisal

Additional information about what the test measures Reading attainment
Are additional versions available? Termly tests (Reception Spring & Summer; Years 1-6 Autumn, Spring, Summer).Note that standardisation of the Summer tests has been postponed due to the pandemic and will be collected 2021.Paper and pencil format OR online.New PiRA (3rd Edition) has about 20% of questions updated/replaced. Includes more open inferential questions, and extension questions.Superceeds 2nd and 1st Edition PiRA.
Can subtests be administered in isolation? No
Administration group size small group, whole class
Administration duration 30-55 minutes, depending on year.Tests for Reception and Year 1 can be administered in multiple sessions.
Description of materials needed to administer test ManualPaper version: each pupil will require a test booklet, pencil/pen, eraser, ruler.Digital version: each pupil will require an interactive test credit and a computer/tablet.
Any special testing conditions? no

Response format

Response mode Electronic OR Paper and pencil
What device is required Computer, tablet
Queston format. mixed
Progress through questions Flat

Assessor requirements

Is any prior knowledge/training/profession accreditation required for administration? Not stated (no)
Is administration scripted? Yes

Scoring

Description of materials needed to score test Paper version: Manual (mark scheme).Standardisation tables are in the manual or use MARK (my assessment and reporting kit) online analysis and reporting tool.Digital version: automatically marked.
Types and range of available scores raw score, standardised (year cohort or age <70->130),reading age (range depends on the test, full range is <4;07-12;02 - NB will be extended when Summer standardisation complete)hodder score strand level performance,
Score transformation for standard score Age standardised/Year cohort standardised
Age bands used for norming 1 month
Scoring procedures computer scoring with direct entry by test taker/computer scoring with manual entry of responses from paper form/simple manual scoring key – clerical skills required
Automatised norming computerised/online

Construct Validity

Does it adequately measure literacy, mathematics or science?
Does it reflect the multidimensionality of the subject? Generic literacy
Construct validity comments (and reference for source) The Interim Test Guidance suggests that the measure has high face validity - it is aligned to 2014 national curriculum. Curriculum maps are provided. Systematically sampled Key Stage One and Key Stage Two performance descriptors for English, using the 2016 Reading Test Framework and beinginformed by the Key Stage One and Key Stage Two national tests. Care has been taken to ensure that the overall balance of questions in New PiRA reflects the balance and style of questions now found in the Key Stage One and Key Stage Two SATs, with the exception that we have ensured a more consistent andcomprehensive curriculum coverage than is commonly seen in a SATs paper.Key Stage One focuses on measures of literal comprehension, while Key Stage 2 increasingly measures inferential comprehension.However. this is not tested statically (correlations with age are low but this is to be expected due to termly tests and standardisation)

Criterion Validity

Does test performance adequately correlate with later, current or past performance?
Summarise available comparisons Criterion validity (correlations with SATS scores) will be reported in Autumn 2021 (the standardisation trial was impacted by the COVID-19 pandemic)

Reliability

Is test performance reliable?
Summarise available comparisons Reliability varies across different versions of the test. Internal consistency for each test adequate-excellent; Cronbach's alpha .75-.92, SEM 2.79-3.49; 90% confidence band 3.37-5.76; 95% confidence band 4.08-6.98Temporal stability and equivalence reliability have not been assessed.

Is the norm-derived population appropriate and free from bias?

Is population appropriate and free from bias? Yes
If any biases are noted in sampling, these will be indicated here. Large and representative sample of schools took part in standardisation trials.Note that standardisation of Summer assessments has not been completed due to the pandemic, and will be published Autumn 2021

Sources

Sources Ruttle, K., Lallaway, M., Bennett, M., Pepper, L., Kilburn, V., Swift, J., . . . McCarty, C. (2020). New PiRA primary: Progress in Reading Assessment. Key Stage One & Key Stage Two Interim Test Guidance. Abingdon, UK: RS Assessment from Hodder Education.