Progress in Reading Assessment – New PiRA Primary

About the measure

Version

New PiRA/​PiRA

Previous version(s)

New PiRA primary (paper or digital), PiRA (paper or digital) Key Stage 1, Key Stage 2, Key Stage 3, PiRA Scotland.

Subject

Literacy

Assessment screening

Subscales

N/​a

Publisher

RS Assessment from Hodder Education

Test source

https://www.risingstars-uk.com/series/assessment/rising-stars-pira-tests

Guidelines available?

Yes

Norm-referenced scores

Yes

Age range

5 – 11 years

Key Stage

Key Stage 1, Key Stage 2

UK standardisation sample

Yes

Publication date

2020

Re-norming date

N/​a

Eligibility

Validity measures available?

Yes

Reliability measures available?

Yes

note whether shortlisted, and reasons why not if relevant

Shortlisted

Administration format

Additional information about what the test measures

Reading attainment

Are additional versions available?

Termly tests (Reception spring & summer; Years 1 – 6 autumn, spring, summer). Note that standardisation of the summer tests has been postponed due to the pandemic and will be collected 2021. Paper and pencil format or online. New PiRA (3rd Edition) has about 20% of questions updated/​replaced. Includes more open inferential questions, and extension questions. Superceeds 2nd and 1st Edition PiRA.

Can subtests be administered in isolation?

No

Administration Group Size

Small group, Whole class

Administration duration

30 – 55 minutes, depending on year. Tests for Reception and Year 1 can be administered in multiple sessions.

Description of materials needed to administer test

Manual. Paper version: each pupil will require a test booklet, pencil/​pen, eraser, ruler. Digital version: each pupil will require an interactive test credit and a computer/​tablet.

Any special testing conditions?

No

Response format

Response mode

Electronic, Paper and Pencil

What device is required?

Computer, tablet

Question format

Mixed

Progress through questions

Flat

Assessor requirements

Is any prior knowledge/training/profession accreditation required for administration?

Not stated (no)

Is administration scripted?

N/​a

Assessor requirements

Description of materials needed to score test

Paper version: manual (mark scheme). Standardisation tables are in the manual or use MARK (My Assessment and Reporting Kit) online analysis and reporting tool. Digital version: automatically marked.

Types and range of available scores

Raw score; standardised (year cohort or age <70 – >130); reading age (range depends on the test, full range is <4;07 – 12;02 — NB will be extended when summer standardisation complete); Hodder score; strand level performance.

Score transformation for standard score

Age standardised/​year cohort standardised

Age bands used for norming

1 month

Scoring procedures

Computer scoring with direct entry by test taker/​computer scoring with manual entry of responses from paper form/​simple manual scoring key — clerical skills required.

Automatised norming

Computerised/​online

Construct Validity

Rating Construct

Does it reflect the multidimensionality of the subject?

Generic literacy

Construct validity comments (and reference for source)

The Interim Test Guidance suggests that the measure has high face validity — it is aligned to 2014 national curriculum. Curriculum maps are provided. Systematically sampled Key Stage 1 and Key Stage 2 performance descriptors for English, using the 2016 Reading Test Framework and informed by the Key Stage 1 and Key Stage 2 national tests. Care has been taken to ensure that the overall balance of questions in New PiRA reflects the balance and style of questions now found in the Key Stage 1 and Key Stage 2 SATs, with the exception that we have ensured a more consistent and comprehensive curriculum coverage than is commonly seen in a SATs paper. Key Stage 1 focuses on measures of literal comprehension, while Key Stage 2 increasingly measures inferential comprehension. However, this is not tested statically (correlations with age are low but this is to be expected due to termly tests and standardisation).

Criterion Validity

Rating Criterion

Summarise available comparisons

Criterion validity (correlations with SATS scores) will be reported in autumn 2021 (the standardisation trial was impacted by the COVID-19 pandemic).

Reliability

Rating Reliability

Summarise available comparisons

Reliability varies across different versions of the test. Internal consistency for each test, adequate-excellent; Cronbach’s alpha .75 – .92; SEM 2.79 – 3.49; 90% confidence band 3.37 – 5.76; 95% confidence band 4.08 – 6.98. Temporal stability and equivalence reliability have not been assessed.

Is the norm-derived population appropriate and free from bias?

Does the standardisation sample represent the target/general population well?

If any biases are noted in sampling, these will be indicated here.

Large and representative sample of schools took part in standardisation trials. Note that standardisation of summer assessments has not been completed due to the pandemic, and will be published autumn 2021.

Sources

Sources

Ruttle, K., Lallaway, M., Bennett, M., Pepper, L., Kilburn, V., Swift, J., … McCarty, C. (2020). New PiRA primary: Progress in Reading Assessment. Key Stage One & Key Stage Two Interim Test Guidance. Abingdon, UK: RS Assessment from Hodder Education.