Progress Test in Maths

About the measure

Version

PT Maths

Assessment screening

Subscales

Vary dependent on test. Mathematical content knowledge (curriculum content category) and Understanding and applying mathematical processes through reasoning and problem solving’ (process category). PTM8 – PTM14 are in two parts: Mental Maths, and Applying and Understanding Maths.

Publisher

GL Assessment

Test source

https://www.gl-assessment.co.uk/products/progress-test-in-maths-ptm/

Guidelines available?

Yes

Norm-referenced scores

Yes

Age range

5 – 14 years

UK standardisation sample

Yes

Publication date

2015

Re-norming date

N/​a

Eligibility

Validity measures available?

Yes

Reliability measures available?

Yes

note whether shortlisted, and reasons why not if relevant

Shortlisted

Administration format

Additional information about what the test measures

Mathematical skill and knowledge, process skills of fluency, mathematical reasoning and problem-solving. Scores can be differentiated by curriculum content area (number; algebra; ration, proportion and rates of change; geometry and measures; probability; statistics) or by process category (fluency in facts and procedures; fluency in conceptual understanding; problem solving; mathematical reasoning).

Are additional versions available?

Paper and digital versions are available. Consists of 10 yearly tests to cover the age range 5 to 14+ (Progress Test in Maths 5 to 14), plus an additional test for pupils aged between 11 and 12 years, which can be used as a transition test on entry to secondary education (Progress Test in Maths 11T).

Can subtests be administered in isolation?

No, but strand scores can be differentiated.

Administration duration

Small group, whole class

Description of materials needed to administer test

Not timed tests — examinees should be given as long as needed. Levels 5 – 7 should take 45 – 60 minutes. Other levels should take no more than 60 – 75 minutes. Tests can be administered in 2 parts.

Any special testing conditions?

Formal test environment

Response format

What device is required?

Computer

Progress through questions

Flat

Assessor requirements

Is any prior knowledge/training/profession accreditation required for administration?

Not stated (no)

Is administration scripted?

N/​a

Assessor requirements

Description of materials needed to score test

No self-scoring available — computerised or bureau service only.

Types and range of available scores

Raw Score; number of questions attempted; percentage accuracy broken down by question, or by curriculum content area (number; algebra; ration, proportion and rates of change; geometry and measures; probability; statistics) or by process category (fluency in facts and procedures; fluency in conceptual understanding; problem solving; mathematical reasoning); Stanines (1 – 9, ST overall); Standard Age Score (70 – 130, SAS); National Percentile Rank (1 – 99, NPR);Group Ranked (dependent on group size, GR). End of KS2 indicators (80 – 120, intended to match SAT scaled scores) or GCSE Indicator.

Score transformation for standard score

Age standardised

Age bands used for norming

Not stated

Scoring procedures

Computer scoring with direct entry by test taker/​bureau service (scored by publisher).

Automatised norming

Computerised/​bureau service

Construct Validity

Rating Construct

Does it reflect the multidimensionality of the subject?

Generic maths

Criterion Validity

Rating Criterion

Summarise available comparisons

The Technical Information and Links to National Curriculum documents indicate that there is good face validity — a good deal of descriptive explanation is provided about test development, including detailed explanation of how the tests align to national curriculum. There was substantial trialling of items and analysis of discriminant validity between high and low performers at the item level before selecting items for the final version and re-standardising. However, these analyses are not presented for evaluation. The only measure of construct validity reported correlates performance on the PTM with PiM (a previous version of the test). This shows good correlations (r .62 – .88) but is not an independent measure of validity.

Reliability

Rating Reliability

Summarise available comparisons

Excellent internal consistency is reported in the Technical Information. However, little information about the sample, Cronbach’s alpha >.9 except for PTM5 (.87 – .95, see p3 of Technical Information for test specific reliabilities); SEM 3.3 – 5.4 (see p3 of Technical Information for test specific reliabilities); 90% SAS band 5 – 9 (see p3 of Technical Information for test specific reliabilities).

Is the norm-derived population appropriate and free from bias?

Does the standardisation sample represent the target/general population well?

If any biases are noted in sampling, these will be indicated here.

Standardisation does not differentiate between digital and paper version. Standardisation samples are independent from trial samples. Separate standardisations conducted for United Kingdom and for Northern Ireland. Standardisation of paper version took place between February and May 2014 for PTM5-11 and September to October 2014 for PTM11T. Sampling was stratified at school level, by country, independent/​grammar school, school performance based on Key Stage 2/GCSE outcomes. However, little information provided about the demographics of the population making it difficult to confirm lack of bias (although this isn’t anticipated to be a problem due to sample size and school characteristics).

Sources

Sources

GL Assessment (2015). Progress Test in Maths: Digital Edition. Administration instructions for all levels. GL Assessment. GL Assessment (2015). PT Maths: Technical Information. GL Assessment. Available at https://www.gl-assessment.co.uk/media/1346/ptm-technical-information.pdf GL Assessment (2015). Progress Test Series: Assessment Overview. GL Assessment. Available at https://www.gl-assessment.co.uk/media/205577/ptseries_assessment_overview1.pdf GL Assessment (2015). PT Maths Links to National Curriculum. Retrieved from https://www.gl-assessment.co.uk/support/ptm-product-support/links-to-national-curricula/ GL Assessment (2015). The Progress Test Series: Primary and Secondary Sample Reports. GL Assessment. Available at https://www.gl-assessment.co.uk/media/182406/pt-series-sample-report-11 – 7.pdf