Test identification

Name of test Adult Reading Test - Second Edition
Version Second Edition
Previous version(s) ART, ART-2
Subjects Literacy
Summary Assess adult reading skills. The Adult Reading Test, Second Edition (ART-2) includes 8 passages, 4 read silently, 4 aloud. The 2 parallel tests use 4 passages each, increase in difficulty and are suitable to assess students in both the further and higher education context.

Assessment screening

Subscales Aloud reading accuracy, aloud reading comprehesion, aloud reading speed, silent reading comprehension, silent reading speed, writing speed.
Additional References n/a
Authors John Everatt, Peter Brooks, and Rob Fidler
Publisher Pearson Clinical
Test source https://www.pearsonclinical.co.uk/Psychology/AdultCognitionNeuropsychologyandLanguage/AdultLanguage/art-2/adult-reading-test-art-2.aspx
Guidelines available? Yes
Norm-referenced scores. Yes
Age range 16 Years +
Key Stage(s) applicable to KS5
UK standardisation sample Yes
Publication date 2016
Re-norming date n/a

Eligibility

Validity measures available? Yes
Reliability measures available? Yes
Reason for exclusion from shortlist shortlisted

Evaluation and Appraisal

Additional information about what the test measures Literacy (Aloud and silent reading comprehension and speed, writing speed. Aloud reading accuracy).
Are additional versions available? (First published 2016, reprinted with corrections 2017. Previous edition: Adult Reading Test)
Can subtests be administered in isolation? Yes. It is anticipated that the aloud reading test would be administered initially and the silent reading test for follow-up. Reading tests could be adminstered without measuring speed in writing (but because it is a written precis task, can't measure writing without reading). Centiles and standard scores are available for each subtest.
Administration group size Individual
Administration duration 20-25 to administer the aloud version, 10-15 minutes to administer the silent version (based on an average achieving reader, lower ability readers will take longer), 2 mins for writing speed task
Description of materials needed to administer test ART 2 Manual, Reading Booklet, Results Sheet, Lined A4 paper, 2 pens, stopwatch, calculator, (audio recorder, if required, for careful analysis of responses)
Any special testing conditions? No

Response format

Response mode Oral/ Paper and pencil
What device is required n/a
Queston format. open ended
Progress through questions Flat

Assessor requirements

Is any prior knowledge/training/profession accreditation required for administration? No
Is administration scripted? Yes

Scoring

Description of materials needed to score test User manual
Types and range of available scores Raw,z score,standardized scores (range 65-125), centiles (for each subtest)
Score transformation for standard score Standardised on adult sample. Not age standardised.
Age bands used for norming None.
Scoring procedures simple manual scoring key – clerical skills required
Automatised norming None

Construct Validity

Does it adequately measure literacy, mathematics or science?
Does it reflect the multidimensionality of the subject? Generic literacy (with specific subtests)
Construct validity comments (and reference for source) The manual provides little information about the rationale of the assessment, nonetheless a good range of statistical evidence is presented to support construct validity.Differences between groups are as expected - t-tests indicated significant differences in performance on all subscales by those with and without reading difficulty (ts > 3.64, ps<.01); those with English as a first language and English as an additional language (ts > 3.10, ps < .002) - except on silent reading comprehension;those with and without a disability (ts >2.58, ps < .01) - except on aloud reading comprehension and silent reading comprehension, and silent reading speed.ANOVAs exploring whether the subscales differentiated NVQ level of study (levels 1-4) also significant p<.001.Correlations with other instruments and performance criteria also supports the construct validity of this assessment. Correlations between ART2 subtest scores and WIAT2 reading, WRAT4 and ART1 (which showed good relationships with BAS reading, Neale Analysis of Reading Analysis - Revised) .51 to .84. (However, correlations between WRAT4 and ART2 silent reading comprehension were weak .29).Correlations between reading subscales showed adequate to good inter-correlations between subtests (.4-.75) - except between silent reading comprehension and silent reading speed (.25). Correlations between reading measures and writing speed are lower (.38-.54), which is as expected as these components of literacy are less closely related.

Criterion Validity

Does test performance adequately correlate with later, current or past performance?
Summarise available comparisons n/a

Reliability

Is test performance reliable?
Summarise available comparisons Good internal consistency is reported in the administration manual (Brooks et al., 2016) - coefficients alpha for accuracy 0.87; comprehension 0.86; reading rate 0.90. No information is given about the sample.Good temporal stability is also reported in the administration manual (Brooks et al., 2016) in a study with 44 students that was conducted independently from the standardisation sample (no demographic information is provided about this sample) - Test-retest correlation coefficients accuracy 0.86, comprehension 0.81, reading rate 0.88, writing speed 0.87

Is the norm-derived population appropriate and free from bias?

Is population appropriate and free from bias? Yes
If any biases are noted in sampling, these will be indicated here. Although recruitment and sample procedures are unclear, the standardisation sample are appropriately drawn from a diverse range of FE and HE colleges across the UK.

Sources

Sources Brooks, P., Everatt, J., & Fidler, R. (2016). Adult Reading Test 2 (Silent and Oral Reading): Manual. Hayling Island, UK: Adult Reading Test Ltd.