Student Engagement Instrument

Psychometric

UK normsⓘWhether the measure has been calibrated with a UK sample (as opposed to generating psychometric details from a Foreign (e.g. USA) sample).

Chronbach's alphaⓘAn estimate of the reliability of the measure. A higher value indicates a more reliable measure (0.7 is normally considered a good benchmark for reliability).

.76-.88

Text retestⓘA measure of reliability. This indicates how ‘stable’ responses to a measure are over time.

Not reported

Inter-rater reliabilityⓘWhere observations (e.g. teacher or peer report rather than self report) are used, this measure of reliability indicates how closely related each score is. A higher value suggests a more reliable measure.

Not reported

EFAⓘExploratory Factor Analysis – This is measure of the validity, showing how well the underlying structure of the domain is represented by the individual items. Higher values (factor loadings) indicate a good fit between items and the sub-domains of the measure.

6‑factor solutio

CFAⓘConfirmatory Factor Analysis – Similar to EFA, this measure of validity assesses the extent to which items fit pre-specified sub-domains of a measure. Higher values indicate a better fit.

Chi-square(373)= 1603p< .001CFI= .96RMSEA= .04

Criterion validityⓘAn assessment of how well the measures relates to other, well-validated assessments.

Not reported

Construct validityⓘFurther to the use of CFA and EFA, this reports any details demonstrating how well the measure is seen to represent the conceptual domain it comes from.

r= [.01,.25] with Grade Point Average; r= [-.29,.17] with NorthwestAchievement Levels Test (NALT)

Predictive validityⓘThe extent to which the measure can be seen to predict other outcomes.

Not reported

ResponsivenessⓘAn indicate of how well a measure if able to detect change during a pre-specified time (if applicable).

Not reported

Floor/CeilingⓘIndicates whether there are any issues with ceiling (maximum scores) or floor (minimum scores) effects with large portions of particular groups of respondents.

Not reported

References

Appleton, J. J., Christenson, S. L., Kim, D., & Reschly, A. L. (2006). Measuring cognitive and psychological engagement: Validation of the Student Engagement Instrument. Journal of School Psychology, 44(5), 427 – 445. doi:10.1016/j.jsp.2006.04.002 Betts, J. E., Appleton, J. J., Reschly, A. L., Christenson, S. L., & Huebner, E. S. (2010). A study of the factorial invariance of the Student Engagement Instrument (SEI): Results from middle and high school students. School Psychology Quarterly, 25(2), 84 – 93. doi:10.1037/a0020259 Carter, C. P., Reschly, A. L., Lovelace, M. D., Appleton, J. J., & Thompson, D. (2012). Measuring student engagement among elementary students: Pilot of the Student Engagement Instrument — Elementary Version. School Psychology Quarterly, 27(2), 61 – 73. doi:10.1037/a0029229

Student Engagement Instrument

About the measure

Subscales

Example

Link

Key Stage

Domains

Rating Psychometric

Rating Implementation

Implementation

No. of itemsⓘNumber of items included in the measure

FormatⓘType of response scale

RespondentⓘWho is asked to complete the measure.

ScoringⓘStandardised: Can easily be summed or averaged Complex: Requires judgement or assessment on behalf of the scorer

AgeⓘAge (in years) covered by the survey. Using the measure outside this age range may result in inaccurate information.

Cost single purchaseⓘCost (if applicable) of purchasing the measure.

Cost per childⓘDetails if there are additional costs per administration. This can vary, so if a cost is indicated, further contact with the publisher/author is recommended.

Psychometric

UK normsⓘWhether the measure has been calibrated with a UK sample (as opposed to generating psychometric details from a Foreign (e.g. USA) sample).

Chronbach's alphaⓘAn estimate of the reliability of the measure. A higher value indicates a more reliable measure (0.7 is normally considered a good benchmark for reliability).

Text retestⓘA measure of reliability. This indicates how ‘stable’ responses to a measure are over time.

Inter-rater reliabilityⓘWhere observations (e.g. teacher or peer report rather than self report) are used, this measure of reliability indicates how closely related each score is. A higher value suggests a more reliable measure.

EFAⓘExploratory Factor Analysis – This is measure of the validity, showing how well the underlying structure of the domain is represented by the individual items. Higher values (factor loadings) indicate a good fit between items and the sub-domains of the measure.

CFAⓘConfirmatory Factor Analysis – Similar to EFA, this measure of validity assesses the extent to which items fit pre-specified sub-domains of a measure. Higher values indicate a better fit.

Criterion validityⓘAn assessment of how well the measures relates to other, well-validated assessments.

Construct validityⓘFurther to the use of CFA and EFA, this reports any details demonstrating how well the measure is seen to represent the conceptual domain it comes from.

Predictive validityⓘThe extent to which the measure can be seen to predict other outcomes.

ResponsivenessⓘAn indicate of how well a measure if able to detect change during a pre-specified time (if applicable).

Floor/CeilingⓘIndicates whether there are any issues with ceiling (maximum scores) or floor (minimum scores) effects with large portions of particular groups of respondents.

References

Student Engagement Instrument

About the measure

Subscales

Example

Link

Key Stage

Domains

Rating Psychometric

Rating Implementation

Implementation

No. of itemsⓘNumber of items included in the measure

FormatⓘType of response scale

RespondentⓘWho is asked to complete the measure.

ScoringⓘStandardised: Can easily be summed or averaged Complex: Requires judgement or assessment on behalf of the scorer

AgeⓘAge (in years) covered by the survey. Using the measure outside this age range may result in inaccurate information.

Cost single purchaseⓘCost (if applicable) of purchasing the measure.

Cost per childⓘDetails if there are additional costs per administration. This can vary, so if a cost is indicated, further contact with the publisher/​author is recommended.

Psychometric

UK normsⓘWhether the measure has been calibrated with a UK sample (as opposed to generating psychometric details from a Foreign (e.g. USA) sample).

Chronbach's alphaⓘAn estimate of the reliability of the measure. A higher value indicates a more reliable measure (0.7 is normally considered a good benchmark for reliability).

Text retestⓘA measure of reliability. This indicates how ​‘stable’ responses to a measure are over time.

Inter-rater reliabilityⓘWhere observations (e.g. teacher or peer report rather than self report) are used, this measure of reliability indicates how closely related each score is. A higher value suggests a more reliable measure.

EFAⓘExploratory Factor Analysis – This is measure of the validity, showing how well the underlying structure of the domain is represented by the individual items. Higher values (factor loadings) indicate a good fit between items and the sub-domains of the measure.

CFAⓘConfirmatory Factor Analysis – Similar to EFA, this measure of validity assesses the extent to which items fit pre-specified sub-domains of a measure. Higher values indicate a better fit.

Criterion validityⓘAn assessment of how well the measures relates to other, well-validated assessments.

Construct validityⓘFurther to the use of CFA and EFA, this reports any details demonstrating how well the measure is seen to represent the conceptual domain it comes from.

Predictive validityⓘThe extent to which the measure can be seen to predict other outcomes.

ResponsivenessⓘAn indicate of how well a measure if able to detect change during a pre-specified time (if applicable).

Floor/CeilingⓘIndicates whether there are any issues with ceiling (maximum scores) or floor (minimum scores) effects with large portions of particular groups of respondents.

References

Cost per childⓘDetails if there are additional costs per administration. This can vary, so if a cost is indicated, further contact with the publisher/author is recommended.

Text retestⓘA measure of reliability. This indicates how ‘stable’ responses to a measure are over time.