Online Motivation Questionnaire

Psychometric

UK normsⓘWhether the measure has been calibrated with a UK sample (as opposed to generating psychometric details from a Foreign (e.g. USA) sample).

Chronbach's alphaⓘAn estimate of the reliability of the measure. A higher value indicates a more reliable measure (0.7 is normally considered a good benchmark for reliability).

.62-.89

Text retestⓘA measure of reliability. This indicates how ‘stable’ responses to a measure are over time.

2 weeks‑3 months, r= [.45,.78]

Inter-rater reliabilityⓘWhere observations (e.g. teacher or peer report rather than self report) are used, this measure of reliability indicates how closely related each score is. A higher value suggests a more reliable measure.

Not reported

EFAⓘExploratory Factor Analysis – This is measure of the validity, showing how well the underlying structure of the domain is represented by the individual items. Higher values (factor loadings) indicate a good fit between items and the sub-domains of the measure.

Across studies 3

CFAⓘConfirmatory Factor Analysis – Similar to EFA, this measure of validity assesses the extent to which items fit pre-specified sub-domains of a measure. Higher values indicate a better fit.

Time 1 (n=646)Chi-square(8011)= 15925.9RMSEA= .077 – .080SRMSR= .008 – .009Time 2 (n=584)Chi-square(8011)= 16931.9RMSEA= .086 – .089SRMSR= .008 – .010

Criterion validityⓘAn assessment of how well the measures relates to other, well-validated assessments.

Not reported

Construct validityⓘFurther to the use of CFA and EFA, this reports any details demonstrating how well the measure is seen to represent the conceptual domain it comes from.

School Subject Attitude Scale, r= [.39,.73]

Predictive validityⓘThe extent to which the measure can be seen to predict other outcomes.

When Appraisals were added to a regression model model, additional variance in reported effort in homework was explained compared to general and domain-specific predictors(except in one case where variance explained went down after Appraisals were added). Changes in variance ranged from 6.1%-22.5%.

ResponsivenessⓘAn indicate of how well a measure if able to detect change during a pre-specified time (if applicable).

Not reported

Floor/CeilingⓘIndicates whether there are any issues with ceiling (maximum scores) or floor (minimum scores) effects with large portions of particular groups of respondents.

Not reported

References

Boekaerts, M. (2002). The on-line motivation questionnaire: A self-report instrument to assess students’ context sensitivity. Advances in motivation and achievement, 12, 77 – 120. Crombach, M., Boekaerts, M., & Voeten, M. (2003). Online measurement of appraisals of students faced with curricular tasks. Educational and Psychological Measurement, 63(1), 96 – 111. doi:10.1177/0013164402239319

Online Motivation Questionnaire

About the measure

Subscales

Example

Link

Key Stage

Domains

Rating Psychometric

Rating Implementation

Implementation

No. of itemsⓘNumber of items included in the measure

FormatⓘType of response scale

RespondentⓘWho is asked to complete the measure.

ScoringⓘStandardised: Can easily be summed or averaged Complex: Requires judgement or assessment on behalf of the scorer

TimeⓘAn estimate of the time (in minutes) taken for an individual to complete one survey

AgeⓘAge (in years) covered by the survey. Using the measure outside this age range may result in inaccurate information.

Cost single purchaseⓘCost (if applicable) of purchasing the measure.

Cost per childⓘDetails if there are additional costs per administration. This can vary, so if a cost is indicated, further contact with the publisher/author is recommended.

Psychometric

UK normsⓘWhether the measure has been calibrated with a UK sample (as opposed to generating psychometric details from a Foreign (e.g. USA) sample).

Chronbach's alphaⓘAn estimate of the reliability of the measure. A higher value indicates a more reliable measure (0.7 is normally considered a good benchmark for reliability).

Text retestⓘA measure of reliability. This indicates how ‘stable’ responses to a measure are over time.

Inter-rater reliabilityⓘWhere observations (e.g. teacher or peer report rather than self report) are used, this measure of reliability indicates how closely related each score is. A higher value suggests a more reliable measure.

EFAⓘExploratory Factor Analysis – This is measure of the validity, showing how well the underlying structure of the domain is represented by the individual items. Higher values (factor loadings) indicate a good fit between items and the sub-domains of the measure.

CFAⓘConfirmatory Factor Analysis – Similar to EFA, this measure of validity assesses the extent to which items fit pre-specified sub-domains of a measure. Higher values indicate a better fit.

Criterion validityⓘAn assessment of how well the measures relates to other, well-validated assessments.

Construct validityⓘFurther to the use of CFA and EFA, this reports any details demonstrating how well the measure is seen to represent the conceptual domain it comes from.

Predictive validityⓘThe extent to which the measure can be seen to predict other outcomes.

ResponsivenessⓘAn indicate of how well a measure if able to detect change during a pre-specified time (if applicable).

Floor/CeilingⓘIndicates whether there are any issues with ceiling (maximum scores) or floor (minimum scores) effects with large portions of particular groups of respondents.

References

Online Motivation Questionnaire

About the measure

Subscales

Example

Link

Key Stage

Domains

Rating Psychometric

Rating Implementation

Implementation

No. of itemsⓘNumber of items included in the measure

FormatⓘType of response scale

RespondentⓘWho is asked to complete the measure.

ScoringⓘStandardised: Can easily be summed or averaged Complex: Requires judgement or assessment on behalf of the scorer

TimeⓘAn estimate of the time (in minutes) taken for an individual to complete one survey

AgeⓘAge (in years) covered by the survey. Using the measure outside this age range may result in inaccurate information.

Cost single purchaseⓘCost (if applicable) of purchasing the measure.

Cost per childⓘDetails if there are additional costs per administration. This can vary, so if a cost is indicated, further contact with the publisher/​author is recommended.

Psychometric

UK normsⓘWhether the measure has been calibrated with a UK sample (as opposed to generating psychometric details from a Foreign (e.g. USA) sample).

Chronbach's alphaⓘAn estimate of the reliability of the measure. A higher value indicates a more reliable measure (0.7 is normally considered a good benchmark for reliability).

Text retestⓘA measure of reliability. This indicates how ​‘stable’ responses to a measure are over time.

Inter-rater reliabilityⓘWhere observations (e.g. teacher or peer report rather than self report) are used, this measure of reliability indicates how closely related each score is. A higher value suggests a more reliable measure.

EFAⓘExploratory Factor Analysis – This is measure of the validity, showing how well the underlying structure of the domain is represented by the individual items. Higher values (factor loadings) indicate a good fit between items and the sub-domains of the measure.

CFAⓘConfirmatory Factor Analysis – Similar to EFA, this measure of validity assesses the extent to which items fit pre-specified sub-domains of a measure. Higher values indicate a better fit.

Criterion validityⓘAn assessment of how well the measures relates to other, well-validated assessments.

Construct validityⓘFurther to the use of CFA and EFA, this reports any details demonstrating how well the measure is seen to represent the conceptual domain it comes from.

Predictive validityⓘThe extent to which the measure can be seen to predict other outcomes.

ResponsivenessⓘAn indicate of how well a measure if able to detect change during a pre-specified time (if applicable).

Floor/CeilingⓘIndicates whether there are any issues with ceiling (maximum scores) or floor (minimum scores) effects with large portions of particular groups of respondents.

References

Cost per childⓘDetails if there are additional costs per administration. This can vary, so if a cost is indicated, further contact with the publisher/author is recommended.

Text retestⓘA measure of reliability. This indicates how ‘stable’ responses to a measure are over time.