Doing what it says on the tin?: A psychometric evaluation of the Assessment Experience Questionnaire

John Batten, Tansy Jessop, Phil Birch

Research output: Contribution to journalArticleResearchpeer-review

Abstract

The Assessment Experience Questionnaire has been widely used to measure conditions of learning from assessment. It is one of three methods used in the ‘Transforming the Experience of Students through Assessment’ research process, originally funded by the Higher Education Academy to explore programme assessment patterns, and now used extensively in universities in the United Kingdom. Given the growth of assessment and feedback research over the last decade, the Assessment Experience Questionnaire is ripe for revision. Critics have queried its theoretical and statistical robustness. This study investigated the psychometric properties of the Assessment Experience Questionnaire, as the first step in the process of strengthening the instrument. Specifically, we examined the validity of the questionnaire with a sample of final year undergraduate students from eight UK universities (n = 633). Results were mixed, confirming that the questionnaire has some value, but indicating that not all sub-scales possess adequate psychometric properties to underpin confident conclusions. As a result, we have embarked on a process of making conceptual modifications to the Assessment Experience Questionnaire, both to update the theoretical constructs, and to ensure stronger overall validity.
LanguageEnglish
JournalAssessment & Evaluation in Higher Education
DOIs
Publication statusPublished - 4 Nov 2018

Keywords

  • assessment environment
  • student experience
  • deep learning
  • questionnaire validity

Cite this

@article{648fa3a44a5240b582001ea499187c94,
title = "Doing what it says on the tin?: A psychometric evaluation of the Assessment Experience Questionnaire",
abstract = "The Assessment Experience Questionnaire has been widely used to measure conditions of learning from assessment. It is one of three methods used in the ‘Transforming the Experience of Students through Assessment’ research process, originally funded by the Higher Education Academy to explore programme assessment patterns, and now used extensively in universities in the United Kingdom. Given the growth of assessment and feedback research over the last decade, the Assessment Experience Questionnaire is ripe for revision. Critics have queried its theoretical and statistical robustness. This study investigated the psychometric properties of the Assessment Experience Questionnaire, as the first step in the process of strengthening the instrument. Specifically, we examined the validity of the questionnaire with a sample of final year undergraduate students from eight UK universities (n = 633). Results were mixed, confirming that the questionnaire has some value, but indicating that not all sub-scales possess adequate psychometric properties to underpin confident conclusions. As a result, we have embarked on a process of making conceptual modifications to the Assessment Experience Questionnaire, both to update the theoretical constructs, and to ensure stronger overall validity.",
keywords = "assessment environment, student experience, deep learning, questionnaire validity",
author = "John Batten and Tansy Jessop and Phil Birch",
year = "2018",
month = "11",
day = "4",
doi = "10.1080/02602938.2018.1499867",
language = "English",

}

Doing what it says on the tin? A psychometric evaluation of the Assessment Experience Questionnaire. / Batten, John; Jessop, Tansy; Birch, Phil.

04.11.2018.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Doing what it says on the tin?

T2 - A psychometric evaluation of the Assessment Experience Questionnaire

AU - Batten, John

AU - Jessop, Tansy

AU - Birch, Phil

PY - 2018/11/4

Y1 - 2018/11/4

N2 - The Assessment Experience Questionnaire has been widely used to measure conditions of learning from assessment. It is one of three methods used in the ‘Transforming the Experience of Students through Assessment’ research process, originally funded by the Higher Education Academy to explore programme assessment patterns, and now used extensively in universities in the United Kingdom. Given the growth of assessment and feedback research over the last decade, the Assessment Experience Questionnaire is ripe for revision. Critics have queried its theoretical and statistical robustness. This study investigated the psychometric properties of the Assessment Experience Questionnaire, as the first step in the process of strengthening the instrument. Specifically, we examined the validity of the questionnaire with a sample of final year undergraduate students from eight UK universities (n = 633). Results were mixed, confirming that the questionnaire has some value, but indicating that not all sub-scales possess adequate psychometric properties to underpin confident conclusions. As a result, we have embarked on a process of making conceptual modifications to the Assessment Experience Questionnaire, both to update the theoretical constructs, and to ensure stronger overall validity.

AB - The Assessment Experience Questionnaire has been widely used to measure conditions of learning from assessment. It is one of three methods used in the ‘Transforming the Experience of Students through Assessment’ research process, originally funded by the Higher Education Academy to explore programme assessment patterns, and now used extensively in universities in the United Kingdom. Given the growth of assessment and feedback research over the last decade, the Assessment Experience Questionnaire is ripe for revision. Critics have queried its theoretical and statistical robustness. This study investigated the psychometric properties of the Assessment Experience Questionnaire, as the first step in the process of strengthening the instrument. Specifically, we examined the validity of the questionnaire with a sample of final year undergraduate students from eight UK universities (n = 633). Results were mixed, confirming that the questionnaire has some value, but indicating that not all sub-scales possess adequate psychometric properties to underpin confident conclusions. As a result, we have embarked on a process of making conceptual modifications to the Assessment Experience Questionnaire, both to update the theoretical constructs, and to ensure stronger overall validity.

KW - assessment environment

KW - student experience

KW - deep learning

KW - questionnaire validity

U2 - 10.1080/02602938.2018.1499867

DO - 10.1080/02602938.2018.1499867

M3 - Article

ER -