Validity evidence based on response processes

Psicothema. 2014;26(1):136-44. doi: 10.7334/psicothema2013.259.

Abstract

Background: Validity evidence based on response processes was first introduced explicitly as a source of validity evidence in the latest edition of Standards for Educational and Psychological Testing. In this paper, we present the theory, the relationship with other sources of validity evidence, and the methods available for validation studies aimed at obtaining validity evidence about response processes.

Method: A comprehensive review of the literature along with theoretical and practical proposals.

Results: The articles provides arguments for determining when validity evidence based on response processes is critical for supporting the use of the test for a particular purpose, and examples of how to perform a validation study to obtain such validity evidence.

Conclusions: There are methods for obtaining validity evidence based on response processes. Special attention should be paid to validation studies using the cognitive interview method given its features and possibilities. Future research problems pose how to combine data from different methods -qualitative and quantitative-, to develop complete validity arguments that support the use of the test for a particular purpose.

Publication types

  • Research Support, Non-U.S. Gov't
  • Review

MeSH terms

  • Cognition
  • Data Collection
  • Educational Measurement / methods
  • Educational Measurement / standards*
  • Evaluation Studies as Topic
  • Eye Movements
  • Focus Groups
  • Forecasting
  • Humans
  • Interview, Psychological
  • Qualitative Research
  • Reaction Time
  • Sample Size
  • Sampling Studies
  • Surveys and Questionnaires / standards*
  • Validation Studies as Topic*