Publication Type
Journal Article
Version
acceptedVersion
Publication Date
7-2007
Abstract
This study used principles underlying item generation theory to posit competing perspectives about which features of situational judgment tests might enhance or impede consistent measurement across repeat test administrations. This led to 3 alternate-form development approaches (random assignment, incident isomorphism, and item isomorphism). The effects of these approaches on alternate-form consistency, mean score changes, and criterion-related validity were examined in a high-stakes context (N = 3,361). Generally, results revealed that even small changes in the context of the situations presented resulted in significantly lower alternate-form consistency. Conversely, placing more constraints on the alternate-form development process proved beneficial. The contributions, implications, and limitations of these results for the development of situational judgment tests and high-stakes testing are discussed.
Keywords
Situational judgment tests, alternate forms, item generation, high stakes testing
Discipline
Human Resources Management | Organizational Behavior and Theory
Research Areas
Organisational Behaviour and Human Resources
Publication
Journal of Applied Psychology
Volume
92
Issue
4
First Page
1043
Last Page
1055
ISSN
0021-9010
Identifier
10.1037/0021-9010.92.4.1043
Publisher
American Psychological Association
Citation
LIEVENS, Filip and SACKETT, Paul R..
Situational judgment tests in high-stakes settings: Issues and strategies with generating alternate forms. (2007). Journal of Applied Psychology. 92, (4), 1043-1055.
Available at: https://ink.library.smu.edu.sg/lkcsb_research/5675
Copyright Owner and License
Authors
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Additional URL
https://doi.org/10.1037/0021-9010.92.4.1043