Publication Type

Journal Article

Publication Date

7-2007

Abstract

This study used principles underlying item generation theory to posit competing perspectives about which features of situational judgment tests might enhance or impede consistent measurement across repeat test administrations. This led to 3 alternate-form development approaches (random assignment, incident isomorphism, and item isomorphism). The effects of these approaches on alternate-form consistency, mean score changes, and criterion-related validity were examined in a high-stakes context (N = 3,361). Generally, results revealed that even small changes in the context of the situations presented resulted in significantly lower alternate-form consistency. Conversely, placing more constraints on the alternate-form development process proved beneficial. The contributions, implications, and limitations of these results for the development of situational judgment tests and high-stakes testing are discussed.

Keywords

Situational judgment tests, alternate forms, item generation, high stakes testing

Discipline

Human Resources Management | Organizational Behavior and Theory

Research Areas

Organisational Behaviour and Human Resources

Publication

Journal of Applied Psychology

Volume

92

Issue

4

First Page

1043

Last Page

1055

ISSN

0021-9010

Identifier

10.1037/0021-9010.92.4.1043

Publisher

American Psychological Association

Creative Commons License

Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License
This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License.

Additional URL

https://doi.org/10.1037/0021-9010.92.4.1043

Share

COinS