Publication Type
Journal Article
Version
acceptedVersion
Publication Date
7-2009
Abstract
This study fills a key gap in research on response instructions in situational judgment tests (SJTs). The authors examined whether the assumptions behind the differential effects of knowledge and behavioral tendency SJT response instructions hold in a large-scale high-stakes selection context (i.e., admission to medical college). Candidates (N = 2,184) were randomly assigned to a knowledge or behavioral tendency response instruction SJT, while SJT content was kept constant. Contrary to prior research in low-stakes settings, no meaningfully important differences were found between mean scores for the response instruction sets. Consistent with prior research, the SJT with knowledge instructions correlated more highly with cognitive ability than did the SJT with behavioral tendency instructions. Finally, no difference was found between the criterion-related validity of the SJTs under the two response instruction sets.
Keywords
Situational judgment test, response instructions, high-stakes testing
Discipline
Human Resources Management | Organizational Behavior and Theory
Research Areas
Organisational Behaviour and Human Resources
Publication
Journal of Applied Psychology
Volume
94
Issue
4
First Page
1095
Last Page
1101
ISSN
0021-9010
Identifier
10.1037/a0014628
Publisher
American Psychological Association
Citation
LIEVENS, Filip; SACKETT, Paul R.; and BUYSE, Tine.
The effects of response instructions on situational judgment test performance and validity in a high-stakes context. (2009). Journal of Applied Psychology. 94, (4), 1095-1101.
Available at: https://ink.library.smu.edu.sg/lkcsb_research/5670
Copyright Owner and License
Authors
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Additional URL
https://doi.org/10.1037/a0014628