This study fills a key gap in research on response instructions in situational judgment tests (SJTs). The authors examined whether the assumptions behind the differential effects of knowledge and behavioral tendency SJT response instructions hold in a large-scale high-stakes selection context (i.e., admission to medical college). Candidates (N = 2,184) were randomly assigned to a knowledge or behavioral tendency response instruction SJT, while SJT content was kept constant. Contrary to prior research in low-stakes settings, no meaningfully important differences were found between mean scores for the response instruction sets. Consistent with prior research, the SJT with knowledge instructions correlated more highly with cognitive ability than did the SJT with behavioral tendency instructions. Finally, no difference was found between the criterion-related validity of the SJTs under the two response instruction sets.
Situational judgment test, response instructions, high-stakes testing
Human Resources Management | Organizational Behavior and Theory
Organisational Behaviour and Human Resources
Journal of Applied Psychology
American Psychological Association
LIEVENS, Filip; SACKETT, Paul R; and BUYSE, Tine.
The effects of response instructions on situational judgment test performance and validity in a high-stakes context. (2009). Journal of Applied Psychology. 94, (4), 1095-1101. Research Collection Lee Kong Chian School Of Business.
Available at: http://ink.library.smu.edu.sg/lkcsb_research/5670
Creative Commons License
This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License.