In this study, the authors examined whether video-based situational judgment tests (SJTs) have higher predictive validity than written SJTs (keeping verbal content constant). The samples consisted of 1, 159 students who completed a video-based version of an SIT and 1,750 students who completed the same SIT in a written format. The study was conducted in a high stakes testing context. The video-based version of an interpersonally oriented SJT had a lower correlation with cognitive ability than did the written version. It also had higher predictive and incremental validity for predicting interpersonally oriented criteria than did the written version. In this high stakes context, applicants also reacted relatively favorably to the SJTs, although there was no significant difference in face validity between the formats. These findings suggest that SIT format changes be made with caution and that validation evidence is needed when changes are proposed.
Situational judgment test, video, predictive validity
Organizational Behavior and Theory | Social and Behavioral Sciences
Organisational Behaviour and Human Resources
Journal of Applied Psychology
American Psychological Association
LIEVENS, Filip Rene O and SACKETT, Paul R.
Video-based versus written situational judgment tests: A comparison in terms of predictive validity. (2006). Journal of Applied Psychology. 91, (5), 1181-1188. Research Collection Lee Kong Chian School Of Business.
Available at: http://ink.library.smu.edu.sg/lkcsb_research/5511
Creative Commons License
This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License.