This study examined the coachability of two situational judgment tests, the College Student Questionnaire (CSQ) and the Situational Judgment Inventory (SJI), developed for consideration as selection instruments in the college admission process. Strategies for raising scores on each test were generated, and undergraduates were trained in the use of the strategies using a video-based training program. Results indicated that the CSQ was susceptible to coaching. In addition, the scoring format of the CSQ was found to be easily exploited, such that trainees could increase their scores by greater than 1 SD simply by avoiding extreme responses on that test. The results as a whole sounded a note of caution for the potential use of the CSQ in the college admission process.
Organizational Behavior and Theory | Social and Behavioral Sciences
Organisational Behaviour and Human Resources
International Journal of Selection and Assessment
Wiley: 24 months
CULLEN, MJ; SACKETT, PR; and LIEVENS, Filip Rene O.
Threats to the operational use of situational judgment tests in the college admission process. (2006). International Journal of Selection and Assessment. 14, (2), 142-155. Research Collection Lee Kong Chian School Of Business.
Available at: http://ink.library.smu.edu.sg/lkcsb_research/5565
Creative Commons License
This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License.