Publication Type

Journal Article

Publication Date

9-2012

Abstract

Although the evidence for the use of situational judgment tests (SJTs) in high-stakes testing has been generally promising, questions have been raised regarding the potential coachability of SJTs. This study reports the first examination of the effects of coaching on SJT scores in an operational high-stakes setting. We contrast findings from a simple comparison of SJT scores for coached and uncoached participants (posttest only) with three different approaches to deal with the effects of self-selection into coaching programs, namely using a pretest as a covariate and using two different forms of propensity score-based matching using a wide range of variables as covariates. Coaching effects were estimated at about 0.5 SDs. The implications for the use of SJTs in high-stakes settings and for coaching research in general are discussed.

Discipline

Organizational Behavior and Theory | Social and Behavioral Sciences

Research Areas

Organisational Behaviour and Human Resources

Publication

International Journal of Selection and Assessment

Volume

20

Issue

3

First Page

272

Last Page

282

ISSN

0965-075X

Identifier

10.1111/j.1468-2389.2012.00599.x

Publisher

Wiley: 24 months

Creative Commons License

Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License
This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License.

Additional URL

http://doi.org./10.1111/j.1468-2389.2012.00599.x

Share

COinS