A quasi-experiment was conducted to investigate the effects of frame-of-reference training on the quality of competency modeling ratings made by consultants. Human resources consultants from a large consulting firm were randomly assigned to either a training or a control condition. The discriminant validity, interrater reliability, and accuracy of the competency ratings were significantly higher in the training group than in the control group. Further, the discriminant validity and interrater reliability of competency inferences were highest among an additional group of trained consultants who also had competency modeling experience. Together, these results suggest that procedural interventions such as rater training can significantly enhance the quality of competency modeling.
Competency modeling, fraine-of-reference training, job analysis, rating
Human Resources Management | Organizational Behavior and Theory
Organisational Behaviour and Human Resources
Journal of Applied Psychology
American Psychological Association
LIEVENS, Filip and SANCHEZ, Juan I.
Can training improve the quality of inferences made by raters in competency modeling? A quasi-experiment. (2007). Journal of Applied Psychology. 92, (3), 812-819. Research Collection Lee Kong Chian School Of Business.
Available at: http://ink.library.smu.edu.sg/lkcsb_research/5666
Creative Commons License
This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License.