Publication Type

Journal Article

Version

publishedVersion

Publication Date

11-2013

Abstract

Background: The selection methodology for UK general practice is designed to accommodate several thousand applicants per year and targets six core attributes identified in a multi-method job-analysis study. Aim: To evaluate the predictive validity of selection methods for entry into postgraduate training, comprising a clinical problem-solving test, a situational judgement test, and a selection centre. Design and setting: A three-part longitudinal predictive validity study of selection into training for UK general practice. Method: In sample 1, participants were junior doctors applying for training in general practice (n = 6824). In sample 2, participants were GP registrars 1 year into training (n = 196). In sample 3, participants were GP registrars sitting the licensing examination after 3 years, at the end of training (n = 2292). The outcome measures include: assessor ratings of performance in a selection centre comprising job simulation exercises (sample 1); supervisor ratings of trainee job performance 1 year into training (sample 2); and licensing examination results, including an applied knowledge examination and a 12-station clinical skills objective structured clinical examination (OSCE; sample 3). Results: Performance ratings at selection predicted subsequent supervisor ratings of job performance 1 year later. Selection results also significantly predicted performance on both the clinical skills OSCE and applied knowledge examination for licensing at the end of training. Conclusion: In combination, these longitudinal findings provide good evidence of the predictive validity of the selection methods, and are the first reported for entry into postgraduate training. Results show that the best predictor of work performance and training outcomes is a combination of a clinical problem-solving test, a situational judgement test, and a selection centre. Implications for selection methods for all postgraduate specialties are considered.

Keywords

general practice, postgraduate, reliability and validity, student selection

Discipline

Educational Assessment, Evaluation, and Research | Medicine and Health Sciences | Organizational Behavior and Theory

Research Areas

Organisational Behaviour and Human Resources

Publication

British Journal of General Practice

Volume

63

Issue

616

First Page

E734

Last Page

E741

ISSN

0960-1643

Identifier

10.3399/bjgp13X674413

Publisher

Royal College of General Practitioners

Copyright Owner and License

Publisher

External URL

http://bjgp.org/content/63/616/e734/tab-pdf

Additional URL

https://doi.org/10.3399/bjgp13X674413

Download

Share

COinS