The GP tests of competence assessment: which part best predicts fitness to practise decisions?

Authors:
Leila Mehdizadeh
Leila Mehdizadeh
University College London
United Kingdom
Alison Sturrock
Alison Sturrock
University College London

BMC Med Educ 2018 Jan 2;18(1). Epub 2018 Jan 2.

Research Department of Medical Education, University College London, London, UK.

Background: The General Medical Council (GMC) conducts Tests of Competence (ToC) for doctors referred for Fitness to Practise (FtP) issues. GPs take a single best answer knowledge test, an Objective Structured Clinical Examination (OSCE), and a Simulated Surgery (SimSurg) assessment which is a simulated GP consultation. The aim of this study was to examine the similarities between OSCEs and SimSurg to determine whether each assessment contributed something unique to GP ToCs.

Methods: A mixed methods approach was used. Data were collated on 153 GPs who were required to undertake a ToC as a part of being investigated for FtP issues between February 2010 and October 2016. Using correlation analysis, we examined to what degree performance on the knowledge test, OSCE, and SimSurg related to case examiner recommendations and FtP outcomes, including the unique predictive power of these three assessments. The outcome measures were case examiner recommendations (i) not fit to practise; ii) fit to practise on a limited basis; or iii) fit to practise) as well as FtP outcomes (i) erased/removed from the register; ii) having restrictions/conditions; or iii) be in good standing). For the qualitative component, 45 GP assessors were asked to rate whether they assess the same competencies and which assessment provides better feedback about candidates.

Results: There was significant overlap between OSCEs and SimSurg, p < 0.001. SimSurg had additional predictive power in the presence of OSCEs and the knowledge test (p = 0.030) in distinguishing doctors from different FtP categories, while OSCEs did not (p = 0.080). Both the OSCEs (p = 0.004) and SimSurg (p < 0.001) had significant negative correlations with case examiner recommendations when accounting for the effects of the other two assessments. Inductive thematic analysis of the responses to the questionnaire showed that assessors perceived OSCEs to be better suited to target specific knowledge and skills. SimSurg was thought to produce a more global picture as the scenarios more accurately portray a patient consultation.

Conclusion: While all three assessments are strong predictors of both case examiner recommendations and FtP outcomes, our findings suggest that the efficiency of GP ToCs can be improved by removing some of this overlapping content.

Download full-text PDF

Source
http://dx.doi.org/10.1186/s12909-017-1111-0DOI Listing
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC5748949PMC

Still can't find the full text of the article?

We can help you send a request to the authors directly.
January 2018
9 Reads

Publication Analysis

Top Keywords

fit practise
12
examiner recommendations
8
case examiner
8
fitness practise
8
ftp issues
8
ftp outcomes
8
tests competence
8
osces simsurg
8
knowledge test
8
practise
5
determine assessment
4
standing qualitative
4
simsurg determine
4
simsurg case
4
tocsmethods mixed
4
mixed methods
4
good standing
4
unique tocsmethods
4
contributed unique
4
assessment contributed
4

References

(Supplied by CrossRef)
Article in Med Educ
L Southgate et al.
Med Educ 2001
Article in Clin Teach
A Sturrock et al.
Clin Teach 2006
Article in Acad Med
J Dacre et al.
Acad Med 2009
Article in Int J Qual Stud Health Well-being
V Braun et al.
Int J Qual Stud Health Well-being 2014
Article in Ann Intern Med
N Choudhry et al.
Ann Intern Med 2005
Article in J Can Urol Assoc
LN Nguyen et al.
J Can Urol Assoc 2015

Similar Publications