01/04/2010 Medicine Psychology
DOI: 10.1136/adc.2010.186338.176 SemanticScholar ID: 78424768 MAG: 2566372124

“I gave her 10 out of 10!”—can school children contribute to scoring of student performance in an OSCE?

Publication Summary

Aims To explore whether child marking of student performance is valid and has similar statistical characteristics to other simulated patient (SP) scores. Methods 28 primary school children aged 8–10 years participated in a summative year 4 medical student OSCE for 262 students, covering all year 4 specialities. The children underwent cranial nerve examination, and were asked to assign a mark out of 10 in response to the question “If you had to see a doctor again, how happy would you be to see this one?”. The paediatrician examiners were asked to independently predict the child9s score. Data were analysed using SPSS with Pearson9s correlations. Child score (CS) was correlated against: examiner prediction of child score (ES); subscores for organisation and communication (SSOC) within that station; and examiner global rating (EGR) (which contributes to standard setting). CS was then also correlated against summated SSOCs in all other stations, and with summated SP scores for the 10 stations with an adult SP, whose scores were analysed similarly. Results CS and ES were highly negatively skewed, but the examiners9 scores were less skewed (skewness −1.22 and −0.67, respectively). The Pearson correlation between CS and ES was 0.40 (n=217, p Conclusions There was some correlation between child score and examiner prediction of child score, although children were more likely to assign higher ratings. Paediatricians could not accurately predict child score. Within the station, child score did not significantly correlate with subscores for organisation and communication, in contrast to adult SP scores. However, child score did correlate with these subscores across the whole exam. This indicates either that the child score is a less reliable indicator of student performance, or measures a different facet of performance.

CAER Authors

Avatar Image for Jonathan Darling

Dr. Jonathan Darling

University of Leeds - Clinical Associate Professor in Paediatrics and Child Health and Medical Education

Share this

Next publication

2009 Psychology

The Dynamics of Category Conjunctions

R. Hutter, R. Crisp, G. Humphreys, Gillian. M. Waters + 1 more