The student experience in Objective Structured Clinical Examinations (OSCEs): phenomenological analysis

Background and purpose
The dominant psychometric discourse of OSCEs may lead to unexpected problems, such as a checklist-based student performance1 which under emphasises the clinical relationship with student and standardised patient (SP). Such encounters can be dehumanising for SPs2 and have implications for what students learn about relational skills through the assessment process. In this study we explore medical students’ experiences of undertaking OSCEs using a phenomenological frame.
Methodology
Interpretative phenomenological analysis is a form of qualitative methodology which has strong resonance with existentialism and focuses on the lived experience without significant reference to external political or discursive
forces.
Six 4th year undergraduate medical students from Queen’s University Belfast were recruited in December 2013. Maximum variation sampling was used. Students were interviewed by a researcher in the week prior to the
OSCE and then again in the week following the OSCE in Jan 2014. Interviews were minimally structured in order to be open to respondents, rather than adhering to a fixed topic guide, but focussed on participants’ experiences, thoughts and feelings about taking part in OSCEs. Interviews were audio-recorded and
transcribed. Students were also asked to complete a short diary entry in the days prior to the OSCEs and another immediately following. Diary entries were written, emailed or audio-recorded at student’s preference.
Results
Transcripts are currently being analysed by interpretative phenomenological analysis. Preliminary analysis has demonstrated the significance of students’ relationships within the OSCE triad (student, SP and examiner); the effect of the immediate examination environment; realism versus roleplay; students’ perceptions of the purpose of assessment; and coping mechanisms.
Full results will be available by the time of the conference.
Conclusion and Discussion
Understanding the student experience in OSCEs is a crucial step in understanding the complex construction of relationships within the OSCE triad. The focus in OSCEs is typically on standardisation and reliability, but in exploring social interactions we may refocus attention on their inherent potential for learning and effects on both students and patients.
References
1. Hodges B. Medical education and the maintenance of incompetence. Med Teach 2006;28(8):690-6
2. Johnston JL, Lundy G, McCullough M, Gormley GJ. The view from over there: reframing the OSCE through the experience of standardised patient
raters. Med Educ 2013;47(9):899-909

Cultivating creative learners in higher education: Engaging students in anatomy through art

Introduction
Nursing and midwifery students often struggle to engage with bioscience modules because they lack confidence in their ability to study science (Fell et al., 2012). Consequently many have difficulty applying anatomical and physiological information, essential to providing safe and effective patient care (Rogers, 2014; Rogers and Sterling, 2012); therefore a need exists for nurse educators to explore different methods of delivery of these important topics to enhance current curricula (Johnston, 2010). Inspired by the reported success of creative methods to enhance the teaching and learning of anatomy in medical education (Noel, 2013; Finn and McLachlan, 2010), this pilot study engaged nursing students in anatomy through the art of felt. The project was underpinned by the principles of good practice in undergraduate education, staff-student engagement, cooperation among students, active learning, prompt feedback, time on task, high expectations and respect for diverse learning styles (Chickering and Gamson, 1987).

Method
Undergraduate student nurses from Queen’s University, Belfast, enrolled in the year one ‘Health and Wellbeing’ model were invited to participate in the project. Over a six week period the student volunteers worked in partnership with teaching staff to construct individual, unique, three dimensional felt models of the upper body. Students researched the agreed topic for each week in terms of anatomical structure, location, tissue composition and vascular access. Creativity was encouraged in relation to the colour and texture of materials used. The evaluation of the project was based on the four level model detailed by Kirkpatrick and Kirkpatrick (2006) and included both quantitative and qualitative analysis:• pre and post knowledge scores• self-rated confidence• student reflections on the application of learning to practice.

Results
At the end of the project students had created felt pieces reflective of their learning throughout the project and ‘memorable’ three dimensional mental maps of the human anatomy. Evaluation revealed not only acquisition of anatomical knowledge, but the wider benefits of actively engaging in creative learning with other students and faculty teaching staff.

The project has enabled nurse educators to assess the impact of innovative methods for delivery of these important topics.

UK medical graduates’ preparedness for practice (P4P): A multi-site qualitative study

Introduction Previous research has demonstrated mixed findings in terms of graduates’ P4P in terms of their knowledge and skills, and interpersonal, systemic and technological aspects (Monrouxe et al. 2014). Few studies have included diverse stakeholders from multiple sites and employing longitudinal methods. We therefore aimed to understand the extent to which UK medical graduates are prepared for practice as Foundation doctors. Methods Cross-sectional qualitative narrative interview and longitudinal audio-diary (LAD) studies with participants from England, Scotland, Wales and Northern Ireland. Study 1 comprised 27 group and 84 individual interviews (n=185) with participants representing different stakeholders (F1s, fully registered trainees, clinical educators, undergraduate/postgraduate deans/foundation programme directors, other healthcare professionals, employers, policy makers, government representatives, and patient/public representatives). Study 2 comprised LADs with 26 F1s over 4-months. Results Participants found it hard initially to conceptualise the term ‘preparedness for practice’. We identified 2187 personal incident narratives (i.e. stories of P4P experiences) across our data: 506 (23%) were classed as ‘prepared’, 730 (33%) as ‘unprepared’ and 951 (44%) as ‘unspecified’. We identified factors that facilitated (e.g. supportive supervisors/colleagues, opportunities for shadowing) and hindered (e.g. unsupportive or disrespectful colleagues, poor organization, understaffing) transitions into and through the Foundation programme. The LADs suggested that trainees felt more confident and competent over time, but that such development was not always linear as challenging circumstances (e.g. new rotations) sometimes made trainees feel unprepared for situations where they had previously indicated preparedness. Conclusion Our findings add to the existing evidence on medical graduates’ P4P in the UK (e.g. Goldacre et al. 2008; Illing et al. 2013). Our findings support the role of assistantships and supportive supervisors for smoothing transitions from student to F1. Further longitudinal and action research studies are now needed to follow students through their final-year assistantships and into their F2 year.

Reaching out: medical students leading in local communities

Background: Queen's University Red Cross is a medical student-led volunteer group with a key aim of promoting social change within local communities and empowering young people to aspire to higher education. We describe ‘The Personal Development Certificate’, a 12–week community development programme devised by third-year medical students at Queen's University Belfast to target young people who are lacking educational motivation, are disengaged at home or are marginalised through social circumstances.

Context: Community-based education is of increasing importance within undergraduate and postgraduate medical education in the UK, and further afield. We evaluated the perceived improvements in key skills such as teamwork, leadership, communication, and problem solving in students following participation in this programme, and the extent to which their attitude and appreciation of community-based medicine changed.

Innovation: Following facilitation of this community-based initiative, all students reported a perceived improvement in the acquired skill sets. Students made strong links from this programme to previous clinical experiences and appreciated the opportunity to translate a series of classroom-learned skills to real-life environments and interactions. The students’ appreciation and understanding of community-based medicine was the single most improved area of our evaluation.

Implications: We have demonstrated that medical students possess the skills to develop and facilitate their own educational projects. Non-clinical, student-led community projects have the potential to be reproduced using recognised frameworks and guidelines to complement the current undergraduate medical curriculum

Implications of aligning full registration of doctors with medical school graduation:a qualitative study of stakeholder perspectives

OBJECTIVES: The Shape of Training report recommended that full registration is aligned with medical school graduation. As part of a General Medical Council-funded study about the preparedness for practice of UK medical graduates, we explored UK stakeholders' views about this proposal using qualitative interviews (30 group and 87 individual interviews) and Framework Analysis.

SETTING: Four UK study sites, one in each country.Save

PARTICIPANTS: 185 individuals from eight stakeholder groups: (1) foundation year 1 (F1) doctors (n=34); (2) fully registered trainee doctors (n=33); (3) clinical educators (n=32); (4) undergraduate/postgraduate Deans, and Foundation Programme Directors (n=30); (5) other healthcare professionals (n=13); (6) employers (n=7); (7) policy and government (n=11); (8) patient and public representatives (n=25).

RESULTS: We identified four main themes: (1) The F1 year as a safety net: patients were protected by close trainee supervision and 'sign off' to prevent errors; trainees were provided with a safe environment for learning on the job; (2) Implications for undergraduate medical education: if the proposal was accepted, a 'radical review' of undergraduate curricula would be needed; undergraduate education might need to be longer; (3) Implications for F1 work practice: steps to protect healthcare team integration and ensure that F1 doctors stay within competency limits would be required; (4) Financial, structural and political implications: there would be cost implications for trainees; clarification of responsibilities between undergraduate and postgraduate medical education would be needed. Typically, each theme comprised arguments for and against the proposal.

CONCLUSIONS: A policy change to align the timing of full registration with graduation would require considerable planning and preliminary work. These findings will inform policymakers' decision-making. Regardless of the decision, medical students should take on greater responsibility for patient care as undergraduates, assessment methods in clinical practice and professionalism domains need development, and good practice in postgraduate supervision and support must be shared.

Peer tutoring in a medical school: perceptions of tutors and tutees

Background: Peer tutoring has been described as “people from similar social groupings who are not professional teachers helping each other to learn and learning themselves by teaching”. Peer tutoring is well accepted as a source of support in many medical curricula, where participation and learning involve a process of socialisation.
Peer tutoring can ease the transition of the junior students from the university class environment to the hospital workplace. In this paper, we apply the Experienced Based Learning (ExBL) model to explore medical students’ perceptions of their experience of taking part in a newly established peer tutoring program at a hospital based
clinical school.
Methods: In 2014, all students at Sydney Medical School – Central, located at Royal Prince Alfred Hospital were invited to voluntarily participate in the peer tutoring program. Year 3 students (n = 46) were invited to act as tutors for Year 1 students (n = 50), and Year 4 students (n = 60) were invited to act as tutors for Year 2 students (n = 51). Similarly, the ‘tutees’ were invited to take part on a voluntary basis. Students were invited to attend focus groups, which were held at the end of the program. Framework analysis was used to code and categorise data into themes.
Results: In total, 108/207 (52 %) students participated in the program. A total of 42/106 (40 %) of Year 3 and 4 students took part as tutors; and of 66/101 (65 %) of Year 1 and 2 students took part as tutees. Five focus groups were held, with 50/108 (46 %) of students voluntarily participating. Senior students (tutors) valued the opportunity to practice and improve their medical knowledge and teaching skills. Junior students (tutees) valued the opportunity for additional practice and patient interaction, within a relaxed, small group learning environment.
Conclusion: Students perceived the peer tutoring program as affording opportunities not otherwise available within the curriculum. The peer teaching program provided a framework within the medical curriculum for senior students to practice and improve their medical knowledge and teaching skills. Concurrently, junior students were provided with a valuable learning experience that they reported as being qualitatively different to traditional teaching by faculty.

Does video feedback analysis improve CPR performance in phase 5 medical students?

Background The use of simulation in medical education is increasing, with students taught and assessed using simulated patients and manikins. Medical students at Queen’s University of Belfast are taught advanced life support cardiopulmonary resuscitation as part of the undergraduate curriculum. Teaching and feedback in these skills have been developed in Queen’s University with high-fidelity manikins. This study aimed to evaluate the effectiveness of video compared to verbal feedback in assessment of student cardiopulmonary resuscitation performance Methods Final year students participated in this study using a high-fidelity manikin, in the Clinical Skills Centre, Queen’s University Belfast. Cohort A received verbal feedback only on their performance and cohort B received video feedback only. Video analysis using ‘StudioCode’ software was distributed to students. Each group returned for a second scenario and evaluation 4 weeks later. An assessment tool was created for performance assessment, which included individual skill and global score evaluation. Results One hundred thirty eight final year medical students completed the study. 62 % were female and the mean age was 23.9 years. Students having video feedback had significantly greater improvement in overall scores compared to those receiving verbal feedback (p = 0.006, 95 % CI: 2.8–15.8). Individual skills, including ventilation quality and global score were significantly better with video feedback (p = 0.002 and p < 0.001, respectively) when compared with cohort A. There was a positive change in overall score for cohort B from session one to session two (p < 0.001, 95 % CI: 6.3–15.8) indicating video feedback significantly benefited skill retention. In addition, using video feedback showed a significant improvement in the global score (p < 0.001, 95 % CI: 3.3–7.2) and drug administration timing (p = 0.004, 95 % CI: 0.7–3.8) of cohort B participants, from session one to session two. Conclusions There is increased use of simulation in medicine but a paucity of published data comparing feedback methods in cardiopulmonary resuscitation training. Our study shows the use of video feedback when teaching cardiopulmonary resuscitation is more effective than verbal feedback, and enhances skill retention. This is one of the first studies to demonstrate the benefit of video feedback in cardiopulmonary resuscitation teaching.

The impact of curricular change on medical students' knowledge of anatomy

Background: In recent years, following the publication of Tomorrow's Doctors, the undergraduate medical curriculum in most UK medical schools has undergone major revision. This has resulted in a significant reduction in the time allocated to the teaching of the basic medical sciences, including anatomy. However, it is not clear what impact these changes have had on medical students' knowledge of surface anatomy. Aim: This study aimed to assess the impact of these curricular changes on medical students' knowledge of surface anatomy. Setting: Medical student intakes for 1995-98 at the Queen's University of Belfast, UK. Methods: The students were invited to complete a simple examination paper testing their knowledge of surface anatomy. Results from the student intake of 1995, which undertook a traditional, 'old' curriculum, were compared with those from the student intakes of 1996-98, which undertook a new, 'systems-based' curriculum. To enhance linear response and enable the use of linear models for analysis, all data were adjusted using probit transformations of the proportion (percentage) of correct answers for each item and each year group. Results: The student intake of 1995 (old curriculum) were more likely to score higher than the students who undertook the new, systems-based curriculum. Conclusion: The introduction of the new, systems-based course has had a negative impact on medical students' knowledge of surface anatomy.

Computer simulating a trial of a load-bearing implant: example of an intramedullary prosthesis

Computational modelling is becoming ever more important for obtaining regulatory approval for new medical devices. An accepted approach is to infer performance in a population from an analysis conducted for an idealised or ‘average’ patient; we present here a method for predicting the performance of an orthopaedic implant when released into a population—effectively simulating a clinical trial. Specifically we hypothesise that an analysis based on a method for predicting the performance in a population will lead to different conclusions than an analysis based on an idealised or ‘average’ patient. To test this hypothesis we use a finite element model of an intramedullary implant in a bone whose size and remodelling activity is different for each individual in the population. We compare the performance of a low Young’s modulus implant (View the MathML source) to one with a higher Young’s modulus (200 GPa). Cyclic loading is applied and failure is assumed when the migration of the implant relative to the bone exceeds a threshold magnitude. The analysis for an idealised of ‘average’ patient predicts that the lower modulus device survives longer whereas the analysis simulating a clinical trial predicts no statistically-significant tendency (p=0.77) for the low modulus device to perform better. It is concluded that population-based simulations of implant performance–simulating a clinical trial–present a very valuable opportunity for more realistic computational pre-clinical testing of medical devices.

The level playing field: the impact of assessment practice on professional development

Context: The effects of assessment practice on students’ learning are unclear, particularly regarding professional development. Corralling in objective structured clinical examinations (OSCEs) is designed to reduce illicit passing of examination information. Candidates completing an examination are kept secluded until the next cohort of examinees has begun. We used the introduction of corralling as a context in which to explore social influences on examination misconduct, with the aims of improving understanding of the hidden effects of assessment, and evaluating the acceptability of corralling from the student perspective.

Methods: A questionnaire was administered to students corralled post-OSCE for the first time. Eleven semi-structured interviews were subsequently conducted. Questionnaire data were analysed for descriptive statistics and thematic analysis of interview transcripts was carried out.

Results: The questionnaire response rate was 95.4% (251/263). Before corralling, 80.9% (203/251) of students were aware of the sharing of information among peers and 78.5% (197/251) agreed that such misconduct was unprofessional. The majority were in favour of corralling (90.8%, 228/251). Four themes emerged from the semi-structured interviews: the student network versus the individual; assessment-driven culture; the deferring of professionalism, and the ‘level playing field’. Students saw interaction within the student network, on a background of assessment-driven culture, as the key driver in examination misconduct. Conforming to the rules of the social network was prioritised over individual agency, although the mismatch between the rules of the network and the dominant professional discourse caused some conflict for individuals. Deferred professionalism (described as the practice of taking on the norms of professional behaviour only when qualified) was a rationalisation used to minimise this conflict. Corralling provided a ‘level playing field’ in which the influences of the network were minimised.

Conclusions: Examination misconduct is thus a complex social construction with implications for individual learners in terms of professional development. Corralling is one mechanism for addressing misconduct that is acceptable to students, but assessment processes have important hidden effects which educators should acknowledge.