Bespoke Radiology e-Learning

Introduction: Foundation doctors are expected to assess and interpret plain x-ray studies of the chest/abdomen before a definitive report is issued by senior staff. The Royal College of Radiologists have published guidelines (RCR curriculum) on the scope of plain film findings medical students should be familiar with.1 Studies have shown that the x-ray interpretation without feedback does not significantly improve diagnostic ability. 2 Queen’s University, Belfast Trust Radiology and Experior Medical developed an online system to assess individual student ability to interpret X-ray findings. Over a series of assessments each student’s profile is built up, identifying strengths and weakness. The system can then create bespoke individual assessments re-evaluating previously identified weak areas and quantifying interpretative skill improvement. Aim: To determine how readily an online system is adopted by senior medical students, investigating if increasing exposure to x-ray interpretation combined with cyclical formative feedback enhances performance. Methods: The system was offered to all 270 final year medical students as an online resource. The system comprised a series of 20 weekly 30 minute assessments, containing normal and abnormal x-rays within the RCR curriculum. After each assessment students were given formative feedback, including their own result, annotated answers, peer group comparison and a breakdown of areas of strength and weakness. Focus groups of 4-5 students addressed student perspectives of the system, including ease of use, image resolution, system performance across different operating platforms, perceived value of formative feedback loops, breakdown of performance and the value of bespoke personalised assessments. Research Ethics Approval was granted for the study. Data analysis was via two-sided one-sample t-test; initial minimal recruitment was estimated as 60 students, to detect a mean 10% change in performance, with a standard deviation of 20%. Results and Discussion: Over 80% (n = XXX/270) of the student cohort engaged with the study. Student baseline average was 39%, increasing to 62% by the exit test. The steadily sustained improvement (57% relative performance in interpretative diagnostic accuracy) was despite increasing test difficulty. Student feedback via focus groups was universally positive throughout the examined domains. Conclusion: The online resource proved to be valuable, with high levels of student engagement, improving performance despite increasingly difficulty testing and positive learner experience with the system. References: 1. Undergraduate Radiology Curriculum, The Royal College of Ra, April 2012. Ref No. BFCR(12)4 The Royal College of Radiologists, April 2012 2. I Satia, S Bashagha, A Bibi, R Ahmed, S Mellor, F Zaman. Assessing the accuracy and certainty in interpretating chest x-rays in the medical division. Clin Med August 2013 Vol.13 no. 4 349-352

Respecting and fulfilling the right of post-primary pupils to consent to participate in trials and evaluative research: A discussion paper

This paper provides an introduction to issues surrounding the participation rights of young people in research and the implications of their growing involvement in research as well as providing a discourse on the ethical implications related to consent. The unique contribution of this paper is that it considers children’s rights in respect to the increasing opportunities for young people to take part in evaluation research. The aim of this paper, therefore, is to acknowledge the growing involvement for young people in research and the implications of ensuring that their rights of participation are respected. Secondly we will consider the children’s rights legislation and our obligations as researchers to implement this. Finally we will explore consent as an issue in its own right as well as the practicalities of accessing participants. This paper will postulate that any research about young people should involve and prioritise at all stages of the research process; including participation in decision-making. We conclude by identifying five key principles, which we believe can help to facilitate the fulfilment of post-primary pupils’ ability to consent to participate in trials and evaluative research.

Exploring the mobile structural assessment tool: Concept maps for learning website: Concept Maps for Learning Website

In this paper, we describe how the pathfinder algorithm converts relatedness ratings of concept pairs to concept maps; we also present how this algorithm has been used to develop the Concept Maps for Learning website (www.conceptmapsforlearning.com) based on the principles of effective formative assessment. The pathfinder networks, one of the network representation tools, claim to help more students memorize and recall the relations between concepts than spatial representation tools (such as Multi- Dimensional Scaling). Therefore, the pathfinder networks have been used in various studies on knowledge structures, including identifying students’ misconceptions. To accomplish this, each student’s knowledge map and the expert knowledge map are compared via the pathfinder software, and the differences between these maps are highlighted. After misconceptions are identified, the pathfinder software fails to provide any feedback on these misconceptions. To overcome this weakness, we have been developing a mobile-based concept mapping tool providing visual, textual and remedial feedback (ex. videos, website links and applets) on the concept relations. This information is then placed on the expert concept map, but not on the student’s concept map. Additionally, students are asked to note what they understand from given feedback, and given the opportunity to revise their knowledge maps after receiving various types of feedback.

Is Our Students Learning - QuestionMark: Extending E-Assessment Systems for Adapative Marking and Feedback

Our key contribution is a flexible, automated marking system that adds desirable functionality to existing E-Assessment systems. In our approach, any given E-Assessment system is relegated to a data-collection mechanism, whereas marking and the generation and distribution of personalised per-student feedback is handled separately by our own system. This allows content-rich Microsoft Word feedback documents to be generated and distributed to every student simultaneously according to a per-assessment schedule.

The feedback is adaptive in that it corresponds to the answers given by the student and provides guidance on where they may have gone wrong. It is not limited to simple multiple choice which are the most prescriptive question type offered by most E-Assessment Systems and as such most straightforward to mark consistently and provide individual per-alternative feedback strings. It is also better equipped to handle the use of mathematical symbols and images within the feedback documents which is more flexible than existing E-Assessment systems, which can only handle simple text strings.

As well as MCQs the system reliably and robustly handles Multiple Response, Text Matching and Numeric style questions in a more flexible manner than Questionmark: Perception and other E-Assessment Systems. It can also reliably handle multi-part questions where the response to an earlier question influences the answer to a later one and can adjust both scoring and feedback appropriately.

New question formats can be added at any time provided a corresponding marking method conforming to certain templates can also be programmed. Indeed, any question type for which a programmatic method of marking can be devised may be supported by our system. Furthermore, since the student’s response to each is question is marked programmatically, our system can be set to allow for minor deviations from the correct answer, and if appropriate award partial marks.

Does video feedback analysis improve CPR performance in phase 5 medical students?

Background The use of simulation in medical education is increasing, with students taught and assessed using simulated patients and manikins. Medical students at Queen’s University of Belfast are taught advanced life support cardiopulmonary resuscitation as part of the undergraduate curriculum. Teaching and feedback in these skills have been developed in Queen’s University with high-fidelity manikins. This study aimed to evaluate the effectiveness of video compared to verbal feedback in assessment of student cardiopulmonary resuscitation performance Methods Final year students participated in this study using a high-fidelity manikin, in the Clinical Skills Centre, Queen’s University Belfast. Cohort A received verbal feedback only on their performance and cohort B received video feedback only. Video analysis using ‘StudioCode’ software was distributed to students. Each group returned for a second scenario and evaluation 4 weeks later. An assessment tool was created for performance assessment, which included individual skill and global score evaluation. Results One hundred thirty eight final year medical students completed the study. 62 % were female and the mean age was 23.9 years. Students having video feedback had significantly greater improvement in overall scores compared to those receiving verbal feedback (p = 0.006, 95 % CI: 2.8–15.8). Individual skills, including ventilation quality and global score were significantly better with video feedback (p = 0.002 and p < 0.001, respectively) when compared with cohort A. There was a positive change in overall score for cohort B from session one to session two (p < 0.001, 95 % CI: 6.3–15.8) indicating video feedback significantly benefited skill retention. In addition, using video feedback showed a significant improvement in the global score (p < 0.001, 95 % CI: 3.3–7.2) and drug administration timing (p = 0.004, 95 % CI: 0.7–3.8) of cohort B participants, from session one to session two. Conclusions There is increased use of simulation in medicine but a paucity of published data comparing feedback methods in cardiopulmonary resuscitation training. Our study shows the use of video feedback when teaching cardiopulmonary resuscitation is more effective than verbal feedback, and enhances skill retention. This is one of the first studies to demonstrate the benefit of video feedback in cardiopulmonary resuscitation teaching.

The Use of a Pressure-Indicating Sensor Film to Provide Feedback upon Hydrogel-Forming Microneedle Array Self-Application In Vivo

PURPOSE:
To evaluate the combination of a pressure-indicating sensor film with hydrogel-forming microneedle arrays, as a method of feedback to confirm MN insertion in vivo.
METHODS:
Pilot in vitro insertion studies were conducted using a Texture Analyser to insert MN arrays, coupled with a pressure-indicating sensor film, at varying forces into excised neonatal porcine skin. In vivo studies involved twenty human volunteers, who self-applied two hydrogel-forming MN arrays, one with a pressure-indicating sensor film incorporated and one without. Optical coherence tomography was employed to measure the resulting penetration depth and colorimetric analysis to investigate the associated colour change of the pressure-indicating sensor film.
RESULTS:
Microneedle insertion was achieved in vitro at three different forces, demonstrating the colour change of the pressure-indicating sensor film upon application of increasing pressure. When self-applied in vivo, there was no significant difference in the microneedle penetration depth resulting from each type of array, with a mean depth of 237 μm recorded. When the pressure-indicating sensor film was present, a colour change occurred upon each application, providing evidence of insertion.
CONCLUSIONS:
For the first time, this study shows how the incorporation of a simple, low-cost pressure-indicating sensor film can indicate microneedle insertion in vitro and in vivo, providing visual feedback to assure the user of correct application. Such a strategy may enhance usability of a microneedle device and, hence, assist in the future translation of the technology to widespread clinical use.