Training in and assessment of the procedural skills required to perform peripheral nerve blockade

The training and ongoing education of medical practitioners has undergone major changes in an incremental fashion over the past 15 years. These changes have been driven by patient safety, educational, economic and legislative/regulatory factors. In the near future, training in procedural skills will undergo a paradigm shift to proficiency based progression with associated requirements for competence-based programmes, valid, reliable assessment tools and simulation technology. Before training begins, the learning outcomes require clear definition; any form of assessment applied should include measurement of these outcomes. Currently training in a procedural skill often takes place on an ad hoc basis. The number of attempts necessary to attain a defined degree of proficiency varies from procedure to procedure. Convincing evidence exists that simulation training helps trainees to acquire skills more efficiently rather than relying on opportunities in their clinical practice. Simulation provides a safe, stress free environment for trainees for skill acquisition, generalization and transfer via deliberate practice. The work described in this thesis contributes to a greater understanding of how medical procedures can be performed more safely and effectively through education. The effect of feedback, provided to novices in a standardized setting on a bench model, based on knowledge of performance was associated with an increase in the speed of skill acquisition and a decrease in error rate during initial learning. The timing of feedback was also associated with effective learning of skill. A marked attrition of skills (independent of the type of feedback provided) was demonstrable 24 hrs after they have first been learned. Using the principles of feedback as described above, when studying the effect of an intense training program on novices of varied years of experience in anaesthesia (i.e. the present training programmes / courses of an intense training day for one or more procedures). There was a marked attrition of skill at 24 hours with a significant correlation with increasing years of experience; there also appeared to be an inverse relationship between years of experience in anaesthesia and performance. The greater the number of years of practice experience, the longer it required a learner to acquire a new skill. The findings of the studies described in this thesis may have important implications for the trainers, trainees and training bodies in the design and implementation of training courses and the formats of delivery of changing curricula. Both curricula and training modalities will need to take account of characteristics of individual learners and the dynamic nature of procedural healthcare.

To what extent does the Health Professions Admission Test-Ireland predict performance in early undergraduate tests of communication and clinical skills? – An observational cohort study

Background: Internationally, tests of general mental ability are used in the selection of medical students. Examples include the Medical College Admission Test, Undergraduate Medicine and Health Sciences Admission Test and the UK Clinical Aptitude Test. The most widely used measure of their efficacy is predictive validity.A new tool, the Health Professions Admission Test- Ireland (HPAT-Ireland), was introduced in 2009. Traditionally, selection to Irish undergraduate medical schools relied on academic achievement. Since 2009, Irish and EU applicants are selected on a combination of their secondary school academic record (measured predominately by the Leaving Certificate Examination) and HPAT-Ireland score. This is the first study to report on the predictive validity of the HPAT-Ireland for early undergraduate assessments of communication and clinical skills. Method. Students enrolled at two Irish medical schools in 2009 were followed up for two years. Data collected were gender, HPAT-Ireland total and subsection scores; Leaving Certificate Examination plus HPAT-Ireland combined score, Year 1 Objective Structured Clinical Examination (OSCE) scores (Total score, communication and clinical subtest scores), Year 1 Multiple Choice Questions and Year 2 OSCE and subset scores. We report descriptive statistics, Pearson correlation coefficients and Multiple linear regression models. Results: Data were available for 312 students. In Year 1 none of the selection criteria were significantly related to student OSCE performance. The Leaving Certificate Examination and Leaving Certificate plus HPAT-Ireland combined scores correlated with MCQ marks.In Year 2 a series of significant correlations emerged between the HPAT-Ireland and subsections thereof with OSCE Communication Z-scores; OSCE Clinical Z-scores; and Total OSCE Z-scores. However on multiple regression only the relationship between Total OSCE Score and the Total HPAT-Ireland score remained significant; albeit the predictive power was modest. Conclusion: We found that none of our selection criteria strongly predict clinical and communication skills. The HPAT- Ireland appears to measures ability in domains different to those assessed by the Leaving Certificate Examination. While some significant associations did emerge in Year 2 between HPAT Ireland and total OSCE scores further evaluation is required to establish if this pattern continues during the senior years of the medical course.

Sex offender risk assessment and management in Ireland

This research examined sex offender risk assessment and management in Ireland. It focused on the statutory agencies with primary responsibility (Garda Síochána and the Probation Service). The goal was to document the historical, contextual and current systems, in addition to identifying areas of concern/improvements. The research was a mixed-methods approach. Eight studies were conducted. This incorporated documentary reviews of four Commission to Inquire Reports, qualitative interviews/focus groups with Garda staff, Probation Service staff, statutory agencies, community stakeholders, various Non-Governmental Organisations (NGOs) and sex offenders. Quantitative questionnaires were also administered to Garda staff. In all over 70 interviews were conducted and questionnaires were forwarded to 270 Garda members. The overall findings are: •Sex offender management in Ireland has become formal only since 2001. Knowledge, skills and expertise is in its infancy and is still evolving. •Mixed reviews and questions regarding fitness for purpose of currently used risk assessments tools were noted. •The Sex Offender Act 2001 requires additional elements to ensure safe sex offender monitoring and public protection. A judicial review of the Sex Offender Act 2001 was recommended by many respondents. •Interagency working under SORAM was hugely welcomed. The sharing of information has been welcomed by managing agencies as the key benefit to improving sex offender management. •Respondents reported that in practice, sex offender management in Ireland is fragmented and unevenly implemented. The research concluded that an independent National Sex Offender Authority should be established as an oversight and regulatory body for policy, strategy and direction in sex offender management. Further areas of research were also highlighted: ongoing evaluation and audits of the joint agency process and systems in place; recidivism studies tracking the risk assessment ratings and subsequent offending; and an evaluation of the current status of sex offender housing in Ireland.

Assessment in primary education in Ireland

This doctoral study examines assessment in primary education in the Republic of Ireland. The nature and purpose of assessment offer an insight into the values which are prioritised by an education system. In 2011, in the Republic of Ireland, the Department of Education and Skills (DES) published a strategy aiming to improve standards of literacy and numeracy. The document, entitled, Literacy and numeracy for learning and life: the national strategy to improve literacy and numeracy for children and young people 2011-2020, contains improvement targets as measured by standardised tests. It also mandates the increased use of standardised tests in primary education, and directs that aggregated scores should be reported to both Boards of Management and the DES. The study is framed by the theoretical perspectives of Michel Foucault and Pierre Bourdieu. Both of these commentators examine social policy and practice in an effort to provide insight into the history and operation of social institutions. This study is especially influenced by Foucault’s archaeology and genealogy of knowledge, and his notion of governmentality. It is also particularly cognisant of Bourdieu’s thoughts on habitus, doxa and capital. The study contains reviews of literature in the areas of assessment, assessment policy, and assessment policy in Ireland. These reviews highlight current debate in each of these areas while also grounding this debate in an historical context. The dissertation contains four empirical sections. 1) It analyses policy documents prepared in the development of the published strategy as well as investigating the strategy itself. In so doing it is aware of the burgeoning influence of pan-national bodies on policy development. 2) A number of high profile policy makers were interviewed as part of the study and their views are interpreted in light of the findings of the literature reviews. 3) The perspective of teachers was sought through a questionnaire survey. This gathered data on these teachers’ views on the purpose of assessment as well as their actual practice. 4) Finally, children were also included as participants in this study. They were interviewed in focus groups and encouraged to contribute drawings as well on their views of assessment in primary school. Literacy and numeracy for learning and life is seen as a seminal document in Irish education. This study is significant in its analysis of original data from high profile policy makers, including two Ministers for Education and Skills. It is also significant in its inclusion of the perspectives of primary school pupils. Finally, the study considers the nature and role of assessment in a holistic manner by including the views of policy makers, teachers and pupils. The study notes that policy development in Ireland underwent a change in the preparation of Literacy and numeracy for learning and life and that international influences, while present, are also mediated to suit the local context. It also highlights a lack of clarity in the definition of assessment in primary education and argues that there is a lack of balance in the approaches that are prioritised. The study demonstrates that teachers are impacted by the strategy but that they also change it by focusing on their own concerns while using assessment tools. The children provide compelling evidence of the impact of assessment on the learner. The study shows how assessment tools (and school subjects) are valued with differing levels of importance by a variety of stakeholders.