Undergraduate interprofessional education using high-fidelity paediatric simulation

BACKGROUND: High-fidelity simulation is becoming increasingly important in the delivery of teaching and learning to health care professionals within a safe environment. Its use in an interprofessional context and at undergraduate level has the potential to facilitate the learning of good communication and teamworking, in addition to clinical knowledge and skills.

METHODS: Interprofessional teaching and learning workshops using high-fidelity paediatric simulation were developed and delivered to undergraduate medical and nursing students at Queen's University Belfast. Learning outcomes common to both professions, and essential in the clinical management of sick children, included basic competencies, communication and teamworking skills. Quantitative and qualitative evaluation was undertaken using published questionnaires.

RESULTS: Quantitative results - the 32-item questionnaire was analysed for reliability using spss. Responses were positive for both groups of students across four domains - acquisition of knowledge and skills, communication and teamworking, professional identity and role awareness, and attitudes to shared learning. Qualitative results - thematic content analysis was used to analyse open-ended responses. Students from both groups commented that an interprofessional education (IPE) approach to paediatric simulation improved clinical and practice-based skills, and provided a safe learning environment. Students commented that there should be more interprofessional and simulation learning opportunities.

DISCUSSION: High-fidelity paediatric simulation, used in an interprofessional context, has the potential to meet the requirements of undergraduate medical and nursing curricula. Further research is needed into the long-term benefits for patient care, and its generalisability to other areas within health care teaching and learning.

Scientific production on the Mantel-Haenszel procedure as a way of detecting DIF

Resumen tomado de la publicaci??n

Conhecimentos e habilidades de acadêmicos sobre procedimentos em semiologia e semiotécnica da enfermagem

Conselho Nacional de Desenvolvimento Científico e Tecnológico

Evaluación del impacto de una intervención educativa en atención farmacéutica y farmacia clínica

Introduction: The World Health Organization considers pharmaceutical care (PC) of fundamental importance for the patient and the community. Its exercise requires knowledge and skills, which can be acquired in academic and/or continuing educations, credited for effectiveness and impact evaluation. However, few manuscripts in the literature have showed the contribution of the educational interventions on the knowledge, skill and attitude of students and professionals who participate in scientifi c events related to PC. Objective: To evaluate the impact of an educational intervention (EI), and its degree of satisfaction, to pharmacists and pharmacy students. Method: A quasi-experimental study was performed, through an extension course with 40 hours of lectures approaching issues related to PC and clinical pharmacy (CP). Participants answered a survey which was handed out before and after the EI. The statistic tests of Sinais and Mann-Whitney were applied to evaluate the EI signifi cance. Results: Participants (n= 49) were mostly (n= 34) students and performing activities related to PC and CP (n= 20). Statistics differences, before and after the EI, were found in the scores of knowledge, skill and attitude (p <0.001). The evaluated item which showed the most improvement was the last one. Most (n= 30) had exceeded or met their expectations (n= 19). Conclusions: The analysis of the data led us to conclude that an EI of 40 h/week about knowledge, skill and attitude in PC using traditional methods, improves knowledge and problem-solving skills of participants. ©2012 Ediciones Mayo, S.A. All rights reserved.

Ensino de anestesiologia durante a graduação por meio de uma liga acadêmica: qual o impacto no aprendizado dos alunos?

Justificativa e objetivos: As ligas acadêmicas vêm se firmando como instrumentos de ensino médico e inserção dos estudantes de medicina na prática das especialidades, inclusive na anestesiologia. Como o papel das ligas no processo de desenvolvimento de competências e aprendizado de seus alunos não é bem conhecido, avaliou-se o aprendizado dos integrantes de uma liga acadêmica de anestesiologia após um ano de participação nas suas atividades. MÉTODO: Os alunos de uma liga acadêmica de anestesiologia foram acompanhados de março a dezembro de 2010 e avaliados por meio de testes cognitivos objetivos de múltipla escolha aplicados antes do início das atividades e após sua conclusão. A frequência nas atividades e o perfil epidemiológico dos alunos foram correlacionados aos resultados dos testes. RESULTADOS: Foram analisados 20 acadêmicos do 3º ao 6º ano, com média de idade de 22,8 (21-26) anos. A frequência média nas atividades propostas foi 10,4/13 (80%). A média de acertos no primeiro teste foi 8,1/17 (47,6%), sendo que os alunos do 3º ano apresentam notas menores (p < 0,02) em relação aos demais. No teste pós-liga, a média de acertos foi 11,9/17 (70%), mostrando melhora no desempenho dos alunos (p < 0,05), e não houve diferença entre as notas dos diferentes anos da graduação. Foi encontrada relação forte entre frequência nas atividades e melhora nas notas (r = 0,719; p < 0,001). CONCLUSÕES: Os alunos que participaram da liga apresentaram melhora nos testes de avaliação de conhecimento, sugerindo que a liga é útil instrumento de ensino e promove ganho de aprendizado em anestesiologia. As atividades desenvolvidas nas ligas podem ter papel positivo na formação acadêmica dos graduandos, destacando-se, neste artigo, a anestesiologia.

Ensino de anestesiologia durante a graduação por meio de uma liga acadêmica: qual o impacto no aprendizado dos alunos?

JUSTIFICATIVA E OBJETIVOS: As ligas acadêmicas vêm se firmando como instrumentos de ensino médico e inserção dos estudantes de medicina na prática das especialidades, inclusive na anestesiologia. Como o papel das ligas no processo de desenvolvimento de competências e aprendizado de seus alunos não é bem conhecido, avaliou-se o aprendizado dos integrantes de uma liga acadêmica de anestesiologia após um ano de participação nas suas atividades. MÉTODO: Os alunos de uma liga acadêmica de anestesiologia foram acompanhados de março a dezembro de 2010 e avaliados por meio de testes cognitivos objetivos de múltipla escolha aplicados antes do início das atividades e após sua conclusão. A frequência nas atividades e o perfil epidemiológico dos alunos foram correlacionados aos resultados dos testes. RESULTADOS: Foram analisados 20 acadêmicos do 3º ao 6º ano, com média de idade de 22,8 (21-26) anos. A frequência média nas atividades propostas foi 10,4/13 (80%). A média de acertos no primeiro teste foi 8,1/17 (47,6%), sendo que os alunos do 3º ano apresentam notas menores (p < 0,02) em relação aos demais. No teste pós-liga, a média de acertos foi 11,9/17 (70%), mostrando melhora no desempenho dos alunos (p < 0,05), e não houve diferença entre as notas dos diferentes anos da graduação. Foi encontrada relação forte entre frequência nas atividades e melhora nas notas (r = 0,719; p < 0,001). CONCLUSÕES: Os alunos que participaram da liga apresentaram melhora nos testes de avaliação de conhecimento, sugerindo que a liga é útil instrumento de ensino e promove ganho de aprendizado em anestesiologia. As atividades desenvolvidas nas ligas podem ter papel positivo na formação acadêmica dos graduandos, destacando-se, neste artigo, a anestesiologia

Im Nebel der Präzision: die Bestimmung von GrenzfallkandidatInnen oder wie viel Reliabilität ist genug?

Hintergrund: Bei der Durchführung von summativen Prüfungen wird üblicherweise eine Mindestreliabilität von 0,8 gefordert. Bei praktischen Prüfungen wie OSCEs werden manchmal 0,7 akzeptiert (Downing 2004). Doch was kann man sich eigentlich unter der Präzision einer Messung mit einer Reliabilität von 0,7 oder 0,8 vorstellen? Methode: Mittels verschiedener statistischer Methoden wie dem Standardmessfehler oder der Generalisierbarkeitstheorie lässt sich die Reliabilität in ein Konfidenzintervall um eine festgestellte Kandidatenleistung übersetzen (Brennan 2003, Harvill 1991, McManus 2012). Hat ein Kandidat beispielsweise bei einer Prüfung 57 Punkte erreicht, schwankt seine wahre Leistung aufgrund der Messungenauigkeit der Prüfung um diesen Wert (z.B. zwischen 50 und 64 Punkte). Im Bereich der Bestehensgrenze ist die Messgenauigkeit aber besonders wichtig. Läge die Bestehensgrenze in unserem Beispiel bei 60 Punkten, wäre der Kandidat mit 57 Punkten zwar pro forma durchgefallen, allerdings könnte er aufgrund der Schwankungsbreite um seine gemessene Leistung in Wahrheit auch knapp bestanden haben. Überträgt man diese Erkenntnisse auf alle KandidatInnen einer Prüfung, kann man die Anzahl der Grenzfallkandidaten bestimmen, also all jene Kandidatinnen, die mit Ihrem Prüfungsergebnis so nahe an der Bestehensgrenze liegen, dass ihr jeweiliges Prüfungsresultate falsch positiv oder falsch negativ sein kann. Ergebnisse: Die Anzahl der GrenzfallkandidatInnen in einer Prüfung ist, nicht nur von der Reliabilität abhängig, sondern auch von der Leistung der KandidatInnen, der Varianz, dem Abstand der Bestehensgrenze zum Mittelwert und der Schiefe der Verteilung. Es wird anhand von Modelldaten und konkreten Prüfungsdaten der Zusammenhang zwischen der Reliabilität und der Anzahl der Grenzfallkandidaten auch für den Nichtstatistiker verständlich dargestellt. Es wird gezeigt, warum selbst eine Reliabilität von 0.8 in besonderen Situationen keine befriedigende Präzision der Messung bieten wird, während in manchen OSCEs die Reliabilität fast ignoriert werden kann. Schlussfolgerungen: Die Berechnung oder Schätzung der Grenzfallkandidaten anstatt der Reliabilität verbessert auf anschauliche Weise das Verständnis für die Präzision einer Prüfung. Wenn es darum geht, wie viele Stationen ein summativer OSCE benötigt oder wie lange eine MC-Prüfung dauern soll, sind Grenzfallkandidaten ein valideres Entscheidungskriterium als die Reliabilität. Brennan, R.L. (2003) Generalizability Theory. New York, Springer Downing, S.M. (2004) ‘Reliability: on the reproducibility of assessment data’, Medical Education 2004, 38, 1006–12 Harvill, L.M. (1991) ‘Standard Error of Measurement’, Educational Measurement: Issues and Practice, 33-41 McManus, I.C. (2012) ‘The misinterpretation of the standard error of measurement in medical education: A primer on the problems, pitfalls and peculiarities of the three different standard errors of measurement’ Medical teacher, 34, 569 - 76

Influence of experience and training on dental students’ examination performance regarding panoramic images

Physician training has greatly benefitted from insights gained in understanding the manner in which experts search medical images for abnormalities. The aims of this study were to compare the search patterns of 30 fourth-year dental students and 15 certified oral and maxillofacial radiologists (OMRs) over panoramic images and to determine the most robust variables for future studies involving image visualization. Eye tracking was used to capture the eye movement patterns of both subject groups when examining 20 panoramic images classified as normal or abnormal. Abnormal images were further subclassified as having an obvious, intermediate, or subtle abnormality. The images were presented in random order to each participant, and data were collected on duration of the participants’ observations and total distance tracked, time to first eye fixation, and total duration and numbers of fixations on and off the area of interest (AOI). The results showed that the OMRs covered greater distances than the dental students (p<0.001) for normal images. For images of pathosis, the OMRs required less total time (p<0.001), made fewer eye fixations (p<0.01) with fewer saccades (p<0.001) than the students, and required less time before making the first fixation on the AOI (p<0.01). Furthermore, the OMRs covered less distance (p<0.001) than the dental students for obvious pathoses. For investigations of images of pathosis, time to first fixation is a robust parameter in predicting ability. For images with different levels of subtlety of pathoses, the number of fixations, total time spent, and numbers of revisits are important parameters to analyze when comparing observer groups with different levels of experience.

Influence of experience and training on dental students’ examination performance regarding panoramic images.

Physician training has greatly benefitted from insights gained in understanding the manner in which experts search medical images for abnormalities. The aims of this study were to compare the search patterns of 30 fourth-year dental students and 15 certified oral and maxillofacial radiologists (OMRs) over panoramic images and to determine the most robust variables for future studies involving image visualization. Eye tracking was used to capture the eye movement patterns of both subject groups when examining 20 panoramic images classified as normal or abnormal. Abnormal images were further subclassified as having an obvious, intermediate, or subtle abnormality. The images were presented in random order to each participant, and data were collected on duration of the participants’ observations and total distance tracked, time to first eye fixation, and total duration and numbers of fixations on and off the area of interest (AOI). The results showed that the OMRs covered greater distances than the dental students (p<0.001) for normal images. For images of pathosis, the OMRs required less total time (p<0.001), made fewer eye fixations (p<0.01) with fewer saccades (p<0.001) than the students, and required less time before making the first fixation on the AOI (p<0.01). Furthermore, the OMRs covered less distance (p<0.001) than the dental students for obvious pathoses. For investigations of images of pathosis, time to first fixation is a robust parameter in predicting ability. For images with different levels of subtlety of pathoses, the number of fixations, total time spent, and numbers of revisits are important parameters to analyze when comparing observer groups with different levels of experience.

A pilot study of orthopaedic resident self-assessment using a milestones' survey just prior to milestones implementation.

OBJECTIVE: To pilot test if Orthopaedic Surgery residents could self-assess their performance using newly created milestones, as defined by the Accreditation Council on Graduate Medical Education. METHODS: In June 2012, an email was sent to Program Directors and administrative coordinators of the 154 accredited Orthopaedic Surgery Programs, asking them to send their residents a link to an online survey. The survey was adapted from the Orthopaedic Surgery Milestone Project. Completed surveys were aggregated in an anonymous, confidential database. SAS 9.3 was used to perform the analyses. RESULTS: Responses from 71 residents were analyzed. First and second year residents indicated through self-assessment that they had substantially achieved Level 1 and Level 2 milestones. Third year residents reported they had substantially achieved 30/41, and fourth year residents, all Level 3 milestones. Fifth year, graduating residents, reported they had substantially achieved 17 Level 4 milestones, and were extremely close on another 15. No milestone was rated at Level 5, the maximum possible. Earlier in training, Patient Care and Medical Knowledge milestones were rated lower than the milestones reflecting the other four competencies of Practice Based Learning and Improvement, Systems Based Practice, Professionalism, and Interpersonal Communication. The gap was closed by the fourth year. CONCLUSIONS: Residents were able to successfully self-assess using the 41 Orthopaedic Surgery milestones. Respondents' rate improved proficiency over time. Graduating residents report they have substantially, or close to substantially, achieved all Level 4 milestones. Milestone self-assessment may be a useful tool as one component of a program's overall performance assessment strategy.

La carpeta de aprendizaje y la evaluación entre iguales de los estudiantes. Resultados de una innovación docente en los estudios universitarios de las artes

Students reflect more on their learning in course subjects when they participate in managing their teaching–learning environment. As a form of guided participation, peer assessment serves the following purposes: (a) it improves the student’s understanding of previously established learning objectives; (b) it is a powerful metacognitive tool; (c) it transfers to the student part of the responsibility for assessing learning, which means deciding which learning activities are important and choosing the degree of effort a course subject will require; (d) it emphasizes the collective aspect of the nature of knowledge; and (e) the educational benefits derived from peer assessment clearly justify the efforts required to implement activities. This paper reports on the relative merits of a learning portfolio compiled during fine arts-related studies in which peer assessment played an important role. The researchers analyzed the student work load and the final marks students received for compulsory art subjects. They conclude that the use of a closed learning portfolio with a well-structured, sequential and analytical design can have a positive effect on student learning and that, although implementing peer assessment may be complex and students need to become familiar with it, its use is not only feasible but recommendable.

Práticas avaliativas na graduação de enfermagem: percepção de estudantes

A concepção de avaliação que marca a trajetória dos docentes e estudantes é, na maioria das vezes, a que compreende esse processo como um ato de atribuir valor (notas) e de julgamento (certo, errado), de acordo com a aprendizagem do estudante. O docente cumpre uma exigência burocrática e o estudante, comumente vivencia o processo avaliativo passivamente, não dinamizando seu processo de produção do conhecimento. Assim, tem-se como objetivo compreender como os estudantes de Enfermagem percebem e participam das práticas avaliativas desenvolvidas na Graduação de Enfermagem; e compreender como os estudantes de Enfermagem relacionam as práticas avaliativas desenvolvidas no Curso de Enfermagem com o seu processo de ensino e aprendizagem. Para tanto,esta Pesquisa foi aprovada pelo Comitê de Ética em Pesquisa na Área da Saúde – CEPAS/FURG, mediante Parecer 169/2013. Foram mantidos e respeitados os preceitos da Resolução nº 466/2012 do Conselho Nacional de Saúde. Tratou-se de uma pesquisa com abordagem qualitativa descritiva-exploratória, mediante a entrevista semi estruturada com 26 estudantes de Enfermagem de uma universidade pública do sul do país. O processo de análise ocorreu através da Análise Textual Discursiva, composta por quatro focos: processo de unitarização; categorização; captação do novo emergente; e processo autoorganizado do texto. Obteve-se como resultado duas categorias: Percepção de estudantes sobre as práticas avaliativas desenvolvidas na graduação de enfermagem e participação de estudantes nas práticas avaliativas desenvolvidas na graduação de enfermagem. Conclui-se que as reflexões deste estudo possam suscitar uma maior sensibilidade da comunidade acadêmica, melhoria da qualidade dos processos avaliativos desenvolvidos entre professores e estudantes do Curso de Enfermagem e um agir ético nesse ambiente, resultando em benefícios potenciais para a qualidade não só do processo de ensino e aprendizagem, mas também, do exercício profissionalcomo futuros trabalhadores da saúde.

Reliability assessment of a peer evaluation instrument in a team-based learning course

Objective: To evaluate the reliability of a peer evaluation instrument in a longitudinal team-based learning setting. Methods: Student pharmacists were instructed to evaluate the contributions of their peers. Evaluations were analyzed for the variance of the scores by identifying low, medium, and high scores. Agreement between performance ratings within each group of students was assessed via intra-class correlation coefficient (ICC). Results: We found little variation in the standard deviation (SD) based on the score means among the high, medium, and low scores within each group. The lack of variation in SD of results between groups suggests that the peer evaluation instrument produces precise results. The ICC showed strong concordance among raters. Conclusions: Findings suggest that our student peer evaluation instrument provides a reliable method for peer assessment in team-based learning settings.

Evaluation of the quality of the teaching-learning process in undergraduate courses in Nursing

Objective: to identify aspects of improvement of the quality of the teaching-learning process through the analysis of tools that evaluated the acquisition of skills by undergraduate students of Nursing. Method: prospective longitudinal study conducted in a population of 60 second-year Nursing students based on registration data, from which quality indicators that evaluate the acquisition of skills were obtained, with descriptive and inferential analysis. Results: nine items were identified and nine learning activities included in the assessment tools that did not reach the established quality indicators (p<0.05). There are statistically significant differences depending on the hospital and clinical practices unit (p<0.05). Conclusion: the analysis of the evaluation tools used in the article "Nursing Care in Welfare Processes" of the analyzed university undergraduate course enabled the detection of the areas for improvement in the teaching-learning process. The challenge of education in nursing is to reach the best clinical research and educational results, in order to provide improvements to the quality of education and health care.

Educational stress among Chinese adolescents : measurement, risk factors and associations with mental health

Academic pressure among adolescents is a major risk factor for poor mental health and suicide and other harmful behaviours. While this is a worldwide phenomenon, it appears to be especially pronounced in China and other East Asian countries. Despite a growing body of research into adolescent mental health in recent years, the multiple constructs within the ‘educational stress’ phenomenon have not been clearly articulated in Chinese contexts. Further, the individual, family, school and peer influencing factors for educational stress and its associations with adolescent mental health are not well understood. An in-depth investigation may provide important information for the ongoing educational reform in Mainland China with a special focus on students’ mental health and wellbeing. The primary goal of this study was to examine the relative contribution of educational stress to poor mental health, in comparison to other well-known individual, family, school and peer factors. Another important task was to identify significant risk factors for educational stress. In addition, due to the lack of a culturally suitable instrument for educational stress in this population, a new tool – the Educational Stress Scale for Adolescents (ESSA) was initially developed in this study and tested for reliability and validity. A self-administered questionnaire was used to collect information from convenient samples of secondary school students in Shandong, China. The pilot survey was conducted with 347 students (grades 8 and 11) to test the psychometric properties of the ESSA and other scales or questions in the questionnaire. Based on factor analysis and reliability and validity testing, the 16-item scale (the ESSA) with five factors showed adequate to good internal consistency, 2-week test-retest reliability, and satisfactory concurrent and predictive validity. Its factor structure was further demonstrated in the main survey with a confirmatory factor analysis illustrating a good fit of the proposed model based on a confirmatory factor analysis. The reliabilities of other scales and questions were also adequate to be used in this study. The main survey was subsequently conducted with a sample of 1627 secondary school (grades 7-12) students to examine the influencing factors of educational stress and its associations with mental health outcomes, including depression, happiness and suicidal behaviours. A wide range of individual, family, school and peer factors were found to have a significant association with the total ESSA and subscale scores. Most of the strong factors for academic stress were school or study-related, including rural school location, low school connectedness, perceived poor academic grades and frequent emotional conflicts with teachers and peers. Unexpectedly, family and parental factors, such as parental bonding, family connectedness and conflicts with parents were found to have little or no association with educational stress. Educational stress was the most predictive variable for depression, but was not strongly associated with happiness. It had a strong association with suicide ideation but not with suicide attempts. Among five subscales of the ESSA, ‘Study despondency’ score had the strongest associations with these mental health measures. Surprising, two subscales, ‘Self-expectation’ and ‘Worry about grades’ showed a protective effect on suicidal behaviours. An additional analysis revealed that although academic pressure was the most commonly reported reason for suicidal thinking, the occurrence of problems in peer relationships such as peer teasing and bullying, and romantic problems had a much stronger relationship with actual attempts. This study provides some insights into the nature and health implications of educational stress among Chinese adolescents. Findings in this study suggest that interventions on educational stress should focus on school environment and academic factors. Intervention programs focused on educational stress may have a high impact on the prevalence of common mental disorders such as depression. Efforts to increase perceived happiness however should cover a wider range of individual, family and school factors. The importance of healthy peer relationships should be adequately emphasised in suicide prevention. In addition, the newly developed scale (the ESSA) demonstrates sound psychometric properties and is expected to be used in future research into academic-related stress among secondary school adolescents.