Simulated Patient as Co-facilitators: Benefits and Challenges of the Interprofessional Team OSCE (Submission #9350).

Hypothesis: The quality of care for chronic patients depends on the collaborative skills of the healthcare providers.1,2 The literature lacks reports of the use of simulation to teach collaborative skills in non-acute care settings. We posit that simulation offers benefits for supporting the development of collaborative practice in non-acute settings. We explored the benefits and challenges of using an Interprofessional Team - Objective Structured Clinical Examination (IT-OSCE) as a formative assessment tool. IT-OSCE is an intervention which involves an interprofessional team of trainees interacting with a simulated patient (SP) enabling them to practice collaborative skills in non-acute care settings.5 A simulated patient are people trained to portray patients in a simulated scenario for educational purposes.6,7 Since interprofessional education (IPE) ultimately aims to provide collaborative patient-centered care.8,9 We sought to promote patient-centeredness in the learning process. Methods: The IT-OSCE was conducted with four trios of students from different professions. The debriefing was co-facilitated by the SP with a faculty. The participants were final-year students in nursing, physiotherapy and medicine. Our research question focused on the introduction of co-facilitated (SP and faculty) debriefing after an IT-OSCE: 1) What are the benefits and challenges of involving the SP during the debriefing? and 2) To evaluate the IT-OSCE, an exploratory case study was used to provide fine grained data 10, 11. Three focus groups were conducted - two with students (n=6; n=5), one with SPs (n=3) and one with faculty (n=4). Audiotapes were transcribed for thematic analysis performed by three researchers, who found a consensus on the final set of themes. Results: The thematic analysis showed little differentiation between SPs, student and faculty perspectives. The analysis of transcripts revealed more particularly, that the SP's co-facilitation during the debriefing of an IT-OSCE proved to be feasible. It was appreciated by all the participants and appeared to value and to promote patient-centeredness in the learning process. The main challenge consisted in SPs feedback, more particularly in how they could report accurate observations to a students' group rather than individual students. Conclusion: In conclusion, SP methodology using an IT-OSCE seems to be a useful and promising way to train collaborative skills, aligning IPE, simulation-based team training in a non-acute care setting and patient-centeredness. We acknowledge the limitations of the study, especially the small sample and consider the exploration of SP-based IPE in non-acute care settings as strength. Future studies could consider the preparation of SPs and faculty as co-facilitators. References: 1. Borrill CS, Carletta J, Carter AJ, et al. The effectiveness of health care teams in the National Health Service. Aston centre for Health Service Organisational Research. 2001. 2. Reeves S, Lewin S, Espin S, Zwarenstein M. Interprofessional teamwork for health and social care. Oxford: Wiley-Blackwell; 2010. 3. Issenberg S, McGaghie WC, Petrusa ER, Gordon DL, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning - a BEME systematic review. Medical Teacher. 2005;27(1):10-28. 4. McGaghie W, Petrusa ER, Gordon DL, Scalese RJ. A critical review of simulation-based medical education research: 2003-2009. Medical Education. 2010;44(1):50-63. 5. Simmons B, Egan-Lee E, Wagner SJ, Esdaile M, Baker L, Reeves S. Assessment of interprofessional learning: the design of an interprofessional objective structured clinical examination (iOSCE) approach. Journal of Interprofessional Care. 2011;25(1):73-74. 6. Nestel D, Layat Burn C, Pritchard SA, Glastonbury R, Tabak D. The use of simulated patients in medical education: Guide Supplement 42.1 - Viewpoint. Medical teacher. 2011;33(12):1027-1029. Disclosures: None (C) 2014 by Lippincott Williams & Wilkins, Inc.

Participação de estudantes de medicina como avaliadores em exame estruturado de habilidades clínicas (Osce)

Descrevem-se duas experiências realizadas com o objetivo de verificar se estudantes de Medicina de etapas avançadas podem ser utilizados em Osce para avaliar habilidades clínicas básicas de alunos iniciantes. Na primeira experiência, 6 internos e 6 professores avaliaram 59 alunos do currículo tradicional em Osce com 6 estações focadas na anamnese, exame físico e comunicação com o paciente. As notas dadas pelos professores foram maiores que as dos estudantes em todas as estações, exceto uma (comunicação), mas não houve diferenças significantes entre elas, exceto numa estação de exame físico (p < 0,001) (teste de Wilcoxon). Na segunda experiência, 15 internos do currículo tradicional e 9 professores avaliaram 58 estudantes do 1º ano, currículo PBL, em Osce com 3 estações para avaliar anamnese, exame físico e manipulação de luvas esterilizadas. Os estudantes foram pareados aos professores, e cada um fez sua avaliação individualizada usando o mesmo protocolo. Em metade das estações, os valores médios das notas de professores e estudantes foram significativamente diferentes. Isso aparentemente se deveu à variação significativa entre as notas dos professores, o que não ocorreu com relação às notas dadas pelos estudantes avaliadores (p < 0,05) (teste de Wilcoxon e Anova - Turkey, Dunn). Conclui-se que estudantes em fase de treinamento podem ser utilizados como examinadores confiáveis em exame de habilidades clínicas de estudantes iniciantes, sendo que a variabilidade entre as notas que atribuem para a mesma tarefa parece ser inferior à que se verifica nas notas dos professores.

OSCE para Competências de Comunicação Clínica e Profissionalismo: Relato de Experiência e Meta-Avaliação

RESUMO A comunicação clínica e o profissionalismo estão entre as principais competências médicas e, portanto, devem ter sua avaliação garantida. Nesse contexto, o exame clínico objetivo estruturado (OSCE) tem papel fundamental. Objetivos Descrever as etapas de elaboração de um OSCE, bem como a avaliação da qualidade das estações e a percepção do estudante de Medicina sobre a sua realização. Método O estudo é composto pela realização de um OSCE com quatro estações por 16 estudantes de Medicina e pela análise da qualidade psicométrica e aplicação de um questionário de satisfação. Resultados Para os estudantes, o OSCE é o método que melhor avalia e ensina essas competências, ao passo que os testes de múltipla escolha estão no polo oposto quanto à avaliação. Em relação à qualidade múltipla das estações: duas se apresentaram com boa confiabilidade, uma se tornou satisfatória após adequação e uma se revelou inconsistente. Conclusão Mesmo bem avaliadas pelos estudantes, algumas estações apresentaram falhas. A análise do OSCE é fundamental para sua validade e mensurabilidade, em especial para o OSCE de alta aposta.

Metodologias Ativas em Fisioterapia: Estudo de Confiabilidade Interexaminador do Método Osce

RESUMO O presente estudo relata a experiência da aplicação do Exame Clínico Objetivo Estruturado (do inglês Objective Structured Clinical Examination – Osce) em um curso de Fisioterapia e demonstrar a confiabilidade interexaminador dos instrumentos de avaliação da simulação de atendimento fisioterapêutico. Participaram do estudo 29 estudantes regularmente matriculados no sétimo período do curso de Fisioterapia da Faculdade de Ciências da Saúde do Trairi, da Universidade Federal do Rio Grande do Norte (Facisa/UFRN). Foram elaboradas quatro estações de casos clínicos referentes à área de aparelho locomotor; para cada estação, havia um instrumento de avaliação da simulação do atendimento fisioterapêutico com as opções de resposta “sim”, “não” e “insuficiente”, com avaliação realizada por dois docentes em cada estação. O aluno teve sete minutos em cada estação para realizar a tarefa clínica, sendo que quatro alunos foram avaliados simultaneamente. Houve diferença significativa na distribuição de notas entre as estações 1 e 2 (p < 0,001) e 1 e 3 (p = 0,001). Verificou-se confiabilidade interexaminador excelente nas estações 1 (CCI = 0,89), 2 (CCI = 0,99) e 3 (CCI = 0,99), enquanto na estação 4 a confiabilidade interexaminador foi satisfatória (CCI = 0,73). Dessa forma, os achados indicam que o Osce na prática fisioterapêutica possui confiabilidade interexaminador de satisfatória a excelente, independentemente do perfil de ensino-aprendizagem e do instrumento de avaliação adotado, podendo ser um método útil para o processo avaliativo da formação profissional em saúde.

Quality Control for SP Performance Regarding Patient Portrayal in a High-Stakes OSCE

Introduction Since the quality of patient portrayal of standardized patients (SPs) during an Objective Structured Clinical Exam (OSCE) has a major impact on the reliability and validity of the exam, quality control should be initiated. Literature about quality control of SP’s performance focuses on feedback [1, 2] or completion of checklists [3, 4]. Since we did not find a published instrument meeting our needs for the assessment of patient portrayal, we developed such an instrument after being inspired by others [5] and used it in our high-stakes exam. Methods SP trainers from all five Swiss medical faculties collected and prioritized quality criteria for patient portrayal. Items were revised with the partners twice, based on experiences during OSCEs. The final instrument contains 14 criteria for acting (i.e. adequate verbal and non-verbal expression) and standardization (i.e. verbatim delivery of the first sentence). All partners used the instrument during a high-stakes OSCE. Both, SPs and trainers were introduced to the instrument. The tool was used in training (more than 100 observations) and during the exam (more than 250 observations). FAIR_OSCE The list of items to assess the quality of the simulation by SPs was primarily developed and used to provide formative feedback to the SPs in order to help them to improve their performance. It was therefore named “Feedbackstruckture for the Assessment of Interactive Role play in Objective Structured Clinical Exams (FAIR_OSCE). It was also used to assess the quality of patient portrayal during the exam. The results were calculated for each of the five faculties individually. Formative evaluation was given to the five faculties with individual feedback without revealing results of other faculties other than overall results. Results High quality of patient portrayal during the exam was documented. More than 90% of SP performances were rated to be completely correct or sufficient. An increase in quality of performance between training and exam was noted. In example the rate of completely correct reaction in medical tests increased from 88% to 95%. 95% completely correct reactions together with 4% sufficient reactions add up to 99% of the reactions meeting the requirements of the exam. SP educators using the instrument reported an augmentation of SPs performance induced by the use of the instrument. Disadvantages mentioned were high concentration needed to explicitly observe all criteria and cumbersome handling of the paper-based forms. Conclusion We were able to document a very high quality of SP performance in our exam. The data also indicate that our training is effective. We believe that the high concentration needed using the instrument is well invested, considering the observed augmentation of performance. The development of an iPad based application for the form is planned to address the cumbersome handling of the paper.