Have OSCEs come of age in nursing education?

This article is intended to contribute to the current debate as to whether the objective structured clinical examination (OSCE) should become a standard assessment tool for undergraduate nursing education as they currently are for medicine. The authors describe how one UK university developed an OSCE for a nursing undergraduate programme with the aim of emphasising the need for nursing students to be competent in clinical skills and offering a means of standardising the assessment of these skills. There has been an increasing number of research studies carried out in this area at international level and this article's main contribution to the literature is the description of the Angoff standard-setting procedure that was used to calibrate the OSCE at this University and which makes it the first nursing OSCE in the UK to incorporate a scientific standard-setting procedure.

Factors influencing the output of rural cataract surgical facilities in China: the SHARP study

Purpose: To identify factors associated prospectively with increased cataract surgical rate (CSR) in rural Chinese hospitals.

Methods: Annual cataract surgical output was obtained at baseline and 24 months later from operating room records at 42 rural, county-level hospitals. Total local CSR (cases/million population/y), and proportion of CSR from hospital and local competitors were calculated from government records. Hospital administrators completed questionnaires providing demographic and professional information, and annual clinic and outreach screening volume. Independent cataract surgeons provided clinical information and videotapes of cases for grading by two masked experts using the Ophthalmology Surgical Competency Assessment Rubric (OSCAR). Uncorrected vision was recorded for 10 consecutive cataract cases at each facility, and 10 randomly-identified patients completed hospital satisfaction questionnaires. Total value of international nongovernmental development organization (INGDO) investment in the previous three years and demographic information on hospital catchment areas were obtained. Main outcome was 2-year percentage change in hospital CSR.

Results: Among the 42 hospitals (median catchment population 530,000, median hospital CSR 643), 78.6% (33/42) were receiving INGDO support. Median change in hospital CSR (interquartile range) was 33.3% (-6.25%, 72.3%). Predictors of greater increase in CSR included higher INGDO investment (P = 0.02, simple model), reducing patient dissatisfaction (P = 0.03, simple model), and more outreach patient screening (P = 0.002, simple and multiple model).

Conclusions: Outreach cataract screening was the strongest predictor of increased surgical output. Government and INGDO investment in screening may be most likely to enhance output of county hospitals, a major goal of China's Blindness Prevention Plan.

Undergraduate interprofessional education using high-fidelity paediatric simulation

BACKGROUND: High-fidelity simulation is becoming increasingly important in the delivery of teaching and learning to health care professionals within a safe environment. Its use in an interprofessional context and at undergraduate level has the potential to facilitate the learning of good communication and teamworking, in addition to clinical knowledge and skills.

METHODS: Interprofessional teaching and learning workshops using high-fidelity paediatric simulation were developed and delivered to undergraduate medical and nursing students at Queen's University Belfast. Learning outcomes common to both professions, and essential in the clinical management of sick children, included basic competencies, communication and teamworking skills. Quantitative and qualitative evaluation was undertaken using published questionnaires.

RESULTS: Quantitative results - the 32-item questionnaire was analysed for reliability using spss. Responses were positive for both groups of students across four domains - acquisition of knowledge and skills, communication and teamworking, professional identity and role awareness, and attitudes to shared learning. Qualitative results - thematic content analysis was used to analyse open-ended responses. Students from both groups commented that an interprofessional education (IPE) approach to paediatric simulation improved clinical and practice-based skills, and provided a safe learning environment. Students commented that there should be more interprofessional and simulation learning opportunities.

DISCUSSION: High-fidelity paediatric simulation, used in an interprofessional context, has the potential to meet the requirements of undergraduate medical and nursing curricula. Further research is needed into the long-term benefits for patient care, and its generalisability to other areas within health care teaching and learning.

Improving allied health professionals' research implementation behaviours for children with cerebral palsy: protocol for a before-after study

BACKGROUND: Cerebral palsy is a permanent disorder of posture and movement caused by disturbances in the developing brain. It affects approximately 1 in every 500 children in developed countries and is the most common form of childhood physical disability. People with cerebral palsy may also have problems with speech, vision and hearing, intellectual difficulties and epilepsy. Health and therapy services are frequently required throughout life, and this care should be effective and evidence informed; however, accessing and adopting new research findings into day-to-day clinical practice is often delayed.

METHODS/DESIGN: This 3-year study employs a before and after design to evaluate if a multi-strategy intervention can improve research implementation among allied health professionals (AHPs) who work with children and young people with cerebral palsy and to establish if children's health outcomes can be improved by routine clinical assessment. The intervention comprises (1) knowledge brokering with AHPs, (2) access to an online research evidence library, (3) provision of negotiated evidence-based training and education, and (4) routine use of evidence-based measures with children and young people aged 3-18 years with cerebral palsy. The study is being implemented in four organisations, with a fifth organisation acting as a comparison site, across four Australian states. Effectiveness will be assessed using questionnaires completed by AHPs at baseline, 6, 12 and 24 months, and by monitoring the extent of use of evidence-based measures. Children's health outcomes will be evaluated by longitudinal analyses.

DISCUSSION: Government, policy makers and service providers all seek evidence-based information to support decision-making about how to distribute scarce resources, and families are seeking information to support intervention choices. This study will provide knowledge about what constitutes an efficient, evidence-informed service and which allied health interventions are implemented for children with cerebral palsy.

TRIAL REGISTRATION: Trial is not a controlled healthcare intervention and is not registered.

A Communication Intervention for Training Southern European Oncologists to Recognize Psychosocial Morbidity in Cancer. I - Development of the Model and Preliminary Results on Physicians' Satisfaction

BACKGROUND: The detection of psychosocial distress is a significant communication problem in Southern Europe and other countries. Work in this area is hampered by a lack of data. Because not much is known about training aimed at improving the recognition of psychosocial disorders in cancer patients, we developed a basic course model for medical oncology professionals. METHODS: A specific educational and experiential model (12 hours divided into 2 modules) involving formal teaching (ie, journal articles, large-group presentations), practice in small groups (ie, small-group exercises and role playing), and discussion in large groups was developed with the aim of improving the ability of oncologists to detect emotional disturbances in cancer patients (ie, depression, anxiety, and adjustment disorders). RESULTS: A total of 30 oncologists from 3 Southern European countries (Italy, Portugal, and Spain) participated in the workshop. The training course was well accepted by most participants who expressed general satisfaction and a positive subjective perception of the utility of the course for clinical practice. Of the total participants, 28 physicians (93.3%) thought that had they been exposed to this material sooner, they would have incorporated the techniques received in the workshop into their practices; 2 participants stated they would likely have done so. Half of the doctors (n = 15) believed that their clinical communication techniques were improved by participating in the workshop, and the remaining half thought that their abilities to communicate with cancer patients had improved. CONCLUSIONS: This model is a feasible approach for oncologists and is easily applicable to various oncology settings. Further studies will demonstrate the effectiveness of this method for improving oncologists skills in recognizing emotional disorders in their patients with cancer.

Training medical students to conduct motivational interviewing: a randomized controlled trial.

OBJECTIVE: To examine the effectiveness of motivational interviewing (MI) training among medical students. METHODS: All students (n=131) (year 5) at Lausanne Medical School, Switzerland were randomized into an experimental or a control group. After a training in basic communication skills (control condition), an 8-h MI training was completed by 84.8% students in the exprimental group. One week later, students in both groups were invited to meet with two standardized patients. MI skills were coded by blinded research assistants using the Motivational Interviewing Treatment Integrity 3.0. RESULTS: Superior MI performance was shown for trained versus control students, as demonstrated by higher scores for "Empathy" [p<0.001] and "MI Spirit" [p<0.001]. Scores were similar between groups for "Direction", indicating that students in both groups invited the patient to talk about behavior change. Behavior counts assessment demonstrated better performance in MI in trained versus untrained students regarding occurences of MI-adherent behavior [p<0.001], MI non-adherent behavior [p<0.001], Closed questions [p<0.001], Open questions [p=0.001], simple reflections [p=0.03], and Complex reflections [p<0.001]. Occurrences were similar between groups regarding "Giving information". CONCLUSION: An 8-h training workshop was associated with improved MI performance. PRACTICE IMPLICATIONS: These findings lend support for the implementation of MI training in medical schools.

Reforms of the pre-graduate curriculum for medical students: the Bologna process and beyond.

For several years, all five medical faculties of Switzerland have embarked on a reform of their training curricula for two reasons: first, according to a new federal act issued in 2006 by the administration of the confederation, faculties needed to meet international standards in terms of content and pedagogic approaches; second, all Swiss universities and thus all medical faculties had to adapt the structure of their curriculum to the frame and principles which govern the Bologna process. This process is the result of the Bologna Declaration of June 1999 which proposes and requires a series of reforms to make European Higher Education more compatible and comparable, more competitive and more attractive for Europeans students. The present paper reviews some of the results achieved in the field, focusing on several issues such as the shortage of physicians and primary care practitioners, the importance of public health, community medicine and medical humanities, and the implementation of new training approaches including e-learning and simulation. In the future, faculties should work on several specific challenges such as: students' mobility, the improvement of students' autonomy and critical thinking as well as their generic and specific skills and finally a reflection on how to improve the attractiveness of the academic career, for physicians of both sexes.

Construction d'une échelle décrivant les niveaux de compétence de collaboration, à partir d'indicateurs validés par des enseignants cliniciens en médecine

La collaboration est une compétence essentielle que les futurs médecins doivent développer. La détermination des niveaux de compétence est cruciale dans la planification de cet apprentissage. Les échelles descriptives suscitent un intérêt croissant, car elles décrivent en termes qualitatifs les performances attendues. Nous inspirant de la méthodologie mixte de Blais, Laurier, & Rousseau (2009), nous avons construit en cinq étapes une échelle de niveau de compétence de collaboration: 1) formulation d’une liste d’indicateurs situés à quatre niveaux de la formation médicale (préclinique, externat, résidence junior et sénior) par les chercheurs (n= 3) et un groupe d’éducateurs (n=7), leaders pédagogiques possédant une expertise pour la compétence de collaboration; 2) sondage en ligne comprenant quatre questionnaires portant sur les niveaux de 118 indicateurs, auprès d’enseignants cliniciens représentant les différentes spécialités (n=277); 3) analyse, avec le modèle partial credit de Rasch, des réponses aux questionnaires appariés par calibration concurrente; 4) détermination des niveaux des indicateurs par les éducateurs et les chercheurs; et 5) rédaction de l’échelle à partir des indicateurs de chaque niveau. L’analyse itérative des réponses montre une adéquation au modèle de Rasch et répartit les indicateurs sur l’échelle linéaire aux quatre niveaux. Les éducateurs déterminent le niveau des 111 indicateurs retenus en tenant compte des résultats du sondage et de la cohérence avec le curriculum. L’échelle comporte un paragraphe descriptif par niveau, selon trois capacités : 1) participer au fonctionnement d’une équipe; 2) prévenir et gérer les conflits; et 3) planifier, coordonner et dispenser les soins en équipe. Cette échelle rend explicites les comportements collaboratifs attendus à la fin de chaque niveau et est utile à la planification de l’apprentissage et de l’évaluation de cette compétence. La discordance entre les niveaux choisis par les éducateurs et ceux issus de l’analyse des réponses des enseignants cliniciens est principalement due au faible choix de réponse du niveau préclinique par les enseignants et aux problèmes d’adéquation pour les indicateurs décrivant la gestion des conflits. Cette recherche marque une avan- cée dans la compréhension de la compétence de collaboration et démontre l’efficacité de la méthodologie de Blais (2009) dans un contexte de compétence transversale, en sciences de la santé. Cette méthodologie pourrait aider à approfondir les trajectoires de développement d’autres compétences.

Concordancia de presión sistólica pulmonar estimada por ultrasonografía y cateterismo cardíaco derecho en pacientes candidatos a trasplante cardíaco

Introducción: A los pacientes con Insuficiencia Cardíaca (IC) estadio D candidatos a trasplante cardiaco se les realiza la determinación de las presiones de la arteria pulmonar por CCD considerada como prueba de oro. Se decidió conocer si la medición de las presión de la arteria pulmonar obtenidas por ECO TT tenían concordancia con las obtenidas por el CCDen estos paciente que fueron evaluados para trasplante cardiaco. Metodología: Se realizó una recolección retrospectiva de los datos consignados en las historias clínicas de todos los pacientes que fueron receptores de un trasplante cardiaco en la FCI-IC desde septiembre del 2005 hasta Mayo del 2013 y se determinó la concordancia entre la presión sistólica pulmonar evaluado por ECO TT y CCD. Resultados: Se incluyeron 46 pacientes. El 76,1% son hombres y con edad promedio de 46,4 ± 13,1. La PSAP estimada por CCD fue 48,3 ± 13,1 mmHg Vs 45,1 ± 12,1 mmHg por ECO TT. La fracción de eyección fue 15,1 ± 4,06% (IC: 13,95-16,36). El 75,9% de los pacientes tenían HTP moderada y severa. La concordancia entre la PSAP determinada por ambos métodos fue 0,475 (I,C: 0.256 - 0.694), y el coeficiente de correlación intraclase fue de 0,090, indicando una baja concordancia entre los dos métodos. Discusión: La determinación de las presiones pulmonares determinada por ECO TT tiene mala concordancia con las obtenidas por CCD. No se debe usar este estudio para excluir los pacientes candidatos a trasplante cardiaco ni para evaluar las variaciones de las misma en la evolución de la enfermedad.

La importancia de la evaluación por competencias en contextos clínicos dentro de la docencia universitaria en Salud

La evaluación por competencias (ExC) ha renovado la manera de determinar el desempeño clínico de los profesionales en Salud. Para tal efecto, el docente universitario requiere del dominio conceptual y metodológico de las distintas técnicas de evaluación formativa. Este artículo da cuenta de las principales técnicas de evaluación por competencias en escenarios clínicos, concibiéndola como una competencia fundamental para la docencia universitaria en Salud.

The Cognitive Behaviour Therapy Scale for Children and Young People (CBTS-CYP): development and psychometric properties

Background: There is increased interest in developing training in cognitive behaviour therapy (CBT) with children and young people. However, the assessment of clinical competence has relied upon the use of measures such as the Cognitive Therapy Scale-Revised (CTSR: Blackburn et al., 2001) which has been validated to assess competence with adults. The appropriateness of this measure to assess competence when working with children and young people has been questioned. Aim: This paper describes the development and initial evaluation of the Cognitive Behaviour Therapy Scale for Children and Young People (CBTSCYP) developed specifically to assess competence in CBT with children and young people. Method: A cross section of child CBT practitioners (n = 61) were consulted to establish face validity. Internal reliability, convergent validity and discriminative ability were assessed in two studies. In the first, 12 assessors independently rated a single video using both the Cognitive Behaviour Therapy Scale for Children and Young People (CBTS-CYP) and Cognitive Therapy Scale-Revised (CTS-Revised: Blackburn et al., 2001). In the second, 48 different recordings of CBT undertaken with children and young people were rated on both the CBTS-CYP and CTS-R. Results: Face validity and internal reliability of the CBTS-CYP were high, and convergent validity with the CTS-R was good. The CBTS-CYP compared well with the CTSR in discriminative ability. Conclusion: The CBTS-CYP provides an appropriate way of assessing competence in using CBT with children and young people. Further work is required to assess robustness with younger children and the impact of group training in reducing interrater variations.

Balancing the role of the dental school in teaching, research and patient care; including care for underserved areas

Inequalities within dentistry are common and are reflected in wide differences in the levels of oral health and the standard of care available both within and between countries and communities. Furthermore there are patients, particularly those with special treatment needs, who do not have the same access to dental services as the general public. The dental school should aim to recruit students from varied backgrounds into all areas covered by the oral healthcare team and to train students to treat the full spectrum of patients including those with special needs. It is essential, however, that the dental student achieves a high standard of clinical competence and this cannot be gained by treating only those patients with low expectations for care. Balancing these aspects of clinical education is difficult. Research is an important stimulus to better teaching and better clinical care. It is recognized that dental school staff should be active in research, teaching, clinical work and frequently administration. Maintaining a balance between the commitments to clinical care, teaching and research while also taking account of underserved areas in each of these categories is a difficult challenge but one that has to be met to a high degree in a successful, modern dental school.

Multiple mini-interview : how long is long enough?

Objectives The multiple mini-interview (MMI) overcomes the limitations of the traditional panel interview by multiple sampling to provide improved objectivity and reliability. Reliability of the MMI is affected by number of stations; however, there are few data reporting the influence of interview duration on MMI outcome and reliability. We aimed to determine whether MMI stations can be shortened without affecting applicant rankings or compromising test reliability.
Methods A total of 175 applicants were interviewed and assessed at 10 8-minute stations. Applicants were scored once after 8 minutes at five control stations and twice after 5 minutes and 8 minutes at five experimental stations. Scores at 5 and 8 minutes were compared using t-tests and correlation coefficients. Rankings of applicants based on 5- and 8-minute scores were compared using Spearman's rank order coefficient. The reliability of the MMI was examined for 5- and 8-minute scores using generalisability theory.
Results Mean scores at 5 minutes were lower than mean scores at 8 minutes. Cumulative scores at 5 minutes were also lower. There were highly significant correlations between 5- and 8-minute scores at all experimental stations (0.82–0.91; P < 0.01) and between the cumulative scores at 5 and 8 minutes (0.92; P < 0.01). There was a strong correlation between applicant rankings based on cumulative 5- and 8-minute scores (Spearman's rank order coefficient 0.92). Reliability was not affected.
Conclusions Reducing the duration of MMI stations from 8 to 5 minutes conserves resources with minimal effect on applicant ranking and test reliability.