The new final Clinical Skills examination in human medicine in Switzerland: Essential steps of exam development, implementation and evaluation, and central insights from the perspective of the national Working Group

Objective: Since 2011, the new national final examination in human medicine has been implemented in Switzerland, with a structured clinical-practical part in the OSCE format. From the perspective of the national Working Group, the current article describes the essential steps in the development, implementation and evaluation of the Federal Licensing Examination Clinical Skills (FLE CS) as well as the applied quality assurance measures. Finally, central insights gained from the last years are presented. Methods: Based on the principles of action research, the FLE CS is in a constant state of further development. On the foundation of systematically documented experiences from previous years, in the Working Group, unresolved questions are discussed and resulting solution approaches are substantiated (planning), implemented in the examination (implementation) and subsequently evaluated (reflection). The presented results are the product of this iterative procedure. Results: The FLE CS is created by experts from all faculties and subject areas in a multistage process. The examination is administered in German and French on a decentralised basis and consists of twelve interdisciplinary stations per candidate. As important quality assurance measures, the national Review Board (content validation) and the meetings of the standardised patient trainers (standardisation) have proven worthwhile. The statistical analyses show good measurement reliability and support the construct validity of the examination. Among the central insights of the past years, it has been established that the consistent implementation of the principles of action research contributes to the successful further development of the examination. Conclusion: The centrally coordinated, collaborative-iterative process, incorporating experts from all faculties, makes a fundamental contribution to the quality of the FLE CS. The processes and insights presented here can be useful for others planning a similar undertaking. Keywords: national final examination, licensing examination, summative assessment, OSCE, action research

Kompetenzorientierte Evaluation = Kompetenzorientierte Lehre? Kann eine kompetenzorientierte Evaluation die Haltung der Lehrenden zur kompetenzorientierten Lehre verändern?

In dem Beitrag wurden wurde die hochschulpolitische Ausgangslage sowie der aktuelle Stand zur Umsetzung von kompetenzorientierter Lehre an deutschen Hochschulen betrachtet. Es wurde aufgezeigt, dass eine ergebnisorientierte Evaluation zu einer Haltungsänderung bei Lehrenden führen kann. Chancen und Herausforderungen einer ergebnisorientierten Evaluation wurden besprochen und folgende Fragen diskutiert: Führt kompetenzorientierte Evaluation zu einer verbesserten Akzeptanz von Lernergebnissen und wird somit eine kompetenzorientierte Lehre befördert? Oder führt sie zu einer ungewünschten Gegenreaktion, die eine Abwehrhaltung bei den Lehrenden herbeiführt?

European university-based study programmes in evaluation: characteristics and future challenges

This chapter examines the state of evaluation training programs at European universities in 2012. It summarises the results of a survey that was conducted among representatives of 15 programs located in Belgium, Denmark, Greece, Italy, France, The Netherlands, Romania, Spain, Sweden and Switzerland. Some basic information about the programs are reported (e.g. organising body, degree offered, admission requirements, duration in months, price), as well as the programs’ core subjects and learning outcomes. The chapter discusses the challenges for university-based study programmes that arise from the current situation of the evaluation profession, and concludes with some thoughts on education and training as requirements for professionalisation in evaluation

Evaluation of Medical Students’ Attitudes and Performance of Basic Surgery Skills in a Training Program Using Fresh Human skin, Excised During Body Contouring Surgeries

BACKGROUND: Learning surgical skills in the operating room may be a challenge for medical students. Therefore, more approaches using simulation to enable students to develop their practical skills are required. OBJECTIVES: We hypothesized that (1) there would be a need for additional surgical training for medical students in the pre-final year, and (2) our basic surgery skills training program using fresh human skin would improve medical students' surgical skills. DESIGN: We conducted a preliminary survey of medical students to clarify the need for further training in basic surgery procedures. A new approach using simulation to teach surgical skills on human skin was set up. The procedural skills of 15 randomly selected students were assessed in the operating room before and after participation in the simulation, using Objective Structured Assessment of Technical Skills. Furthermore, subjective assessment was performed based on students' self-evaluation. The data were analyzed using SPSS, version 21 (SPSS, Inc., Chicago, IL). SETTING: The study took place at the Inselspital, Bern University Hospital. PARTICIPANTS: A total of 186 pre-final-year medical students were enrolled into the preliminary survey; 15 randomly selected medical students participated in the basic surgical skills training course on the fresh human skin operating room. RESULTS: The preliminary survey revealed the need for a surgical skills curriculum. The simulation approach we developed showed significant (p < 0.001) improvement for all 12 surgical skills, with mean cumulative precourse and postcourse values of 31.25 ± 5.013 and 45.38 ± 3.557, respectively. The self-evaluation contained positive feedback as well. CONCLUSION: Simulation of surgery using human tissue samples could help medical students become more proficient in handling surgical instruments before stepping into a real surgical situation. We suggest further studies evaluating our proposed teaching method and the possibility of integrating this simulation approach into the medical school curriculum.

Long-term evaluation of Class II subdivision treatment with unilateral maxillary first molar extraction

OBJECTIVE To evaluate the long-term effects of asymmetrical maxillary first molar (M1) extraction in Class II subdivision treatment. MATERIALS AND METHODS Records of 20 Class II subdivision whites (7 boys, 13 girls; mean age, 13.0 years; SD, 1.7 years) consecutively treated with the Begg technique and M1 extraction, and 15 untreated asymmetrical Class II adolescents (4 boys, 11 girls; mean age, 12.2 years; SD, 1.3 years) were examined in this study. Cephalometric analysis and PAR assessment were carried out before treatment (T1), after treatment (T2), and on average 2.5 years posttreatment (T3) for the treatment group, and at similar time points and average follow-up of 1.8 years for the controls. RESULTS The adjusted analysis indicated that the maxillary incisors were 2.3 mm more retracted in relation to A-Pog between T1 and T3 (β  =  2.31; 95% CI; 0.76, 3.87), whereas the mandibular incisors were 1.3 mm more protracted (β  =  1.34; 95% CI; 0.09, 2.59), and 5.9° more proclined to the mandibular plane (β  =  5.92; 95% CI; 1.43, 10.41) compared with controls. The lower lip appeared 1.4 mm more protrusive relative to the subnasale-soft tissue-Pog line throughout the observation period in the treated adolescents (β  =  1.43; 95% CI; 0.18, 2.67). There was a significant PAR score reduction over the entire follow-up period in the molar extraction group (β  =  -6.73; 95% CI; -10.7, -2.7). At T2, 65% of the subjects had maxillary midlines perfectly aligned with the face. CONCLUSIONS Unilateral M1 extraction in asymmetrical Class II cases may lead to favorable occlusal outcomes in the long term without harming the midline esthetics and soft tissue profile.

Evaluation of the effectiveness of the Fresh and Healthy Program

Background. Diets high in fat and calories are promoted by the toxic food environment in which high fat, high calorie foods are readily accessible, thus contributing to high rates of overweight and obesity.^ Hypothesis. Changing the food environment to make low-fat, low-calorie foods readily identifiable and accessible while simultaneously offering incentives for choosing those foods will result in increased consumption of targeted foods, thus decreasing caloric and fat intake and ultimately decreasing obesity rates.^ Objective. To conduct an outcome evaluation study on the effectiveness of The Fresh & Healthy Program, a health promotion project designed to promote healthy eating among The Methodist Hospital employees by labeling and promoting low calorie, low fat items in the hospital cafeteria. ^ Program. By promoting healthy eating, this program seeks to address unhealthy dietary behaviors, one of the most widely known and influential behavioral causes of obesity. Food items that are included in the program meet nutritional criteria for calories and fat and are labeled with a special logo. Program participants receive incentives for purchasing Fresh & Healthy items. The program was designed and implemented by a team of registered dietitians, two health education specialists, and retail foodservice managers at The Methodist Hospital in the Texas Medical Center in Houston and has been in existence since April 2006.^ Methods. The evaluation uses a non-randomized, one-group, time series design to evaluate the effect of the program on sales of targeted food items.^ Key words. point-of-purchase, menu labeling, environmental obesity interventions, food pricing interventions ^

Incident hypertension among pre-hypertensive adolescents: Evaluation of pre-hypertension as an independent risk factor among secondary school students in the Houston area

Cardiovascular disease has been the leading cause of death in the United States for over fifty years. While multiple risk factors for cardiovascular disease have been identified, hypertension is one of the most commonly recognized and treatable. Recent studies indicate that the prevalence of hypertension among children and adolescents is between 3-5%, much higher than originally estimated and likely rising due to the epidemic of obesity in the U.S. In 2004, the National High Blood Pressure Education Program Working Group on High Blood Pressure in Children and Adolescents published new guidelines for the diagnosis and treatment of hypertension in this population. Included in these recommendations was the creation of a new diagnosis, pre-hypertension, aimed at identifying children at-risk for hypertension to provide early lifestyle interventions in an effort to prevent its ultimate development. In order to determine the risk associated with pre-hypertension for the development of incident HTN, a secondary analysis of a repeated cross-sectional study measuring blood pressure in Houston area adolescents from 2000 to 2007 was performed. Of 1006 students participating in the blood pressure screening on more than one occasion not diagnosed with hypertension at initial encounter, eleven were later found to have hypertension providing an overall incident rate of 0.5% per year. Incidence rates were higher among overweight adolescents–1.9% per year [IRR 8.6 (1.97, 51.63)]; students “at-risk for hypertension” (pre-hypertensive or initial blood pressure in the hypertensive range but falling on subsequent measures)–1.4% per year [IRR 4.77 (1.21, 19.78)]; and those with blood pressure ≥90th percentile on three occasions–6.6% per year [IRR 21.87 (3.40, 112.40)]. Students with pre-hypertension as currently defined by the Task Force did have an increased rate of hypertension (1.1% per year) but it did not reach statistical significance [IRR 2.44 (0.42, 10.18)]. Further research is needed to determine the morbidity and mortality associated with pre-hypertension in this age group as well as the effectiveness of various interventions for preventing the development of hypertensive disease among these at-risk individuals. ^

A formative evaluation of the American Diabetes Association's Choosing Health and Sensible Exercise childhood obesity intervention

Background. The increasing prevalence of overweight among youth in the United States, and the parallel rise in related medical comorbidities has led to a growing need for efficient weight-management interventions. Purpose. The aim of this study was to evaluate the effects of the Choosing Health and Sensible Exercise (C.H.A.S.E.) childhood obesity prevention program on Body Mass Index (BMI), physical activity and dietary behaviors. Methods. This study utilized de-identified data collected during the fall 2006 session of the C.H.A.S.E. program. A total of 65 students at Woodview Elementary School and Deepwater Elementary School participated in this intervention. The C.H.A.S.E. program is a 10-week obesity prevention program that focuses on nutrition and physical activity education. Collection of height and weight data, and a health behavior survey was conducted during the first and last week of the intervention. Paired t-tests were used to determine statistically significant differences between pre- and post-intervention measurements. One-way analysis of variance was used to adjust for potential confounders, such as gender, age, BMI category ("normal weight", "at risk overweight", or "overweight"), and self-reported weight loss goals. Data were analyzed using STATA, v. 9.2. Results. A significant decrease in mean BMI (p< 0.05) was found after the 10-week intervention. While the results were statistically significant for the group as a whole, changes in BMI were not significant when stratified by age, sex, or ethnicity. The mean overall scores for the behavior survey did not change significantly pre- and post-intervention; however, significant differences were found in the dietary intention scale, indicating that students were more likely to intend to make healthier food choices (p<0.05). No statistically significant decreases in BMI were found when stratified for baseline BMI-for-age percentiles or baseline weight loss efforts (p>0.05). Conclusion. The results of this evaluation provide information that will be useful in planning and implementing an effective childhood obesity intervention in the future. Changes in the self-reported dietary intentions and BMI show that the C.H.A.S.E. program is capable of modifying food choice selection and decreasing BMI. Results from the behavior questionnaire indicate that students in the intervention program were making changes in a positive direction. Future implementation of the C.H.A.S.E. program, as well as other childhood obesity interventions, may want to consider incorporating additional strategies to increase knowledge and other behavioral constructs associated with decreased BMI. In addition, obesity prevention programs may want to increase parental involvement and increase the dose or intensity of the intervention. ^

Evaluation of a pilot diabetes educational intervention using the American Diabetes Association's Risk Assessment form with the patrons of The Health Museum, Houston Texas

Diabetes Mellitus is not a disease, but a group of diseases. Common to all types of diabetes is high levels of blood glucose produced from a variety of causes. In 2006, the American Diabetes Association ranked diabetes as the fifth leading cause of death in the United States. The complications and consequences are serious and include nephropathy, retinopathy, neuropathy, heart disease, amputations, pregnancy complications, sexual dysfunction, biochemical imbalances, susceptibility and sensitivity to many other diseases and in some cases death. ^ The serious nature of diabetes mellitus and its complications has compelled researchers to devise new strategies to reach population segments at high risk. Various avenues of outreach have been attempted. This pilot program is not unique in using a health museum as a point of outreach. However health museums have not been a major source of interventions, either. Little information was available regarding health museum visitor demographics, visitation patterns, companion status and museum trust levels prior to this pilot intervention. This visitor information will improve planning for further interventions and studies. ^ This thesis also examined prevalence data in a temporal context, the populations at risk for diabetes, the collecting agencies, and other relevant collected data. The prevalence of diabetes has been rapidly increasing. The increase is partially explained by refinement of the definition of diabetes as the etiology has become better understood. Increasing obesity and sedentary lifestyles have contributed to the increase, as well as the burdensome increase on minority populations. ^ Treatment options are complex and have had limited effectiveness. This would lead one to conclude that prevention and early diagnosis are preferable. However, the general public has insufficient awareness and education regarding diabetes symptoms and the serious risks and complications the disease can cause. Reaching high risk, high prevalence, populations is challenging for any intervention. During its “free family Thursdays” The Health Museum (Houston, Texas) has attracted a variety of ethnic patrons; similar to the Houston and Harris County demographics. This research project explored the effectiveness of a pilot diabetes educational intervention in a health museum setting where people chose to visit. ^

Evaluation of the association between cryptosporidiosis outbreaks and two interactive water fountain parks: Epidemiologic analysis and implications for public health

Background. A community-wide outbreak of cryptosporidiosis occurred in Dallas County during the summer of 2008. A subset of cases occurring with onset of illness within a 2 week interval was epidemiologically linked to 2 neighborhood interactive water fountain parks. ^ Methods. A case control study was conducted to evaluate risk factors associated with developing illness with cryptosporidiosis from the fountain parks. Cases were selected from a line list from the epidemiological study. The selection for the controls was either healthy family members or a daycare center nearby. Cases and controls were not matched. ^ Results. Interviews were completed for 44 fountain park attendees who met case definition and 54 community controls. Twenty-seven percent (27.3%) of the cases and 13.0% of the controls were between the ages of 0–4 years. Thirty-nine percent (38.6%) of the cases and 24.1% of the controls were between the ages of 5–13 years. Fourteen percent (13.6%) of the cases and 33.3% of the controls were between the ages of 14–31 years. Twenty percent (20.5%) of the cases and 29.6% of the controls were between the ages of 32–63 years. 47.7% of the cases and 42.6% of the controls were males. Fountain park attendees who reported having been splashed in the face with water were 10 times more likely to become ill than controls (OR = 10.0, 95% CI = 2.8–35.1). Persons who reported having swallowed water from the interactive fountains were 34 times more likely to become ill than controls (OR = 34.3, 95%CI = 9.3–125.7). ^ Conclusion. Prompt reporting of cases, identification of outbreak sources, and immediate implementation of remediation measures were critical in curtailing further transmission from these particular sites through the remainder of the season. This investigation underscores the potential for cryptosporidiosis outbreaks to occur in interactive fountain parks, and the need for enhanced preventive measures in these settings. Education of the public regarding avoidance of behaviors such as drinking water from interactive fountains is also an important component of public health prevention efforts. ^

The association between classroom characteristics and student physical activity in physical education classrooms

Background. With the rapid rise in childhood obesity, physical activity participation among young children has become the subject of much recent attention. Physical education classes have been specifically targeted as a method of providing opportunities for all children to be active. Unfortunately, student participation in moderate-to-vigorous physical activity during these classes still falls far below the current recommendations. While some research to date has reported the levels of activity among elementary-aged children, research is limited on the relationship between these activity levels and the environmental characteristics that exist within the PE classroom. ^ Purpose. The purpose of this study is to examine the association between specific classroom characteristics and contextual characteristics (lesson context, class size, class location, teacher gender, and teacher encouragement for PA) with elementary aged children's moderate-to-vigorous activity during PE class. ^ Methods. A secondary analysis of 211 3rd, 4th and 5th grade physical education classes amongst 39 elementary schools in Harris County, TX and 35 elementary schools in Travis County, TX was conducted using cross-sectional data from the evaluation of a school-based health program. Lesson context and student activity levels were measured using a direct observation measurement tool. Additionally, these variables were further analyzed against a number of classroom characteristics to determine any significant associations. ^ Results. Overall, elementary PE classes are still participating in low levels of moderate-to-vigorous physical activity averaging only 38% of class time. Additionally, close to 25% of class time is spent in classroom management. Male directed classes spent significantly more time in game activities and female directed classes spent more time in fitness, knowledge, and skill activities. Classes that took place outdoors were more active and spent more time in games than those that took place indoors. Significant correlations were demonstrated between class size and time spent in management context. Time spent in management context was also correlated with time spent sitting and standing. Additionally, positive correlations were demonstrated between time very active and teachers that praised students and encouraged physical activity among their classes.^

Process evaluation of intervention program for prevention of early sexual activity and alcohol use among Hispanic teenagers

Hispanic teens are a high-risk population for initiation of early sexual activity and alcohol use which in turn has numerous social and health consequences. One strategy to address prevention of these behaviors is to implement a capacity building intervention that promotes parent child communication, encompasses their cultural values and community participation. This study describes the process evaluation of a pilot intervention program amongst Hispanic teens and their families living along the Texas-Mexico border. “Girls Lets Talk” is a small group intervention with 10-14 year old teens and their female adult family members that involves education regarding effects of alcohol use and sexual activity as well as activities for monitoring and refusal skills to prevent risky behaviors. Two waves of the program each consisting of at least seven mother daughter dyads were conducted. During the designing process, community advisory board meetings and focus groups were held to review course materials and ensure they were appropriate to the Mexican American culture. Parent and adolescent surveys were administered at the beginning and end of the intervention to assess for psychosocial outcome variables. All sessions received high mean satisfactory scores (mean of 4.00 or better on a five point scale) for both adult and adolescent participants. Qualitative feedback was obtained via debriefing sessions to evaluate experience as well as alter recruitment strategies. A Wilcoxon Sign Rank analysis of the pre and post intervention surveys was done that showed significant changes in some outcome variables such as intentions and confidence for monitoring behaviors for adults and beliefs regarding sexual activity. “Girls Lets Talk” is a promising example of how a process evaluation plan can help develop a theory based health promotion program using the community based participatory research approach. The intervention may also be effective in altering intentions and enhancing self-efficacy among parents and teens in order to decrease risky behaviors such as early sexual activity and alcohol use.^

An evaluation of a behavioral change intervention for smokeless tobacco use

During the last three decades considerable attention has been placed on the reduction of tobacco use due to cigarette smoking. During this time, studies have been funded and programs have been developed that focus on both prevention and cessation of cigarette smoking. This intense focus has led to a significant decline in cigarette smoking. But now, use of another form of tobacco--smokeless tobacco--is gaining in popularity.^ In 1989, the National Cancer Institute funded a research study at The University of Texas M. D. Anderson Cancer Center, called Working Well, to develop, implement, and evaluate worksite health promotion programs aimed at reducing cancer risks. As part of this program, a behavioral intervention for smokeless tobacco use was developed. This dissertation evaluates the impact of that behavioral change intervention for smokeless tobacco use.^ Data collected during the Working Well program were analyzed to determine the effect of the intervention. The primary outcomes analyzed were smokeless tobacco cessation, stages of change movement, and prevalence. The secondary outcomes analyzed included the prediction of smokeless tobacco use, stage movement, and cessation. Primary outcome analyses were conducted using the worksite as the unit of analysis, while the secondary analyses were conducted using the individual as the unit of analysis.^ Approximately 20% of the male population used smokeless tobacco. Results of intervention analyses indicate that the Working Well program produced no intervention effect on any of the primary outcomes. At the final observation, the experimental worksites achieved a quit rate of 27%, while the control worksites achieved a quit rate of 26% (P = 0.78). Stage movement for the experimental worksites was 49%, while the control worksites experienced stage movement of 43% (P = 0.20). The results of the analyses on smokeless tobacco prevalence followed the same pattern. Predictors of smokeless tobacco use, cessation, and stage movement were also identified.^ Based on the results found in this study, smokeless tobacco should remain a research priority. Future research should focus on smokeless tobacco use, including the identification of the determinants of smokeless tobacco use and the development of measures and effective intervention strategies. ^

A DESCRIPTION AND EVALUATION OF EDUCATIONAL PROGRAMS FOR HEALTH MANPOWER IN NIGERIA

A descriptive study of the current educational programs of selected health personnel in Nigeria was made in 1986. Data on the content of educational programs was obtained from personal communication with the Heads of the various institutions and from their published materials (catalogs, course outlines and program descriptions). Adequacy of these programs was judged in the light of current health problems and needs of the population. Evaluation was based on the following criteria: (a) Selection of students to maximize their usefulness in the provision of health care. (b) Relevance of the curriculum to the tasks the trainee will be called upon to perform. (c) Types of courses that focus on community health needs. Using official reports, the health situation in the country was described to give a relative priority of health services.^ Findings indicate the following: (1) Health conditions in Nigeria are related to a high prevalence of illness and disease, unsanitary living conditions, a high ratio of infant mortality and a shortage of public health services. Priority needs for improvement call for attitudinal and environmental changes. (2) All health training programs have improved the relevance of education to community health needs by strengthening practical field experience, and teaching those courses which focus on disease prevention. (3) Prospective nurses and community health workers are selected on the basis of a number of personal and intellectual characteristics, but academic performance alone is the criterion for medical students. (4) The curriculum in the medical school needs to be restructured to cut back on time devoted to enriching the medical "background". Basic sciences need better integration with hospital work. (5) Managerial and organization courses have been well incorporated into the nursing and community health workers' curricula. (6) There is a marked overlap in the tasks the community health workers are expected to perform. This causes some redundancy in having four separate categories of these health personnel. ^