Quality assurance of simulated patient feedback in communication training for fourth-year medical students

Introduction In our program, simulated patients (SPs) give feedback to medical students in the course of communication skills training. To ensure effective training, quality control of the SPs’ feedback should be implemented. At other institutions, medical students evaluate the SPs’ feedback for quality control (Bouter et al., 2012). Thinking about implementing quality control for SPs’ feedback in our program, we wondered whether the evaluation by students would result in the same scores as evaluation by experts. Methods Consultations simulated by 4th-year medical students with SPs were video taped including the SP’s feedback to the students (n=85). At the end of the training sessions students rated the SPs’ performance using a rating instrument called Bernese Assessment for Role-play and Feedback (BARF) containing 11 items concerning feedback quality. Additionally the videos were evaluated by 3 trained experts using the BARF. Results The experts showed a high interrater agreement when rating identical feedbacks (ICCunjust=0.953). Comparing the rating of students and experts, high agreement was found with regard to the following items: 1. The SP invited the student to reflect on the consultation first, Amin (= minimal agreement) 97% 2. The SP asked the student what he/she liked about the consultation, Amin = 88%. 3. The SP started with positive feedback, Amin = 91%. 4. The SP was comparing the student with other students, Amin = 92%. In contrast the following items showed differences between the rating of experts and students: 1. The SP used precise situations for feedback, Amax (=maximal agreement) 55%, Students rated 67 of SPs’ feedbacks to be perfect with regard to this item (highest rating on a 5 point Likert scale), while only 29 feedbacks were rated this way by the experts. 2. The SP gave precise suggestions for improvement, Amax 75%, 62 of SPs’ feedbacks obtained the highest rating from students, while only 44 of SPs’ feedbacks achieved the highest rating in the view of the experts. 3. The SP speaks about his/her role in the third person, Amax 60%. Students rated 77 feedbacks with the highest score, while experts judged only 43 feedbacks this way. Conclusion Although evaluation by the students was in agreement with that of experts concerning some items, students rated the SPs’ feedback more often with the optimal score than experts did. Moreover it seems difficult for students to notice when SPs talk about the role in the first instead of the third person. Since precision and talking about the role in the third person are important quality criteria of feedback, this result should be taken into account when thinking about students’ evaluation of SPs’ feedback for quality control. Bouter, S., E. van Weel-Baumgarten, and S. Bolhuis. 2012. Construction and Validation of the Nijmegen Evaluation of the Simulated Patient (NESP): Assessing Simulated Patients’ Ability to Role-Play and Provide Feedback to Students. Academic Medicine: Journal of the Association of American Medical Colleges

An investigation into the factors that encourage learner participation in a large group medical classroom

BACKGROUND: Effective lectures often incorporate activities that encourage learner participation. A challenge for educators is how to facilitate this in the large group lecture setting. This study investigates the individual student characteristics involved in encouraging (or dissuading) learners to interact, ask questions, and make comments in class. METHODS: Students enrolled in a Doctor of Veterinary Medicine program at Ross University School of Veterinary Medicine, St Kitts, were invited to complete a questionnaire canvassing their participation in the large group classroom. Data from the questionnaire were analyzed using Excel (Microsoft, Redmond, WA, USA) and the R software environment (http://www.r-project.org/). RESULTS: One hundred and ninety-two students completed the questionnaire (response rate, 85.7%). The results showed statistically significant differences between male and female students when asked to self-report their level of participation (P=0.011) and their confidence to participate (P<0.001) in class. No statistically significant difference was identified between different age groups of students (P=0.594). Student responses reflected that an "aversion to public speaking" acted as the main deterrent to participating during a lecture. Female participants were 3.56 times more likely to report a fear of public speaking than male participants (odds ratio 3.56, 95% confidence interval 1.28-12.33, P=0.01). Students also reported "smaller sizes of class and small group activities" and "other students participating" as factors that made it easier for them to participate during a lecture. CONCLUSION: In this study, sex likely played a role in learner participation in the large group veterinary classroom. Male students were more likely to participate in class and reported feeling more confident to participate than female students. Female students in this study commonly identified aversion to public speaking as a factor which held them back from participating in the large group lecture setting. These are important findings for veterinary and medical educators aiming to improve learner participation in the classroom. Potential ways of addressing this challenge include addition of small group activities and audience response systems during lectures, and inclusion of training interventions in public speaking at an early stage of veterinary and medical curricula.

Loss of appetite in acutely ill medical inpatients: physiological response or therapeutic target?

Loss of appetite and ensuing weight loss is a key feature of severe illnesses. Protein-energy malnutrition (PEM) contributes significantly to the adverse outcome of these conditions. Pharmacological interventions to target appetite stimulation have little efficacy but considerable side effects. Therefore nutritional therapy appears to be the logical step to combat inadequate nutrition. However, clinical trial data demonstrating benefits are sparse and there is no current established standard algorithm for use of nutritional support in malnourished, acutely ill medical inpatients. Recent high-quality evidence from critical care demonstrating harmful effects when parenteral nutritional support is used indiscriminately has led to speculation that loss of appetite in the acute phase of illness is indeed an adaptive, protective response that improves cell recycling (autophagy) and detoxification. Outside critical care, there is an important gap in high quality clinical trial data shedding further light on these important issues. The selection, timing, and doses of nutrition should be evaluated as carefully as with any other therapeutic intervention, with the aim of maximising efficacy and minimising adverse effects and costs. In light of the current controversy, a reappraisal of how nutritional support should be used in acutely ill medical inpatients outside critical care is urgently required. The aim of this review is to discuss current pathophysiological concepts of PEM and to review the current evidence for the efficacy of nutritional support regarding patient outcomes when used in an acutely ill medical patient population outside critical care.

Improving the Assessment of Communication Skills at the Swiss Federal Licensing Exam: Results of a Student's Needs Assessment

Introduction With a three year project the assessment of communication skills within the Swiss Federal Licensing Examinations (FLE) shall be improved. As a first step a needs assessment among communication experts and medical students of the Swiss Medical Faculties will be performed. In this presentation the results of the students’ needs assessment will be presented. Methods A bilingual student’s online questionnaire will be developed by an expert panel taking relevant literature, the Swiss Catalogue of Learning Objectives and other consensus statements for communication (e.g., the European and Basler consensus statements) into account. With a think aloud study response process validity evidence will be sought. The questionnaire will focus on the following topics related to communication skills: (1) What has been taught?, (2) What has been assessed in the faculty exams?, (3) What has been assessed in the FLE?, (4) What should have been assessed in the FLE and how should the assessment be improved? Results Results of the students’ needs assessment will be available by the end of 2015 and be presented. Conclusions/ Take-home message We hope for valuable input for improving the assessment of communications skills within the FLE also from the students’ side. Results of the needs assessment from the students and experts will be combined and taken as input for an international expert symposium on how to improve the communication skills assessment within the FLE.

INCREASED EXPRESSION OF ONE OF TWO ADENOSINE DEAMINASE ALLELES IN A HUMAN CHORIOCARCINOMA CELL LINE FOLLOWING SELECTION WITH ADENINE NUCLEOSIDES

The human choriocarcinoma cell line JEG-3 is heterozygous at the adenosine deaminase (ADA) gene locus. Both allelic genes are under strong but incomplete repression causing a very low level expression of the gene locus. Because cytotoxic adenosine analogues such as 9-(beta)-D arabinofuranosyladenine (ara-A) and 9-(beta)-D xylofuranosyladenine (xyl-A) can be specifically detoxified by the action of ADA, these analogues were used to select for JEG-3 derived cells which had increased ADA expression. When JEG-3 cells were subjected to a multi-step, successively increasing dosage of either ara-A or xyl-A, resistant cells with increased ADA expression were generated. This increased ADA expression in the resistant cells was unstable, so that when the selective pressure was removed, cellular ADA expression would decrease. Subclone analysis of xyl-A resistant cells revealed that compared to parental JEG-3 cells, individual resistant cells had either elevated ADA levels or decreased adenosine kinase (ADK) levels or both. This altered ADA and ADK expression in the resistant cells were found to be independent events. Because of high endogenous tissue conversion factor (TCF) expression in the JEG-3 cells, the allelic nature of the increased ADA expression in most of the resistant cells could not be determined. However, several resistant subcloned cells were found to have lost TCF expression. These TCF('-) cells expressed only the ADA*2 allelic gene product. Cell fusion experiments demonstrated that the ADA*1 allelic gene was intact and functional in the A3-1A7 cell line. Chromosomal analysis of the A3-1A7 cells showed that they had no double-minutes or homogeneously staining chromosomal regions, although a pair of new chromosomes were found in these cells. Segregation analysis of the hybrid cells indicated that an ADA*2 allelic gene was probably located on this new chromosome. The analysis of the A3-1A7 cell line suggested that the expression of only ADA 2 in these cells was the result of possibly a cis-deregulation of the ADA gene locus or more probably an amplification of the ADA*2 allelic gene. Two effective positive selection systems for ADA('+) cells were also developed and tested. These selection systems should eventually lead to the isolation of the ADA gene.^

STUDIES ON THE PATTERNS OF NUCLEOTIDE AND AMINO ACID SUBSTITUTION (ELECTROPHORESIS, MUTATION RATE, SELECTION, BASE, COMPOSITION)

Theoretical and empirical studies were conducted on the pattern of nucleotide and amino acid substitution in evolution, taking into account the effects of mutation at the nucleotide level and purifying selection at the amino acid level. A theoretical model for predicting the evolutionary change in electrophoretic mobility of a protein was also developed by using information on the pattern of amino acid substitution. The specific problems studied and the main results obtained are as follows: (1) Estimation of the pattern of nucleotide substitution in DNA nuclear genomes. The pattern of point mutations and nucleotide substitutions among the four different nucleotides are inferred from the evolutionary changes of pseudogenes and functional genes, respectively. Both patterns are non-random, the rate of change varying considerably with nucleotide pair, and that in both cases transitions occur somewhat more frequently than transversions. In protein evolution, substitution occurs more often between amino acids with similar physico-chemical properties than between dissimilar amino acids. (2) Estimation of the pattern of nucleotide substitution in RNA genomes. The majority of mutations in retroviruses accumulate at the reverse transcription stage. Selection at the amino acid level is very weak, and almost non-existent between synonymous codons. The pattern of mutation is very different from that in DNA genomes. Nevertheless, the pattern of purifying selection at the amino acid level is similar to that in DNA genomes, although selection intensity is much weaker. (3) Evaluation of the determinants of molecular evolutionary rates in protein-coding genes. Based on rates of nucleotide substitution for mammalian genes, the rate of amino acid substitution of a protein is determined by its amino acid composition. The content of glycine is shown to correlate strongly and negatively with the rate of substitution. Empirical formulae, called indices of mutability, are developed in order to predict the rate of molecular evolution of a protein from data on its amino acid sequence. (4) Studies on the evolutionary patterns of electrophoretic mobility of proteins. A theoretical model was constructed that predicts the electric charge of a protein at any given pH and its isoelectric point from data on its primary and quaternary structures. Using this model, the evolutionary change in electrophoretic mobilities of different proteins and the expected amount of electrophoretically hidden genetic variation were studied. In the absence of selection for the pI value, proteins will on the average evolve toward a mildly basic pI. (Abstract shortened with permission of author.) ^

The utility of rapid participatory appraisal for community assessment, diagnosis, and policy development

The selection of a model to guide the understanding and resolution of community problems is an important issue relating to the foundation of public health practice: assessment, policy development, and assurance. Many assessment models produce a diagnosis of community weaknesses, but fail to promote planning and interventions. Rapid Participatory Appraisal (RPA) is a participatory action research model which regards assessment as the first step in the problem solving process, and claims to achieve assessment and policy development within limited resources of time and money. Literature documenting the fulfillment of these claims, and thereby supporting the utility of the model, is relatively sparse and difficult to obtain. Very few articles discuss the changes resulting from RPA assessments in urban areas, and those that do describe studies conducted outside the U.S.A. ^ This study examines the utility of the RPA model and its underlying theories: systems theory, grounded theory, and principles of participatory change, as illustrated by the case study of a community assessment conducted for the Texas Diabetes Institute (TDI), San Antonio, Texas, and subsequent outcomes. Diabetes has a high prevalence and is a major issue in San Antonio. Faculty and students conducted the assessment by informal collaboration between two nursing and public health assessment courses, providing practical student experiences. The study area was large, and the flexibility of the model tested by its use in contiguous sub-regions, reanalyzing aggregated results for the study area. Official TDI reports, and a mail survey of agency employees, described policy development resulting from community diagnoses revealed by the assessment. ^ The RPA model met the criteria for utility from the perspectives of merit, worth, efficiency, and effectiveness. The RPA model best met the agencies' criteria (merit), met the data needs of TDI in this particular situation (worth), provided valid results within budget, time, and personnel constraints (efficiency), and stimulated policy development by TDI (effectiveness). ^ The RPA model appears to have utility for community assessment, diagnosis, and policy development in circumstances similar to the TDI diabetes study. ^

Detecting the signature of natural selection with microsatellites

Natural selection is one of the major factors in the evolution of all organisms. Detecting the signature of natural selection has been a central theme in evolutionary genetics. With the availability of microsatellite data, it is of interest to study how natural selection can be detected with microsatellites. ^ The overall aim of this research is to detect signatures of natural selection with data on genetic variation at microsatellite loci. The null hypothesis to be tested is the neutral mutation theory of molecular evolution, which states that different alleles at a locus have equivalent effects on fitness. Currently used tests of this hypothesis based on data on genetic polymorphism in natural populations presume that mutations at the loci follow the infinite allele/site models (IAM, ISM), in the sense that at each site at most only one mutation event is recorded, and each mutation leads to an allele not seen before in the population. Microsatellite loci, which are abundant in the genome, do not obey these mutation models, since the new alleles at such loci can be created either by contraction or expansion of tandem repeat sizes of core motifs. Since the current genome map is mainly composed of microsatellite loci and this class of loci is still most commonly studied in the context of human genome diversity, this research explores how the current test procedures for testing the neutral mutation hypothesis should be modified to take into account a generalized model of forward-backward stepwise mutations. In addition, recent literature also suggested that past demographic history of populations, presence of population substructure, and varying rates of mutations across loci all have confounding effects for detecting signatures of natural selection. ^ The effects of the stepwise mutation model and other confounding factors on detecting signature of natural selection are the main results of the research. ^

Single nucleotide polymorphism (SNP) selection for genotype-phenotype association studies

With hundreds of single nucleotide polymorphisms (SNPs) in a candidate gene and millions of SNPs across the genome, selecting an informative subset of SNPs to maximize the ability to detect genotype-phenotype association is of great interest and importance. In addition, with a large number of SNPs, analytic methods are needed that allow investigators to control the false positive rate resulting from large numbers of SNP genotype-phenotype analyses. This dissertation uses simulated data to explore methods for selecting SNPs for genotype-phenotype association studies. I examined the pattern of linkage disequilibrium (LD) across a candidate gene region and used this pattern to aid in localizing a disease-influencing mutation. The results indicate that the r2 measure of linkage disequilibrium is preferred over the common D′ measure for use in genotype-phenotype association studies. Using step-wise linear regression, the best predictor of the quantitative trait was not usually the single functional mutation. Rather it was a SNP that was in high linkage disequilibrium with the functional mutation. Next, I compared three strategies for selecting SNPs for application to phenotype association studies: based on measures of linkage disequilibrium, based on a measure of haplotype diversity, and random selection. The results demonstrate that SNPs selected based on maximum haplotype diversity are more informative and yield higher power than randomly selected SNPs or SNPs selected based on low pair-wise LD. The data also indicate that for genes with small contribution to the phenotype, it is more prudent for investigators to increase their sample size than to continuously increase the number of SNPs in order to improve statistical power. When typing large numbers of SNPs, researchers are faced with the challenge of utilizing an appropriate statistical method that controls the type I error rate while maintaining adequate power. We show that an empirical genotype based multi-locus global test that uses permutation testing to investigate the null distribution of the maximum test statistic maintains a desired overall type I error rate while not overly sacrificing statistical power. The results also show that when the penetrance model is simple the multi-locus global test does as well or better than the haplotype analysis. However, for more complex models, haplotype analyses offer advantages. The results of this dissertation will be of utility to human geneticists designing large-scale multi-locus genotype-phenotype association studies. ^

Student Performance in Traditional vs. Online Format: Evidence from an MBA Level Introductory Economics Class

All previous studies comparing online and face-to-face format for instruction of economics compared courses that were either online or face-to-face format and regressed exam scores on selected student characteristics. This approach is subject to the econometric problems of self-selection omitted unobserved variables. Our study uses two methods to deal with these problems. First we eliminate self-selection bias by using students from a course that uses both instruction formats. Second, we use the exam questions as the unit of observation, and eliminate omitted variable bias by using an indicator variable for each student to capture the effect of differences in unobserved student characteristics on learning outcomes. We report the finding that students had a significantly greater chance of answering a question correctly if it came from a chapter covered online.

An empirical evaluation of the Random Forests classifier models for variable selection in a large-scale lung cancer case-control study

Random Forests™ is reported to be one of the most accurate classification algorithms in complex data analysis. It shows excellent performance even when most predictors are noisy and the number of variables is much larger than the number of observations. In this thesis Random Forests was applied to a large-scale lung cancer case-control study. A novel way of automatically selecting prognostic factors was proposed. Also, synthetic positive control was used to validate Random Forests method. Throughout this study we showed that Random Forests can deal with large number of weak input variables without overfitting. It can account for non-additive interactions between these input variables. Random Forests can also be used for variable selection without being adversely affected by collinearities. ^ Random Forests can deal with the large-scale data sets without rigorous data preprocessing. It has robust variable importance ranking measure. Proposed is a novel variable selection method in context of Random Forests that uses the data noise level as the cut-off value to determine the subset of the important predictors. This new approach enhanced the ability of the Random Forests algorithm to automatically identify important predictors for complex data. The cut-off value can also be adjusted based on the results of the synthetic positive control experiments. ^ When the data set had high variables to observations ratio, Random Forests complemented the established logistic regression. This study suggested that Random Forests is recommended for such high dimensionality data. One can use Random Forests to select the important variables and then use logistic regression or Random Forests itself to estimate the effect size of the predictors and to classify new observations. ^ We also found that the mean decrease of accuracy is a more reliable variable ranking measurement than mean decrease of Gini. ^

An innovative approach to impacting student academic achievement and attitudes: Pilot study of the HEADS UP Virtual Molecular Biology Lab

Objective. To evaluate the HEADS UP Virtual Molecular Biology Lab, a computer-based simulated laboratory designed to teach advanced high school biology students how to create a mouse model. ^ Design. A randomized clinical control design of forty-four students from two science magnet high schools in Mercedes, Texas was utilized to assess knowledge and skills of molecular laboratory procedures, attitudes towards science and computers as a learning tool, and usability of the program. ^ Measurements. Data was collected using five paper-and-pencil formatted questionnaires and an internal "lab notebook." ^ Results. The Virtual Lab was found to significantly increase student knowledge over time (p<0.005) and with each use (p<0.001) as well as positively increase attitudes towards computers (p<0.001) and skills (p<0.005). No significant differences were seen in science attitude scores.^ Conclusion. These results provide evidence that the HEADS UP Virtual Molecular Biology Lab is a potentially effective educational tool for high school molecular biology education.^

Locus of control as a predictor of students dropping out of high school

Education is related to health. In cross-sectional data, education level has been associated with physical functioning. Also, lower levels of education have been associated with health behaviors including smoking, alcohol use, and greater body weight. In school, students may benefit from greater exposed to health-related messages, while students who have dropped out may be more susceptible to influences regarding negative health behaviors such as smoking. ^ Improved school retention might improve long-term health outcomes. However, there is limited evidence regarding modifiable factors that predict likelihood of dropping out. Two likely psychosocial measures are locus of control and parent-child academic conversations. In the current study, data from two waves of a population-based longitudinal survey, the National Education Longitudinal Survey, were utilized to evaluate whether these two psychosocial measures could predict likelihood of dropping out, for students (n = 16,749) in tenth grade at 1990, with dropout status determined at 1992, while controlling for recognized sociodemographic predictors including parental income, parental education level, race/ethnicity, and sex. Locus of control was measured with the Pearlin Mastery Scale, and parent-child academic conversations were measured by three questions concerning course selection at school, school activities and events, and things the student studied in class. ^ In a logistic regression model, with the sociodemographic control measures entered in a first step before entry of the psychosocial measures in a second step, this study determined that lower levels of locus of control were associated with greater likelihood of dropping out after two years (odds ratio (OR) = 1.11, 95% confidence interval (CI) 108 to 1.15, p < .001), and two of the three parent-child academic discussion items were associated with greater likelihood of dropping out after two years (OR = 1.69, CI 1.48-1.93, p < .001; OR = 1.22, CI 1.05-1.41, p = .01; OR = 1.01, CI .88-1.15, p = .94). ^ It is possible that interventions aimed at improving locus of control, and aimed at building parent-child academic conversations, could lower the likelihood of students dropping out, and this in turn could yield improved heath behaviors and health status in the child's future. ^

Assessment of US Air Force student pilots with intermittent monofixation syndrome on a non-stereoptic dependent flight maneuver in pilot training

The United States Air Force School of Aerospace Medicine (USAFSAM) and Aeromedical Consult Service (ACS) have developed waiver criteria for pilots with subtle substandard depth perception. This is to allow United States Air Force (USAF) pilots with mild depth perception deficiency to continue flying duties while limiting the risk to flight safety and ensuring the availability of costly human resources. From 1999 to 2005, 166 aviators were given waivers for intermittent monofixation syndrome (IMFS). Of these, 96 were student pilots who performed slightly worse at stereoptic dependent flight maneuvers than student pilots (8,907) with normal depth perception (Lowry, 2006).^ This study's purpose is to evaluate the performance of the extended-trail maneuver, a non-stereoptic dependent flying maneuver, as executed by a cohort of 12 United States Air Force student pilots with intermittent monofixation syndrome versus the cohort of 100 student pilots with normal depth perception. These subjects are extracted from the cohorts examined by Lowry (2006) and the null hypothesis predicts no statistical difference in the performance of the non-stereoptic dependant flight maneuver extended-trail between student pilots with intermittent monofixation syndrome and those without the condition. ^

A qualitative analysis of leadership styles and the selection of quality improvement in primary care practice

In the Practice Change Model, physicians act as key stakeholders, people who have both an investment in the practice and the capacity to influence how the practice performs. This leadership role is critical to the development and change of the practice. Leadership roles and effectiveness are an important factor in quality improvement in primary care practices.^ The study conducted involved a comparative case study analysis to identify leadership roles and the relationship between leadership roles and the number and type of quality improvement strategies adopted during a Practice Change Model-based intervention study. The research utilized secondary data from four primary care practices with various leadership styles. The practices are located in the San Antonio region and serve a large Hispanic population. The data was collected by two ABC Project Facilitators from each practice during a 12-month period including Key Informant Interviews (all staff members), MAP (Multi-method Assessment Process), and Practice Facilitation field notes. This data was used to evaluate leadership styles, management within the practice, and intervention tools that were implemented. The chief steps will be (1) to analyze if the leader-member relations contribute to the type of quality improvement strategy or strategies selected (2) to investigate if leader-position power contributes to the number of strategies selected and the type of strategy selected (3) and to explore whether the task structure varies across the four primary care practices.^ The research found that involving more members of the clinic staff in decision-making, building bridges between organizational staff and clinical staff, and task structure are all associated with the direct influence on the number and type of quality improvement strategies implemented in primary care practice.^ Although this research only investigated leadership styles of four different practices, it will offer future guidance on how to establish the priorities and implementation of quality improvement strategies that will have the greatest impact on patient care improvement. ^