The mini-clinical evaluation exercise during medical clerkships: are learning needs and learning goals aligned?

OBJECTIVES The generation of learning goals (LGs) that are aligned with learning needs (LNs) is one of the main purposes of formative workplace-based assessment. In this study, we aimed to analyse how often trainer–student pairs identified corresponding LNs in mini-clinical evaluation exercise (mini-CEX) encounters and to what degree these LNs aligned with recorded LGs, taking into account the social environment (e.g. clinic size) in which the mini-CEX was conducted. METHODS Retrospective analyses of adapted mini-CEX forms (trainers’ and students’ assessments) completed by all Year 4 medical students during clerkships were performed. Learning needs were defined by the lowest score(s) assigned to one or more of the mini-CEX domains. Learning goals were categorised qualitatively according to their correspondence with the six mini-CEX domains (e.g. history taking, professionalism). Following descriptive analyses of LNs and LGs, multi-level logistic regression models were used to predict LGs by identified LNs and social context variables. RESULTS A total of 512 trainers and 165 students conducted 1783 mini-CEXs (98% completion rate). Concordantly, trainer–student pairs most often identified LNs in the domains of ‘clinical reasoning’ (23% of 1167 complete forms), ‘organisation/efficiency’ (20%) and ‘physical examination’ (20%). At least one ‘defined’ LG was noted on 313 student forms (18% of 1710). Of the 446 LGs noted in total, the most frequently noted were ‘physical examination’ (49%) and ‘history taking’ (21%). Corresponding LNs as well as social context factors (e.g. clinic size) were found to be predictors of these LGs. CONCLUSIONS Although trainer–student pairs often agreed in the LNs they identified, many assessments did not result in aligned LGs. The sparseness of LGs, their dependency on social context and their partial non-alignment with students’ LNs raise questions about how the full potential of the mini-CEX as not only a ‘diagnostic’ but also an ‘educational’ tool can be exploited.

Alignment between learning needs and learning goals of Mini-CEX in clerkships

Background: Defining learning goals (LG) in alignment with learning needs (LN) is one of the key purposes of formative workplace-based assessment, but studies about this topic are scarce. Summary of Work: We analysed quantitatively and qualitatively how often trainer-student pairs identified the same LN during Mini Clinical Evaluation Exercises (Mini-CEX) in clerkships and to what degree those LNs were in line with the recorded LGs. Multilevel logistic regression models were used to predict LGs by identified LNs, controlling for context variables. Summary of Results: 512 trainers and 165 students conducted 1783 Mini-CEX (98% completion rate). Concordantly, trainer-student pairs most often identified LNs in the domains ‘clinical reasoning’ (23% of 1167 complete forms), ‘organisation / efficiency’ (20%) and ‘physical examination’ (20%). At least one ‘defined’ LG was noted on 313 student forms (18% of 1710), with a total of 446 LGs. Of these, the most frequent LGs were ‘physical examination’ (49% of 446 LGs) and ‘history taking’ (21%); corresponding LNs as well as context variables (e.g. clinic size) were found to be predictors of these LGs. Discussion and Conclusions: Although trainer-student pairs often agreed in their identified LNs, many assessments did not result in an aligned LG or a LG at all. Interventions are needed to enhance the proportion of (aligned) LGs in Mini-CEX in order to tap into its full potential not only as a ‘diagnostic’ but also as an ‘educational tool’. Take-home messages: The sparseness of LGs, their dependency on context variables and their partial non-alignment with students’ LNs raise the question of how the effectiveness of Mini-CEX can be further enhanced.

FAIR_OSCE – Feedback structure for assessment of interactive roleplay in Objective Structured Clinical Exams

Introduction Since the quality of patient portrayal of standardized patients (SPs) during an Objective Structured Clinical Exam (OSCE) has a major impact on the reliability and validity of the exam, quality control should be initiated. Literature about quality control of SPs’ performance focuses on feedback [1, 2] or completion of checklists [3, 4]. Since we did not find a published instrument meeting our needs for the assessment of patient portrayal, we developed such an instrument after being inspired by others [5] and used it in our high-stakes exam. Project description SP trainers from five medical faculties collected and prioritized quality criteria for patient portrayal. Items were revised twice, based on experiences during OSCEs. The final instrument contains 14 criteria for acting (i.e. adequate verbal and non-verbal expression) and standardization (i.e. verbatim delivery of the first sentence). All partners used the instrument during a high-stakes OSCE. SPs and trainers were introduced to the instrument. The tool was used in training (more than 100 observations) and during the exam (more than 250 observations). Outcome High quality of SPs’ patient portrayal during the exam was documented. More than 90% of SP performances were rated to be completely correct or sufficient. An increase in quality of performance between training and exam was noted. For example, the rate of completely correct reaction in medical tests increased from 88% to 95%. Together with 4% of sufficient performances these 95% add up to 99% of the reactions in medical tests meeting the standards of the exam. SP educators using the instrument reported an augmentation of SPs’ performance induced by the use of the instrument. Disadvantages mentioned were the high concentration needed to observe all criteria and the cumbersome handling of the paper-based forms. Discussion We were able to document a very high quality of SP performance in our exam. The data also indicates that our training is effective. We believe that the high concentration needed using the instrument is well invested, considering the observed enhancement of performance. The development of an iPad-based application for the form is planned to address the cumbersome handling of the paper.

Integrated testing strategy (ITS) for bioaccumulation assessment under REACH

REACH (registration, evaluation, authorisation and restriction of chemicals) regulation requires that all the chemicals produced or imported in Europe above 1 tonne/year are registered. To register a chemical, physicochemical, toxicological and ecotoxicological information needs to be reported in a dossier. REACH promotes the use of alternative methods to replace, refine and reduce the use of animal (eco)toxicity testing. Within the EU OSIRIS project, integrated testing strategies (ITSs) have been developed for the rational use of non-animal testing approaches in chemical hazard assessment. Here we present an ITS for evaluating the bioaccumulation potential of organic chemicals. The scheme includes the use of all available data (also the non-optimal ones), waiving schemes, analysis of physicochemical properties related to the end point and alternative methods (both in silico and in vitro). In vivo methods are used only as last resort. Using the ITS, in vivo testing could be waived for about 67% of the examined compounds, but bioaccumulation potential could be estimated on the basis of non-animal methods. The presented ITS is freely available through a web tool.

Why evolutionary biologists should get seriously involved in ecological monitoring and applied biodiversity assessment programs

While ecological monitoring and biodiversity assessment programs are widely implemented and relatively well developed to survey and monitor the structure and dynamics of populations and communities in many ecosystems, quantitative assessment and monitoring of genetic and phenotypic diversity that is important to understand evolutionary dynamics is only rarely integrated. As a consequence, monitoring programs often fail to detect changes in these key components of biodiversity until after major loss of diversity has occurred. The extensive efforts in ecological monitoring have generated large data sets of unique value to macro-scale and long-term ecological research, but the insights gained from such data sets could be multiplied by the inclusion of evolutionary biological approaches. We argue that the lack of process-based evolutionary thinking in ecological monitoring means a significant loss of opportunity for research and conservation. Assessment of genetic and phenotypic variation within and between species needs to be fully integrated to safeguard biodiversity and the ecological and evolutionary dynamics in natural ecosystems. We illustrate our case with examples from fishes and conclude with examples of ongoing monitoring programs and provide suggestions on how to improve future quantitative diversity surveys.

Challenges in the participatory assessment of sustainable management practices in dryland ecosystems under regime shifts

Regime shifts, defined as a radical and persistent reconfiguration of an ecosystem following a disturbance, have been acknowledged by scientists as a very important aspect of the dynamic of ecosystems. However, their consideration in land management planning remains marginal and limited to specific processes and systems. Current research focuses on mathematical modeling and statistical analysis of spatio-temporal data for specific environmental variables. These methods do not fulfill the needs of land managers, who are confronted with a multitude of processes and pressure types and require clear and simple strategies to prevent regime shift or to increase the resilience of their environment. The EU-FP7 CASCADE project is looking at regime shifts of dryland ecosystems in southern Europe and specifically focuses on rangeland and forest systems which are prone to various land degradation threats. One of the aims of the project is to evaluate the impact of different management practices on the dynamic of the environment in a participatory manner, including a multi-stakeholder evaluation of the state of the environment and of the management potential. To achieve this objective we have organized several stakeholder meetings and we have compiled a review of management practices using the WOCAT methodology, which enables merging scientific and land users knowledge. We highlight here the main challenges we have encountered in applying the notion of regime shift to real world socio-ecological systems and in translating related concepts such as tipping points, stable states, hysteresis and resilience to land managers, using concrete examples from CASCADE study sites. Secondly, we explore the advantages of including land users’ knowledge in the scientific understanding of regime shifts. Moreover, we discuss useful alternative concepts and lessons learnt that will allow us to build a participatory method for the assessment of resilient management practices in specific socio-ecological systems and to foster adaptive dryland management.

The care of adults with congenital heart disease across the globe: Current assessment and future perspective

The number of adults with congenital heart disease (CHD) has increased markedly over the past few decades as a result of astounding successes in pediatric cardiac care. Nevertheless, it is now well understood that CHD is not cured but palliated, such that life-long expert care is required to optimize outcomes. All countries in the world that experience improved survival in CHD must face new challenges inherent to the emergence of a growing and aging CHD population with changing needs and medical and psychosocial issues. Founded in 1992, the International Society for Adult Congenital Heart Disease (ISACHD) is the leading global organization of professionals dedicated to pursuing excellence in the care of adults with CHD worldwide. Recognizing the unique and varied issues involved in caring for adults with CHD, ISACHD established a task force to assess the current status of care for adults with CHD across the globe, highlight major challenges and priorities, and provide future direction. The writing committee consisted of experts from North America, South America, Europe, South Asia, East Asia, and Oceania. The committee was divided into subgroups to review key aspects of adult CHD (ACHD) care. Regional representatives were tasked with investigating and reporting on relevant local issues as accurately as possible, within the constraints of available data. The resulting ISACHD position statement addresses changing patterns of worldwide epidemiology, models of care and organization of care, education and training, and the global research landscape in ACHD.

The utility of rapid participatory appraisal for community assessment, diagnosis, and policy development

The selection of a model to guide the understanding and resolution of community problems is an important issue relating to the foundation of public health practice: assessment, policy development, and assurance. Many assessment models produce a diagnosis of community weaknesses, but fail to promote planning and interventions. Rapid Participatory Appraisal (RPA) is a participatory action research model which regards assessment as the first step in the problem solving process, and claims to achieve assessment and policy development within limited resources of time and money. Literature documenting the fulfillment of these claims, and thereby supporting the utility of the model, is relatively sparse and difficult to obtain. Very few articles discuss the changes resulting from RPA assessments in urban areas, and those that do describe studies conducted outside the U.S.A. ^ This study examines the utility of the RPA model and its underlying theories: systems theory, grounded theory, and principles of participatory change, as illustrated by the case study of a community assessment conducted for the Texas Diabetes Institute (TDI), San Antonio, Texas, and subsequent outcomes. Diabetes has a high prevalence and is a major issue in San Antonio. Faculty and students conducted the assessment by informal collaboration between two nursing and public health assessment courses, providing practical student experiences. The study area was large, and the flexibility of the model tested by its use in contiguous sub-regions, reanalyzing aggregated results for the study area. Official TDI reports, and a mail survey of agency employees, described policy development resulting from community diagnoses revealed by the assessment. ^ The RPA model met the criteria for utility from the perspectives of merit, worth, efficiency, and effectiveness. The RPA model best met the agencies' criteria (merit), met the data needs of TDI in this particular situation (worth), provided valid results within budget, time, and personnel constraints (efficiency), and stimulated policy development by TDI (effectiveness). ^ The RPA model appears to have utility for community assessment, diagnosis, and policy development in circumstances similar to the TDI diabetes study. ^

An assessment of the nutritional status of orphaned adolescents living in Nyanza Province, Kenya

Increasing numbers of children and adolescents are becoming vulnerable or orphaned due to the HIV/AIDS epidemic in Nyanza Province, Kenya. Research indicates food security remains a top concern for those caring for these children or adolescents. This study was a examined thinness, stunting, and perceptions about food availability in adolescents ages 10-17 years in Nyanza Province. No evidence was found suggesting orphaned adolescents experience greater amounts of stunting or thinness over non-orphaned adolescents in the province. Orphans did not perceive less available food in their households. Instead, predictors of thinness, stunting, or low perceptions of food availability included age, household facilities, perceptions of equal or unequal treatment in the household, and perceptions about the household's ability to provide them with basic needs. Findings suggest interventions aimed at decreasing malnutrition focus less on orphaned versus non-orphaned adolescents, but they should focus on adolescents made vulnerable due to lower socioeconomic status. ^

Comparing experience of diabetes care with chronic illness care in the primary care clinic using the Patient Assessment of Chronic Illness Care (PACIC)

Purpose. The overall purpose of the study was to evaluate the patient experience relevant to the Chronic Care Model as measured by the PACIC. Chronic illness care of patients with diabetes was compared to those with other chronic illnesses. In addition, chronic illness care of Hispanics was compared to those of other race/ethnicity. ^ Methods. The setting of this study was 20 primary care practices located in San Antonio, TX. The subjects in this study were consecutive adult patients age >18 yrs. Data was collected via a survey (PACIC) administered to 40-60 consecutive adult patients in each primary care clinic who presented for a scheduled appointment. ^ Results. Patient experience of the Chronic Care Model is different among those with diabetes than those with other chronic diseases: those with diabetes report a higher PACIC score. (P = 0.012) Although Hispanic patients report a higher PACIC score, patient experience of the Chronic Care Model among Hispanic patients is not significantly different than that of patients of other race/ethnicity regardless of chronic disease. (P = 0.053) After controlling for the patient characteristics of age, education, health status, and race/ethnicity, the diabetes status of the patient remains significantly associated with the outcome, the PACIC score. (P = 0.033) ^ Conclusions. Diabetes is associated with a greater experience of the Chronic Care model. Contributing factors to diabetes patients’ greater experience of the Chronic Care Model include the greater heath care use and higher self-care needs unique to individuals with diabetes. Special consideration must be given to the specific needs diabetic patients to ensure effective interventions, higher patient education, greater patient compliance, and lower health care costs. ^

Prospective gated 64 slice computed tomography in assessment of coronary artery disease: A single center experience and relationship of body mass index to outcomes

Coronary artery disease (CAD) is the most common cause of morbidity and mortality in the United States. While Coronary Angiography (CA) is the gold standard test to investigate coronary artery disease, Prospective gated-64 Slice Computed Tomography (Prosp-64CT) is a new non-invasive technology that uses the 64Slice computed tomography (64CT) with electrocardiographic gating to investigate coronary artery disease. The aim of the current study was to investigate the role of Body Mass Index (BMI) as a factor affecting occurrence of CA after a Prosp-64CT, as well as the quality of the Prosp-64CT. Demographic and clinical characteristics of the study population were described. A secondary analysis of data on patients who underwent a Prosp-64CT for evaluation of coronary artery disease was performed. Seventy seven patients who underwent Prosp-64CT for evaluation for coronary artery disease were included. Fifteen patients were excluded because they had missing data regarding BMI, quality of the Prosp-64CT or CA. Thus, a total of 62 patients were included in the final analysis. The mean age was 56.2 years. The mean BMI was 31.3 kg/m 2. Eight (13%) patients underwent a CA within one month of Prosp-64CT. Eight (13%) patients had a poor quality Prosp-64CT. There was significant association of higher BMI as a factor for occurrence of CA post Prosp-64CT (P<0.05). There was a trend, but no statistical significance was observed for the association of being obese and occurrence of CA (P=0.06). BMI, as well as obesity, were not found to be significantly associated with poor quality of Prosp-64CT (P=0.19 and P=0.76, respectively). In conclusion, BMI was significantly associated with occurrence of CA within one month of Prosp-64CT. Thus, in patients with a higher BMI, diagnostic investigation with both tests could be avoided; rather, only a CA could be performed. However, the relationship of BMI to quality of Prosp-64CT needs to be further investigated since the sample size of the current study was small.^

Assessment of executive function before and after vitamin D replacement in vulnerable adults who self-neglect

Purpose: Self-neglect (SN) is the inability to maintain self-care needs. It is thought that older adults who have impaired executive function (EF) develop the inability to do self-care and to protect themselves. The specific aims were to (1) determine the feasibility of using multiple EF measures with community-dwelling elders with SN, (2) identify changes in EF between baseline and 5-months in community-dwelling elders with SN who receive 50,000 IU or 400 IU of oral vitamin D monthly and (2) explore changes in specific dimensions of EF between the groups. ^ Methods: Fifty adults, 65 years of age and older, were recruited from Adult Protective Services with confirmed SN. A research nurse administered the following tests at baseline and five-months: Delis-Kaplan Card Sort Test (D-KEFS), Executive Interview (EXIT 25), CLOX Drawing Test (CLOX I, II), Trails Making Test A and B (TMT A & B) and the Mini-Mental State Examination (MMSE). Demographic data was collected at baseline and serum 25-OHD levels were collected at baseline and five-months. ^ Results: Older adults with SN were more likely to fail the CLOX1 and D-KEFS, while passing the MMSE, CLOX II, TMT A & B and the EXIT 25. At five-months, the only statistically significant difference between groups was in the TMT A & B test scores; the control group did better than the treatment group. There was a non-significant increase in serum vitamin D levels for both groups and no difference between groups. ^ Conclusions: Results from this study provide support that individuals who SN will complete a battery of EF tests and that they exhibit the following impairments consistent with executive dysfunction: 'concept generation', 'planning', 'inhibition', and 'spatial working memory'. Utilizing only one EF measure in individuals with intact cognition may result in unidentification of individuals with executive dysfunction, thus delaying necessary treatment. Future studies should attempt to determine different etiologies of executive dysfunction and determine if early treatment can prevent or reverse SN. ^ Key Words: Self-neglect, Executive Dysfunction, Executive Function, Adult Protective Services, Community-dwelling, Vitamin D ^

AN ASSESSMENT OF KNOWLEDGE AND ATTITUDES OF GENETIC COUNSELING SERVICES IN U.S. HTCs

Hemophilia is a hereditary bleeding disorder which requires lifelong specialized care. A network of Hemophilia Treatment Centers (HTCs) exists to meet the medical needs of patients affected by hemophilia. Genetic counseling services are an integral part of the HTC model of care; however, many HTCs do not have genetic counselors on staff. As a result, the duty to provide these services must fall to other healthcare providers within the HTC. To assess the knowledge and attitudes of these providers we developed a 49 question survey that was distributed electronically to hematologists and nurses at U.S. HTCs. The survey consisted of a three sections: demographic information, knowledge of hemophilia genetics, and attitudes towards genetic services. A total of 111 complete responses were received and analyzed. The average knowledge score among all participants was 74.8% with a total of 81 participants receiving a passing score of 70% or above. Thirty participants scored below 70% in the knowledge section. In general, attitude scores were high indicating that the majority of hematologists and nurses in HTCs feel confident in their ability to provide genetic counseling services. Over 90% of participants reported that they have some form of access to genetic counseling services at their center. Hematologists and nurses practicing in U.S. HTCs demonstrate sufficient knowledge of the genetics of hemophilia, and they generally feel confident in their ability to provide genetic counseling services to their patients. While their knowledge is sufficient, the average knowledge score was lower than 75%. Certain questions covering new genetic technologies and testing practices were more commonly missed than questions asking about more basic aspects of hemophilia genetics, such as inheritance and carrier testing. Finally, many clinics report having access to a counselor, but it is oftentimes a hematologist or nurse who is providing genetic counseling services to patients. Given the inconsistency in knowledge among providers coupled with the high confidence in one’s ability to counsel patients, it leaves room to question whether information about the genetics of hemophilia is being communicated to patients in the most appropriate and accurate manner.

Assessment of Youth-Friendly Postabortion Care Services: A Global Tool for Assessing and Improving Postabortion Care for Youth

This tool is designed to help assessment teams, project managers, supervisors, and providers collect detailed information on the quality of Postabortion Care (PAC) services provided to adolescents at a given facility in order to make services more youth-friendly. It can also be used before PAC services have been established to see how best to design PAC services to meet youth’s needs. The assessment process facilitates the development of action plans for quality improvement that can help facilities address policy, operations, training, and other program areas needing adjustments and change. The tool also provides essential baseline information, allowing for repeated applications to measure changes and the impact of program interventions. Although the tool is primarily for use by a team, it may also be used by an individual.

Approach to the use of indicators for the assessment of the environmental level of construction products

The European construction industry is supposed to consume the 40% of the natural European resources and to generate the 40% of the European solid waste. Conscious of the great damage being suffered by the environment because of construction activity, this work tries to provide the building actors with a new tool to improve the current situation. The tool proposed is a model for the comprehensive evaluation of construction products by determining their environmental level. In this research, the environmental level of a construction product has been defined as its quality of accomplishing the construction requirements needed by causing the minimum ecological impact in its surrounding environment. This information allows building actors to choose suitable materials for building needs and also for the environment, mainly in the project stage or on the building site, contributing to improve the relationship between buildings and environment. For the assessment of the environmental level of construction products, five indicators have been identified regarding their global environmental impact through the product life cycle: CO2 emissions provoked during their production, volume and toxicity of waste generated on the building site, durability and recycling capacity after their useful life. Therefore, the less environmental impact one construction product produces, the higher environmental level performs. The model has been tested in 30 construction products that include environmental criteria in their description. The results obtained will be discussed in this article. Furthermore, this model can lay down guidelines for the selection of ecoefficient construction products and the design of new eco-competitive and eco-committed ones