Comparability of Outcome Frameworks in Medical Education: Implications for framework development

Background: The demand for international harmonization in medical education increases with the growing mobility of students and health professionals. Many medical societies and governmental offices have issued outcome frameworks (OF), which describe aims and contents of medical education based on competencies. These national standards affect the development of curricula as well as assessment and licensing procedures. Comparing OF and identifying factors that limit their comparability may thus foster international harmonization of medical education. Summary of Work: We conducted a systematic search for national OF in MedLine, EmBase and the internet. We included all OF in German or English that resulted from a national consensus process and were published or endorsed by a national society or governmental body. We extracted information in five predetermined categories: history of origin, audience, formal structure, medical schooling system and key terms. Summary of Results: Out of 1816 results, 13 OF were included into further analyses. OF reference each other, often without addressing existing differences (e.g. in target audiences). The two most cited OF are “CanMEDs” and “Scottish Doctor”. OF differ especially in their level of detail as well as in the underlying educational system. Discussion and Conclusions: Based on our results we propose a two-step blueprint for OF, that may help to establish comparability for internationally aligned key features – so-called “core competencies” – while at the same time allowing for necessary regional adaptations in terms of “secondary competencies”. Take-home messages: Considerable differences in at least five categories of OF currently hinder the comparability of outcome frameworks.

The Church Music Program: The Effect of Moving from Performance-based to Education-based Emphasis in a Church Music Program

This research project sought to answer the primary research question: What occurs when the music program in a church changes its emphasis from performance to education? This qualitative study of a church choir included participant observation of Wednesday evening and Sunday morning rehearsals over a 12 week period, individual interviews, group interviews, written responses, and written and visual assessment of musical skills. The goal was a rich description of the participants and emerging themes resulting from the shift in emphasis. Analysis of data occurred through inductive processing. Data was initially coded and then the codes were categorized into sub-themes, and finally into major themes. Early analysis of the data began with reflection in a researcher journal. Following the completion of the study the journal was entered into a word processor, as were transcriptions of videotaped rehearsals, and written reflections from the participants. After all data had been reviewed repeatedly and entered into the word processor, it was coded, reexamined, and finally categorized into sub-themes and themes. After coding and identification of major themes and sub-themes the finding were challenged by looking for disconfirming evidence. Finally, after the completion of the analysis stage, member checks were conducted. The results of the analysis of data revealed themes that could be associated either with the choir or the director. The key themes primarily associated with the choir were: Response to the change in rehearsal format; Attitude toward learning; Appropriateness of community learning model; and, Member's perceptions of the results of the program. The key themes associated with the director were identified as: Conductor assuming the role of educator; Conductor recognizing the choir as learners; Conductor treating rehearsals as a time for teaching and learning; and, Conductor's perception of the effectiveness of the change in focus. The study concluded that a change in focus from performance to education did not noticeably improve the sound of the choir after twelve-weeks. There were however, indications that improvements were being made by the individual members. Further study of the effects over a longer period of time is recommended.

Cost-effectiveness analysis of a 2-stage community-based hepatocellular carcinoma screening program in Taiwan

Hepatocellular carcinoma (HCC) has been ranked as the top cause of death due to neoplasm malignancy in Taiwan for years. The high incidence of HCC in Taiwan is primarily attributed to high prevalence of hepatitis viral infection. Screening the subjects with liver cirrhosis for HCC was widely recommended by many previous studies. The latest practice guideline for management of HCC released by the American Association for the Study of Liver Disease (AASLD) in 2005 recommended that the high risk groups, including cirrhotic patients, chronic HBV/HCV carriers, and subjects with family history of HCC and etc., should undergo surveillance.^ This study aims to investigate (1) whether the HCC screening program can prolong survival period of the high risk group, (2) what is the incremental cost-effectiveness ratio of the HCC screening program in Taiwan, as compared with a non-screening strategy from the payer perspective, (3) which high risk group has the lowest ICER for the HCC screening program from the insurer's perspective, in comparison with no screening strategy of each group, and (4) the estimated total cost of providing the HCC screening program to all high risk groups.^ The high risk subjects in the study were identified from the communities with high prevalence of hepatitis viral infection and classified into three groups (cirrhosis group, early cirrhosis group, and no cirrhosis group) at different levels of risk to HCC by status of liver disease at the time of enrollment. The repeated ultrasound screenings at an interval of 3, 6, and 12 months were applied to cirrhosis group, early cirrhosis group, and no cirrhosis group, respectively. The Markov-based decision model was constructed to simulate progression of HCC and to estimate the ICER for each group of subjects.^ The screening group had longer survival in the statistical results and the model outcomes. Owing to the low HCC incidence rate in the community-based screening program, screening services only have limited effect on survival of the screening group. The incremental cost-effectiveness ratio of the HCC screening program was $3834 per year of life saved, in comparison with the non-screening strategy. The estimated total cost of each group from the screening model over 13.5 years approximately consumes 0.13%, 1.06%, and 0.71% of total amount of adjusted National Health Expenditure from Jan 1992 to Jun 2005. ^ The subjects at high risk of developing HCC to undergo repeated ultrasound screenings had longer survival than those without screening, but screening was not the only factor to cause longer survival in the screening group. The incremental cost-effectiveness ratio of the 2-stage community-based HCC screening program in Taiwan was small. The HCC screening program was worthy of investment in Taiwan. In comparison with early cirrhosis group and no cirrhosis group, cirrhosis group has the lowest ICER when the screening period is less than 19 years. The estimated total cost of providing the HCC screening program to all high risk groups consumes approximately 1.90% of total amount of adjusted 13.5-year NHE in Taiwan.^

A systematic review of community-based participatory research interventions in pediatric and adolescent populations

Background. Community-based participatory research (CBPR) is a collaborative approach to research actively involving community members in all aspects of the research process. CBPR is not a new research method, but an approach that has gained increased attention in the field of public health over the last several years. Recognition of the inequalities in health status associated with social and environmental factors have led to calls for a renewed focus on ecological approaches to research. Ecological approaches acknowledge that the health of the community is dependent on an interaction between behavioral and environmental factors affecting the entire population. While many published studies document the benefits of CBPR in difficult-to-reach populations and describe successful implementation of this approach in adult populations, relatively few studies have been conducted in child and adolescent populations. Given that children and adolescents are particularly sensitive to the effects of their physical environments and may also be distrustful of outsiders, ecological approaches involving the community as partners, such as CBPR, may be especially useful in this population. ^ Objective. This thesis reviews published studies using a community-based participatory research approach in children and adolescents to assess the appropriateness of this approach in this population. ^ Method. Studies using CBPR in youth populations were identified using Medline and other Internet searches through both MeSH heading and text-word searches. ^ Results. A total of 16 studies were identified and analyzed for this review. Nine of the sixteen studies were experimental or quasi-experimental design, with Asthma being the most commonly studied disease. ^ Conclusions. While many studies using CBPR were not conducted with the level of scientific rigor typically found in clinical trial research, the studies reviewed each contributed to a greater understanding of the problems they investigated. Furthermore, interventional studies provided lasting benefits to communities under study above what would be found in studies using more traditional research approaches. While CBPR may not be appropriate for all research situations due to the time and resources required, we conclude that is a useful approach and should be considered when conducting community-based research for pediatric and adolescent populations.^

Evaluation of a solid phase microextraction method for community-based monitoring of 1,3-butadiene and benzene in Houston, Texas

The Houston region is home to arguably the largest petrochemical and refining complex anywhere. The effluent of this complex includes many potentially hazardous compounds. Study of some of these compounds has led to recognition that a number of known and probable carcinogens are at elevated levels in ambient air. Two of these, benzene and 1,3-butadiene, have been found in concentrations which may pose health risk for residents of Houston.^ Recent popular journalism and publications by local research institutions has increased the interest of the public in Houston's air quality. Much of the literature has been critical of local regulatory agencies' oversight of industrial pollution. A number of citizens in the region have begun to volunteer with air quality advocacy groups in the testing of community air. Inexpensive methods exist for monitoring of ozone, particulate matter and airborne toxic ambient concentrations. This study is an evaluation of a technique that has been successfully applied to airborne toxics.^ This technique, solid phase microextraction (SPME), has been used to measure airborne volatile organic hydrocarbons at community-level concentrations. It is has yielded accurate and rapid concentration estimates at a relatively low cost per sample. Examples of its application to measurement of airborne benzene exist in the literature. None have been found for airborne 1,3-butadiene. These compounds were selected for an evaluation of SPME as a community-deployed technique, to replicate previous application to benzene, to expand application to 1,3-butadiene and due to the salience of these compounds in this community. ^ This study demonstrates that SPME is a useful technique for quantification of 1,3-butadiene at concentrations observed in Houston. Laboratory background levels precluded recommendation of the technique for benzene. One type of SPME fiber, 85 μm Carboxen/PDMS, was found to be a sensitive sampling device for 1,3-butadiene under temperature and humidity conditions common in Houston. This study indicates that these variables affect instrument response. This suggests the necessity of calibration within specific conditions of these variables. While deployment of this technique was less expensive than other methods of quantification of 1,3-butadiene, the complexity of calibration may exclude an SPME method from broad deployment by community groups.^

A community-based assessment of the spatiotemporal distribution of influenza in a U.S.-Mexico border county during the spring 2009 novel H1N1 swine-origin influenza A pandemic

This study retrospectively evaluated the spatial and temporal disease patterns associated with influenza-like illness (ILI), positive rapid influenza antigen detection tests (RIDT), and confirmed H1N1 S-OIV cases reported to the Cameron County Department of Health and Human Services between April 26 and May 13, 2009 using the space-time permutation scan statistic software SaTScan in conjunction with geographical information system (GIS) software ArcGIS 9.3. The rate and age-adjusted relative risk of each influenza measure was calculated and a cluster analysis was conducted to determine the geographic regions with statistically higher incidence of disease. A Poisson distribution model was developed to identify the effect that socioeconomic status, population density, and certain population attributes of a census block-group had on that area's frequency of S-OIV confirmed cases over the entire outbreak. Predominant among the spatiotemporal analyses of ILI, RIDT and S-OIV cases in Cameron County is the consistent pattern of a high concentration of cases along the southern border with Mexico. These findings in conjunction with the slight northward space-time shifts of ILI and RIDT cluster centers highlight the southern border as the primary site for public health interventions. Finally, the community-based multiple regression model revealed that three factors—percentage of the population under age 15, average household size, and the number of high school graduates over age 25—were significantly associated with laboratory-confirmed S-OIV in the Lower Rio Grande Valley. Together, these findings underscore the need for community-based surveillance, improve our understanding of the distribution of the burden of influenza within the community, and have implications for vaccination and community outreach initiatives.^

Impact of hormonal therapy on survival and racial disparities in a large community-based cohort of older men with local/regional prostate cancer

Prostate cancer (CaP) is the most diagnosed non-cutaneous malignancy and the second leading cause of cancer mortality among United States males. Major racial disparities in incidence, survival, as well as treatment persist. The mortality is three times higher among African Americans (AAs) compared with Caucasians. Androgen carcinogenesis has been persistently implicated but results are inconsistent; and hormone manipulation has been the main stay of treatment for metastatic disease, supportive of the androgen carcinogenesis. The survival disadvantage of AAs has been attributed to the differences in socioeconomic factors (SES), tumor stage, and treatment. We hypostasized that HT prolongs survival in CaP and that the racial disparities in survival is influenced by variation in HT and primary therapies as well as SES. To address these overall hypothesis, we first utilized a random-effect meta-analytic design to examine evidence from randomized trials on the efficacy of androgen deprivation therapy in localized and metastatic disease, and assessed, using Cox proportional hazards models, the effectiveness of HT in prolonging survival in a large community-based cohort of older males diagnosed with local/regional CaP. Further we examined the role of HT and primary therapies on the racial disparities in CaP survival. The results indicated that adjuvant HT compared with standard care alone is efficacious in improving overall survival, whereas HT has no significant benefit in the real world experience in increasing the overall survival of older males in the community treated for local/regional disease. Further, racial differences in survival persist and were explained to some extent by the differences in the primary therapies (radical prostatectomy, radiation and watchful waiting) and largely by SES. Therefore, given the increased used of hormonal therapy and the cost-effectiveness today, more RCTs are needed to assess whether or not survival prolongation translates to improved quality of life, and to answer the research question on whether or not the decreased use of radical prostatectomy by AAs is driven by the Clinicians bias or AAs's preference of conservative therapy and to encourage AAs to seek curative therapies, thus narrowing to some degree the persistent mortality disparities between AAs and Caucasians. ^

Adherence to adjuvant chemotherapy and post-treatment surveillance in a large community-based cohort of patients with colon cancer

The objective of this dissertation was to determine the initiation and completion rates of adjuvant chemotherapy, its toxicity and the compliance rates of post-treatment surveillance for elderly patients with colon cancer using the linked Surveillance, Epidemiology, and End Results – Medicare database.^ The first study assessed the initiation and completion rate of 5-fluorouracil-based adjuvant chemotherapy and its relationship with patient characteristics. Of the 12,265 patients diagnosed with stage III colon adenocarcinoma in 1991-2005, 64.4% received adjuvant chemotherapy within 3-months after tumor resection and 40% of them completed the treatment. Age, marital status, and comorbidity score were significant predictors for chemotherapy initiation and completion.^ The second study estimated the incidence rate of toxicity-related endpoints among stage III colon adenocarcinoma patients treated with chemotherapy in 1991-2005. Of the 12,099 patients, 63.9% underwent chemotherapy and had volume depletion disorder (3-month cumulative incidence rate [CIR]=9.1%), agranulocytosis (CIR=3.4%), diarrhea (CIR=2.4%), nausea and vomiting (CIR=2.3%). Cox regression analysis confirmed such association (HR=2.76; 95% CI=2.42-3.15). The risk of ischemic heart diseases was slightly associated with chemotherapy (HR=1.08), but significantly among patients aged <75 with no comorbidity (HR=1.70). ^ The third study determined the adherence rate of follow-up cares among patients diagnosed with stage I-III colon adenocarcinoma in 2000 - June 2002. We identified 7,348 patients with a median follow-up of 59 months. The adherence rate was 83.9% for office visits, 29.4% for CEA tests, and 74.3% for colonoscopy. Overall, 25.2% met the recommended post-treatment care. Younger age at diagnosis, white race, married, advanced stage, fewer comorbidities, and chemotherapy use were significantly associated with guideline adherence.^ In conclusions, not all colon cancer patients received chemotherapy. Receiving chemotherapy was associated with increased risk of developing gastrointestinal, hematological and cardiac toxicities. Patients were more likely to comply with the schedule for office visits and colonoscopy but failed in CEA tests. ^

The Open Door Mission: Measuring and predicting outcomes of one community-based substance abuse treatment program

The objectives of this study were to identify and measure the average outcomes of the Open Door Mission's nine-month community-based substance abuse treatment program, identify predictors of successful outcomes, and make recommendations to the Open Door Mission for improving its treatment program.^ The Mission's program is exclusive to adult men who have limited financial resources: most of which were homeless or dependent on parents or other family members for basic living needs. Many, but not all, of these men are either chemically dependent or have a history of substance abuse.^ This study tracked a cohort of the Mission's graduates throughout this one-year study and identified various indicators of success at short-term intervals, which may be predictive of longer-term outcomes. We tracked various levels of 12-step program involvement, as well as other social and spiritual activities, such as church affiliation and recovery support.^ Twenty-four of the 66 subjects, or 36% met the Mission's requirements for success. Specific to this success criteria; Fifty-four, or 82% reported affiliation with a home church; Twenty-six, or 39% reported full-time employment; Sixty-one, or 92% did not report or were not identified as having any post-treatment arrests or incarceration, and; Forty, or 61% reported continuous abstinence from both drugs and alcohol.^ Five research-based hypotheses were developed and tested. The primary analysis tool was the web-based non-parametric dependency modeling tool, B-Course, which revealed some strong associations with certain variables, and helped the researchers generate and test several data-driven hypotheses. Full-time employment is the greatest predictor of abstinence: 95% of those who reported full time employment also reported continuous post-treatment abstinence, while 50% of those working part-time were abstinent and 29% of those with no employment were abstinent. Working with a 12-step sponsor, attending aftercare, and service with others were identified as predictors of abstinence.^ This study demonstrates that associations with abstinence and the ODM success criteria are not simply based on one social or behavioral factor. Rather, these relationships are interdependent, and show that abstinence is achieved and maintained through a combination of several 12-step recovery activities. This study used a simple assessment methodology, which demonstrated strong associations across variables and outcomes, which have practical applicability to the Open Door Mission for improving its treatment program. By leveraging the predictive capability of the various success determination methodologies discussed and developed throughout this study, we can identify accurate outcomes with both validity and reliability. This assessment instrument can also be used as an intervention that, if operationalized to the Mission’s clients during the primary treatment program, may measurably improve the effectiveness and outcomes of the Open Door Mission.^

Liberation of hope: An ethnographic study of community-based initiatives in Houston, Texas

This is an ethnographic study about the worldview of community-based initiatives in Houston, Texas, and the people who work in them. People who participated in this study recognize that their direct constructive action is at the heart of authentic social change in their minority communities. Through qualitative data analysis, a constellation of relationships and process patterns were found to constitute themselves into the system of the community-based initiative. The predominant patterns identified from the findings in this study are: the pervasiveness of place, the importance of people, unique initiatory patterns, the concrete local sustainability, the ever-present action orientation, the resourceful use of networks and inter-relationships, the significance of church influence, the core sense of spirituality and the essence of hope. These patterns emerged out of the local knowledge, which is acutely sensitive to the elements of history and lived experience, embedded in the distinctive moral and visionary patterns of meaning and expression. Findings from the research reveal that these community-based initiatives are not programs--they are people--people who keep hope alive in their communities and who, by their daily practice, liberate others. ^

Use of empowerment evaluation to determine a sustainability plan for a community-based preconception care program

Women With IMPACT (WWI) is a community-based preconception care educational intervention. WWI is being implemented by the Impacting Maternal and Prenatal Care Together (IMPACT) Collaborative and targets zip codes in Harris County, Texas at high risk for infant mortality, low birthweight, and preterm birth. WWI started March 2012 and continues through August 2013. Three workshop series are planned. This study was conducted with participants and facilitators from the first workshop series. This study aimed to 1) evaluate the WWI program using empowerment evaluation, 2) engage all WWI stakeholders in an empowerment evaluation so the method could be adopted as a participatory evaluation process for future IMPACT activities, and 3) develop recommendations for sustainability of the WWI intervention, based on empowerment evaluation findings and results from the pre/post program evaluation completed by WWI participants. Study participants included WWI participants and facilitators and IMPACT Collaborative Steering Committee members. WWI participants were female, 18-35 year-old, non-pregnant residents of zip codes at high risk of adverse birth outcomes. All other study participants were 18 years or older. A two-phased empowerment evaluation (EE) was utilized in this study. Sessions 1-4 were conducted independently of one another – 3 with participants at different sites and one with the facilitators. The fifth session included WWI participant and facilitator representatives, and IMPACT Steering Committee members. Session 5 built upon the work of the other sessions. Observation notes were recorded during each session. Thematic content analysis was conducted on all EE tables and observation notes. Mission statements drafted by each group focused on improvement of physical and mental health through behavior change and empowerment of all participants. The top 5 overall program components were: physical activity, nutrition, self-worth, in-class communication, and stress. Goals for program improvement were set by EE participants for each of these components. Through thematic content analysis of the tables and observation notes, social support emerged as an important theme of the program among all participant groups. Change to a healthy lifestyle emerged as an important theme in terms of program improvement. Two-phased EE provided an opportunity for all program stakeholders to provide feedback regarding important program components and provide suggestions for program improvement. EE, thematic content analysis, pre/post evaluation results, and inherent program knowledge were triangulated to make recommendations to sustain the program once the initial funding ends. ^

Perceptions of institutional support of community -based participatory research within prevention research centers

The Institute of Medicine (IOM) report on the future of health care states that the focus on health needs to shift to the management and prevention of chronic illnesses and that academic health centers (AHCs) should play an active role in this process through community partnerships (IOM, 2002). Grant funding from the National Institutes of Health and the creation of the Centers for Disease Control and Prevention (CDC) Prevention Research Centers (PRC) across the county represent a transition toward more proactively seeking out community partnerships to better design and disseminate health promotion programs (Green, 2001). ^ The focus of the PRCs is to conduct rigorous, community-based, prevention research, to seek outcomes applicable to public health programs and policies. The PRCs work is to create and foster partnerships among public health and community organizations, to address health promotion and disease prevention issues (CDC, 2003). ^ The W.K. Kellogg Foundation defines CBPR as "a collaborative approach to research that equitably involves all partners in the research process and recognizes the unique strengths that each brings. CBPR begins with a research topic of importance to the community with the aim of combining knowledge and action for social change to improve community health." ^ In 1995, CDC asked the IOM to review the PRC program to examine the extent to which the program is providing the public health community with strategies to address public health problems in disease prevention and health promotion (IOM, 1997). No comprehensive evaluation n of the individual PRCs had ever been done (IOM, 1997). ^ The CDC was interested in understanding how it could better support the PRC program through improved management and oversight to influence the program's success. The CDC only represents one of the entities that influence the success of a PRC. Another key entity to consider is the support of and influence of the Schools of Public Health in which the PRCs reside. Using evaluation criteria similar to those that were developed by the IOM, this study examined how aspects of structural capacity of the Schools of Public Health in which the PRCs reside are perceived to influence PRC community-based research activities. ^

Blood pressure and mortality in elderly people aged 85 and older: community based study

Objective: To determine whether the inverse relation between blood pressure and all cause mortality in elderly people over 85 years of age can be explained by adjusting for health status, and to determine whether high blood pressure is a risk factor for mortality when the effects of poor health are accounted for.