Grey literature in meta-analyses of randomized trials of health care interventions

BACKGROUND: The inclusion of grey literature (i.e. literature that has not been formally published) in systematic reviews may help to overcome some of the problems of publication bias, which can arise due to the selective availability of data. OBJECTIVES: To review systematically research studies, which have investigated the impact of grey literature in meta-analyses of randomized trials of health care interventions. SEARCH STRATEGY: We searched the Cochrane Methodology Register (The Cochrane Library Issue 3, 2005), MEDLINE (1966 to 20 May 2005), the Science Citation Index (June 2005) and contacted researchers who may have carried out relevant studies. SELECTION CRITERIA: A study was considered eligible for this review if it compared the effect of the inclusion and exclusion of grey literature on the results of a cohort of meta-analyses of randomized trials. DATA COLLECTION AND ANALYSIS: Data were extracted from each report independently by two reviewers. The main outcome measure was an estimate of the impact of trials from the grey literature on the pooled effect estimates of the meta-analyses. Information was also collected on the area of health care, the number of meta-analyses, the number of trials, the number of trial participants, the year of publication of the trials, the language and country of publication of the trials, the number and type of grey and published literature, and methodological quality. MAIN RESULTS: Five studies met the inclusion criteria. All five studies showed that published trials showed an overall greater treatment effect than grey trials. This difference was statistically significant in one of the five studies. Data could be combined for three of the five studies. This showed that, on average, published trials showed a 9% greater treatment effect than grey trials (ratio of odds ratios for grey versus published trials 1.09; 95% CI 1.03-1.16). Overall there were more published trials included in the meta-analyses than grey trials (median 224 (IQR 108-365) versus 45(IQR 40-102)). Published trials had more participants on average. The most common types of grey literature were abstracts (55%) and unpublished data (30%). There is limited evidence to show whether grey trials are of poorer methodological quality than published trials. AUTHORS' CONCLUSIONS: This review shows that published trials tend to be larger and show an overall greater treatment effect than grey trials. This has important implications for reviewers who need to ensure they identify grey trials, in order to minimise the risk of introducing bias into their review.

Source of funding and results of studies of health effects of mobile phone use: systematic review of experimental studies

OBJECTIVES: There is concern regarding the possible health effects of cellular telephone use. We examined whether the source of funding of studies of the effects of low-level radiofrequency radiation is associated with the results of studies. We conducted a systematic review of studies of controlled exposure to radiofrequency radiation with health-related outcomes (electroencephalogram, cognitive or cardiovascular function, hormone levels, symptoms, and subjective well-being). DATA SOURCES: We searched EMBASE, Medline, and a specialist database in February 2005 and scrutinized reference lists from relevant publications. DATA EXTRACTION: Data on the source of funding, study design, methodologic quality, and other study characteristics were extracted. The primary outcome was the reporting of at least one statistically significant association between the exposure and a health-related outcome. Data were analyzed using logistic regression models. DATA SYNTHESIS: Of 59 studies, 12 (20%) were funded exclusively by the telecommunications industry, 11 (19%) were funded by public agencies or charities, 14 (24%) had mixed funding (including industry), and in 22 (37%) the source of funding was not reported. Studies funded exclusively by industry reported the largest number of outcomes, but were least likely to report a statistically significant result: The odds ratio was 0.11 (95% confidence interval, 0.02-0.78), compared with studies funded by public agencies or charities. This finding was not materially altered in analyses adjusted for the number of outcomes reported, study quality, and other factors. CONCLUSIONS: The interpretation of results from studies of health effects of radiofrequency radiation should take sponsorship into account.

The PRO-AGE study: an international randomised controlled study of health risk appraisal for older persons based in general practice

BACKGROUND: This paper describes the study protocol, the recruitment, and base-line data for evaluating the success of randomisation of the PRO-AGE (PRevention in Older people-Assessment in GEneralists' practices) project. METHODS/DESIGN: A group of general practitioners (GPs) in London (U.K.), Hamburg (Germany) and Solothurn (Switzerland) were trained in risk identification, health promotion, and prevention in older people. Their non-disabled older patients were invited to participate in a randomised controlled study. Participants allocated to the intervention group were offered the Health Risk Appraisal for Older Persons (HRA-O) instrument with a site-specific method for reinforcement (London: physician reminders in electronic medical record; Hamburg: one group session or two preventive home visits; Solothurn: six-monthly preventive home visits over a two-year period). Participants allocated to the control group received usual care. At each site, an additional group of GPs did not receive the training, and their eligible patients were invited to participate in a concurrent comparison group. Primary outcomes are self-reported health behaviour and preventative care use at one-year follow-up. In Solothurn, an additional follow-up was conducted at two years. The number of older persons agreeing to participate (% of eligible persons) in the randomised controlled study was 2503 (66.0%) in London, 2580 (53.6%) in Hamburg, and 2284 (67.5%) in Solothurn. Base-line findings confirm that randomisation of participants was successful, with comparable characteristics between intervention and control groups. The number of persons (% of eligible) enrolled in the concurrent comparison group was 636 (48.8%) in London, 746 (35.7%) in Hamburg, and 1171 (63.0%) in Solothurn. DISCUSSION: PRO-AGE is the first large-scale randomised controlled trial of health risk appraisal for older people in Europe. Its results will inform about the effects of implementing HRA-O with different methods of reinforcement.

Modelling the results of health promotion activities in Switzerland: development of the Swiss Model for Outcome Classification in Health Promotion and Prevention

This paper describes the Model for Outcome Classification in Health Promotion and Prevention adopted by Health Promotion Switzerland (SMOC, Swiss Model for Outcome Classification) and the process of its development. The context and method of model development, and the aim and objectives of the model are outlined. Preliminary experience with application of the model in evaluation planning and situation analysis is reported. On the basis of an extensive literature search, the model is situated within the wider international context of similar efforts to meet the challenge of developing tools to assess systematically the activities of health promotion and prevention.

Incidence and outcome of chronic graft-versus-host disease using National Institutes of Health consensus criteria

Chronic graft-versus-host disease (cGVHD), a common complication after stem cell transplant (SCT), has an impact on morbidity and survival. Previous classification of cGVHD has not been reproducible or prognostic for nonrelapse mortality (NRM). Recently the National Institutes of Health (NIH) consensus criteria were proposed, but the ability of this classification to predict outcome of various subtypes of cGVHD is unknown. Patients (N = 110) undergoing an SCT for a hematologic malignancy and surviving until day 100 posttransplant from 2001 to 2003 were studied. The overall survival (OS) using a landmark analysis at day 100 was 44% versus 66% (no GVHD vs. GVHD, P = .026). The OS of patients with various types of GVHD as proposed by the NIH criteria were significantly different (P < .0001). In a univariate analyses, this was more apparent when patients with any acute features of GVHD were compared to classic cGVHD (3-year OS 46% vs. 68%, P = .033). The 3-year NRM for the entire cohort was 21%, and was not affected by presence or absence of GVHD or subtypes of GVHD. In a multivariable analysis, extensive cGVHD (hazard ratio [HR] 0.35, P = .015) and having any acute feature of GVHD after day 100 (HR 3.36, P = .0144) were significant independent predictors of survival. The OS with different NIH subtypes of GVHD after day 100 from SCT varies, and is superior for patients with classic cGVHD.

Intermediate results of health related quality of life after vertical banded gastroplasty

OBJECTIVES: The purpose of this study is to evaluate (a) health-related quality of life (HRQL) after vertical banded gastroplasty (VBG) (Mason) and (b) predictors of HRQL. SUBJECTS: Eighty-two consecutive patients were assessed preoperatively and then after 6, 12 and 24 months. Patients filled out questionnaires for subjective appraisal of HRQL (physical well-being, mood, physical performance, perceived health, social support and coping/adjustment). RESULTS: The greatest improvement in weight and HRQL was seen within 6 months of surgery. Twenty-four months after VBG weight reduction (P<0.05), perceived health (P<0.05), physical well-being (P<0.05), physical performance (P<0.05), mood (P<0.05), coping/adjustment (P<0.05) continued to be better than before surgery. Preoperative binge eating was the most important predictor of HRQL. CONCLUSION: Two years after VBG weight loss and a significant improvement of HRQL can be found. HRQL and weight loss are not associated in terms of outcome, indicating that weight loss alone may not be enough to improve HRQL.

Content comparison of health-related quality of life instruments for COPD

BACKGROUND: Due to the increasing importance of quality of life assessments in chronic obstructive pulmonary disease (COPD) patients, and the increased use of the International Classification of Functioning, Disability and Health (ICF) for comparative purposes it is essential to understand the relationship between health-related quality of life (HRQL) instruments and the ICF. OBJECTIVE: The objective of this study was to compare the content of recommended COPD-specific HRQL instruments using the ICF as reference. COPD-specific instruments mentioned in widely accepted guidelines were linked to the ICF using standardized linking rules. The degree of agreement between various health professionals was assessed by calculating the kappa statistic. RESULTS: Eleven instruments were included. They varied strongly in the number of concepts contained and the number of ICF categories used to map these concepts. A total of 548 concepts were identified and linked to 60 different ICF categories. Only the single category 'dyspnea' was covered by all instruments, whilst 21 categories were unique to specific instruments. The relationships of the measures with the ICF were identified. CONCLUSIONS: This study may aid researchers and clinicians to choose the most appropriate instrument for a specific purpose as well as help compare studies that have used different instruments for HRQL assessment.

Primary care physician supply and other key determinants of health care utilisation: The case of Switzerland

Background The Swiss government decided to freeze new accreditations for physicians in private practice in Switzerland based on the assumption that demand-induced health care spending may be cut by limiting care offers. This legislation initiated an ongoing controversial public debate in Switzerland. The aim of this study is therefore the determination of socio-demographic and health system-related factors of per capita consultation rates with primary care physicians in the multicultural population of Switzerland. Methods The data were derived from the complete claims data of Swiss health insurers for 2004 and included 21.4 million consultations provided by 6564 Swiss primary care physicians on a fee-for-service basis. Socio-demographic data were obtained from the Swiss Federal Statistical Office. Utilisation-based health service areas were created and were used as observational units for statistical procedures. Multivariate and hierarchical models were applied to analyze the data. Results Models within the study allowed the definition of 1018 primary care service areas with a median population of 3754 and an average per capita consultation rate of 2.95 per year. Statistical models yielded significant effects for various geographical, socio-demographic and cultural factors. The regional density of physicians in independent practice was also significantly associated with annual consultation rates and indicated an associated increase 0.10 for each additional primary care physician in a population of 10,000 inhabitants. Considerable differences across Swiss language regions were observed with reference to the supply of ambulatory health resources provided either by primary care physicians, specialists, or hospital-based ambulatory care. Conclusion The study documents a large small-area variation in utilisation and provision of health care resources in Switzerland. Effects of physician density appeared to be strongly related to Swiss language regions and may be rooted in the different cultural backgrounds of the served populations.

Promotion of health in older people: a randomised controlled trial of health risk appraisal in British general practice

BACKGROUND: there is inadequate evidence to support currently formulated NHS strategies to achieve health promotion and preventative care in older people through broad-based screening and assessment in primary care. The most extensively evaluated delivery instrument for this purpose is Health Risk Appraisal (HRA). This article describes a trial using HRA to evaluate the effect on health behaviour and preventative-care uptake in older people in NHS primary care. METHODS: a randomised controlled trial was undertaken in three London primary care group practices. Functionally independent community-dwelling patients older than 65 years (n = 2,503) received a self-administered Health Risk Appraisal for Older Persons (HRA-O) questionnaire leading to computer-generated individualised written feedback to participants and general practitioners (GPs), integrated into practice information-technology (IT) systems. All primary care staff received training in preventative health in older people. The main outcome measures were self-reported health behaviour and preventative care uptake at 1-year follow-up. RESULTS: of 2,503 individuals randomised, 2,006 respondents (80.1%) (intervention, n = 940, control n = 1,066) were available for analysis. Intervention group respondents reported slightly higher pneumococcal vaccination uptake and equivocal improvement in physical activity levels compared with controls. No significant differences were observed for any other categories of health behaviour or preventative care measures at 1-year follow-up. CONCLUSIONS: HRA-O implemented in this way resulted in minimal improvement of health behaviour or uptake of preventative care measures in older people. Supplementary reinforcement involving contact by health professionals with patients over and above routine clinical encounters may be a prerequisite to the effectiveness of IT-based delivery systems for health promotion in older people.

Content comparison of health-related quality of life instruments for obstructive sleep apnea

BACKGROUND AND PURPOSE: Due to the increasing importance of quality of life assessments in obstructive sleep apnea (OSA) patients and due to an increased use of the International Classification of Functioning, Disability and Health (ICF), for comparative purposes it is essential to understand the relationship between health-related quality of life (HRQOL) instruments and the ICF. The purpose of this study was to compare the content covered by OSA-specific instruments using the ICF. PATIENTS AND METHODS: OSA-specific instruments were identified, including the Calgary Sleep Apnea Quality of Life Index, the Functional Outcomes of Sleep Questionnaire, the Obstructive Sleep Apnea Patient-Oriented Severity Index, and the Quebec Sleep Questionnaire, and linked to the ICF by six health professionals according to standardized guidelines. The degree of agreement between health professionals was calculated by means of the kappa statistic. RESULTS: A total of 308 concepts were identified and linked to 78 different ICF categories; 35 categories of the component body function, one category of the component body structure, 38 categories of the component activities and participation, and four categories of the component environmental factors. Only contents within the chapters mental functions, mobility and social life were addressed by all instruments. Forty-seven categories were covered by only one instrument. CONCLUSION: The ICF proved highly useful for the comparison of HRQOL instruments. This analysis may help researchers and clinicians to choose the most appropriate HRQOL instrument for a specific purpose as well as help to compare study outcomes of studies using different instruments for HRQOL assessment.

Defining Goals and Learning Objectives for a Longitudinal Clerkship in the Complex Context of Health Care

In autumn 2007 the Swiss Medical School of Berne (Switzerland) implemented mandatory short-term clerkships in primary health care for all undergraduate medical students. Students studying for a Bachelor degree complete 8 half-days per year in the office of a general practitioner, while students studying for a Masters complete a three-week clerkship. Every student completes his clerkships in the same GP office during his four years of study. The purpose of this paper is to show how the goals and learning objectives were developed and evaluated. Method:A working group of general practitioners and faculty had the task of defining goals and learning objectives for a specific training program within the complex context of primary health care. The group based its work on various national and international publications. An evaluation of the program, a list of minimum requirements for the clerkships, an oral exam in the first year and an OSCE assignment in the third year assessed achievement of the learning objectives. Results: The findings present the goals and principal learning objectives for these clerkships, the results of the evaluation and the achievement of minimum requirements. Most of the defined learning objectives were taught and duly learned by students. Some learning objectives proved to be incompatible in the context of ambulatory primary care and had to be adjusted accordingly. Discussion: The learning objectives were evaluated and adapted to address students’ and teachers’ needs and the requirements of the medical school. The achievement of minimum requirements (and hence of the learning objectives) for clerkships has been mandatory since 2008. Further evaluations will show whether additional learning objectives need to be adopte