Reporting and handling missing outcome data in mental health: a systematic review of Cochrane systematic reviews and meta-analyses

OBJECTIVES The purpose of the study was to provide empirical evidence about the reporting of methodology to address missing outcome data and the acknowledgement of their impact in Cochrane systematic reviews in the mental health field. METHODS Systematic reviews published in the Cochrane Database of Systematic Reviews after January 1, 2009 by three Cochrane Review Groups relating to mental health were included. RESULTS One hundred ninety systematic reviews were considered. Missing outcome data were present in at least one included study in 175 systematic reviews. Of these 175 systematic reviews, 147 (84%) accounted for missing outcome data by considering a relevant primary or secondary outcome (e.g., dropout). Missing outcome data implications were reported only in 61 (35%) systematic reviews and primarily in the discussion section by commenting on the amount of the missing outcome data. One hundred forty eligible meta-analyses with missing data were scrutinized. Seventy-nine (56%) of them had studies with total dropout rate between 10 and 30%. One hundred nine (78%) meta-analyses reported to have performed intention-to-treat analysis by including trials with imputed outcome data. Sensitivity analysis for incomplete outcome data was implemented in less than 20% of the meta-analyses. CONCLUSIONS Reporting of the techniques for handling missing outcome data and their implications in the findings of the systematic reviews are suboptimal.

Addressing missing participant outcome data in dental clinical trials

Missing outcome data are common in clinical trials and despite a well-designed study protocol, some of the randomized participants may leave the trial early without providing any or all of the data, or may be excluded after randomization. Premature discontinuation causes loss of information, potentially resulting in attrition bias leading to problems during interpretation of trial findings. The causes of information loss in a trial, known as mechanisms of missingness, may influence the credibility of the trial results. Analysis of trials with missing outcome data should ideally be handled with intention to treat (ITT) rather than per protocol (PP) analysis. However, true ITT analysis requires appropriate assumptions and imputation of missing data. Using a worked example from a published dental study, we highlight the key issues associated with missing outcome data in clinical trials, describe the most recognized approaches to handling missing outcome data, and explain the principles of ITT and PP analysis.

Electronic medical record systems, data quality and loss to follow-up: survey of antiretroviral therapy programmes in resource-limited settings

OBJECTIVE: To describe the electronic medical databases used in antiretroviral therapy (ART) programmes in lower-income countries and assess the measures such programmes employ to maintain and improve data quality and reduce the loss of patients to follow-up. METHODS: In 15 countries of Africa, South America and Asia, a survey was conducted from December 2006 to February 2007 on the use of electronic medical record systems in ART programmes. Patients enrolled in the sites at the time of the survey but not seen during the previous 12 months were considered lost to follow-up. The quality of the data was assessed by computing the percentage of missing key variables (age, sex, clinical stage of HIV infection, CD4+ lymphocyte count and year of ART initiation). Associations between site characteristics (such as number of staff members dedicated to data management), measures to reduce loss to follow-up (such as the presence of staff dedicated to tracing patients) and data quality and loss to follow-up were analysed using multivariate logit models. FINDINGS: Twenty-one sites that together provided ART to 50 060 patients were included (median number of patients per site: 1000; interquartile range, IQR: 72-19 320). Eighteen sites (86%) used an electronic database for medical record-keeping; 15 (83%) such sites relied on software intended for personal or small business use. The median percentage of missing data for key variables per site was 10.9% (IQR: 2.0-18.9%) and declined with training in data management (odds ratio, OR: 0.58; 95% confidence interval, CI: 0.37-0.90) and weekly hours spent by a clerk on the database per 100 patients on ART (OR: 0.95; 95% CI: 0.90-0.99). About 10 weekly hours per 100 patients on ART were required to reduce missing data for key variables to below 10%. The median percentage of patients lost to follow-up 1 year after starting ART was 8.5% (IQR: 4.2-19.7%). Strategies to reduce loss to follow-up included outreach teams, community-based organizations and checking death registry data. Implementation of all three strategies substantially reduced losses to follow-up (OR: 0.17; 95% CI: 0.15-0.20). CONCLUSION: The quality of the data collected and the retention of patients in ART treatment programmes are unsatisfactory for many sites involved in the scale-up of ART in resource-limited settings, mainly because of insufficient staff trained to manage data and trace patients lost to follow-up.

Gender differences in survival among adult patients starting antiretroviral therapy in South Africa: a multicentre cohort study

Background Increased mortality among men on antiretroviral therapy (ART) has been documented but remains poorly understood. We examined the magnitude of and risk factors for gender differences in mortality on ART. Methods and Findings Analyses included 46,201 ART-naïve adults starting ART between January 2002 and December 2009 in eight ART programmes across South Africa (SA). Patients were followed from initiation of ART to outcome or analysis closure. The primary outcome was mortality; secondary outcomes were loss to follow-up (LTF), virologic suppression, and CD4+ cell count responses. Survival analyses were used to examine the hazard of death on ART by gender. Sensitivity analyses were limited to patients who were virologically suppressed and patients whose CD4+ cell count reached >200 cells/µl. We compared gender differences in mortality among HIV+ patients on ART with mortality in an age-standardised HIV-negative population. Among 46,201 adults (65% female, median age 35 years), during 77,578 person-years of follow-up, men had lower median CD4+ cell counts than women (85 versus 110 cells/µl, p<0.001), were more likely to be classified WHO stage III/IV (86 versus 77%, p<0.001), and had higher mortality in crude (8.5 versus 5.7 deaths/100 person-years, p<0.001) and adjusted analyses (adjusted hazard ratio [AHR] 1.31, 95% CI 1.22–1.41). After 36 months on ART, men were more likely than women to be truly LTF (AHR 1.20, 95% CI 1.12–1.28) but not to die after LTF (AHR 1.04, 95% CI 0.86–1.25). Findings were consistent across all eight programmes. Virologic suppression was similar by gender; women had slightly better immunologic responses than men. Notably, the observed gender differences in mortality on ART were smaller than gender differences in age-standardised death rates in the HIV-negative South African population. Over time, non-HIV mortality appeared to account for an increasing proportion of observed mortality. The analysis was limited by missing data on baseline HIV disease characteristics, and we did not observe directly mortality in HIV-negative populations where the participating cohorts were located. Conclusions HIV-infected men have higher mortality on ART than women in South African programmes, but these differences are only partly explained by more advanced HIV disease at the time of ART initiation, differential LTF and subsequent mortality, and differences in responses to treatment. The observed differences in mortality on ART may be best explained by background differences in mortality between men and women in the South African population unrelated to the HIV/AIDS epidemic.

The self-administered 24-item geriatric pain measure (GPM-24-SA): psychometric properties in three European populations of community-dwelling older adults

OBJECTIVE: To explore the feasibility and psychometric properties of a self-administered version of the 24-item Geriatric Pain Measure (GPM-24-SA). DESIGN: Secondary analysis of baseline data from the Prevention in Older People-Assessment in Generalists' practices trial, an international multi-center study of a health-risk appraisal system. PARTICIPANTS: One thousand seventy-two community dwelling nondisabled older adults self-reporting pain from London, UK; Hamburg, Germany; and Solothurn, Switzerland. OUTCOME MEASURES: GPM-24-SA as part of a multidimensional Health Risk Appraisal Questionnaire including self-reported demographic and health-related information. RESULTS: Among the 1,072 subjects, 655 had complete GPM-24-SA data, 404 had 30% missing GPM-24-SA data. In psychometric analyses across the three European populations with complete GPM-24-SA data, the measure exhibited stable internal consistency, good convergent, divergent and discriminant validity, and produced stable pain measurements. However, factor analysis indicated differences in the GPM-24-SA across sites with discrepancies mainly related to items of a single subscale that failed to load appropriately. Analyses including imputation for subjects with

Prophylactic antibiotics or G-CSF for the prevention of infections and improvement of survival in cancer patients undergoing chemotherapy

BACKGROUND: Febrile neutropenia (FN) and other infectious complications are some of the most serious treatment-related toxicities of chemotherapy for cancer, with a mortality rate of 2% to 21%. The two main types of prophylactic regimens are granulocyte (G-CSF) or granulocyte-macrophage colony stimulating factors (GM-CSF); and antibiotics, frequently quinolones or cotrimoxazole. Important current guidelines recommend the use of colony stimulating factors when the risk of febrile neutropenia is above 20% but they do not mention the use of antibiotics. However, both regimens have been shown to reduce the incidence of infections. Since no systematic review has compared the two regimens, a systematic review was undertaken. OBJECTIVES: To compare the effectiveness of G-CSF or GM-CSF with antibiotics in cancer patients receiving myeloablative chemotherapy with respect to preventing fever, febrile neutropenia, infection, infection-related mortality, early mortality and improving quality of life. SEARCH STRATEGY: We searched The Cochrane Library, MEDLINE, EMBASE, databases of ongoing trials, and conference proceedings of the American Society of Clinical Oncology and the American Society of Hematology (1980 to 2007). We planned to include both full-text and abstract publications. SELECTION CRITERIA: Randomised controlled trials comparing prophylaxis with G-CSF or GM-CSF versus antibiotics in cancer patients of all ages receiving chemotherapy or bone marrow or stem cell transplantation were included for review. Both study arms had to receive identical chemotherapy regimes and other supportive care. DATA COLLECTION AND ANALYSIS: Trial eligibility and quality assessment, data extraction and analysis were done in duplicate. Authors were contacted to obtain missing data. MAIN RESULTS: We included two eligible randomised controlled trials with 195 patients. Due to differences in the outcomes reported, the trials could not be pooled for meta-analysis. Both trials showed non-significant results favouring antibiotics for the prevention of fever or hospitalisation for febrile neutropenia. AUTHORS' CONCLUSIONS: There is no evidence for or against antibiotics compared to G(M)-CSFs for the prevention of infections in cancer patients.

IDH/MGMT-driven molecular classification of low-grade glioma is a strong predictor for long-term survival

BACKGROUND Low-grade gliomas (LGGs) are rare brain neoplasms, with survival spanning up to a few decades. Thus, accurate evaluations on how biomarkers impact survival among patients with LGG require long-term studies on samples prospectively collected over a long period. METHODS The 210 adult LGGs collected in our databank were screened for IDH1 and IDH2 mutations (IDHmut), MGMT gene promoter methylation (MGMTmet), 1p/19q loss of heterozygosity (1p19qloh), and nuclear TP53 immunopositivity (TP53pos). Multivariate survival analyses with multiple imputation of missing data were performed using either histopathology or molecular markers. Both models were compared using Akaike's information criterion (AIC). The molecular model was reduced by stepwise model selection to filter out the most critical predictors. A third model was generated to assess for various marker combinations. RESULTS Molecular parameters were better survival predictors than histology (ΔAIC = 12.5, P< .001). Forty-five percent of studied patients died. MGMTmet was positively associated with IDHmut (P< .001). In the molecular model with marker combinations, IDHmut/MGMTmet combined status had a favorable impact on overall survival, compared with IDHwt (hazard ratio [HR] = 0.33, P< .01), and even more so the triple combination, IDHmut/MGMTmet/1p19qloh (HR = 0.18, P< .001). Furthermore, IDHmut/MGMTmet/TP53pos triple combination was a significant risk factor for malignant transformation (HR = 2.75, P< .05). CONCLUSION By integrating networks of activated molecular glioma pathways, the model based on genotype better predicts prognosis than histology and, therefore, provides a more reliable tool for standardizing future treatment strategies.

Non-ignorable loss to follow-up: correcting mortality estimates based on additional outcome ascertainment

Loss to follow-up (LTFU) is a common problem in many epidemiological studies. In antiretroviral treatment (ART) programs for patients with human immunodeficiency virus (HIV), mortality estimates can be biased if the LTFU mechanism is non-ignorable, that is, mortality differs between lost and retained patients. In this setting, routine procedures for handling missing data may lead to biased estimates. To appropriately deal with non-ignorable LTFU, explicit modeling of the missing data mechanism is needed. This can be based on additional outcome ascertainment for a sample of patients LTFU, for example, through linkage to national registries or through survey-based methods. In this paper, we demonstrate how this additional information can be used to construct estimators based on inverse probability weights (IPW) or multiple imputation. We use simulations to contrast the performance of the proposed estimators with methods widely used in HIV cohort research for dealing with missing data. The practical implications of our approach are illustrated using South African ART data, which are partially linkable to South African national vital registration data. Our results demonstrate that while IPWs and proper imputation procedures can be easily constructed from additional outcome ascertainment to obtain valid overall estimates, neglecting non-ignorable LTFU can result in substantial bias. We believe the proposed estimators are readily applicable to a growing number of studies where LTFU is appreciable, but additional outcome data are available through linkage or surveys of patients LTFU. Copyright © 2013 John Wiley & Sons, Ltd.

Prognosis of Children with HIV-1 Infection Starting Antiretroviral Therapy in Southern Africa: A Collaborative Analysis of Treatment Programs

BACKGROUND: Prognostic models for children starting antiretroviral therapy (ART) in Africa are lacking. We developed models to estimate the probability of death during the first year receiving ART in Southern Africa. METHODS: We analyzed data from children ≤10 years old who started ART in Malawi, South Africa, Zambia or Zimbabwe from 2004-2010. Children lost to follow-up or transferred were excluded. The primary outcome was all-cause mortality in the first year of ART. We used Weibull survival models to construct two prognostic models: one with CD4%, age, WHO clinical stage, weight-for-age z-score (WAZ) and anemia and one without CD4%, because it is not routinely measured in many programs. We used multiple imputation to account for missing data. RESULTS: Among 12655 children, 877 (6.9%) died in the first year of ART. 1780 children were lost to follow-up/transferred and excluded from main analyses; 10875 children were included. With the CD4% model probability of death at 1 year ranged from 1.8% (95% CI: 1.5-2.3) in children 5-10 years with CD4% ≥10%, WHO stage I/II, WAZ ≥-2 and without severe anemia to 46.3% (95% CI: 38.2-55.2) in children <1 year with CD4% <5%, stage III/IV, WAZ< -3 and severe anemia. The corresponding range for the model without CD4% was 2.2% (95% CI: 1.8-2.7) to 33.4% (95% CI: 28.2-39.3). Agreement between predicted and observed mortality was good (C-statistics=0.753 and 0.745 for models with and without CD4% respectively). CONCLUSION: These models may be useful to counsel children/caregivers, for program planning and to assess program outcomes after allowing for differences in patient disease severity characteristics.

Informative State-Based Video Communication

We study state-based video communication where a client simultaneously informs the server about the presence status of various packets in its buffer. In sender-driven transmission, the client periodically sends to the server a single acknowledgement packet that provides information about all packets that have arrived at the client by the time the acknowledgment is sent. In receiver-driven streaming, the client periodically sends to the server a single request packet that comprises a transmission schedule for sending missing data to the client over a horizon of time. We develop a comprehensive optimization framework that enables computing packet transmission decisions that maximize the end-to-end video quality for the given bandwidth resources, in both prospective scenarios. The core step of the optimization comprises computing the probability that a single packet will be communicated in error as a function of the expected transmission redundancy (or cost) used to communicate the packet. Through comprehensive simulation experiments, we carefully examine the performance advances that our framework enables relative to state-of-the-art scheduling systems that employ regular acknowledgement or request packets. Consistent gains in video quality of up to 2B are demonstrated across a variety of content types. We show that there is a direct analogy between the error-cost efficiency of streaming a single packet and the overall rate-distortion performance of streaming the whole content. In the case of sender-driven transmission, we develop an effective modeling approach that accurately characterizes the end-to-end performance as a function of the packet loss rate on the backward channel and the source encoding characteristics.

Expectation Conditional Maximization-Based Deformable Shape Registration

This paper addresses the issue of matching statistical and non-rigid shapes, and introduces an Expectation Conditional Maximization-based deformable shape registration (ECM-DSR) algorithm. Similar to previous works, we cast the statistical and non-rigid shape registration problem into a missing data framework and handle the unknown correspondences with Gaussian Mixture Models (GMM). The registration problem is then solved by fitting the GMM centroids to the data. But unlike previous works where equal isotropic covariances are used, our new algorithm uses heteroscedastic covariances whose values are iteratively estimated from the data. A previously introduced virtual observation concept is adopted here to simplify the estimation of the registration parameters. Based on this concept, we derive closed-form solutions to estimate parameters for statistical or non-rigid shape registrations in each iteration. Our experiments conducted on synthesized and real data demonstrate that the ECM-DSR algorithm has various advantages over existing algorithms.

Strengthening the Reporting of Molecular Epidemiology for Infectious Diseases (STROME-ID): an extension of the STROBE statement

Molecular data are now widely used in epidemiological studies to investigate the transmission, distribution, biology, and diversity of pathogens. Our objective was to establish recommendations to support good scientific reporting of molecular epidemiological studies to encourage authors to consider specific threats to valid inference. The statement Strengthening the Reporting of Molecular Epidemiology for Infectious Diseases (STROME-ID) builds upon the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) initiative. The STROME-ID statement was developed by a working group of epidemiologists, statisticians, bioinformaticians, virologists, and microbiologists with expertise in control of infection and communicable diseases. The statement focuses on issues relating to the reporting of epidemiological studies of infectious diseases using molecular data that were not addressed by STROBE. STROME-ID addresses terminology, measures of genetic diversity within pathogen populations, laboratory methods, sample collection, use of molecular markers, molecular clocks, timeframe, multiple-strain infections, non-independence of infectious-disease data, missing data, ascertainment bias, consistency between molecular and epidemiological data, and ethical considerations with respect to infectious-disease research. In total, 20 items were added to the 22 item STROBE checklist. When used, the STROME-ID recommendations should advance the quality and transparency of scientific reporting, with clear benefits for evidence reviews and health-policy decision making.

The VEINES-QOL/Sym questionnaire is a reliable and valid disease-specific quality of life measure for deep vein thrombosis in elderly patients.

PURPOSE To prospectively evaluate the psychometric properties of the Venous Insufficiency Epidemiological and Economic Study (VEINES-QOL/Sym) questionnaire, an instrument to measure disease-specific quality of life and symptoms in elderly patients with deep vein thrombosis (DVT), and to validate a German version of the questionnaire. METHODS In a prospective multicenter cohort study of patients aged ≥ 65 years with acute venous thromboembolism, we used standard psychometric tests and criteria to evaluate the reliability, validity, and responsiveness of the VEINES-QOL/Sym in patients with acute symptomatic DVT. We also performed an exploratory factor analysis. RESULTS Overall, 352 French- and German-speaking patients were enrolled (response rate of 87 %). Both language versions of the VEINES-QOL/Sym showed good acceptability (missing data, floor and ceiling effects), reliability (internal consistency, item-total and inter-item correlations), validity (convergent, discriminant, known-groups differences), and responsiveness to clinical change over time in elderly patients with DVT. The exploratory factor analysis of the VEINES-QOL/Sym suggested three underlying dimensions: limitations in daily activities, DVT-related symptoms, and psychological impact. CONCLUSIONS The VEINES-QOL/Sym questionnaire is a practical, reliable, valid, and responsive instrument to measure quality of life and symptoms in elderly patients with DVT and can be used with confidence in prospective studies to measure outcomes in such patients.

Nötige und unnötige Behandlungen beim Hämorrhoidalleiden: Der Patient bestimmt mit

Up to one third of the general population suffers from symptoms caused by hemorrhoids. Conservative treatment comes first unless the patient presents with an acute hemorrhoidal prolapse or a thrombosis. A fiber enriched diet is the primary treatment option, recommended in the perioperative period as well as a long-term prophylaxis. A timely limited application of topical ointments or suppositories and/or flavonoids are further treatment options. When symptoms persist interventional procedures for grade I-II hemorrhoids, and surgery for grade III-IV hemorrhoids should be considered. Rubber band ligation is the interventional treatment of choice. A comparable efficacy using sclerosing or infrared therapy has not yet been demonstrated. We therefore do not recommend these treatment options for the cure of hemorrhoids. Self-treatment by anal insertion of bougies is of lowrisk and may be successful, particularly in the setting of an elevated sphincter pressure. Anal dilation, sphincterotomy, cryosurgery, bipolar diathermy, galvanic electrotherapy, and heat therapy should be regarded as obsolete given the poor or missing data reported for these methods. For a long time, the classic excisional hemorrhoidectomy was considered to be the gold standard as far as surgical procedures are concerned. Primary closure (Ferguson) seems to be superior compared to the "open" version (Milligan Morgan) with respect to postoperative pain and wound healing. The more recently proposed stapled hemorrhoidopexy (Longo) is particularly advisable for circular hemorrhoids. Compared to excisional hemorrhoidectomy the Longo-operation is associated with reduced postoperative pain, shorter operation time and hospital stay as well as a faster recovery, with the disadvantage though of a higher recurrence rate. Data from Hemorrhoidal Artery Ligation (HAL)-, if appropriate in combination with a Recto-Anal Repair (HAL/RAR)-, demonstrates a similar trend towards a better tolerance of the procedure at the expense of a higher recurrence rate. These relatively "new" procedures equally qualify for the treatment of grade III and IV hemorrhoids, and, in the case of stapled hemorrhoidopexy, may even be employed in the emergency situation of an acute anal prolapse. While under certain circumstances different treatment options are equivalent, there is a clear specificity with respect to the application of those procedures in other situations. The respective pros and cons need to be discussed separately with every patient. According to their own requirements a treatment strategy has to be defined according to their individual requirements.

Adjunctive corticosteroids for Pneumocystis jiroveci pneumonia in patients with HIV infection.

BACKGROUND Pneumocystis jiroveci pneumonia (PCP) remains the most common opportunistic infection in patients infected with the human immunodeficiency virus (HIV). Among patients with HIV infection and PCP the mortality rate is 10% to 20% during the initial infection and this increases substantially with the need for mechanical ventilation. It has been suggested that corticosteroids adjunctive to standard treatment for PCP could prevent the need for mechanical ventilation and decrease mortality in these patients. OBJECTIVES To assess the effects of adjunctive corticosteroids on overall mortality and the need for mechanical ventilation in HIV-infected patients with PCP and substantial hypoxaemia (arterial oxygen partial pressure < 70 mmHg or alveolar-arterial gradient > 35 mmHg on room air). SEARCH METHODS For the original review we searched The Cochrane Library (2004, Issue 4), MEDLINE (January 1980 to December 2004) and EMBASE (January 1985 to December 2004) without language restrictions. We further reviewed the reference lists from previously published overviews, searched UptoDate version 2005 and Clinical Evidence Concise (Issue 12, 2004), contacted experts in the field and searched the reference lists of identified publications for citations of additional relevant articles.In this update of our review, we searched the above-mentioned databases in September 2010 and April 2014 for trials published since our original review. We also searched for ongoing trials in ClinicalTrials.gov and the World Health Organization International Clinical Trial Registry Platform (ICTRP). We searched for conference abstracts via AEGIS. SELECTION CRITERIA Randomised controlled trials that compared corticosteroids to placebo or usual care in HIV-infected patients with PCP in addition to baseline treatment with trimethoprim-sulfamethoxazole, pentamidine or dapsone-trimethoprim, and reported mortality data. We excluded trials in patients with no or mild hypoxaemia (arterial oxygen partial pressure > 70 mmHg or an alveolar-arterial gradient < 35 mmHg on room air) and trials with a follow-up of less than 30 days. DATA COLLECTION AND ANALYSIS Two teams of review authors independently evaluated the methodology and extracted data from each primary study. We pooled treatment effects across studies and calculated a weighted average risk ratio of overall mortality in the treatment and control groups using a random-effects model.In this update of our review, we used the GRADE methodology to assess evidence quality. MAIN RESULTS Of 2029 screened records, we included seven studies in the review and six in the meta-analysis. Risk of bias varied: the randomisation and allocation process was often not clearly described, five of seven studies were double-blind and there was almost no missing data. The quality of the evidence for mortality was high. Risk ratios for overall mortality for adjunctive corticosteroids were 0.56 (95% confidence interval (CI) 0.32 to 0.98) at one month and 0.59 (95% CI 0.41 to 0.85) at three to four months of follow-up. In adults, to prevent one death, numbers needed to treat are nine patients in a setting without highly active antiretroviral therapy (HAART) available, and 23 patients with HAART available. The three largest trials provided moderate quality data on the need for mechanical ventilation, with a risk ratio of 0.38 (95% CI 0.20 to 0.73) in favour of adjunctive corticosteroids. One study was conducted in infants, suggesting a risk ratio for death in hospital of 0.81 (95% CI 0.51 to 1.29; moderate quality evidence). AUTHORS' CONCLUSIONS The number and size of trials investigating adjunctive corticosteroids for HIV-infected patients with PCP is small, but the evidence from this review suggests a beneficial effect for adult patients with substantial hypoxaemia. There is insufficient evidence on the effect of adjunctive corticosteroids on survival in infants.