On making causal claims: A review and recommendations

Social scientists often estimate models from correlational data, where the independent variable has not been exogenously manipulated; they also make implicit or explicit causal claims based on these models. When can these claims be made? We answer this question by first discussing design and estimation conditions under which model estimates can be interpreted, using the randomized experiment as the gold standard. We show how endogeneity--which includes omitted variables, omitted selection, simultaneity, common methods bias, and measurement error--renders estimates causally uninterpretable. Second, we present methods that allow researchers to test causal claims in situations where randomization is not possible or when causal interpretation is confounded, including fixed-effects panel, sample selection, instrumental variable, regression discontinuity, and difference-in-differences models. Third, we take stock of the methodological rigor with which causal claims are being made in a social sciences discipline by reviewing a representative sample of 110 articles on leadership published in the previous 10 years in top-tier journals. Our key finding is that researchers fail to address at least 66 % and up to 90 % of design and estimation conditions that make causal claims invalid. We conclude by offering 10 suggestions on how to improve non-experimental research.

Is the diagnostic yield of upper GI endoscopy improved by the use of explicit panel-based appropriateness criteria?

BACKGROUND: Increasing the appropriateness of use of upper gastrointestinal (GI) endoscopy is important to improve quality of care while at the same time containing costs. This study explored whether detailed explicit appropriateness criteria significantly improve the diagnostic yield of upper GI endoscopy. METHODS: Consecutive patients referred for upper GI endoscopy at 6 centers (1 university hospital, 2 district hospitals, 3 gastroenterology practices) were prospectively included over a 6-month period. After controlling for disease presentation and patient characteristics, the relationship between the appropriateness of upper GI endoscopy, as assessed by explicit Swiss criteria developed by the RAND/UCLA panel method, and the presence of relevant endoscopic lesions was analyzed. RESULTS: A total of 2088 patients (60% outpatients, 57% men) were included. Analysis was restricted to the 1681 patients referred for diagnostic upper GI endoscopy. Forty-six percent of upper GI endoscopies were judged to be appropriate, 15% uncertain, and 39% inappropriate by the explicit criteria. No cancer was found in upper GI endoscopies judged to be inappropriate. Upper GI endoscopies judged appropriate or uncertain yielded significantly more relevant lesions (60%) than did those judged to be inappropriate (37%; odds ratio 2.6: 95% CI [2.2, 3.2]). In multivariate analyses, the diagnostic yield of upper GI endoscopy was significantly influenced by appropriateness, patient gender and age, treatment setting, and symptoms. CONCLUSIONS: Upper GI endoscopies performed for appropriate indications resulted in detecting significantly more clinically relevant lesions than did those performed for inappropriate indications. In addition, no upper GI endoscopy that resulted in a diagnosis of cancer was judged to be inappropriate. The use of such criteria improves patient selection for upper GI endoscopy and can thus contribute to efforts aimed at enhancing the quality and efficiency of care. (Gastrointest Endosc 2000;52:333-41).

Inter-informant agreement and prevalence estimates for substance use disorders: direct interview versus family history method.

OBJECTIVES: Family studies typically use multiple sources of information on each individual including direct interviews and family history information. The aims of the present study were to: (1) assess agreement for diagnoses of specific substance use disorders between direct interviews and the family history method; (2) compare prevalence estimates according to the two methods; (3) test strategies to approximate prevalence estimates according to family history reports to those based on direct interviews; (4) determine covariates of inter-informant agreement; and (5) identify covariates that affect the likelihood of reporting disorders by informants. METHODS: Analyses were based on family study data which included 1621 distinct informant (first-degree relatives and spouses) - index subject pairs. RESULTS: Our main findings were: (1) inter-informant agreement was fair to good for all substance disorders, except for alcohol abuse; (2) the family history method underestimated the prevalence of drug but not alcohol use disorders; (3) lowering diagnostic thresholds for drug disorders and combining multiple family histories increased the accuracy of prevalence estimates for these disorders according to the family history method; (4) female sex of index subjects was associated with higher agreement for nearly all disorders; and (5) informants who themselves had a history of the same substance use disorder were more likely to report this disorder in their relatives, which entails the risk of overestimation of the size of familial aggregation. CONCLUSION: Our findings have important implications for the best-estimate procedure applied in family studies.

Antiretroviral treatment of adult HIV infection: 2012 recommendations of the International Antiviral Society-USA panel.

CONTEXT: New trial data and drug regimens that have become available in the last 2 years warrant an update to guidelines for antiretroviral therapy (ART) in human immunodeficiency virus (HIV)-infected adults in resource-rich settings. OBJECTIVE: To provide current recommendations for the treatment of adult HIV infection with ART and use of laboratory-monitoring tools. Guidelines include when to start therapy and with what drugs, monitoring for response and toxic effects, special considerations in therapy, and managing antiretroviral failure. DATA SOURCES, STUDY SELECTION, AND DATA EXTRACTION: Data that had been published or presented in abstract form at scientific conferences in the past 2 years were systematically searched and reviewed by an International Antiviral Society-USA panel. The panel reviewed available evidence and formed recommendations by full panel consensus. DATA SYNTHESIS: Treatment is recommended for all adults with HIV infection; the strength of the recommendation and the quality of the evidence increase with decreasing CD4 cell count and the presence of certain concurrent conditions. Recommended initial regimens include 2 nucleoside reverse transcriptase inhibitors (tenofovir/emtricitabine or abacavir/lamivudine) plus a nonnucleoside reverse transcriptase inhibitor (efavirenz), a ritonavir-boosted protease inhibitor (atazanavir or darunavir), or an integrase strand transfer inhibitor (raltegravir). Alternatives in each class are recommended for patients with or at risk of certain concurrent conditions. CD4 cell count and HIV-1 RNA level should be monitored, as should engagement in care, ART adherence, HIV drug resistance, and quality-of-care indicators. Reasons for regimen switching include virologic, immunologic, or clinical failure and drug toxicity or intolerance. Confirmed treatment failure should be addressed promptly and multiple factors considered. CONCLUSION: New recommendations for HIV patient care include offering ART to all patients regardless of CD4 cell count, changes in therapeutic options, and modifications in the timing and choice of ART in the setting of opportunistic illnesses such as cryptococcal disease and tuberculosis.

Oxidative potential of a panel of carbonaceous and metallic nanoparticles

Characterisation of nanoparticles (NP) based on size distribution, surface area, reactivity, and aggregation status of nanoparticles (NP) are of prime importance because they are usually closely related to toxicity. To date, most of the toxicity studies are quite time and money consuming. In the present study we report the oxidative properties of a panel of various NP (four Carbonaceous, nine Metal oxides, and one Metal as showed in Table 1) assessed with an acellular reactivity test measuring dithiothreitol (DTT) consumption (Sauvain et al. 2008). Such a test allows determining the ability of NP to catalyse the transfer of electrons from DTT to oxygen. DTT is used as a reductant species. NP were diluted and sonicated in Tween 80® to a final concentration of 50 g/mL. Printex 90 was diluted 5 times before doing the DTT assay because of its expected higher activity. Suspensions were characterised for NP size distribution by Nanoparticle Tracking Analysis (Nanosight©). Fresh solutions were incubated with DTT (100 μM). Aliquots were taken every 5 min and the remaining DTT was determined by reacting it with DTNB. The reaction rate was determined for NP suspensions and blank in parallel. The mean Brownian size distribution of NP agglomerates in suspension is presented in Table 1. D values correspond to 10th, and 50th percentiles of the particle diameters. All the NP agglomerated in Tween 80 with a D50 size corresponding to at least twice their primary size, except for Al2O3 (300 nm). The DTT test showed Printex 90 sample to be the most reactive one, followed by Diesel EPA and Nanotubes. Most of the metallic NP was nonresponding toward this test, except for NiO and Ag which reacted positively and ZnO which presented the most negative reactivity (see Figure 1). This last observation suggests that electron transfer between DTT and oxygen is hindered in presence of ZnO compared with the blank. Such "stabilization" could be attributable to ZnO dissolution and complexation between Zn2+ ions and DTT.

Quantifying uncertainty: physicians' estimates of infection in critically ill neonates and children.

To determine the diagnostic accuracy of physicians' prior probability estimates of serious infection in critically ill neonates and children, we conducted a prospective cohort study in 2 intensive care units. Using available clinical, laboratory, and radiographic information, 27 physicians provided 2567 probability estimates for 347 patients (follow-up rate, 92%). The median probability estimate of infection increased from 0% (i.e., no antibiotic treatment or diagnostic work-up for sepsis), to 2% on the day preceding initiation of antibiotic therapy, to 20% at initiation of antibiotic treatment (P<.001). At initiation of treatment, predictions discriminated well between episodes subsequently classified as proven infection and episodes ultimately judged unlikely to be infection (area under the curve, 0.88). Physicians also showed a good ability to predict blood culture-positive sepsis (area under the curve, 0.77). Treatment and testing thresholds were derived from the provided predictions and treatment rates. Physicians' prognoses regarding the presence of serious infection were remarkably precise. Studies investigating the value of new tests for diagnosis of sepsis should establish that they add incremental value to physicians' judgment.

Theoretical estimates of consumable food and probability of acquiring food in larvae of Chrysomya putoria (Diptera: Calliphoridae)

An indirect estimate of consumable food and probability of acquiring food in a blowfly species, Chrysomya putoria, is presented. This alternative procedure combines three distinct models to estimate consumable food in the context of the exploitative competition experienced by immature individuals in blowfly populations. The relevant parameters are derived from data for pupal weight and survival and estimates of density-independent larval mortality in twenty different larval densities. As part of this procedure, the probability of acquiring food per unit of time and the time taken to exhaust the food supply are also calculated. The procedure employed here may be valuable for estimations in insects whose immature stages develop inside the food substrate, where it is difficult to partial out confounding effects such as separation of faeces. This procedure also has the advantage of taking into account the population dynamics of immatures living under crowded conditions, which are particularly characteristic of blowflies and other insects as well.

Appropriate treatment for Crohn's disease: methodology and summary results of a multidisciplinary international expert panel approach--EPACT.

BACKGROUND/AIMS: For many therapeutic decisions in Crohn's disease (CD), high-grade evidence is lacking. To assist clinical decision-making, explicit panel-based appropriateness criteria were developed by an international, multidisciplinary expert panel. METHODS: 10 gastroenterologists, 3 surgeons and 2 general practitioners from 12 European countries assessed the appropriateness of therapy for CD using the RAND Appropriateness Method. Their assessment was based on the study of a recent literature review of the subject, combined with their own expert clinical judgment. Panelists rated clinical indications and treatment options using a 9-point scale (1 = extremely inappropriate; 9 = extremely appropriate). These scenarios were then discussed in detail at the panel meeting and re-rated. Median ratings and disagreement were used to aggregate ratings into three assessment categories: appropriate (A), uncertain (U) and inappropriate (I). RESULTS: 569 specific indications were rated, dealing with 9 clinical presentations: mild/moderate luminal CD (n = 104), severe CD (n = 126), steroid-dependent CD (n = 25), steroid-refractory CD (n = 37), fistulizing CD (n = 49), fibrostenotic CD (n = 35), maintenance of medical remission of CD (n = 84), maintenance of surgical remission (n = 78), drug safety in pregnancy (n = 24) and use of infliximab (n = 7). Overall, 146 indications (26%) were judged appropriate, 129 (23%) uncertain and 294 (52%) inappropriate. Frank disagreement was low (14% overall) with the greatest disagreement (54% of scenarios) being observed for treatment of steroid-refractory disease. CONCLUSIONS: Detailed explicit appropriateness criteria for the appropriate use of therapy for CD were developed for the first time by a European expert panel. Disease location, severity and previous treatments were the main factors taken into account. User-friendly access to EPACT criteria is available via an Internet site, www.epact.ch, allowing prospective evaluation and improvement of appropriateness of current CD therapy.

Gaussian estimates for the density of the non-linear stochastic heat equation in any space dimension

In this paper, we establish lower and upper Gaussian bounds for the probability density of the mild solution to the stochastic heat equation with multiplicative noise and in any space dimension. The driving perturbation is a Gaussian noise which is white in time with some spatially homogeneous covariance. These estimates are obtained using tools of the Malliavin calculus. The most challenging part is the lower bound, which is obtained by adapting a general method developed by Kohatsu-Higa to the underlying spatially homogeneous Gaussian setting. Both lower and upper estimates have the same form: a Gaussian density with a variance which is equal to that of the mild solution of the corresponding linear equation with additive noise.

Regional value added in Italy over the long run (1891-2001): linking indirect estimates with official figures, and implications

This paper presents value added estimates for the Italian regions, in benchmark years from 1891 until 1951, which are linked to those from official figures available from 1971 in order to offer a long-term picture. Sources and methodology are documented and discussed, whilst regional activity rates and productivity are also presented and compared. Thus some questions are briefly reconsidered: the origins and extent of the north-south divide, the role of migration and regional policy in shaping the pattern of regional inequality, the importance of social capital, and the positioning of Italy in the international debate on regional convergence, where it stands out for the long run persistence of its disparities.

Parent-child agreement and prevalence estimates of diagnoses in childhood: direct interview versus family history method.

Diagnostic information on children is typically elicited from both children and their parents. The aims of the present paper were to: (1) compare prevalence estimates according to maternal reports, paternal reports and direct interviews of children [major depressive disorder (MDD), anxiety and attention-deficit and disruptive behavioural disorders]; (2) assess mother-child, father-child and inter-parental agreement for these disorders; (3) determine the association between several child, parent and familial characteristics and the degree of diagnostic agreement or the likelihood of parental reporting; (4) determine the predictive validity of diagnostic information provided by parents and children. Analyses were based on 235 mother-offspring, 189 father-offspring and 128 mother-father pairs. Diagnostic assessment included the Kiddie-schedule for Affective Disorders and Schizophrenia (K-SADS) (offspring) and the Diagnostic Interview for Genetic Studies (DIGS) (parents and offspring at follow-up) interviews. Parental reports were collected using the Family History - Research Diagnostic Criteria (FH-RDC). Analyses revealed: (1) prevalence estimates for internalizing disorders were generally lower according to parental information than according to the K-SADS; (2) mother-child and father-child agreement was poor and within similar ranges; (3) parents with a history of MDD or attention deficit hyperactivity disorder (ADHD) reported these disorders in their children more frequently; (4) in a sub-sample followed-up into adulthood, diagnoses of MDD, separation anxiety and conduct disorder at baseline concurred with the corresponding lifetime diagnosis at age 19 according to the child rather than according to the parents. In conclusion, our findings support large discrepancies of diagnostic information provided by parents and children with generally lower reporting of internalizing disorders by parents, and differential reporting of depression and ADHD by parental disease status. Follow-up data also supports the validity of information provided by adolescent offspring.

Preliminary estimates and forecasts of the population prevalence of self reported of hypertension, of ischaemic heart disease and stroke in the Republic of Ireland from 2005 - 2015

Ireland and Northern Ireland’s Population Health Observatory (INIsPHO) recently published estimates of the population prevalence of diabetes in 2005 and forecasts to 2010 and 2015 for the island of Ireland, at the national and sub-national levels. These estimates are based the PBS Model developed by York and Humber Public Health Observatory (YHPHO), Brent NHS Trust and the School of Health and Related Research (ScHARR).The Department of Health and Children (DoHC) has requested additional estimates and forecasts for hypertension.This paper outlines the results from preliminary work from the initial steps towards a more systematic approach to monitoring the prevalence of other chronic diseases on the island.

Comparison of IPH prevalence estimates with other survey-based estimates

The Institute of Public Health in Ireland publishes estimates and forecasts of the prevalence of chronic health conditions for national and subnational areas on the island of Ireland. The estimates and forecasts are based on statistical models of nationally representative health survey data that estimate the risk of having the condition. The risks of having the condition are then applied to population estimates and projections. The purpose of this document is to: 1. Compare IPH prevalence estimates with prevalence estimates from other health surveys on the island. 2. Highlight the methodological issues in comparing prevalence estimates from different surveys.

Nonclassical measurement error with applications to labor and development issues

Zero correlation between measurement error and model error has been assumed in existing panel data models dealing specifically with measurement error. We extend this literature and propose a simple model where one regressor is mismeasured, allowing the measurement error to correlate with model error. Zero correlation between measurement error and model error is a special case in our model where correlated measurement error equals zero. We ask two research questions. First, we wonder if the correlated measurement error can be identified in the context of panel data. Second, we wonder if classical instrumental variables in panel data need to be adjusted when correlation between measurement error and model error cannot be ignored. Under some regularity conditions the answer is yes to both questions. We then propose a two-step estimation corresponding to the two questions. The first step estimates correlated measurement error from a reverse regression; and the second step estimates usual coefficients of interest using adjusted instruments.

Antiretroviral treatment of adult HIV infection: 2014 recommendations of the International Antiviral Society-USA Panel.

IMPORTANCE: New data and antiretroviral regimens expand treatment choices in resource-rich settings and warrant an update of recommendations to treat adults infected with human immunodeficiency virus (HIV). OBJECTIVE: To provide updated treatment recommendations for adults with HIV, emphasizing when to start treatment; what treatment to start; the use of laboratory monitoring tools; and managing treatment failure, switches, and simplification. DATA SOURCES, STUDY SELECTION, AND DATA SYNTHESIS: An International Antiviral Society-USA panel of experts in HIV research and patient care considered previous data and reviewed new data since the 2012 update with literature searches in PubMed and EMBASE through June 2014. Recommendations and ratings were based on the quality of evidence and consensus. RESULTS: Antiretroviral therapy is recommended for all adults with HIV infection. Evidence for benefits of treatment and quality of available data increase at lower CD4 cell counts. Recommended initial regimens include 2 nucleoside reverse transcriptase inhibitors (NRTIs; abacavir/lamivudine or tenofovir disoproxil fumarate/emtricitabine) and a third single or boosted drug, which should be an integrase strand transfer inhibitor (dolutegravir, elvitegravir, or raltegravir), a nonnucleoside reverse transcriptase inhibitor (efavirenz or rilpivirine) or a boosted protease inhibitor (darunavir or atazanavir). Alternative regimens are available. Boosted protease inhibitor monotherapy is generally not recommended, but NRTI-sparing approaches may be considered. New guidance for optimal timing of monitoring of laboratory parameters is provided. Suspected treatment failure warrants rapid confirmation, performance of resistance testing while the patient is receiving the failing regimen, and evaluation of reasons for failure before consideration of switching therapy. Regimen switches for adverse effects, convenience, or to reduce costs should not jeopardize antiretroviral potency. CONCLUSIONS AND RELEVANCE: After confirmed diagnosis of HIV infection, antiretroviral therapy should be initiated in all individuals who are willing and ready to start treatment. Regimens should be selected or changed based on resistance test results with consideration of dosing frequency, pill burden, adverse toxic effect profiles, comorbidities, and drug interactions.