How to assess the external validity of therapeutic trials: a conceptual approach

Background External validity of study results is an important issue from a clinical point of view. From a methodological point of view, however, the concept of external validity is more complex than it seems to be at first glance. Methods Methodological review to address the concept of external validity. Results External validity refers to the question whether results are generalizable to persons other than the population in the original study. The only formal way to establish the external validity would be to repeat the study for that specific target population. We propose a three-way approach for assessing the external validity for specified target populations. (i) The study population might not be representative for the eligibility criteria that were intended. It should be addressed whether the study population differs from the intended source population with respect to characteristics that influence outcome. (ii) The target population will, by definition, differ from the study population with respect to geographical, temporal and ethnical conditions. Pondering external validity means asking the question whether these differences may influence study results. (iii) It should be assessed whether the study's conclusions can be generalized to target populations that do not meet all the eligibility criteria. Conclusion Judging the external validity of study results cannot be done by applying given eligibility criteria to a single target population. Rather, it is a complex reflection in which prior knowledge, statistical considerations, biological plausibility and eligibility criteria all have place.

Effectiveness of integrated care including therapeutic assertive community treatment in severe schizophrenia spectrum and bipolar I disorders: the 24-month follow-up ACCESS II study

OBJECTIVE The ACCESS treatment model offers assertive community treatment embedded in an integrated care program to patients with psychoses. Compared to standard care and within a controlled study, it proved to be more effective in terms of service disengagement and illness outcomes in patients with schizophrenia spectrum disorders over 12 months. ACCESS was implemented into clinical routine and its effectiveness assessed over 24 months in severe schizophrenia spectrum disorders and bipolar I disorder with psychotic features (DSM-IV) in a cohort study. METHOD All 115 patients treated in ACCESS (from May 2007 to October 2009) were included in the ACCESS II study. The primary outcome was rate of service disengagement. Secondary outcomes were change of psychopathology, severity of illness, psychosocial functioning, quality of life, satisfaction with care, medication nonadherence, length of hospital stay, and rates of involuntary hospitalization. RESULTS Only 4 patients (3.4%) disengaged with the service. Another 11 (9.6%) left because they moved outside the catchment area. Patients received a mean of 1.6 outpatient contacts per week. Involuntary admissions decreased from 34.8% in the 2 previous years to 7.8% during ACCESS (P < .001). Mixed models repeated-measures analyses revealed significant improvements among all patients in psychopathology (effect size d = 0.64, P < .001), illness severity (d = 0.84, P = .03), functioning level (d = 0.65, P < .001), quality of life (d = 0.50, P < .001), and client satisfaction (d = 0.11, P < .001). At 24 months, 78.3% were fully adherent to medication, compared to 25.2% at baseline (P = .002). CONCLUSIONS ACCESS was successfully implemented in clinical routine and maintained excellent rates of service engagement and other outcomes in patients with schizophrenia spectrum disorders or bipolar I disorder with psychotic features over 24 months. TRIAL REGISTRATION ClinicalTrials.gov identifier: NCT01888627.

Viscosupplementation for the treatment of osteoarthritis of the knee (Review)

Background Osteoarthritis (OA) is the most prevalent chronic joint disorder worldwide and is associated with significant pain and disability. Objectives To assess the effects of viscosupplementation in the treatment of OA of the knee. The products were hyaluronan and hylan derivatives (Adant, Arthrum H, Artz (Artzal, Supartz), BioHy (Arthrease, Euflexxa, Nuflexxa), Durolane, Fermathron, Go-On, Hyalgan, Hylan G-F 20 (Synvisc Hylan G-F 20), Hyruan, NRD-101 (Suvenyl), Orthovisc, Ostenil, Replasyn, SLM-10, Suplasyn, Synject and Zeel compositum). Search strategy MEDLINE (up to January (week 1) 2006 for update), EMBASE, PREMEDLINE, Current Contents up to July 2003, and the Cochrane Central Register of Controlled Trials (CENTRAL) were searched. Specialised journals and reference lists of identified randomised controlled trials (RCTs) and pertinent review articles up to December 2005 were handsearched. Selection criteria RCTs of viscosupplementation for the treatment of people with a diagnosis of OA of the knee were eligible. Single and double-blinded studies, placebo-based and comparative studies were eligible. At least one of the four OMERACT III core set outcome measures had to be reported (Bellamy 1997). Data collection and analysis Each trial was assessed independently by two reviewers for its methodological quality using a validated tool. All data were extracted by one reviewer and verified by a second reviewer. Continuous outcome measures were analysed as weighted mean differences (WMD) with 95% confidence intervals (CI). However, where different scales were used to measure the same outcome, standardized mean differences (SMD) were used. Dichotomous outcomes were analyzed by relative risk (RR). Main results Seventy-six trials with a median quality score of 3 (range 1 to 5) were identified. Follow-up periods varied between day of last injection and eighteen months. Forty trials included comparisons of hyaluronan/hylan and placebo (saline or arthrocentesis), ten trials included comparisons of intra-articular (IA) corticosteroids, six trials included comparisons of nonsteroidal anti-inflammatory drugs (NSAIDs), three trials included comparisons of physical therapy, two trials included comparisons of exercise, two trials included comparisons of arthroscopy, two trials included comparisons of conventional treatment, and fifteen trials included comparisons of other hyaluronans/hylan. The pooled analyses of the effects of viscosupplements against 'placebo' controls generally supported the efficacy of this class of intervention. In these same analyses, differential efficacy effects were observed for different products on different variables and at different timepoints. Of note is the 5 to 13 week post injection period which showed a percent improvement from baseline of 28 to 54% for pain and 9 to 32% for function. In general, comparable efficacy was noted against NSAIDs and longer-term benefits were noted in comparisons against IA corticosteroids. In general, few adverse events were reported in the hyaluronan/hylan trials included in these analyses. Authors' conclusions Based on the aforementioned analyses, viscosupplementation is an effective treatment for OA of the knee with beneficial effects: on pain, function and patient global assessment; and at different post injection periods but especially at the 5 to 13 week post injection period. It is of note that the magnitude of the clinical effect, as expressed by the WMD and standardised mean difference (SMD) from the RevMan 4.2 output, is different for different products, comparisons, timepoints, variables and trial designs. However, there are few randomised head-to-head comparisons of different viscosupplements and readers should be cautious, therefore, in drawing conclusions regarding the relative value of different products. The clinical effect for some products, against placebo, on some variables at some timepoints is in the moderate to large effect-size range. Readers should refer to relevant tables to review specific detail given the heterogeneity in effects across the product class and some discrepancies observed between the RevMan 4.2 analyses and the original publications. Overall, the analyses performed are positive for the HA class and particularly positive for some products with respect to certain variables and timepoints, such as pain on weight bearing at 5 to 13 weeks postinjection. In general, sample-size restrictions preclude any definitive comment on the safety of the HA class of products; however, within the constraints of the trial designs employed no major safety issues were detected. In some analyses viscosupplements were comparable in efficacy to systemic forms of active intervention, with more local reactions but fewer systemic adverse events. In other analyses HA products had more prolonged effects than IA corticosteroids. Overall, the aforementioned analyses support the use of the HA class of products in the treatment of knee OA.

Small study effects in meta-analyses of osteoarthritis trials: meta-epidemiological study

Objective To examine the presence and extent of small study effects in clinical osteoarthritis research. Design Meta-epidemiological study. Data sources 13 meta-analyses including 153 randomised trials (41 605 patients) that compared therapeutic interventions with placebo or non-intervention control in patients with osteoarthritis of the hip or knee and used patients’ reported pain as an outcome. Methods We compared estimated benefits of treatment between large trials (at least 100 patients per arm) and small trials, explored funnel plots supplemented with lines of predicted effects and contours of significance, and used three approaches to estimate treatment effects: meta-analyses including all trials irrespective of sample size, meta-analyses restricted to large trials, and treatment effects predicted for large trials. Results On average, treatment effects were more beneficial in small than in large trials (difference in effect sizes −0.21, 95% confidence interval −0.34 to −0.08, P=0.001). Depending on criteria used, six to eight funnel plots indicated small study effects. In six of 13 meta-analyses, the overall pooled estimate suggested a clinically relevant, significant benefit of treatment, whereas analyses restricted to large trials and predicted effects in large trials yielded smaller non-significant estimates. Conclusions Small study effects can often distort results of meta-analyses. The influence of small trials on estimated treatment effects should be routinely assessed.

The effects of excluding patients from the analysis in randomised controlled trials: meta-epidemiological study

OBJECTIVE: To examine whether excluding patients from the analysis of randomised trials are associated with biased estimates of treatment effects and higher heterogeneity between trials. DESIGN: Meta-epidemiological study based on a collection of meta-analyses of randomised trials. DATA SOURCES: 14 meta-analyses including 167 trials that compared therapeutic interventions with placebo or non-intervention control in patients with osteoarthritis of the hip or knee and used patient reported pain as an outcome. METHODS: Effect sizes were calculated from differences in means of pain intensity between groups at the end of follow-up, divided by the pooled standard deviation. Trials were combined by using random effects meta-analysis. Estimates of treatment effects were compared between trials with and trials without exclusions from the analysis, and the impact of restricting meta-analyses to trials without exclusions was assessed. RESULTS: 39 trials (23%) had included all patients in the analysis. In 128 trials (77%) some patients were excluded from the analysis. Effect sizes from trials with exclusions tended to be more beneficial than those from trials without exclusions (difference -0.13, 95% confidence interval -0.29 to 0.04). However, estimates of bias between individual meta-analyses varied considerably (tau(2)=0.07). Tests of interaction between exclusions from the analysis and estimates of treatment effects were positive in five meta-analyses. Stratified analyses indicated that differences in effect sizes between trials with and trials without exclusions were more pronounced in meta-analyses with high between trial heterogeneity, in meta-analyses with large estimated treatment benefits, and in meta-analyses of complementary medicine. Restriction of meta-analyses to trials without exclusions resulted in smaller estimated treatment benefits, larger P values, and considerable decreases in between trial heterogeneity. CONCLUSION: Excluding patients from the analysis in randomised trials often results in biased estimates of treatment effects, but the extent and direction of bias is unpredictable. Results from intention to treat analyses should always be described in reports of randomised trials. In systematic reviews, the influence of exclusions from the analysis on estimated treatment effects should routinely be assessed.

Biotechnological, nutritional and therapeutic uses of Pleurotus spp. (Oyster mushroom) related with its chemical composition: A review on the past decade findings

The particular characteristics of growth and development of mushrooms in nature result in the accumulation of a variety of secondary metabolites, several of them with biological activities. The genus Pleurotus is a cosmopolitan group of mushrooms with high nutritional value and therapeutic properties, besides a wide array of biotechnological and environmental applications. Scope and approach: The present report aims to provide a critical review on aspects related to chemical compounds isolated from the genus Pleurotus with possible biotechnological, nutritional and therapeutic uses. Investigations on the genus have immensely accelerated during the last ten years, so that only reports published after 2005 have been considered. Key findings and conclusions: The most important Pleurotus species cultivated in large scale are P. ostreatus and P. pulmonarius. However, more than 200 species have already been investigated to various degrees. Both basidiomata and mycelia of Pleurotus are a great renewable and easily accessible source of functional foods/nutraceuticals and pharmaceuticals with antioxidant, antimicrobial, anti-inflammatory, antitumor and immunomodulatory effects. A series of compounds have already been precisely defined including several polysaccharides, phenolics, terpenes and sterols. However, intensification of structure determination is highly desirable and demands considerable efforts. Further studies including clinical trials need to be carried out to ascertain the safety of these compounds as adequate alternatives to conventional drugs. Not less important is to extend the search for novel bioactives to less explored Pleurotus species.

p53-independent NOXA induction overcomes apoptotic resistance of malignant melanomas

Once melanoma metastasizes, no effective treatment modalities prolong survival in most patients. This notorious refractoriness to therapy challenges investigators to identify agents that overcome melanoma resistance to apoptosis. Whereas many survival pathways contribute to the death-defying phenotype in melanoma, a defect in apoptotic machinery previously highlighted inactivation of Apaf-1, an apoptosome component engaged after mitochondrial damage. During studies involving Notch signaling in melanoma, we observed a gamma-secretase tripeptide inhibitor (GSI; z-Leu-Leu-Nle-CHO), selected from a group of compounds originally used in Alzheimer's disease, induced apoptosis in nine of nine melanoma lines. GSI only induced G2-M growth arrest (but not killing) in five of five normal melanocyte cultures tested. Effective killing of melanoma cells by GSI involved new protein synthesis and a mitochondrial-based pathway mediated by up-regulation of BH3-only members (Bim and NOXA). p53 activation was not necessary for up-regulation of NOXA in melanoma cells. Blocking GSI-induced NOXA using an antisense (but not control) oligonucleotide significantly reduced the apoptotic response. GSI also killed melanoma cell lines with low Apaf-1 levels. We conclude that GSI is highly effective in killing melanoma cells while sparing normal melanocytes. Direct enhancement of BH3-only proteins executes an apoptotic program overcoming resistance of this lethal tumor. Identification of a p53-independent apoptotic pathway in melanoma cells, including cells with low Apaf-1, bypasses an impediment to current cytotoxic therapy and provides new targets for future therapeutic trials involving chemoresistant tumors.

Clinical trials in pediatrics

“Children are not little adults.” Almost all aspects of children's health including clinical trials and drug development are poor cousins of adult health. Over the years, pediatricians worldwide caution against blind extrapolation of adult data to children as it may result in considerable harm [1,2]. Also, it is increasingly recognized that the roots of many chronic diseases in adulthood stem from childhood and tackling health issues in children lead to improved health in adults [3,4]. Furthermore, investment in early childhood has long-term benefits in adults not only in health but also in other aspects of life such as education and crime reduction [4,5]. Arguably, health at birth is the single most important predictor of health in adulthood as the inequality of an infant at birth has intergenerational effects [5]. The Carolina Abecedarian Project showed that early childhood programs that are of high quality result in substantial societal benefits (e.g., reduction of crime, increased earnings, better education) [4,5]. A recent publication from this project found that this benefit also translated into improved adult health outcomes [4]. In a randomized trial, Campbell and colleagues described that disadvantaged children who were randomized to the intervention group (early education, health screenings and nutrition program) had significantly lower rates of metabolic syndrome, obesity and hypertension, when aged in their mid-30s, compared with the control group [4]...

Genetics and genomics of ankylosing spondylitis

Ankylosing spondylitis (AS) is a common, highly heritable arthropathy, the pathogenesis of which is poorly understood. The mechanism by which the main gene for the disease, HLA-B27, leads to AS is unknown. Genetic and genomic studies have demonstrated involvement of the interleukin-23 (IL-23) signaling pathway in AS, a finding which has stimulated much new research into the disease and has led to therapeutic trials. Several other genes and genetic regions, including further major histocompatibility complex (MHC) and non-MHC loci, have been shown to be involved in the disease, but it is not clear yet how they actually induce the condition. These findings have shown that there is a strong genetic overlap between AS and Crohn's disease in particular, although there are also major differences in the genes involved in the two conditions, presumably explaining their different presentations. Genomic and proteomic studies are in an early phase but have potential both as diagnostic/prognostic tools and as a further hypothesis-free tool to investigate AS pathogenesis. Given the slow progress in studying the mechanism of association of HLA-B27 with AS, these may prove to be more fruitful approaches to investigating the pathogenesis of the disease. © 2009 John Wiley & Sons A/S.

Lipoproteins and diabetic microvascular complications

Risk factors for the microvascular complications (nephropathy and retinopathy) of Type 1 and Type 2 diabetes mellitus and the associated accelerated atherosclerosis include: age, diabetes duration, genetic factors, hyperglycaemia, hypertension, smoking, inflammation, glycation and oxidative stress and dyslipoproteinaemia. Hypertriglyceridaemia, low HDL and small dense LDL are common features of Type 2 diabetes and Type 1 diabetes with poor glycaemic control or renal complications. With the expansion of knowledge and of clinical and research laboratory tools, a broader definition of 'lipid' abnormalities in diabetes is appropriate. Dyslipoproteinaemia encompasses alterations in lipid levels, lipoprotein subclass distribution, composition (including modifications such as non-enzymatic glycation and oxidative damage), lipoprotein-related enzymes, and receptor interactions and subsequent cell signaling. Alterations occur in all lipoprotein classes; chylomicrons, VLDL, LDL, HDL, and Lp(a). There is also emerging evidence implicating lipoprotein related genotypes in the development of diabetic nephropathy and retinopathy. Lipoprotein related mechanisms associated with damage to the cardiovascular system may also be relevant to damage to the renal and ocular microvasculature. Adverse tissue effects are mediated by both alterations in lipoprotein function and adverse cellular responses. Recognition and treatment of lipoprotein-related risk factors, supported by an increasing array of assays and therapeutic agents, may facilitate early recognition and treatment of high complication risk diabetic patients. Further clinical and basic research, including intervention trials, is warranted to guide clinical practice. Optimal lipoprotein management, as part of a multi-faceted approach to diabetes care, may reduce the excessive personal and economic burden of microvascular complications and the related accelerated atherosclerosis.

Abundant genetic overlap between blood lipids and immune-mediated diseases indicates shared molecular genetic mechanisms

Epidemiological studies suggest a relationship between blood lipids and immune-mediated diseases, but the nature of these associations is not well understood. We used genome-wide association studies (GWAS) to investigate shared single nucleotide polymorphisms (SNPs) between blood lipids and immune-mediated diseases. We analyzed data from GWAS (n~200,000 individuals), applying new False Discovery Rate (FDR) methods, to investigate genetic overlap between blood lipid levels [triglycerides (TG), low density lipoproteins (LDL), high density lipoproteins (HDL)] and a selection of archetypal immune-mediated diseases (Crohn's disease, ulcerative colitis, rheumatoid arthritis, type 1 diabetes, celiac disease, psoriasis and sarcoidosis). We found significant polygenic pleiotropy between the blood lipids and all the investigated immune-mediated diseases. We discovered several shared risk loci between the immune-mediated diseases and TG (n = 88), LDL (n = 87) and HDL (n = 52). Three-way analyses differentiated the pattern of pleiotropy among the immune-mediated diseases. The new pleiotropic loci increased the number of functional gene network nodes representing blood lipid loci by 40%. Pathway analyses implicated several novel shared mechanisms for immune pathogenesis and lipid biology, including glycosphingolipid synthesis (e.g. FUT2) and intestinal host-microbe interactions (e.g. ATG16L1). We demonstrate a shared genetic basis for blood lipids and immune-mediated diseases independent of environmental factors. Our findings provide novel mechanistic insights into dyslipidemia and immune-mediated diseases and may have implications for therapeutic trials involving lipid-lowering and anti-inflammatory agents.

Not all roads lead to Rome - a review of quality of life measurement in diabetes

Aims Quality of life (QoL) is recognized widely as an important health outcome in diabetes, where the burden of selfmanagement places great demands on the individual. However, the concept of QoL remains ambiguous and poorly defined. The aim of our review is to clarify the measurement of QoL in terms of conceptualization, terminology and psychometric properties, to review the instruments that have been used most frequently to assess QoL in diabetes research and make recommendations for how to select measures appropriately.

Methods A systematic literature search was conducted to identify the ten measures most frequently used to assess QoL in diabetes research (including clinical trials) from 1995 to March 2008.

Results Six thousand and eight-five abstracts were identified and screened for instrument names. Of the ten instruments most frequently used to assess ‘QoL’, only three actually do so [i.e. the generic World Health Organization Quality of Life (WHOQOL) and the diabetes-specific Diabetes Quality of Life (DQOL) and Audit of Diabetes-Dependent Quality of Life (ADDQoL)]. Seven instruments more accurately measure health status [Short-Form 36 (SF-36), EuroQoL 5-Dimension (EQ-5D)], treatment satisfaction [Diabetes Treatment Satisfaction Questionnaire (DTSQ)] and psychological well-being [Beck Depression Inventory (BDI), Hospital Anxiety and Depression Scale (HADS), Well-Being Questionnaire (W-BQ), Problem Areas in Diabetes (PAID)].

Conclusions No single measure can suit every purpose or application but, when measures are selected inappropriately and data misinterpreted, any conclusions drawn are fundamentally flawed. If we value QoL as a therapeutic goal, we must ensure that the instruments we use are both valid and reliable. QoL assessment has the proven potential to identify ways in which treatments can be tailored to reduce the burden of diabetes. With careful consideration, appropriate measures can be selected and truly robust assessments undertaken successfully.

Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study

OBJECTIVE: To examine whether the association of inadequate or unclear allocation concealment and lack of blinding with biased estimates of intervention effects varies with the nature of the intervention or outcome. DESIGN: Combined analysis of data from three meta-epidemiological studies based on collections of meta-analyses. DATA SOURCES: 146 meta-analyses including 1346 trials examining a wide range of interventions and outcomes. MAIN OUTCOME MEASURES: Ratios of odds ratios quantifying the degree of bias associated with inadequate or unclear allocation concealment, and lack of blinding, for trials with different types of intervention and outcome. A ratio of odds ratios <1 implies that inadequately concealed or non-blinded trials exaggerate intervention effect estimates. RESULTS: In trials with subjective outcomes effect estimates were exaggerated when there was inadequate or unclear allocation concealment (ratio of odds ratios 0.69 (95% CI 0.59 to 0.82)) or lack of blinding (0.75 (0.61 to 0.93)). In contrast, there was little evidence of bias in trials with objective outcomes: ratios of odds ratios 0.91 (0.80 to 1.03) for inadequate or unclear allocation concealment and 1.01 (0.92 to 1.10) for lack of blinding. There was little evidence for a difference between trials of drug and non-drug interventions. Except for trials with all cause mortality as the outcome, the magnitude of bias varied between meta-analyses. CONCLUSIONS: The average bias associated with defects in the conduct of randomised trials varies with the type of outcome. Systematic reviewers should routinely assess the risk of bias in the results of trials, and should report meta-analyses restricted to trials at low risk of bias either as the primary analysis or in conjunction with less restrictive analyses.

Molecular Characterization of Three Canine Models of Human Rare Bone Diseases: Caffey, van den Ende-Gupta, and Raine Syndromes.

One to two percent of all children are born with a developmental disorder requiring pediatric hospital admissions. For many such syndromes, the molecular pathogenesis remains poorly characterized. Parallel developmental disorders in other species could provide complementary models for human rare diseases by uncovering new candidate genes, improving the understanding of the molecular mechanisms and opening possibilities for therapeutic trials. We performed various experiments, e.g. combined genome-wide association and next generation sequencing, to investigate the clinico-pathological features and genetic causes of three developmental syndromes in dogs, including craniomandibular osteopathy (CMO), a previously undescribed skeletal syndrome, and dental hypomineralization, for which we identified pathogenic variants in the canine SLC37A2 (truncating splicing enhancer variant), SCARF2 (truncating 2-bp deletion) and FAM20C (missense variant) genes, respectively. CMO is a clinical equivalent to an infantile cortical hyperostosis (Caffey disease), for which SLC37A2 is a new candidate gene. SLC37A2 is a poorly characterized member of a glucose-phosphate transporter family without previous disease associations. It is expressed in many tissues, including cells of the macrophage lineage, e.g. osteoclasts, and suggests a disease mechanism, in which an impaired glucose homeostasis in osteoclasts compromises their function in the developing bone, leading to hyperostosis. Mutations in SCARF2 and FAM20C have been associated with the human van den Ende-Gupta and Raine syndromes that include numerous features similar to the affected dogs. Given the growing interest in the molecular characterization and treatment of human rare diseases, our study presents three novel physiologically relevant models for further research and therapy approaches, while providing the molecular identity for the canine conditions.