Small study effects in meta-analyses of osteoarthritis trials: meta-epidemiological study

Objective To examine the presence and extent of small study effects in clinical osteoarthritis research. Design Meta-epidemiological study. Data sources 13 meta-analyses including 153 randomised trials (41 605 patients) that compared therapeutic interventions with placebo or non-intervention control in patients with osteoarthritis of the hip or knee and used patients’ reported pain as an outcome. Methods We compared estimated benefits of treatment between large trials (at least 100 patients per arm) and small trials, explored funnel plots supplemented with lines of predicted effects and contours of significance, and used three approaches to estimate treatment effects: meta-analyses including all trials irrespective of sample size, meta-analyses restricted to large trials, and treatment effects predicted for large trials. Results On average, treatment effects were more beneficial in small than in large trials (difference in effect sizes −0.21, 95% confidence interval −0.34 to −0.08, P=0.001). Depending on criteria used, six to eight funnel plots indicated small study effects. In six of 13 meta-analyses, the overall pooled estimate suggested a clinically relevant, significant benefit of treatment, whereas analyses restricted to large trials and predicted effects in large trials yielded smaller non-significant estimates. Conclusions Small study effects can often distort results of meta-analyses. The influence of small trials on estimated treatment effects should be routinely assessed.

Methods to convert continuous outcomes into odds ratios of treatment response and numbers needed to treat: meta-epidemiological study

Clinicians find standardized mean differences (SMDs) calculated from continuous outcomes difficult to interpret. Our objective was to determine the performance of methods in converting SMDs or means to odds ratios of treatment response and numbers needed to treat (NNTs) as more intuitive measures of treatment effect.

Epidemiological study of pestiviruses in South American camelids in Switzerland

BACKGROUND: In the context of the ongoing eradication campaign for bovine viral diarrhea virus (BVDV) in cattle in Switzerland, the role of South American camelids (SAC) as a possible virus reservoir needed to be evaluated. OBJECTIVE: To assess and characterize the prevalence of pestivirus infections in SAC in Switzerland. ANIMALS: Serum samples collected from 348 animals (40 herds) in 2008 and from 248 animals (39 herds) in 2000 were examined for antibodies against pestiviruses and for the presence of BVDV viral RNA. METHODS: Cross-sectional study using stratified, representative herd sampling. An indirect BVDV-ELISA was used to analyze serum samples for pestivirus antibodies, and positive samples underwent a serum neutralization test (SNT). Real-time RT-PCR to detect pestiviral RNA was carried out in all animals from herds with at least 1 seropositive animal. RESULTS: In 2008, the overall prevalence of animals positive for antibodies (ELISA) and pestiviral RNA or was 5.75 and 0%, respectively. In 2000, the corresponding prevalences were 3.63 and 0%, respectively. The seroprevalences (SNT) for BVDV, border disease virus or undetermined pestiviruses were estimated to be 0, 1.73, and 4.02% in 2008, and 0.40, 1.21, and 2.02% in 2000, respectively. CONCLUSIONS AND CLINICAL IMPORTANCE: At the present time, SAC appear to represent a negligible risk of re-infection for the BVDV eradication program in cattle in Switzerland.

[A descriptive epidemiological study on canine babesiosis in the Lake Geneva region]

A descriptive study was carried out in the district of the Lake Geneva between March 1, 2005 and August 31,2006 to assess the incidence and prevalence of canine babesiosis, to genotype the Babesia species occurring, to assess the most frequently clinical signs found and to address the potential of autochthonous transmission. This included a data assessment on the different tick-populations occurring in the area and on the prevalence of Babesia-DNA in these ticks. A total of 56 veterinary practices participated in the study. By blood smear and PCR, Babesia canis canis was found in 12 out of 21 cases with suspected babesiosis. In an additional 13th case, the parasite could only be detected by PCR. All autochthonous cases originated from the Western part of the Lake Geneva region. Clinical signs in affected dogs included inappetence, apathy, anemia, fever, hemoglobinuria and thrombocytopenia. There were no risk factors with regard to age, sex and breed. Most cases were diagnosed during the spring periods of 2005 and 2006 (11 cases) and two cases in autumn 2005, coinciding with the main activity period of Dermacentor reticulatus, the main vector of B. canis canis. A total of 495 ticks were collected on patients by the veterinarians, 473 were identified as Ixodes sp., 7 as Rhipicephalus sanguineus and 15 as Dermacentor reticulatus. While Ixodes sp. was found in the whole study area, D. reticulatus and R. sanguineus occurred only in the Western part till Lausanne. PCR and sequencing yielded B. canis canis positivity in 3 D. reticulatus specimen, these three ticks were collected from two different dogs both suffering from babesiosis. All R. sanguineus were negative by Babesia-PCR. Global warming, ecological changes in the potential habitat of ticks, increasing host- and vector-populations and increasing mobility of dog owners may be responsible for an emergence situation of infection risk for Babesia spp. by time. E.g., Dermacentor reticulatus has become autochtonously prevalent already till Lausanne in the Lake Geneva region, and further surveillance is suggested to tackle this problem.

Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study

OBJECTIVE: To examine whether the association of inadequate or unclear allocation concealment and lack of blinding with biased estimates of intervention effects varies with the nature of the intervention or outcome. DESIGN: Combined analysis of data from three meta-epidemiological studies based on collections of meta-analyses. DATA SOURCES: 146 meta-analyses including 1346 trials examining a wide range of interventions and outcomes. MAIN OUTCOME MEASURES: Ratios of odds ratios quantifying the degree of bias associated with inadequate or unclear allocation concealment, and lack of blinding, for trials with different types of intervention and outcome. A ratio of odds ratios <1 implies that inadequately concealed or non-blinded trials exaggerate intervention effect estimates. RESULTS: In trials with subjective outcomes effect estimates were exaggerated when there was inadequate or unclear allocation concealment (ratio of odds ratios 0.69 (95% CI 0.59 to 0.82)) or lack of blinding (0.75 (0.61 to 0.93)). In contrast, there was little evidence of bias in trials with objective outcomes: ratios of odds ratios 0.91 (0.80 to 1.03) for inadequate or unclear allocation concealment and 1.01 (0.92 to 1.10) for lack of blinding. There was little evidence for a difference between trials of drug and non-drug interventions. Except for trials with all cause mortality as the outcome, the magnitude of bias varied between meta-analyses. CONCLUSIONS: The average bias associated with defects in the conduct of randomised trials varies with the type of outcome. Systematic reviewers should routinely assess the risk of bias in the results of trials, and should report meta-analyses restricted to trials at low risk of bias either as the primary analysis or in conjunction with less restrictive analyses.

The effects of excluding patients from the analysis in randomised controlled trials: meta-epidemiological study

OBJECTIVE: To examine whether excluding patients from the analysis of randomised trials are associated with biased estimates of treatment effects and higher heterogeneity between trials. DESIGN: Meta-epidemiological study based on a collection of meta-analyses of randomised trials. DATA SOURCES: 14 meta-analyses including 167 trials that compared therapeutic interventions with placebo or non-intervention control in patients with osteoarthritis of the hip or knee and used patient reported pain as an outcome. METHODS: Effect sizes were calculated from differences in means of pain intensity between groups at the end of follow-up, divided by the pooled standard deviation. Trials were combined by using random effects meta-analysis. Estimates of treatment effects were compared between trials with and trials without exclusions from the analysis, and the impact of restricting meta-analyses to trials without exclusions was assessed. RESULTS: 39 trials (23%) had included all patients in the analysis. In 128 trials (77%) some patients were excluded from the analysis. Effect sizes from trials with exclusions tended to be more beneficial than those from trials without exclusions (difference -0.13, 95% confidence interval -0.29 to 0.04). However, estimates of bias between individual meta-analyses varied considerably (tau(2)=0.07). Tests of interaction between exclusions from the analysis and estimates of treatment effects were positive in five meta-analyses. Stratified analyses indicated that differences in effect sizes between trials with and trials without exclusions were more pronounced in meta-analyses with high between trial heterogeneity, in meta-analyses with large estimated treatment benefits, and in meta-analyses of complementary medicine. Restriction of meta-analyses to trials without exclusions resulted in smaller estimated treatment benefits, larger P values, and considerable decreases in between trial heterogeneity. CONCLUSION: Excluding patients from the analysis in randomised trials often results in biased estimates of treatment effects, but the extent and direction of bias is unpredictable. Results from intention to treat analyses should always be described in reports of randomised trials. In systematic reviews, the influence of exclusions from the analysis on estimated treatment effects should routinely be assessed.

Combining follow-up and change data is valid in meta-analyses of continuous outcomes: a meta-epidemiological study

OBJECTIVE To investigate whether it is valid to combine follow-up and change data when conducting meta-analyses of continuous outcomes. STUDY DESIGN AND SETTING Meta-epidemiological study of randomized controlled trials in patients with osteoarthritis of the knee/hip, which assessed patient-reported pain. We calculated standardized mean differences (SMDs) based on follow-up and change data, and pooled within-trial differences in SMDs. We also derived pooled SMDs indicating the largest treatment effect within a trial (optimistic selection of SMDs) and derived pooled SMDs from the estimate indicating the smallest treatment effect within a trial (pessimistic selection of SMDs). RESULTS A total of 21 meta-analyses with 189 trials with 292 randomized comparisons in 41,256 patients were included. On average, SMDs were 0.04 standard deviation units more beneficial when follow-up values were used (difference in SMDs: -0.04; 95% confidence interval: -0.13, 0.06; P=0.44). In 13 meta-analyses (62%), there was a relevant difference in clinical and/or significance level between optimistic and pessimistic pooled SMDs. CONCLUSION On average, there is no relevant difference between follow-up and change data SMDs, and combining these estimates in meta-analysis is generally valid. Decision on which type of data to use when both follow-up and change data are available should be prespecified in the meta-analysis protocol.

Effects of study precision and risk of bias in networks of interventions: a network meta-epidemiological study

BACKGROUND Empirical research has illustrated an association between study size and relative treatment effects, but conclusions have been inconsistent about the association of study size with the risk of bias items. Small studies give generally imprecisely estimated treatment effects, and study variance can serve as a surrogate for study size. METHODS We conducted a network meta-epidemiological study analyzing 32 networks including 613 randomized controlled trials, and used Bayesian network meta-analysis and meta-regression models to evaluate the impact of trial characteristics and study variance on the results of network meta-analysis. We examined changes in relative effects and between-studies variation in network meta-regression models as a function of the variance of the observed effect size and indicators for the adequacy of each risk of bias item. Adjustment was performed both within and across networks, allowing for between-networks variability. RESULTS Imprecise studies with large variances tended to exaggerate the effects of the active or new intervention in the majority of networks, with a ratio of odds ratios of 1.83 (95% CI: 1.09,3.32). Inappropriate or unclear conduct of random sequence generation and allocation concealment, as well as lack of blinding of patients and outcome assessors, did not materially impact on the summary results. Imprecise studies also appeared to be more prone to inadequate conduct. CONCLUSIONS Compared to more precise studies, studies with large variance may give substantially different answers that alter the results of network meta-analyses for dichotomous outcomes.

PEDro or Cochrane to Assess the Quality of Clinical Trials? A Meta-Epidemiological Study.

OBJECTIVE There is debate on how the methodological quality of clinical trials should be assessed. We compared trials of physical therapy (PT) judged to be of adequate quality based on summary scores from the Physiotherapy Evidence Database (PEDro) scale with trials judged to be of adequate quality by Cochrane Risk of Bias criteria. DESIGN Meta-epidemiological study within Cochrane Database of Systematic Reviews. METHODS Meta-analyses of PT trials were identified in the Cochrane Database of Systematic Reviews. For each trial PeDro and Cochrane assessments were extracted from the PeDro and Cochrane databases. Adequate quality was defined as adequate generation of random sequence, concealment of allocation, and blinding of outcome assessors (Cochrane criteria) or as trials with a PEDro summary score ≥5 or ≥6 points. We combined trials of adequate quality using random-effects meta-analysis. RESULTS Forty-one Cochrane reviews and 353 PT trials were included. All meta-analyses included trials with PEDro scores ≥5, 37 (90.2%) included trials with PEDro scores ≥6 and only 22 (53.7%) meta-analyses included trials of adequate quality according to the Cochrane criteria. Agreement between PeDro and Cochrane was poor for PeDro scores of ≥5 points (kappa = 0.12; 95% CI 0.07 to 0.16) and slight for ≥6 points (kappa 0.24; 95% CI 0.16-0.32). When combining effect sizes of trials deemed to be of adequate quality according to PEDro or Cochrane criteria, we found that a substantial difference in the combined effect size (≥0.15) was evident in 9 (22%) out of the 41 meta-analyses for PEDro cutoff ≥5 and 10 (24%) for cutoff ≥6. CONCLUSIONS The PeDro and Cochrane approaches lead to different sets of trials of adequate quality, and different combined treatment estimates from meta-analyses of these trials. A consistent approach to assessing RoB in trials of physical therapy should be adopted.

What is the influence of randomisation sequence generation and allocation concealment on treatment effects of physical therapy trials? A meta-epidemiological study.

OBJECTIVE To determine if adequacy of randomisation and allocation concealment is associated with changes in effect sizes (ES) when comparing physical therapy (PT) trials with and without these methodological characteristics. DESIGN Meta-epidemiological study. PARTICIPANTS A random sample of randomised controlled trials (RCTs) included in meta-analyses in the PT discipline were identified. INTERVENTION Data extraction including assessments of random sequence generation and allocation concealment was conducted independently by two reviewers. To determine the association between sequence generation, and allocation concealment and ES, a two-level analysis was conducted using a meta-meta-analytic approach. PRIMARY AND SECONDARY OUTCOME MEASURES association between random sequence generation and allocation concealment and ES in PT trials. RESULTS 393 trials included in 43 meta-analyses, analysing 44 622 patients contributed to this study. Adequate random sequence generation and appropriate allocation concealment were accomplished in only 39.7% and 11.5% of PT trials, respectively. Although trials with inappropriate allocation concealment tended to have an overestimate treatment effect when compared with trials with adequate concealment of allocation, the difference was non-statistically significant (ES=0.12; 95% CI -0.06 to 0.30). When pooling our results with those of Nuesch et al, we obtained a pooled statistically significant value (ES=0.14; 95% CI 0.02 to 0.26). There was no difference in ES in trials with appropriate or inappropriate random sequence generation (ES=0.02; 95% CI -0.12 to 0.15). CONCLUSIONS Our results suggest that when evaluating risk of bias of primary RCTs in PT area, systematic reviewers and clinicians implementing research into practice should pay attention to these biases since they could exaggerate treatment effects. Systematic reviewers should perform sensitivity analysis including trials with low risk of bias in these domains as primary analysis and/or in combination with less restrictive analyses. Authors and editors should make sure that allocation concealment and random sequence generation are properly reported in trial reports.

"Pseudo-Beijing": evidence for convergent evolution in the direct repeat region of Mycobacterium tuberculosis

Background Mycobacterium tuberculosis has a global population structure consisting of six main phylogenetic lineages associated with specific geographic regions and human populations. One particular M. tuberculosis genotype known as “Beijing” has repeatedly been associated with drug resistance and has been emerging in some parts of the world. “Beijing” strains are traditionally defined based on a characteristic spoligotyping pattern. We used three alternative genotyping techniques to revisit the phylogenetic classification of M. tuberculosis complex (MTBC) strains exhibiting the typical “Beijing” spoligotyping pattern. Methods and Findings MTBC strains were obtained from an ongoing molecular epidemiological study in Switzerland and Nepal. MTBC genotyping was performed based on SNPs, genomic deletions, and 24-loci MIRU-VNTR. We identified three MTBC strains from patients originating from Tibet, Portugal and Nepal which exhibited a spoligotyping patterns identical to the classical Beijing signature. However, based on three alternative molecular markers, these strains were assigned to Lineage 3 (also known as Delhi/CAS) rather than to Lineage 2 (also known as East-Asian lineage). Sequencing of the RD207 in one of these strains showed that the deletion responsible for this “Pseudo-Beijing” spoligotype was about 1,000 base pairs smaller than the usual deletion of RD207 in classical “Beijing” strains, which is consistent with an evolutionarily independent deletion event in the direct repeat (DR) region of MTBC. Conclusions We provide an example of convergent evolution in the DR locus of MTBC, and highlight the limitation of using spoligotypes for strain classification. Our results indicate that a proportion of “Beijing” strains may have been misclassified in the past. Markers that are more phylogenetically robust should be used when exploring strain-specific differences in experimental or clinical phenotypes.

Seroprevalence of Taenia saginata cysticercosis in the federal state of Lower Saxony in Germany

Based on ELISA results from randomly selected serum samples taken from 128 cattle from different administrative and urban districts in the federal state of Lower Saxony in Germany a seroprevalence estimate of Taenia saginata cysticercosis in this area was derived. This estimate was subsequently used to calculate the sample size required in an epidemiological study to determine the actual prevalence of this infection in the cattle population (n = 2 604 767) in this federal state. The sample size was calculated as 1518 and the samples were collected according to the distribution of cattle among the 48 administrative and urban districts in Lower Saxony. The samples were tested with an evaluated antibody ELISA. The results showed a positive antibody titre rate of 8.83% from the total tested samples.

[Feline hemoplasmas in Switzerland: identification of a novel species, diagnosis, prevalence, and clinical importance]

Two feline hemotropic mycoplasma spp. (aka hemoplasma) have previously been recognized. We recently discovered a third novel species in a cat with hemolytic anemia, designated 'Candidatus Mycoplasma turicensis', which is closely related to rodent haemoplasmas. This novel species induced anemia after experimental transmission to two SPF cats. Three quantitative real-time PCR assays were newly designed and applied to an epidemiological study surveying the Swiss pet cat population. Blood samples from 713 healthy and ill cats were analyzed. Up to 104 parameters per cat (detailed questionnaire, case history, laboratory parameters and retroviral infections) were evaluated. 'Candidatus Mycoplasma haemominutum' infection was more prevalent (8.5%) than Mycoplasma haemofelis (0.5%) and 'Candidatus Mycoplasma turicensis' (1%). Hemoplasma infections were associated with male gender, outdoor access, and old age, but not with disease or anemia. Infections were more frequently found in the South and West of Switzerland. Several hemoplasma infected cats, some acutely infected, others co-infected with FIV or FeLV, showed hemolytic anemia indicating that additional factors might play a role in the pathogenesis of the disease.

Serotype-specific invasiveness and colonization prevalence in Streptococcus pneumoniae correlate with the lag phase during in vitro growth

Serotypes of Streptococcus pneumoniae differ in colonization prevalence and the likelihood of causing disease. In vitro growth in brain heart infusion broth with or without 5% fetal calf serum (FCS) was compared for 47 clinical isolates representing 15 pneumococcal serotypes. Serotype-specific colonization prevalence and odds ratios for the invasive potential were obtained from an international and a local epidemiological study. The duration of the lag phase increased with the invasiveness and was inversely associated with the colonization prevalence of a serotype. Supplementation with FCS shortened the lag phase preferentially in serotypes associated with invasive disease (P=0.007). Reduction of oxidative stress by addition of manganese (Mn(2+)), Tiron, mannitol or catalase did not influence the duration of the lag phase significantly. Serotype specific invasiveness and colonization prevalence of S. pneumoniae are associated with the length of the lag phase during in vitro growth. This may correlate with serotype specific selection in vivo.

HIV infection disrupts the sympatric host-pathogen relationship in human tuberculosis

The phylogeographic population structure of Mycobacterium tuberculosis suggests local adaptation to sympatric human populations. We hypothesized that HIV infection, which induces immunodeficiency, will alter the sympatric relationship between M. tuberculosis and its human host. To test this hypothesis, we performed a nine-year nation-wide molecular-epidemiological study of HIV-infected and HIV-negative patients with tuberculosis (TB) between 2000 and 2008 in Switzerland. We analyzed 518 TB patients of whom 112 (21.6%) were HIV-infected and 233 (45.0%) were born in Europe. We found that among European-born TB patients, recent transmission was more likely to occur in sympatric compared to allopatric host-pathogen combinations (adjusted odds ratio [OR] 7.5, 95% confidence interval [95% CI] 1.21-infinity, p = 0.03). HIV infection was significantly associated with TB caused by an allopatric (as opposed to sympatric) M. tuberculosis lineage (OR 7.0, 95% CI 2.5-19.1, p<0.0001). This association remained when adjusting for frequent travelling, contact with foreigners, age, sex, and country of birth (adjusted OR 5.6, 95% CI 1.5-20.8, p = 0.01). Moreover, it became stronger with greater immunosuppression as defined by CD4 T-cell depletion and was not the result of increased social mixing in HIV-infected patients. Our observation was replicated in a second independent panel of 440 M. tuberculosis strains collected during a population-based study in the Canton of Bern between 1991 and 2011. In summary, these findings support a model for TB in which the stable relationship between the human host and its locally adapted M. tuberculosis is disrupted by HIV infection.