Appraising the quality of randomized controlled trials: inter-rater reliability for the OTseeker evidence database

Rationale and aims 'OTseeker' is an online database of randomized controlled trials (RCTs) and systematic reviews relevant to occupational therapy. RCTs are critically appraised and rated for quality using the 'PEDro' scale. We aimed to investigate the inter-rater reliability of the PEDro scale before and after revising rating guidelines. Methods In study 1, five raters scored 100 RCTs using the original PEDro scale guidelines. In study 2, two raters scored 40 different RCTs using revised guidelines. All RCTs were randomly selected from the OTseeker database. Reliability was calculated using Kappa and intraclass correlation coefficients [ICC (model 2,1)]. Results Inter-rater reliability was 'good to excellent' in the first study (Kappas >= 0.53; ICCs >= 0.71). After revising the rating guidelines, the reliability levels were equivalent or higher to those previously obtained (Kappas >= 0.53; ICCs >= 0.89), except for the item, 'groups similar at baseline', which still had moderate reliability (Kappa = 0.53). In study 2, two PEDro scale items, which had their definitions revised, 'less than 15% dropout' and 'point measures and variability', showed higher reliability. In both studies, the PEDro items with the lowest reliability were 'groups similar at baseline' (Kappas = 0.53), 'less than 15% dropout' (Kappas

A Comparison of Methodologies from Two Longitudinal Community-Based Randomized Controlled Trials of Similar Interventions in Palliative Care: What Worked and What Did Not

Background: Methodological challenges such as recruitment problems and participant burden make clinical trials in palliative care difficult. In 2001-2004, two community-based randomized controlled trials (RCTs) of case conferences in palliative care settings were independently conducted in Australia-the Queensland Case Conferences trial (QCC) and the Palliative Care Trial (PCT). Design: A structured comparative study of the QCC and PCT was conducted, organized by known practical and organizational barriers to clinical trials in palliative care. Results: Differences in funding dictated study designs and recruitment success; PCT had 6 times the budget of QCC. Sample size attainment. Only PCT achieved the sample size goal. QCC focused on reducing attrition through gatekeeping while PCT maximized participation through detailed recruitment strategies and planned for significant attrition. Testing sustainable interventions. QCC achieved a higher percentage of planned case conferences; the QCC strategy required minimal extra work for clinicians while PCT superimposed conferences on normal work schedules. Minimizing participant burden. Differing strategies of data collection were implemented to reduce participant burden. QCC had short survey instruments. PCT incorporated all data collection into normal clinical nursing encounters. Other. Both studies had acceptable withdrawal rates. Intention-to-treat analyses are planned. Both studies included substudies to validate new outcome measures. Conclusions: Health service interventions in palliative care can be studied using RCTs. Detailed comparative information of strategies, successes and challenges can inform the design of future trials. Key lessons include adequate funding, recruitment focus, sustainable interventions, and mechanisms to minimize participant burden.

An integrated analysis of five double-blind, randomized controlled trials evaluating the safety and efficacy of a hyaluronan product for intra-articular injection in osteoarthritis of the kneel

Objective: Five double-blind, randomized, saline-controlled trials (RCTs) were included in the United States marketing application for an intra-articular hyaluronan (IA-HA) product for the treatment of osteoarthritis (OA) of the knee. We report an integrated analysis of the primary Case Report Form (CRF) data from these trials. Method. Trials were similar in design, patient population and outcome measures - all included the Lequesne Algofunctional Index (LI), a validated composite index of pain and function, evaluating treatment over 3 months. Individual patient data were pooled; a repeated measures analysis of covariance was performed in the intent-to-treat (ITT) population. Analyses utilized both fixed and random effects models. Safety data from the five RCTs were summarized. Results: A total of 1155 patients with radiologically confirmed knee OA were enrolled: 619 received three or five IA-HA injections; 536 received. placebo saline injections. In the active and control groups, mean ages were 61.8 and 61.4 years; 62.4% and 58.8% were women; baseline total Lequesne scores 11.03 and 11.30, respectively. Integrated analysis of the pooled data set found a statistically significant reduction (P < 0.001) in total Lequesne score with hyaluronan (HA) (-2.68) vs placebo (-2.00); estimated difference -0.68 (95% CI: -0.56 to -0.79), effect size 0.20. Additional modeling approaches confirmed robustness of the analyses. Conclusions: This integrated analysis demonstrates that multiple design factors influence the results of RCTs assessing efficacy of intra-articular (IA) therapies, and that integrated analyses based on primary data differ from meta-analyses using transformed data. (C) 2006 OsteoArthritis Research Society International. Published by Elsevier Ltd. All rights reserved.

Small-scale randomized controlled trials need more powerful methods of mediational analysis than the Baron-Kenny method

Objective: To devise more-effective physical activity interventions, the mediating mechanisms yielding behavioral change need to be identified. The Baron-Kenny method is most commonly used. but has low statistical power and May not identify mechanisms of behavioral change in small-to-medium size Studies. More powerful statistical tests are available, Study Design and Setting: Inactive adults (N = 52) were randomized to either a print or a print-plus-telephone intervention. Walking and exercise-related social support Were assessed at baseline, after file intervention, and 4 weeks later. The Baron-Kenny and three alternative methods of mediational analysis (Freedman-Schatzkin; MacKinnon et al.: bootstrap method) were used to examine the effects of social support on initial behavior change and maintenance. Results: A significant mediational effect of social support on initial behavior change was indicated by the MacKinnon et al., bootstrap. and. marginally. Freedman-Schatzkin methods, but not by the Baron-Kenny method. No significant mediational effecl of social support on maintenance of walking was found. Conclusions: Methodologically rigorous intervention studies to identify mediators of change in physical activity are costly and labor intensive, and may not be feasible with large samples. The Use of statistically powerful tests of mediational effects in small-scale studies can inform the development of more effective interventions. (C) 2006 Elsevier Inc. All rights reserved.

Psychological therapies for chronic pelvic pain:systematic review of randomized controlled trials

Chronic pelvic pain (CPP), a common cause of disability in women, is a condition best viewed in the biopsychosocial framework. Psychological interventions are frequently considered alongside medical and surgical treatments. Our objective was to evaluate the effectiveness of psychological therapies for the treatment of CPP. Electronic literature searches were conducted in Medline, Embase, PsycInfo and DARE databases from database inception to April 2010. Reference lists of selected articles were searched for further articles. The studies selected were randomized controlled trials of psychological therapies in patients with CPP compared with no treatment, standard gynecological treatment or another form of psychological therapy. Two reviewers independently selected articles without language restrictions and extracted data covering study characteristics, study quality and results. Reduction in pain, measured using visual analog scales or other measurements, was the main outcome measure. Of the 107 citations identified, four studies satisfied the inclusion criteria. Compared with no psychological intervention, therapy produced a standardized mean pain score of -3.27 [95% confidence interval (CI) -4.52 to -2.02] and 1.11 (95% CI -0.05 to 2.27) at 3 months and -3.95 (95% CI -5.35 to -2.55) and 0.54 (95% CI -0.78 to 1.86) at 6 months and greater, based on a visual analog scale score of 0-10. The current evidence does not allow us to conclude whether psychological interventions have an effect on self-reported pain scores in women with CPP.

Pronounced reduction of postprandial glucagon by lixisenatide:a meta-analysis of randomized clinical trials

Glucagon-like peptide-1 (GLP-1) receptor agonists improve islet function and delay gastric emptying in patients with type 2 diabetes mellitus (T2DM). This meta-analysis aimed to investigate the effects of the once-daily prandial GLP-1 receptor agonist lixisenatide on postprandial plasma glucose (PPG), glucagon and insulin levels. Methods: Six randomized, placebo-controlled studies of lixisenatide 20μg once daily were included in this analysis: lixisenatide as monotherapy (GetGoal-Mono), as add-on to oral antidiabetic drugs (OADs; GetGoal-M, GetGoal-S) or in combination with basal insulin (GetGoal-L, GetGoal-Duo-1 and GetGoal-L-Asia). Change in 2-h PPG and glucose excursion were evaluated across six studies. Change in 2-h glucagon and postprandial insulin were evaluated across two studies. A meta-analysis was performed on least square (LS) mean estimates obtained from analysis of covariance (ANCOVA)-based linear regression. Results: Lixisenatide significantly reduced 2-h PPG from baseline (LS mean difference vs. placebo: -4.9mmol/l, p<0.001) and glucose excursion (LS mean difference vs. placebo: -4.5mmol/l, p<0.001). As measured in two studies, lixisenatide also reduced postprandial glucagon (LS mean difference vs. placebo: -19.0ng/l, p<0.001) and insulin (LS mean difference vs. placebo: -64.8 pmol/l, p<0.001). There was a stronger correlation between 2-h postprandial glucagon and 2-h PPG with lixisenatide than with placebo. Conclusions: Lixisenatide significantly reduced 2-h PPG and glucose excursion together with a marked reduction in postprandial glucagon and insulin; thus, lixisenatide appears to have biological effects on blood glucose that are independent of increased insulin secretion. These effects may be, in part, attributed to reduced glucagon secretion. © 2014 John Wiley and Sons Ltd.

Systematic review investigating the reporting of comorbidities and medication in randomized controlled trials of people with dementia

Objectives: dementia is a debilitating condition characterised by global loss of cognitive and intellectual functioning, which reduces social and occupational performance. This population frequently presents with medical co-morbidities such as hypertension, cardiovascular disease and diabetes. The CONSORT statement outlines recommended guidance on reporting of participant characteristics in clinical trials. It is, however, unclear how much these are adhered to in trials assessing people with dementia. This paper assesses the reporting of medical co-morbidities and prescribed medications for people with dementia within randomised controlled trial (RCT) reports. Design: a systematic review of the published literature from the databases AMED, CINAHL, MEDLINE, EMBASE and the Cochrane Clinical Trial Registry from 1 January 1997 to 9 January 2014 was undertaken in order to identify RCTs detailing baseline medical co-morbidities and prescribed medications . Eligible studies were appraised using the Critical Appraisal Skills Programme (CASP) RCT appraisal tool, and descriptive statistical analyses were calculated to determine point prevalence. Results: nine trials, including 1474 people with dementia, were identified presenting medical co-morbidity data. These indicated neurological disorders ( prevalence 91%), vascular disorders (prevalence 91%), cardiac disorders ( prevalence 74%) and ischaemic cerebrovascular disease ( prevalence 53%) were most frequently seen. Conclusions: published RCTs poorly report medical co-morbidities and medications for people with dementia. Future trials should include the report of these items to allow interpretation of whether the results are generalisable to frailer older populations.

Methods and processes for development of a CONSORT extension for reporting pilot randomized controlled trials

Peer reviewed

Effectiveness of inulin intake on indicators of chronic constipation; a meta-analysis of controlled randomized clinical trials

Background: Constipation is an intestinal dysfunction. Prebiotics, such as inulin, can improve bowel function by positively influencing intestinal biota. Aim: To analyze the scientific evidence for the role of inulin in improving bowel function in patients with chronic constipation. Methods: A meta-analysis of randomized controlled clinical trials was conducted, grounded on a literature search for the period 1995-2013 (descriptors: inulin & constipation) on PubMed, ScieLo and Central Trials Register Cochrane databases. A total of 24 articles were found, 5 of them were selected for this meta-analysis, involving 252 subjects (experimental group: n = 144, control group: n = 108). The quality of the studies was assessed using the Jadad scale. Results: We found a significant overall effect of inulin on stool frequency (DEM = 0.69, 95%CI: 0.04, 1.34), stool consistency (Bristol scale) (DEM = 1.07, 95% CI: 0.70, 1.45), transit time (DEM = -0.57, 95% CI: -0.99, -0.15) and hardness of stool (RR = 0.42, 95% CI: 0.26, 0.70). Pain and bloating do not improve with inulin intake. Conclusions: inulin intake has a positive effect on bowel function.