Appraising the quality of randomized controlled trials: inter-rater reliability for the OTseeker evidence database

Rationale and aims 'OTseeker' is an online database of randomized controlled trials (RCTs) and systematic reviews relevant to occupational therapy. RCTs are critically appraised and rated for quality using the 'PEDro' scale. We aimed to investigate the inter-rater reliability of the PEDro scale before and after revising rating guidelines. Methods In study 1, five raters scored 100 RCTs using the original PEDro scale guidelines. In study 2, two raters scored 40 different RCTs using revised guidelines. All RCTs were randomly selected from the OTseeker database. Reliability was calculated using Kappa and intraclass correlation coefficients [ICC (model 2,1)]. Results Inter-rater reliability was 'good to excellent' in the first study (Kappas >= 0.53; ICCs >= 0.71). After revising the rating guidelines, the reliability levels were equivalent or higher to those previously obtained (Kappas >= 0.53; ICCs >= 0.89), except for the item, 'groups similar at baseline', which still had moderate reliability (Kappa = 0.53). In study 2, two PEDro scale items, which had their definitions revised, 'less than 15% dropout' and 'point measures and variability', showed higher reliability. In both studies, the PEDro items with the lowest reliability were 'groups similar at baseline' (Kappas = 0.53), 'less than 15% dropout' (Kappas

A medical management of interstitial ectopic pregnancy: A 5-year clinical study

Background: Medical treatment of the rare interstitial ectopic pregnancy with methotrexate has been considered an alternative to surgical resection. Aim: To determine the treatment success rate with a single-dose intravenous methotrexate/folinic acid regimen and to identify predictors of treatment outcome. Methods: A 5-year audit (April 2000-August 2005) was carried out, collecting clinical imaging data and serum beta-human chorionic gonadotrophin (beta-hCG). Time taken for complete beta-hCG resolution was recorded, and a negative beta-hCG result was used as an endpoint of successful outcome. Results: Of the 13 cases, two required urgent surgery for rupture on presentation. In the remaining 11 cases, intravenous methotrexate (300 mg) was used, with oral folinic acid rescue (15 mg x 4 doses). There were no side-effects. Complete beta-hCG resolution was achieved in 10 of the 11 medically treated cases (91% success rate), requiring 21-129 days. Successful outcome was seen with initial beta-hCG level as high as 106 634 IU/L and gestation sac as large as 6 cm and a live fetus. Conclusion: The methotrexate/folinic acid regimen used as a one-dose treatment is safe and effective for unruptured interstitial pregnancy, with no side-effects and the advantage of avoiding invasive surgery. Subsequent tubal patency and reproductive function are yet to be ascertained.

A pragmatic 2 × 2 × 2 factorial cluster randomized controlled trial of educational outreach visiting and case conferencing in palliative care—methodology of the Palliative Care Trial [ISRCTN 81117481]

The demand for palliative care is increasing, yet there are few data on the best models of care nor well-validated interventions that translate current evidence into clinical practice. Supporting multidisciplinary patient-centered palliative care while successfully conducting a large clinical trial is a challenge. The Palliative Care Trial (PCT) is a pragmatic 2 x 2 x 2 factorial cluster randomized controlled trial that tests the ability of educational outreach visiting and case conferencing to improve patient-based outcomes such as performance status and pain intensity. Four hundred sixty-one consenting patients and their general practitioners (GPs) were randomized to the following: (1) GP educational outreach visiting versus usual care, (2) Structured patient and caregiver educational outreach visiting versus usual care and (3) A coordinated palliative care model of case conferencing versus the standard model of palliative care in Adelaide, South Australia (3:1 randomization). Main outcome measures included patient functional status over time, pain intensity, and resource utilization. Participants were followed longitudinally until death or November 30, 2004. The interventions are aimed at translating current evidence into clinical practice and there was particular attention in the trial's design to addressing common pitfalls for clinical studies in palliative care. Given the need for evidence about optimal interventions and service delivery models that improve the care of people with life-limiting illness, the results of this rigorous, high quality clinical trial will inform practice. Initial results are expected in mid 2005. (c) 2005 Elsevier Inc. All rights reserved.

Ethical issues in social research

There are numerous ethical issues that one must consider when developing a research project; however, much discussion about ethics in health research has focused on experimental studies such as clinical trials. As a result, there remains some ambiguity as to the ethical issues that need to be considered in health-related social research. This paper outlines a number of important ethical issues that CAM researchers should be aware of when developing, running and writing up social research. Maintaining high ethical standards is extremely important in social research as it protects participants and researchers, improves the quality of the data retrieved and ensures that future researchers will have access to participants within the community. (C) 2005 Elsevier Ltd. All rights reserved.

Cautionary tales in the interpretation of systematic reviews of therapy trials

This is the second in a series of articles emphasizing the cautions in the interpretation of health-care studies. Systematic reviews are presented as comprehensive, unbiased summaries of evidence and are often referred to by clinicians, guideline developers and health policy-makers. Their strengths and limitations, and how their results can be subject to bias and misinterpretation, are discussed.