An official American thoracic society research statement: Comparative effectiveness research in pulmonary, critical care, and sleep medicine

Background: Comparative effectiveness research (CER) is intended to inform decision making in clinical practice, and is central to patientcentered outcomes research (PCOR). Purpose: To summarize key aspects of CER definitions and provide examples highlighting the complementary nature of efficacy and CER studies in pulmonary, critical care, and sleep medicine. Methods: An ad hoc working group of the American Thoracic Society with experience in clinical trials, health services research, quality improvement, and behavioral sciences in pulmonary, critical care, and sleepmedicinewas convened. The group used an iterative consensus process, including a reviewbyAmerican Thoracic Society committees and assemblies. Results: The traditional efficacy paradigm relies on clinical trials with high internal validity to evaluate interventions in narrowly defined populations and in research settings. Efficacy studies address the question, "Can it work in optimal conditions?" The CER paradigm employs a wide range of study designs to understand the effects of interventions in clinical settings. CER studies address the question, "Does it work in practice?" The results of efficacy and CER studies may or may not agree. CER incorporates many attributes of outcomes research and health services research, while placing greater emphasis on meeting the expressed needs of nonresearcher stakeholders (e.g., patients, clinicians, and others). Conclusions: CER complements traditional efficacy research by placing greater emphasis on the effects of interventions in practice, and developing evidence to address the needs of the many stakeholders involved in health care decisions. Stakeholder engagement is an important component of CER. Copyright © 2013 by the American Thoracic Society.

SWAT-1: The effectiveness of a 'site visit' intervention on recruitment rates in a multi-centre randomised trial

Background: Recruitment rates in multi-centre randomised trials often fall below target recruitment rates, causing problems for study outcomes. The Studies Within A Trial (SWAT) Programme, established by the All-Ireland Hub for Trials Methodology Research in collaboration with the Medical Research Council Network of Hubs in the United Kingdom and others, is developing methods for evaluating aspects of trial methodology through the conduct of research within research. A recently published design for a SWAT-1 provides a protocol for evaluating the effect of a site visit by the principal investigator on recruitment in multi-centre trials.

Methods: Using the SWAT-1 design, the effect of a site visit, with the sole purpose of discussing trial recruitment, on recruitment rates in a large multicentre trial in the Republic of Ireland was evaluated. A controlled before and after intervention comparison was used, where the date of the site visit provides the time point for the intervention, and for the comparison to control sites. Site A received the intervention. Site B and Site C acted as the controls. Z-scores for proportions were calculated to determine within site recruitment differences. Odds ratios and 95% confidence intervals were calculated to determine between site recruitment differences.

Results: Recruitment rates were increased in Site A post-intervention (17% and 14% percentage point increases at 1 and 3 months, respectively). No differences in recruitment occurred in Site B or in Site C. Comparing between site differences, at 3 months post-intervention, a statistically significant difference was detected in favour of higher recruitment in Site A (34% versus 25%; odds ratio 1.57, 95% confidence interval 1.09 to 2.26).

Conclusions: This is the first reported example of a study in the SWAT programme.. It provides evidence that a site visit, combined with a scheduled meeting, increases recruitment in a clinical trial. Using this example, other researchers might be encouraged to consider conducting a similar study, allowing the findings of future SWAT-1s to be compared and combined, so that higher level evidence on the effect of a site visit by the principal investigator can be obtained.

Clinical and Cost-Effectiveness of Procalcitonin Test for Prodromal Meningococcal Disease-A Meta-Analysis

BACKGROUND: Despite vaccines and improved medical intensive care, clinicians must continue to be vigilant of possible Meningococcal Disease in children. The objective was to establish if the procalcitonin test was a cost-effective adjunct for prodromal Meningococcal Disease in children presenting at emergency department with fever without source.

METHODS AND FINDINGS: Data to evaluate procalcitonin, C-reactive protein and white cell count tests as indicators of Meningococcal Disease were collected from six independent studies identified through a systematic literature search, applying PRISMA guidelines. The data included 881 children with fever without source in developed countries.The optimal cut-off value for the procalcitonin, C-reactive protein and white cell count tests, each as an indicator of Meningococcal Disease, was determined. Summary Receiver Operator Curve analysis determined the overall diagnostic performance of each test with 95% confidence intervals. A decision analytic model was designed to reflect realistic clinical pathways for a child presenting with fever without source by comparing two diagnostic strategies: standard testing using combined C-reactive protein and white cell count tests compared to standard testing plus procalcitonin test. The costs of each of the four diagnosis groups (true positive, false negative, true negative and false positive) were assessed from a National Health Service payer perspective. The procalcitonin test was more accurate (sensitivity=0.89, 95%CI=0.76-0.96; specificity=0.74, 95%CI=0.4-0.92) for early Meningococcal Disease compared to standard testing alone (sensitivity=0.47, 95%CI=0.32-0.62; specificity=0.8, 95% CI=0.64-0.9). Decision analytic model outcomes indicated that the incremental cost effectiveness ratio for the base case was £-8,137.25 (US $ -13,371.94) per correctly treated patient.

CONCLUSIONS: Procalcitonin plus standard recommended tests, improved the discriminatory ability for fatal Meningococcal Disease and was more cost-effective; it was also a superior biomarker in infants. Further research is recommended for point-of-care procalcitonin testing and Markov modelling to incorporate cost per QALY with a life-time model.

Cost Effectiveness of Tooth Replacement Strategies for Partially Dentate Elders

Objectives: This study aimed to compare the cost effectiveness of conventional treatment using partial dentures with functionally-orientated treatment based on the shortened dental arch concept to replace missing teeth for partially dentate elders.
Methods: 44 partially dentate patients aged 65 years and older were recruited following routine dental assessment at a university dental hospital. Patients consented to and were randomly assigned to the two treatment arms. The conventional treatment group received a removable partial denture to replace all missing natural teeth. The functionally-orientated group were restored to a shortened dental arch of 10 occluding contacts using resin bonded bridgework. The costs associated with each treatment were recorded including laboratory charges, treatment time and opportunity costs. The impact on quality of life (OHRQoL) was measured using the 14-item Oral Health Impact Profile.
Results: Both groups reported improvements in OHRQoL after completion of treatment. For the conventional group, the mean OHIP-14 score decreased from 12.4 pre-operatively to 3.3 post-operatively (p<0.001). In the functionally-orientated group the OHIP-14 score decreased from 11.4 to 1.8 following treatment (p<0.001). On average the conventional treatment group required 8.3 clinic visits as compared to 4.4 visits for the functionally-orientated group. The mean total treatment time was 183 minutes 19 seconds for the conventional group versus 124 minutes 8 seconds for the functionally-orientated group. The conventional treatment group had an average of 6.33 teeth replaced at a laboratory cost of 337.31 Euros. The functionally-orientated group had an average of 2.64 teeth replaced at a laboratory cost of 244.05 Euros.
Conclusions: Restoration to a shortened dental arch using functionally-orientated treatment resulted in a similar improvement in OHRQoL with fewer clinic visits, less operative time and at a lower laboratory cost compared with conventional treatment.

A pilot randomised controlled trial (RCT) investigating the effectiveness of reflexology for managing pregnancy low back and/or pelvic pain.

any pregnant women with low back and/or pelvic pain (LBPP) use pain medications to manage this pain, much of which is self-prescribed and potentially harmful. Therefore, there is a need to find effective nonpharmacological treatments for the condition. Reflexology has previously been shown to help nonspecific low back pain. Therefore; a pilot RCT was conducted investigating reflexology in the management of pregnancy-LBPP. 90 primiparous women were randomised to either usual care, a reflexology or footbath intervention. Primary outcome measures were; the Pain Visual Analogue Scale (VAS). 64 women completed the RCT; retention rates for the reflexology group were 80%, usual care group 83.33% and footbath group 50%. The reflexology group demonstrated a Clinically Important Change (CIC) in pain frequency (1.64 cm). Results indicate it is feasible to conduct an RCT in this area, although a footbath is an unsuitable sham treatment. Reflexology may help manage pregnancy-LBPP; however a fully powered trial is needed to confirm this.

A systematic review investigating the effectiveness of Complementary and Alternative Medicine (CAM) for the management of low back and/or pelvic pain (LBPP) in pregnancy

Aim: To evaluate and summarize the current evidence on the effectiveness of complementary and alternative medicine for the management of low back pain and/or pelvic pain in pregnancy.

Background: International research demonstrates that 25-30% of women use complementary and alternative medicine to manage low back and pelvic pain in pregnancy without robust evidence demonstrating its effectiveness.

Design: A systematic review of randomized controlled trials to determine the effectiveness of complementary and alternative medicine for low back and/or pelvic pain in pregnancy.

Data Sources: Cochrane library (1898-2013), PubMed (1996-2013), MEDLINE (1946-2013), AMED (1985-2013), Embase (1974-2013), Cinahl (1937-2013), Index to Thesis (1716-2013) and Ethos (1914-2013).

Review Methods: Selected studies were written in English, randomized controlled trials, a group 1 or 2 therapy and reported pain reduction as an outcome measure. Study quality was reviewed using Risk of Bias and evidence strength the Cochrane Grading of Recommendations and Development Evaluation Tool.

Results: Eight studies were selected for full review. Two acupuncture studies with low risk of bias showed both clinically important changes and statistically significant results. There was evidence of effectiveness for osteopathy and chiropractic. However, osteopathy and chiropractic studies scored high for risk of bias. Strength of the evidence across studies was very low.

Conclusion: There is limited evidence supporting the use of general CAM for managing pregnancy-related low back and/or pelvic pain. However, the restricted availability of high-quality studies, combined with the very low evidence strength, makes it impossible to make evidence-based recommendations for practice.

Effectiveness of a Multifaceted Intervention for Potentially Inappropriate Prescribing in Older Patients in Primary Care: A Cluster-Randomized Controlled Trial (OPTI-SCRIPT Study)

PURPOSE Potentially inappropriate prescribing (PIP) is common in older people and can result in increased morbidity, adverse drug events, and hospitalizations. The OPTI-SCRIPT study (Optimizing Prescribing for Older People in Primary Care, a cluster-randomized controlled trial) tested the effectiveness of a multifaceted intervention for reducing PIP in primary care.

METHODS We conducted a cluster-randomized controlled trial among 21 general practitioner practices and 196 patients with PIP. Intervention participants received a complex, multifaceted intervention incorporating academic detailing; review of medicines with web-based pharmaceutical treatment algorithms that provide recommended alternative-treatment options; and tailored patient information leaflets. Control practices delivered usual care and received simple, patient-level PIP feedback. Primary outcomes were the proportion of patients with PIP and the mean number of potentially inappropriate prescriptions. We performed intention-to-treat analysis using random-effects regression.

RESULTS All 21 practices and 190 patients were followed. At intervention completion, patients in the intervention group had significantly lower odds of having PIP than patients in the control group (adjusted odds ratio = 0.32; 95% CI, 0.15–0.70; P = .02). The mean number of PIP drugs in the intervention group was 0.70, compared with 1.18 in the control group (P = .02). The intervention group was almost one-third less likely than the control group to have PIP drugs at intervention completion, but this difference was not significant (incidence rate ratio = 0.71; 95% CI, 0.50–1.02; P = .49). The intervention was effective in reducing proton pump inhibitor prescribing (adjusted odds ratio = 0.30; 95% CI, 0.14–0.68; P = .04).

CONCLUSIONS The OPTI-SCRIPT intervention incorporating academic detailing with a pharmacist, and a review of medicines with web-based pharmaceutical treatment algorithms, was effective in reducing PIP, particularly in modifying prescribing of proton pump inhibitors, the most commonly occurring PIP drugs nationally.

Consensus on Outcome Measures for Glaucoma Effectiveness Trials: Results From a Delphi and Nominal Group Technique Approaches

PURPOSE: Comparing the relative effectiveness of interventions across glaucoma trials can be problematic due to differences in definitions of outcomes. We sought to identify a key set of clinical outcomes and reach consensus on how best to measure them from the perspective of glaucoma experts.

METHODS: A 2-round electronic Delphi survey was conducted. Round 1 involved 25 items identified from a systematic review. Round 2 was developed based on information gathered in round 1. A 10-point Likert scale was used to quantify importance and consensus of outcomes (7 outcomes) and ways of measuring them (44 measures). Experts were identified through 2 glaucoma societies membership-the UK and Eire Glaucoma Society and the European Glaucoma Society. A Nominal Group Technique (NGT) followed the Delphi process. Results were analyzed using descriptive statistics.

RESULTS: A total of 65 participants completed round 1 out of 320; of whom 56 completed round 2 (86%). Agreement on the importance of outcomes was reached on 48/51 items (94%). Intraocular pressure (IOP), visual field (VF), safety, and anatomic outcomes were classified as highly important. Regarding methods of measurement of IOP, "mean follow-up IOP" using Goldmann applanation tonometry achieved the highest importance, whereas for evaluating VFs "global index mean deviation/defect (MD)" and "rate of VF progression" were the most important. Retinal nerve fiber layer (RNFL) thickness measured by optical coherence tomography (OCT) was identified as highly important. The NGT results reached consensus on "change of IOP (mean of 3 consecutive measurements taken at fixed time of day) from baseline," change of VF-MD values (3 reliable VFs at baseline and follow-up visit) from baseline, and change of RNFL thickness (2 good quality OCT images) from baseline.

CONCLUSIONS: Consensus was reached among glaucoma experts on how best to measure IOP, VF, and anatomic outcomes in glaucoma randomized controlled trials.

Evaluating the effectiveness of domestic abuse prevention education: Are certain children more or less receptive to the messages conveyed?

Purpose
A number of school-based domestic abuse prevention programmes have been developed in the United Kingdom, but evidence as to the effectiveness of such programmes is limited. The aim of the research was to evaluate the effectiveness of one such programme and to see whether the outcomes differ by gender and experiences of domestic abuse.

Method
Pupils aged 13–14 years, across seven schools, receiving a 6-week education programme completed a questionnaire to measure their attitudes towards domestic violence at pre-, post-test, and 3-month follow-up, and also responded to questions about experiences of abuse (as victims, perpetrators, and witnesses) and help seeking. Children in another six schools not yet receiving the intervention responded to the same questions at pre- and post-test. In total, 1,203 children took part in the research.

Results
Boys and girls who had received the intervention became less accepting of domestic violence and more likely to seek help from pre- to post-test compared with those in the control group; outcomes did not vary by experiences of abuse. There was evidence that the change in attitudes for those in the intervention group was maintained at 3-month follow-up.

Conclusions
These findings suggest that such a programme shows great promise, with both boys and girls benefiting from the intervention, and those who have experienced abuse and those who have not (yet) experienced abuse showing a similar degree of attitude change.

The Role and Effectiveness of Public – Private Partnerships (NHS LIFT) in the Development of Enhanced Primary Care Premises and Services:Report for the National Institute for Health Research Service Delivery and Organisation programme

The research project analysed the role and effectiveness of LIFT via a multi-method study which included semi-structured interviews with policy elites and users, as well as case studies and an exploratory analysis of the financial characteristics of three LIFT Companies. While the team felt that it was able to identify key aspects relating to the advantages and drawbacks surrounding LIFT, some aspects relating to the representativeness of the study was adversely affected by a reluctance of PCTs to participate in the case study analysis and commercial confidentiality restrictions. The study was nonetheless able to identify important issues in relation to the funding and procurement of primary care premises and services.

Effectiveness of a biomarker-based exclusion of ventilator-acquired pneumonia to reduce antibiotic use: protocol for a randomised controlled trial (VAPrapid-2):Study protocol for a randomised controlled trial

Background Ventilator-acquired pneumonia (VAP) is a common reason for antimicrobial therapy in the intensive care unit (ICU). Biomarker-based diagnostics could improve antimicrobial stewardship through rapid exclusion of VAP. Bronchoalveloar lavage (BAL) fluid biomarkers have previously been shown to allow the exclusion of VAP with high confidence. Methods/Design This is a prospective, multi-centre, randomised, controlled trial to determine whether a rapid biomarker-based exclusion of VAP results in fewer antibiotics and improved antimicrobial management. Patients with clinically suspected VAP undergo BAL, and VAP is confirmed by growth of a potential pathogen at > 104 colony-forming units per millilitre (CFU/ml). Patients are randomised 1:1, to either a ‘biomarker-guided recommendation on antibiotics’ in which BAL fluid is tested for IL-1β and IL-8 in addition to routine microbiology testing, or to ‘routine use of antibiotics’ in which BAL undergoes routine microbiology testing only. Clinical teams are blinded to intervention until 6 hours after randomisation, when biomarker results are reported to the clinician. The primary outcome is a change in the frequency distribution of antibiotic-free days (AFD) in the 7 days following BAL. Secondary outcome measures include antibiotic use at 14 and 28 days; ventilator-free days; 28-day mortality and ICU mortality; sequential organ failure assessment (SOFA) at days 3, 7 and 14; duration of stay in critical care and the hospital; antibiotic-associated infections; and antibiotic-resistant pathogen cultures up to hospital discharge, death or 56 days. A healthcare-resource-utilisation analysis will be calculated from the duration of critical care and hospital stay. In addition, safety data will be collected with respect to performing BAL. A sample size of 210 will be required to detect a clinically significant shift in the distribution of AFD towards more patients having fewer antibiotics and therefore more AFD. Discussion This trial will test whether a rapid biomarker-based exclusion of VAP results in rapid discontinuation of antibiotics and therefore improves antibiotic management in patients with suspected VAP.