An official American thoracic society research statement: Comparative effectiveness research in pulmonary, critical care, and sleep medicine

Background: Comparative effectiveness research (CER) is intended to inform decision making in clinical practice, and is central to patientcentered outcomes research (PCOR). Purpose: To summarize key aspects of CER definitions and provide examples highlighting the complementary nature of efficacy and CER studies in pulmonary, critical care, and sleep medicine. Methods: An ad hoc working group of the American Thoracic Society with experience in clinical trials, health services research, quality improvement, and behavioral sciences in pulmonary, critical care, and sleepmedicinewas convened. The group used an iterative consensus process, including a reviewbyAmerican Thoracic Society committees and assemblies. Results: The traditional efficacy paradigm relies on clinical trials with high internal validity to evaluate interventions in narrowly defined populations and in research settings. Efficacy studies address the question, "Can it work in optimal conditions?" The CER paradigm employs a wide range of study designs to understand the effects of interventions in clinical settings. CER studies address the question, "Does it work in practice?" The results of efficacy and CER studies may or may not agree. CER incorporates many attributes of outcomes research and health services research, while placing greater emphasis on meeting the expressed needs of nonresearcher stakeholders (e.g., patients, clinicians, and others). Conclusions: CER complements traditional efficacy research by placing greater emphasis on the effects of interventions in practice, and developing evidence to address the needs of the many stakeholders involved in health care decisions. Stakeholder engagement is an important component of CER. Copyright © 2013 by the American Thoracic Society.

Children's use of interventions to learn causal structure

Children aged between 5 and 8 years freely intervened on a three-variable causal system, with their task being to discover whether it was a common-cause structure or one of two causal chains. From 6-7 years, children were able to use information from their interventions to correctly disambiguate the structure of a causal chain. We used a Bayesian model to examine children’s interventions on the system; this showed that with development children became more efficient in producing the interventions needed to disambiguate the causal structure and that the quality of interventions, as measured by their informativeness, improved developmentally. The latter measure was a significant predictor of children’s correct inferences about the causal structure. A second experiment showed that levels of performance were not reduced in a task in which children did not select and carry out interventions themselves, indicating no advantage for self-directed learning. However, children’s performance was not related to intervention quality in these circumstances, suggesting that children learn in a different way when they carry out interventions themselves.

Dedicated severe asthma services improve health-care use and quality of life

Background: Systematic assessment of severe asthma can be used to confirm the diagnosis, identify comorbidities, and address adherence to therapy. However, the prospective usefulness of this approach is yet to be established. The objective of this study was to determine whether the systematic assessment of severe asthma is associated with improved quality of life (QoL) and health-care use and, using prospective data collection, to compare relevant outcomes in patients referred with severe asthma to specialist centers across the United Kingdom. Methods: Data from the National Registry for dedicated UK Difficult Asthma Services were used to compare patient demographics, disease characteristics, and health-care use between initial assessment and a median follow-up of 286 days. Results: The study population consisted of 346 patients with severe asthma. At follow-up, there were significant reductions in health-care use in terms of primary care or ED visits (66.4% vs 87.8%, P < .0001) and hospital admissions (38% vs 48%, P = .0004). Although no difference was noted in terms of those requiring maintenance oral corticosteroids, there was a reduction in steroid dose (10 mg [8-20 mg] vs 15 mg [10-20 mg], P = .003), and fewer subjects required short-burst steroids (77.4% vs 90.8%, P = .01). Significant improvements were seen in QoL and control using the Asthma Quality of Life Questionnaire and the Asthma Control Questionnaire. Conclusions: To our knowledge, this is the first time that a prospective study has shown that a systematic assessment at a dedicated severe asthma center is associated with improved QoL and asthma control and a reduction in health-care use and oral steroid burden.

Critical Success Factors of Construction Project Quality in Brunei Darussalam

This research concentrates on the critical success factors driving construction quality and the barriers that must be overcome to achieve quality in Brunei. It hopes to identify methods of quality improvement and clearly justify investment in this area of local industry. Over the past number of years, Brunei has attempted to diversify its industry from the dominant oil and gas sector into secondary sectors,
including construction. To date, very little research has been carried out in many areas of construction management that take into account the specific industry context in Brunei. A comprehensive literature review has been employed to enable a questionnaire to be constructed and distributed among Brunei construction
professionals. The results have been analyzed through mean testing. This analysis reveals that the key barriers to construction quality in Brunei relate to lack of skills, lack of clarity in responsibility and communication and poor commitment among the design team. The critical success factors include issues relating to competency, capability, commitment and effectiveness, primarily among managers and decision-makers. The results of this study will hopefully contribute to fill the knowledge gap related to construction management in the context of Brunei and facilitate movement towards improved techniques and strategies that will foster higher quality in construction. The findings can be generalised across similar
developing economies and it is suggested that in general, the management concepts governing construction quality remain similar across the borders of East and West.

Improving allied health professionals' research implementation behaviours for children with cerebral palsy: protocol for a before-after study

BACKGROUND: Cerebral palsy is a permanent disorder of posture and movement caused by disturbances in the developing brain. It affects approximately 1 in every 500 children in developed countries and is the most common form of childhood physical disability. People with cerebral palsy may also have problems with speech, vision and hearing, intellectual difficulties and epilepsy. Health and therapy services are frequently required throughout life, and this care should be effective and evidence informed; however, accessing and adopting new research findings into day-to-day clinical practice is often delayed.

METHODS/DESIGN: This 3-year study employs a before and after design to evaluate if a multi-strategy intervention can improve research implementation among allied health professionals (AHPs) who work with children and young people with cerebral palsy and to establish if children's health outcomes can be improved by routine clinical assessment. The intervention comprises (1) knowledge brokering with AHPs, (2) access to an online research evidence library, (3) provision of negotiated evidence-based training and education, and (4) routine use of evidence-based measures with children and young people aged 3-18 years with cerebral palsy. The study is being implemented in four organisations, with a fifth organisation acting as a comparison site, across four Australian states. Effectiveness will be assessed using questionnaires completed by AHPs at baseline, 6, 12 and 24 months, and by monitoring the extent of use of evidence-based measures. Children's health outcomes will be evaluated by longitudinal analyses.

DISCUSSION: Government, policy makers and service providers all seek evidence-based information to support decision-making about how to distribute scarce resources, and families are seeking information to support intervention choices. This study will provide knowledge about what constitutes an efficient, evidence-informed service and which allied health interventions are implemented for children with cerebral palsy.

TRIAL REGISTRATION: Trial is not a controlled healthcare intervention and is not registered.

UK consensus project on quality in palliative day services: developing a quality indicator set using the RAND/UCLA appropriateness method

Introduction
Evaluating quality of palliative day services is essential for assessing care across diverse settings, and for monitoring quality improvement approaches.

Aim
To develop a set of quality indicators for assessment of all aspects (structure, process and outcome) of care in palliative day services.

Methods
Using a modified version of the RAND/UCLA appropriateness method (Fitch et al., 2001), a multidisciplinary panel of 16 experts independently completed a survey rating the appropriateness of 182 potential quality indicators previously identified during a systematic evidence review. Panel members then attended a one day, face-to-face meeting where indicators were discussed and subsequently re-rated. Panel members were also asked to rate the feasibility and necessity of measuring each indicator.

Results
71 indicators classified as inappropriate during the survey were removed based on median appropriateness ratings and level of agreement. Following the panel discussions, a further 60 were removed based on appropriateness and feasibility ratings, level of agreement and assessment of necessity. Themes identified during the panel discussion and findings of the evidence review were used to translate the remaining 51 indicators into a final set of 27.

Conclusion
The final indicator set included information on rationale and supporting evidence, methods of assessment, risk adjustment, and recommended performance levels. Further implementation work will test the suitability of this ‘toolkit’ for measurement and benchmarking. The final indicator set provides the basis for standardised assessment of quality across services, including care delivered in community and primary care settings.

Reference

• Fitch K, Bernstein SJ, Aguilar MD, et al. The RAND/UCLA Appropriateness Method User’s Manual. Santa Monica, CA: RAND Corporation; 2001. http://www.rand.org/pubs/monograph_reports/MR1269

The Evaluation of an Interdisciplinary Pain Protocol in Long Term Care

Objectives: To evaluate the effectiveness of (1) dissemination strategies to improve clinical practice behaviors (eg, frequency and documentation of pain assessments, use of pain medication) among health care team members, and (2) the implementation of the pain protocol in reducing pain in long term care (LTC) residents. Design: A controlled before-after design was used to evaluate the effectiveness of the pain protocol, whereas qualitative interviews and focus groups were used to obtain additional context-driven data. Setting: Four LTC facilities in southern Ontario, Canada; 2 for the intervention group and 2 for the control group. Participants: Data were collected from 200 LTC residents; 99 for the intervention and 101 for the control group. Intervention: Implementation of a pain protocol using a multifaceted approach, including a site working group or Pain Team, pain education and skills training, and other quality improvement activities. Measurements: Resident pain was measured using 3 assessment tools: the Pain Assessment Checklist for Seniors with Limited Ability to Communicate, the Pain Assessment in the Communicatively Impaired Elderly, and the Present Pain Intensity Scale. Clinical practice behaviors were measured using a number of process indicators; for example, use of pain assessment tools, documentation about pain management, and use of pain medications. A semistructured interview guide was used to collect qualitative data via focus groups and interviews. Results: Pain increased significantly more for the control group than the intervention group over the 1-year intervention period. There were significantly more positive changes over the intervention period in the intervention group compared with the control group for the following indicators: the use of a standardized pain assessment tool and completed admission/initial pain assessment. Qualitative findings highlight the importance of reminding staff to think about pain as a priority in caring for residents and to be mindful of it during daily activities. Using onsite champions, in this case advanced practice nurses and a Pain Team, were key to successfully implementing the pain protocol. Conclusions: These study findings indicate that the implementation of a pain protocol intervention improved the way pain was managed and provided pain relief for LTC residents.

Hospital antibiotic use and its relationship to age-adjusted comorbidity and alcohol-based hand rub consumption

SUMMARY The objective of this study was to evaluate the effect of age-adjusted comorbidity and alcohol-based hand rub on monthly hospital antibiotic usage, retrospectively. A multivariate autoregressive integrated moving average (ARIMA) model was built to relate the monthly use of all antibiotics grouped together with age-adjusted comorbidity and alcohol-based hand rub over a 5-year period (April 2005-March 2010). The results showed that monthly antibiotic use was positively related to the age-adjusted comorbidity index (concomitant effect, coefficient 1·103, P = 0·0002), and negatively related to the use of alcohol-based hand rub (2-month delay, coefficient -0·069, P = 0·0533). Alcohol-based hand rub is considered a modifiable factor and as such can be identified as a target for quality improvement programmes. Time-series analysis may provide a suitable methodology for identifying possible predictive variables that explain antibiotic use in healthcare settings. Future research should examine the relationship between infection control practices and antibiotic use, identify other infection control predictive factors for hospital antibiotic use, and evaluate the impact of enhancing different infection control practices on antibiotic use in a healthcare setting.

Positioning Clinical Nurse Specialists and Nurse Practitioners as Change Champions to Implement a Pain Protocol in Long-Term Care

Pain management for older adults in long-term care (LTC) has been recognized as a problem internationally. The purpose of this study was to explore the role of a clinical nurse specialist (CNS) and nurse practitioner (NP) as change champions during the implementation of an evidence-based pain protocol in LTC. In this exploratory, multiple-case design study, we collected data from two LTC homes in Ontario, Canada. Three data sources were used: participant observation of an NP and a CNS for 18 hours each over a 3-week period; CNS and NP diaries recording strategies, barriers, and facilitators to the implementation process; and interviews with members of the interdisciplinary team to explore perceptions about the NP and CNS role in implementing the pain protocol. Data were analyzed using thematic content analysis. The NP and CNS used a variety of effective strategies to promote pain management changes in practice including educational outreach with team members, reminders to nursing staff to highlight the pain protocol and educate about practice changes, chart audits and feedback to the nursing staff, interdisciplinary working group meetings, ad hoc meetings with nursing staff, and resident assessment using advanced skills. The CNS and NP are ideal champions to implement pain management protocols and likely other quality improvement initiatives.

Use of maternity surveys in improving the care experience – a review of the evidence

The use of surveys and direct feedback from women as a measurement of their maternity experience is seen as a means of stimulating quality improvement. Underpinning the overall rationale behind national maternity surveys is the acknowledgement that there is a need to document women's views of maternity services to inform policymakers with a view to enhancing the delivery of quality care to women. The evidence suggests that using maternity surveys to improve maternity care experience is central to UK health policy. It is also evident that qualitative input from women has the power to highlight mismatches of experience between women and professionals. Trusts are required to look to the future and invest in qualitative methodologies, which elicit rich and detailed information on women's experiences. The aim of this literature review is to critically analyse the use of maternity surveys and their validity in improving the care experienced by users of maternity services.

Musculoskeletal (MSK) and Sport and Exercise Medicine (SEM) in General Practice (GP): A Novel GP-based MSK and SEM Clinic for Managing Musculoskeletal symptoms in a GP

Musculoskeletal (MSK) complaints are common within primary care (1) (2) (3) but some General Practitioners (GPs)/family physicians do not feel comfortable managing these symptoms (3), preferring to refer onto hospital specialists or Integrated Clinical Assessment and Treatment Services (ICATs). Long waiting times for hospital outpatient reviews are a major cause of patient inconvenience and complaints (4). We therefore aimed to establish a GP-ran MSK and sport and exercise medicine (SEM) clinic based within a Belfast GP surgery that would contribute to a sustainable improvement in managing these common conditions within primary care as well as reducing waiting times for patients with these conditions to see a specialist. This shift from hospital-based to community-based management is in-keeping with recent policy changes within the UK health-system, including Transforming Your Care within Northern Ireland (NI) (5). The GP-ran MSK and SEM clinic was held monthly within a Belfast GP practice, staffed by one GP with a specialist interest in MSK and SEM conditions and its performance was reviewed over a three month period. Parameters audited included cases seen, orthopaedic and x-ray referral rates and secondary care referrals comparing the GP practice’s performance to the same time period in the previous year as well as patient satisfaction questionnaires.

An audit of antimicrobial treatment of lower respiratory and urinary tract infections in a hospital setting

Objectives: To audit the quality of treatment of lower respiratory tract infections (LRTIs) and urinary tract infections (UTIs) and to identify targets for antibiotic stewardship. Methods: The audit involved collecting data on admitted patients, who were diagnosed with LRTIs or UTIs and subsequently received antibiotic treatment (January 2009-April 2009). Key findings: The percentage adherence rate for hospital antibiotic policy was 68.6% (24/35). Documentation of the CURB-65 score was found in 80% (16/20) of the patients' clinical notes, for which 46.2% (6/13) of patients were treated according to their CURB- 65 score. The percentages of delayed and missed doses for all antibiotics were 21.7% (254/1171) and 8.6% (101/1171), respectively. The percentage of patients switched from intravenous to oral antibiotics in accordance with the policy was 58.5% (31/53). The mean length of stay for patients switched in line with the guidelines was 6.9 days (range: 2-18 days) compared with 13.2 days (range: 4-28 days) for patients treated with intravenous antibiotics >24 h after the intravenous to oral switch criteria were fulfilled; this equates to on average an extra 6.3 days of hospitalisation (p=0.01). Conclusions: The study identified a number of targets for quality improvement including adherence to antibiotic policy, documentation of the CURB-65 score in patients' notes and treating patients accordingly, addressing the issue of missed and delayed doses, and maintaining adherence to the hospital intravenous-to-oral antibiotic switch policy. The findings suggest that the quality of antibiotic prescribing could be improved by measuring and addressing such performance indicators.

Establishing the validity of English GP Patient Survey items evaluating out-of-hours care

Background A 2014 national audit used the English General Practice Patient Survey (GPPS) to compare service users’ experience of out-of-hours general practitioner (GP) services, yet there is no published evidence on the validity of these GPPS items. Objectives Establish the construct and concurrent validity of GPPS items evaluating service users’ experience of GP out-of-hours care. Methods Cross-sectional postal survey of service users (n=1396) of six English out-of-hours providers. Participants reported on four GPPS items evaluating out-of-hours care (three items modified following cognitive interviews with service users), and 14 evaluative items from the Out-of-hours Patient Questionnaire (OPQ). Construct validity was assessed through correlations between any reliable (Cochran's α>0.7) scales, as suggested by a principal component analysis of the modified GPPS items, with the ‘entry access’ (four items) and ‘consultation satisfaction’ (10 items) OPQ subscales. Concurrent validity was determined by investigating whether each modified GPPS item was associated with thematically related items from the OPQ using linear regressions. Results The modified GPPS item-set formed a single scale (α=0.77), which summarised the two-component structure of the OPQ moderately well; explaining 39.7% of variation in the ‘entry access’ scores (r=0.63) and 44.0% of variation in the ‘consultation satisfaction’ scores (r=0.66), demonstrating acceptable construct validity. Concurrent validity was verified as each modified GPPS item was highly associated with a distinct set of related items from the OPQ. Conclusions Minor modifications are required for the English GPPS items evaluating out-of-hours care to improve comprehension by service users. A modified question set was demonstrated to comprise a valid measure of service users’ overall satisfaction with out-of-hours care received. This demonstrates the potential for the use of as few as four items in benchmarking providers and assisting services in identifying, implementing and assessing quality improvement initiatives.

Preconception counselling resource for women with diabetes

Women with diabetes need to plan for pregnancy if they are to reduce their risk of poor pregnancy outcome. While care providers have focused on setting up specialist pre-pregnancy planning clinics to help women prepare for pregnancy, the majority of women do not attend, entering pregnancy unprepared. A major barrier to accessing this care, and a consequence of poor preconception counselling, is a lack of knowledge as to the need to plan and the reasons why. This project addressed an urgent need to raise awareness of the importance of planning for pregnancy among women with diabetes and among the healthcare professionals (HCPs) caring for them. Focus groups with the target groups informed the development of a preconception counselling resource for women with diabetes. Originally produced as a DVD (Diabetes UK funding), this resource has been embedded in routine care in Northern Ireland (NI) since 2010. A subsequent service evaluation of pregnancy planning indicators undertaken across all five antenatal-metabolic clinics in NI indicated that women who viewed the resource were better prepared for pregnancy. In order to increase the positive impact of the resource and to ensure longer term sustainability the DVD was converted to a website, http://www.womenwithdiabetes.net (Public Health Agency NI funding). The evaluation also highlighted that women with type 2 diabetes were a hard to reach group. As these women are often cared for outside of specialist clinics, it is pertinent that all HCPs caring for women with diabetes are aware of the importance of preconception counselling. Funding also supported the development of an e-learning continuing professional development (CPD) resource within the website. The e-learning resource has since been embedded into existing CPD programmes and is an important tool to ensure that all HCPs caring for women with diabetes are empowered to provide preconception counselling at every opportunity.