SWAT-1: The effectiveness of a 'site visit' intervention on recruitment rates in a multi-centre randomised trial

Background: Recruitment rates in multi-centre randomised trials often fall below target recruitment rates, causing problems for study outcomes. The Studies Within A Trial (SWAT) Programme, established by the All-Ireland Hub for Trials Methodology Research in collaboration with the Medical Research Council Network of Hubs in the United Kingdom and others, is developing methods for evaluating aspects of trial methodology through the conduct of research within research. A recently published design for a SWAT-1 provides a protocol for evaluating the effect of a site visit by the principal investigator on recruitment in multi-centre trials.

Methods: Using the SWAT-1 design, the effect of a site visit, with the sole purpose of discussing trial recruitment, on recruitment rates in a large multicentre trial in the Republic of Ireland was evaluated. A controlled before and after intervention comparison was used, where the date of the site visit provides the time point for the intervention, and for the comparison to control sites. Site A received the intervention. Site B and Site C acted as the controls. Z-scores for proportions were calculated to determine within site recruitment differences. Odds ratios and 95% confidence intervals were calculated to determine between site recruitment differences.

Results: Recruitment rates were increased in Site A post-intervention (17% and 14% percentage point increases at 1 and 3 months, respectively). No differences in recruitment occurred in Site B or in Site C. Comparing between site differences, at 3 months post-intervention, a statistically significant difference was detected in favour of higher recruitment in Site A (34% versus 25%; odds ratio 1.57, 95% confidence interval 1.09 to 2.26).

Conclusions: This is the first reported example of a study in the SWAT programme.. It provides evidence that a site visit, combined with a scheduled meeting, increases recruitment in a clinical trial. Using this example, other researchers might be encouraged to consider conducting a similar study, allowing the findings of future SWAT-1s to be compared and combined, so that higher level evidence on the effect of a site visit by the principal investigator can be obtained.

Myeloproliferative neoplasm patient symptom burden and quality of life: evidence of significant impairment compared to controls

The myeloproliferative neoplasms (MPN) including polycythaemia vera (PV), essential thrombocythaemia and primary myelofibrosis (PMF) are rare diseases contributing to significant morbidity. Symptom management is a prime treatment objective but current symptom assessment tools have not been validated compared to the general population. The MPN-symptom assessment form (MPN-SAF), a reliable and validated clinical tool to assess MPN symptom burden, was administered to MPN patients (n = 106) and, for the first time, population controls (n = 124) as part of a UK case–control study. Mean symptom scores were compared between patients and controls adjusting for potential confounders. Mean patient scores were compared to data collected by the Mayo Clinic, USA on 1,446 international MPN patients to determine patient group representativeness. MPN patients had significantly higher mean scores than controls for 25 of the 26 symptoms measured (P < 0.05); fatigue was the most common symptom (92.4% and 78.1%, respectively). Female MPN patients suffered worse symptom burden than male patients (P < 0.001) and substantially worse burden than female controls (P < 0.001). Compared to the Mayo clinic patients, MPN-UK patients reported similar symptom burden but lower satiety (P = 0.046). Patients with PMF reported the worst symptom burden (88.3%); significantly higher than PV patients (P < 0.001). For the first time we report quality of life was worse in MPN-UK patients compared with controls (P < 0.001).

Core Outcomes in Ventilation Trials (COVenT): protocol for a core outcome set using a Delphi survey with a nested randomised trial and observational cohort study

Background
Among clinical trials of interventions that aim to modify time spent on mechanical ventilation for critically ill patients there is considerable inconsistency in chosen outcomes and how they are measured. The Core Outcomes in Ventilation Trials (COVenT) study aims to develop a set of core outcomes for use in future ventilation trials in mechanically ventilated adults and children.

Methods/design
We will use a mixed methods approach that incorporates a randomised trial nested within a Delphi study and a consensus meeting. Additionally, we will conduct an observational cohort study to evaluate uptake of the core outcome set in published studies at 5 and 10 years following core outcome set publication. The three-round online Delphi study will use a list of outcomes that have been reported previously in a review of ventilation trials. The Delphi panel will include a range of stakeholder groups including patient support groups. The panel will be randomised to one of three feedback methods to assess the impact of the feedback mechanism on subsequent ranking of outcomes. A final consensus meeting will be held with stakeholder representatives to review outcomes.

Discussion
The COVenT study aims to develop a core outcome set for ventilation trials in critical care, explore the best Delphi feedback mechanism for achieving consensus and determine if participation increases use of the core outcome set in the long term.

Making randomised trials more efficient: report of the first meeting to discuss the Trial Forge platform

Randomised trials are at the heart of evidence-based healthcare, but the methods and infrastructure for conducting these sometimes complex studies are largely evidence free. Trial Forge (www.trialforge.org) is an initiative that aims to increase the evidence base for trial decision making and, in doing so, to improve trial efficiency.

This paper summarises a one-day workshop held in Edinburgh on 10 July 2014 to discuss Trial Forge and how to advance this initiative. We first outline the problem of inefficiency in randomised trials and go on to describe Trial Forge. We present participants' views on the processes in the life of a randomised trial that should be covered by Trial Forge.

General support existed at the workshop for the Trial Forge approach to increase the evidence base for making randomised trial decisions and for improving trial efficiency. Agreed upon key processes included choosing the right research question; logistical planning for delivery, training of staff, recruitment, and retention; data management and dissemination; and close down. The process of linking to existing initiatives where possible was considered crucial. Trial Forge will not be a guideline or a checklist but a 'go to' website for research on randomised trials methods, with a linked programme of applied methodology research, coupled to an effective evidence-dissemination process. Moreover, it will support an informal network of interested trialists who meet virtually (online) and occasionally in person to build capacity and knowledge in the design and conduct of efficient randomised trials.

Some of the resources invested in randomised trials are wasted because of limited evidence upon which to base many aspects of design, conduct, analysis, and reporting of clinical trials. Trial Forge will help to address this lack of evidence.

Patience, Persistence and Pragmatism: Experiences and Lessons Learnt from the Implementation of Clinically Integrated Teaching and Learning of Evidence-Based Health Care - A Qualitative Study

Background

Clinically integrated teaching and learning are regarded as the best options for improving evidence-based healthcare (EBHC) knowledge, skills and attitudes. To inform implementation of such strategies, we assessed experiences and opinions on lessons learnt of those involved in such programmes.

Methods and Findings

We conducted semi-structured interviews with 24 EBHC programme coordinators from around the world, selected through purposive sampling. Following data transcription, a multidisciplinary group of investigators carried out analysis and data interpretation, using thematic content analysis. Successful implementation of clinically integrated teaching and learning of EBHC takes much time. Student learning needs to start in pre-clinical years with consolidation, application and assessment following in clinical years. Learning is supported through partnerships between various types of staff including the core EBHC team, clinical lecturers and clinicians working in the clinical setting. While full integration of EBHC learning into all clinical rotations is considered necessary, this was not always achieved. Critical success factors were pragmatism and readiness to use opportunities for engagement and including EBHC learning in the curriculum; patience; and a critical mass of the right teachers who have EBHC knowledge and skills and are confident in facilitating learning. Role modelling of EBHC within the clinical setting emerged as an important facilitator. The institutional context exerts an important influence; with faculty buy-in, endorsement by institutional leaders, and an EBHC-friendly culture, together with a supportive community of practice, all acting as key enablers. The most common challenges identified were lack of teaching time within the clinical curriculum, misconceptions about EBHC, resistance of staff, lack of confidence of tutors, lack of time, and negative role modelling.

Conclusions

Implementing clinically integrated EBHC curricula requires institutional support, a critical mass of the right teachers and role models in the clinical setting combined with patience, persistence and pragmatism on the part of teachers.

Primary airway epithelial cell culture and asthma in children-lessons learnt and yet to come

Until recently the airway epithelial cell (AEC) was considered a simple barrier that prevented entry of inhaled matter into the lung parenchyma. The AEC is now recognized as having an important role in the inflammatory response of the respiratory system to inhaled exposures, and abnormalities of these responses are thought to be important to asthma pathogenesis. This review first explores how the challenges of studying nasal and bronchial AECs in children have been addressed and then summarizes the results of studies of primary AEC function in children with and without asthma. There is good evidence that nasal AECs may be a suitable surrogate for the study of certain aspects of bronchial AEC function, although bronchial AECs remain the gold standard for asthma research. There are consistent differences between children with and without asthma for nasal and bronchial AEC mediator release following exposure to a range of pro-inflammatory stimulants including interleukins (IL)-1β, IL-4, and IL-13. However, there are inconsistencies between studies, e.g., release of IL-6, an important pro-inflammatory cytokine, is not increased in children with asthma relative to controls in all studies. Future work should expand current understanding of the "upstream" signalling pathways in AEC, study AEC from children before the onset of asthma symptoms and in vitro models should be developed that replicate the in vivo status more completely, e.g., co-culture with dendritic cells. AECs are difficult to obtain from children and collaboration between centers is expected to yield meaningful advances in asthma understanding and ultimately help deliver novel therapies. 

Beyond Criminal Justice: An anthology of abolitionist papers presented to conferences of the European Group for the Study of Deviance and Social Control over the past decade

Beyond Criminal Justice presents a vision of a future without brutal, authoritarian and repressive penal regimes. Many of the papers brought together here have been unavailable for more than two decades. Their republication indicates not only their continuing theoretical importance to abolitionist studies but also how they provide important insights into the nature and legitimacy of criminal processes in the here and now. Contributors highlight the human consequences of the harms of imprisonment, evidencing the hurt, injury and damage of penal incarceration across a number of different countries in Europe. Focusing on penal power and prisoner contestation to such power, the moral and political crises of imprisonment are laid bare. The contributors to Beyond Criminal Justice explore the urgent need for a coherent, rational and morally and politically sophisticated theoretical basis for penal abolitionism. Advocating a utopian imagination and at the same time practical solutions already implemented in countries around Europe - alongside grappling with controversial debates such as abolitionist responses to rape and sexual violence - the book steps outside of common sense assumptions regarding 'crime', punishment and 'criminal justice'. Beyond Criminal Justice will be of interest to students of criminology, zemiology, sociology, penology and critical legal studies as well as anyone interested in rethinking the problem of 'crime' and challenging the logic of the penal rationale.

Risking peace in the ‘War against the Poor’? Social exclusion and the legacies of the Northern Ireland conflict

Discourses around poverty, dependency and austerity take a particular form when it comes to Northern Ireland which is seen as ripe for economic ‘rebalancing’ and public sector reduction. The Welfare Reform Act 2012 is pivotal in that it provides the muscle for disciplining claimants for a low-waged, flexible labour market. But the Northern Ireland Assembly has not passed the Act or agreed a budget and the return of Direct Rule beckons as a result. The article sheds light on the stand-off over the Welfare Reform Act using data from the 2012 PSE Survey. It demonstrates that the impact of violent conflict is imprinted on the population in terms of high rates of deprivation, poor physical and mental health, and significant differences between those experiencing little or no conflict, and those with ‘high’ experience. In ignoring these legacies of the conflict, the Westminster government is risking peace in its ‘war against the poor’.

COS-STAR: a reporting guideline for studies developing core outcome sets (protocol)

BACKGROUND: Core outcome sets can increase the efficiency and value of research and, as a result, there are an increasing number of studies looking to develop core outcome sets (COS). However, the credibility of a COS depends on both the use of sound methodology in its development and clear and transparent reporting of the processes adopted. To date there is no reporting guideline for reporting COS studies. The aim of this programme of research is to develop a reporting guideline for studies developing COS and to highlight some of the important methodological considerations in the process.

METHODS/DESIGN: The study will include a reporting guideline item generation stage which will then be used in a Delphi study. The Delphi study is anticipated to include two rounds. The first round will ask stakeholders to score the items listed and to add any new items they think are relevant. In the second round of the process, participants will be shown the distribution of scores for all stakeholder groups separately and asked to re-score. A final consensus meeting will be held with an expert panel and stakeholder representatives to review the guideline item list. Following the consensus meeting, a reporting guideline will be drafted and review and testing will be undertaken until the guideline is finalised. The final outcome will be the COS-STAR (Core Outcome Set-STAndards for Reporting) guideline for studies developing COS and a supporting explanatory document.

DISCUSSION: To assess the credibility and usefulness of a COS, readers of a COS development report need complete, clear and transparent information on its methodology and proposed core set of outcomes. The COS-STAR guideline will potentially benefit all stakeholders in COS development: COS developers, COS users, e.g. trialists and systematic reviewers, journal editors, policy-makers and patient groups.

Nuclear disasters and health: lessons learned, challenges, and proposals

Past nuclear disasters, such as the atomic bombings in 1945 and major accidents at nuclear power plants, have highlighted similarities in potential public health effects of radiation in both circumstances, including health issues unrelated to radiation exposure. Although the rarity of nuclear disasters limits opportunities to undertake rigorous research of evidence-based interventions and strategies, identification of lessons learned and development of an effective plan to protect the public, minimise negative effects, and protect emergency workers from exposure to high-dose radiation is important. Additionally, research is needed to help decision makers to avoid premature deaths among patients already in hospitals and other vulnerable groups during evacuation. Since nuclear disasters can affect hundreds of thousands of people, a substantial number of people are at risk of physical and mental harm in each disaster. During the recovery period after a nuclear disaster, physicians might need to screen for psychological burdens and provide general physical and mental health care for many affected residents who might experience long-term displacement. Reliable communication of personalised risks has emerged as a challenge for health-care professionals beyond the need to explain radiation protection. To overcome difficulties of risk communication and provide decision aids to protect workers, vulnerable people, and residents after a nuclear disaster, physicians should receive training in nuclear disaster response. This training should include evidence-based interventions, support decisions to balance potential harms and benefits, and take account of scientific uncertainty in provision of community health care. An open and joint learning process is essential to prepare for, and minimise the effects of, future nuclear disasters.

Individual Participant Data (IPD) Meta-analyses of Randomised Controlled Trials: Guidance on Their Use

Jayne Tierney and colleagues offer guidance on how to spot a well-designed and well-conducted individual participant data meta-analysis.

Summary Points 

• Systematic reviews are most commonly based on aggregate data extracted from publications or obtained from trial investigators. 

• Systematic reviews involving the central collection and analysis of individual participant data (IPD) usually are larger-scale, international, collaborative projects that can bring about substantial improvements to the quantity and quality of data, give greater scope in the analyses, and provide more detailed and robust results. 

• The process of collecting, checking, and analysing IPD is more complex than for aggregate data, and not all IPD meta-analyses are done to the same standard, making it difficult for researchers, clinicians, patients, policy makers, funders, and publishers to judge their quality. 

• Following our step-by-step guide will help reviewers and users of IPD meta-analyses to understand them better and recognise those that are well designed and conducted and so help ensure that policy, practice, and research are informed by robust evidence about the effects of interventions.

How individual participant data meta-analyses have influenced trial design, conduct, and analysis

OBJECTIVES: To demonstrate how individual participant data (IPD) meta-analyses have impacted directly on the design and conduct of trials and highlight other advantages IPD might offer.

STUDY DESIGN AND SETTING: Potential examples of the impact of IPD meta-analyses on trials were identified at an international workshop, attended by individuals with experience in the conduct of IPD meta-analyses and knowledge of trials in their respective clinical areas. Experts in the field who did not attend were asked to provide any further examples. We then examined relevant trial protocols, publications, and Web sites to verify the impacts of the IPD meta-analyses. A subgroup of workshop attendees sought further examples and identified other aspects of trial design and conduct that may inform IPD meta-analyses.

RESULTS: We identified 52 examples of IPD meta-analyses thought to have had a direct impact on the design or conduct of trials. After screening relevant trial protocols and publications, we identified 28 instances where IPD meta-analyses had clearly impacted on trials. They have influenced the selection of comparators and participants, sample size calculations, analysis and interpretation of subsequent trials, and the conduct and analysis of ongoing trials, sometimes in ways that would not possible with systematic reviews of aggregate data. We identified additional potential ways that IPD meta-analyses could be used to influence trials.

CONCLUSIONS: IPD meta-analysis could be better used to inform the design, conduct, analysis, and interpretation of trials.

UK publicly funded Clinical Trials Units supported a controlled access approach to share individual participant data but highlighted concerns

OBJECTIVES: Evaluate current data sharing activities of UK publicly funded Clinical Trial Units (CTUs) and identify good practices and barriers.

STUDY DESIGN AND SETTING: Web-based survey of Directors of 45 UK Clinical Research Collaboration (UKCRC)-registered CTUs.

RESULTS: Twenty-three (51%) CTUs responded: Five (22%) of these had an established data sharing policy and eight (35%) specifically requested consent to use patient data beyond the scope of the original trial. Fifteen (65%) CTUs had received requests for data, and seven (30%) had made external requests for data in the previous 12 months. CTUs supported the need for increased data sharing activities although concerns were raised about patient identification, misuse of data, and financial burden. Custodianship of clinical trial data and requirements for a CTU to align its policy to their parent institutes were also raised. No CTUs supported the use of an open access model for data sharing.

CONCLUSION: There is support within the publicly funded UKCRC-registered CTUs for data sharing, but many perceived barriers remain. CTUs are currently using a variety of approaches and procedures for sharing data. This survey has informed further work, including development of guidance for publicly funded CTUs, to promote good practice and facilitate data sharing.