On the Problems of Mixing RCTs with Qualitative Research: The Case of the MRC Framework for the Evaluation of Complex Healthcare Interventions

In the perceived hierarchy of research designs, the results from randomized controlled trials are considered to provide the highest level of evidence. Indeed these trials have been upheld as the gold standard in research. The benefits and limitations of the randomized controlled trial as a method of evaluating the effectiveness of healthcare interventions are presented. The article then examines the different levels of complexity within healthcare interventions and the problems this poses in determining effectiveness. In an effort to provide a solution to this problem, the Medical Research Council produced a framework to assist investigators to develop and evaluate complex healthcare interventions. The framework is described with reference to an example of implementing and evaluating protocols for weaning patients in the intensive care unit. The framework is critiqued on the basis that it involves an ambiguous or contradictory ontology, which fails to articulate the relationship between the positivism of randomized controlled trials with the relativism of qualitative approaches. It is concluded that the use of realist strategies in combination with randomized controlled trials provides the most coherent solution to this quandary

Ecological coherence in marine reserve network design: an empirical evaluation of sequential site selection using genetic structure

Ecological coherence is a multifaceted conservation objective that includes some potentially conflicting concepts. These concepts include the extent to which the network maximises diversity (including genetic diversity) and the extent to which protected areas interact with non-reserve locations. To examine the consequences of different selection criteria, the preferred location to complement protected sites was examined using samples taken from four locations around each of two marine protected areas: Strangford Lough and Lough Hyne, Ireland. Three different measures of genetic distance were used: FST, Dest and a measure of allelic dissimilarity, along with a direct assessment of the total number of alleles in different candidate networks. Standardized site scores were used for comparisons across methods and selection criteria. The average score for Castlehaven, a site relatively close to Lough Hyne, was highest, implying that this site would capture the most genetic diversity while ensuring highest degree of interaction between protected and unprotected sites. Patterns around Strangford Lough were more ambiguous, potentially reflecting the weaker genetic structure around this protected area in comparison to Lough Hyne. Similar patterns were found across species with different dispersal capacities, indicating that methods based on genetic distance could be used to help maximise ecological coherence in reserve networks. ⺠Ecological coherence is a key component of marine protected area network design. ⺠Coherence contains a number of competing concepts. ⺠Genetic information from field populations can help guide assessments of coherence. ⺠Average choice across different concepts of coherence was consistent among species. ⺠Measures can be combined to compare the coherence of different network designs.

A scaling method for modelling the crashworthiness of novel roadside barrier designs

In this paper, a novel method for modelling a scaled vehicle–barrier crash test similar to the 20◦ angled barrier test specified in EN 1317 is reported. The intended application is for proof-of-concept evaluation of novel roadside barrier designs, and as a cost-effective precursor to full-scale testing or detailed computational modelling. The method is based on the combination of the conservation of energy law and the equation of motion of a spring mass system representing the impact, and shows, for the first time, the feasibility of applying classical scaling theories to evaluation of roadside barrier design. The scaling method is used to set the initial velocity of the vehicle in the scaled test and to provide scaling factors to convert the measured vehicle accelerations in the scaled test to predicted full-scale accelerations. These values can then be used to calculate the Acceleration Severity Index score of the barrier for a full-scale test. The theoretical validity of the method is demonstrated by comparison to numerical simulations of scaled and full-scale angled barrier impacts using multibody analysis implemented in the crash simulation software MADYMO. Results show a maximum error of 0.3% ascribable to the scaling method.

A Pilot Evaluation of the Palliative Performance Scale in Long Term Care: Tips for Success

Aims: Palliative care in long-term care (LTC) homes is an area of growing concern. Little work has been done to explore innovative ways to identify and care for residents who become palliative. The purpose of this intervention study was to evaluate the implementation of the Palliative Performance Scale (PPS) in LTC. Specifically we explored staff perceptions about implementing the PPS and how it cued staff to initiate palliative care discussion with residents and family when a resident’s health declined.

Methods: This study utilized a qualitative descriptive design that included data from four separate sources: journals of three ‘champions’ who were responsible for leading the implementation of the PPS; staff evaluations of three educational training sessions; minutes from meetings; and 11 interviews from key staff who were involved in the implementation process. Data were analyzed using thematic content analysis.

Results: Staff generally felt positively about using the PPS in LTC and stated that it increased awareness of palliative care and helped identify those residents who were nearing the end of life. There were some barriers to implementing it, such as staff resistance and lack of time to complete it. The importance of having a designated ‘champion’ and effective interdisciplinary communication in addition to widespread training, were identified as successful strategies to facilitate the implementation process.

Conclusion: These study findings support the use of the PPS in LTC and offer some perspective about ways to implement it successfully. Future work is needed to evaluate the PPS in LTC using more rigorous designs.

Pan-retinal photocoagulation and other forms of laser treatment and drug therapies for non-proliferative diabetic retinopathy: systematic review and economic evaluation

BACKGROUND: Diabetic retinopathy is an important cause of visual loss. Laser photocoagulation preserves vision in diabetic retinopathy but is currently used at the stage of proliferative diabetic retinopathy (PDR).

OBJECTIVES: The primary aim was to assess the clinical effectiveness and cost-effectiveness of pan-retinal photocoagulation (PRP) given at the non-proliferative stage of diabetic retinopathy (NPDR) compared with waiting until the high-risk PDR (HR-PDR) stage was reached. There have been recent advances in laser photocoagulation techniques, and in the use of laser treatments combined with anti-vascular endothelial growth factor (VEGF) drugs or injected steroids. Our secondary questions were: (1) If PRP were to be used in NPDR, which form of laser treatment should be used? and (2) Is adjuvant therapy with intravitreal drugs clinically effective and cost-effective in PRP?

ELIGIBILITY CRITERIA: Randomised controlled trials (RCTs) for efficacy but other designs also used.

REVIEW METHODS: Systematic review and economic modelling.

RESULTS: The Early Treatment Diabetic Retinopathy Study (ETDRS), published in 1991, was the only trial designed to determine the best time to initiate PRP. It randomised one eye of 3711 patients with mild-to-severe NPDR or early PDR to early photocoagulation, and the other to deferral of PRP until HR-PDR developed. The risk of severe visual loss after 5 years for eyes assigned to PRP for NPDR or early PDR compared with deferral of PRP was reduced by 23% (relative risk 0.77, 99% confidence interval 0.56 to 1.06). However, the ETDRS did not provide results separately for NPDR and early PDR. In economic modelling, the base case found that early PRP could be more effective and less costly than deferred PRP. Sensitivity analyses gave similar results, with early PRP continuing to dominate or having low incremental cost-effectiveness ratio. However, there are substantial uncertainties. For our secondary aims we found 12 trials of lasers in DR, with 982 patients in total, ranging from 40 to 150. Most were in PDR but five included some patients with severe NPDR. Three compared multi-spot pattern lasers against argon laser. RCTs comparing laser applied in a lighter manner (less-intensive burns) with conventional methods (more intense burns) reported little difference in efficacy but fewer adverse effects. One RCT suggested that selective laser treatment targeting only ischaemic areas was effective. Observational studies showed that the most important adverse effect of PRP was macular oedema (MO), which can cause visual impairment, usually temporary. Ten trials of laser and anti-VEGF or steroid drug combinations were consistent in reporting a reduction in risk of PRP-induced MO.

LIMITATION: The current evidence is insufficient to recommend PRP for severe NPDR.

CONCLUSIONS: There is, as yet, no convincing evidence that modern laser systems are more effective than the argon laser used in ETDRS, but they appear to have fewer adverse effects. We recommend a trial of PRP for severe NPDR and early PDR compared with deferring PRP till the HR-PDR stage. The trial would use modern laser technologies, and investigate the value adjuvant prophylactic anti-VEGF or steroid drugs.

STUDY REGISTRATION: This study is registered as PROSPERO CRD42013005408.

FUNDING: The National Institute for Health Research Health Technology Assessment programme.

HIV-1 vaccines and adaptive trial designs.

Developing a vaccine against the human immunodeficiency virus (HIV) poses an exceptional challenge. There are no documented cases of immune-mediated clearance of HIV from an infected individual, and no known correlates of immune protection. Although nonhuman primate models of lentivirus infection have provided valuable data about HIV pathogenesis, such models do not predict HIV vaccine efficacy in humans. The combined lack of a predictive animal model and undefined biomarkers of immune protection against HIV necessitate that vaccines to this pathogen be tested directly in clinical trials. Adaptive clinical trial designs can accelerate vaccine development by rapidly screening out poor vaccines while extending the evaluation of efficacious ones, improving the characterization of promising vaccine candidates and the identification of correlates of immune protection.

Enabling and Measuring Complexity in Evolving Designs using Generative Representations for Artificial Architecture

As the complexity of evolutionary design problems grow, so too must the quality of solutions scale to that complexity. In this research, we develop a genetic programming system with individuals encoded as tree-based generative representations to address scalability. This system is capable of multi-objective evaluation using a ranked sum scoring strategy. We examine Hornby's features and measures of modularity, reuse and hierarchy in evolutionary design problems. Experiments are carried out, using the system to generate three-dimensional forms, and analyses of feature characteristics such as modularity, reuse and hierarchy were performed. This work expands on that of Hornby's, by examining a new and more difficult problem domain. The results from these experiments show that individuals encoded with those three features performed best overall. It is also seen, that the measures of complexity conform to the results of Hornby. Moving forward with only this best performing encoding, the system was applied to the generation of three-dimensional external building architecture. One objective considered was passive solar performance, in which the system was challenged with generating forms that optimize exposure to the Sun. The results from these and other experiments satisfied the requirements. The system was shown to scale well to the architectural problems studied.

I Believe in me, not OCB: Evaluation of Group Function-Based CBT as a Treatment for Obsessive Compulsive Behaviour in Four Children with HFA

Researchers have conceptualized repetitive behaviours in individuals with Autism Spectrum Disorder (ASD) on a continuum oflower-Ievel, motoric, repetitive behaviours and higher-order, repetitive behaviours that include symptoms ofOCD (Hollander, Wang, Braun, & Marsh, 2009). Although obsessional, ritualistic, and stereotyped behaviours are a core feature of ASD, individuals with ASD frequently experience obsessions and compulsions that meet DSM-IV-TR (American Psychiatric Association, 2000) criteria for Obsessive-Compulsive Disorder (OCD). Given the acknowledged difficulty in differentiating between OCD and Autism-related obsessive-compulsive phenomena, the present study uses the term Obsessive Compulsive Behaviour (OCB) to represent both phenomena. This study used a multiple baseline design across behaviours and ABC designs (Cooper, Heron, & Heward, 2007) to investigate if a 9-week Group Function-Based Cognitive Behavioural Therapy (CBT) decreased OCB in four children (ages 7 - 11 years) with High Functioning Autism (HFA). Key treatment components included traditional CBT components (awareness training, cognitive-behavioural skills training, exposure and response prevention) as well as function-based assessment and intervention. Time series data indicated significant decreases in OCBs. Standardized assessments showed decreases in symptom severity, and increases in quality of life for the participants and their families. Issues regarding symptom presentation, assessment, and treatment of a dually diagnosed child are discussed.

A technique for evaluation of interactive evolutionary systems

Very large scale scheduling and planning tasks cannot be effectively addressed by fully automated schedule optimisation systems, since many key factors which govern 'fitness' in such cases are unformalisable. This raises the question of an interactive (or collaborative) approach, where fitness is assigned by the expert user. Though well-researched in the domains of interactively evolved art and music, this method is as yet rarely used in logistics. This paper concerns a difficulty shared by all interactive evolutionary systems (IESs), but especially those used for logistics or design problems. The difficulty is that objective evaluation of IESs is severely hampered by the need for expert humans in the loop. This makes it effectively impossible to, for example, determine with statistical confidence any ranking among a decent number of configurations for the parameters and strategy choices. We make headway into this difficulty with an Automated Tester (AT) for such systems. The AT replaces the human in experiments, and has parameters controlling its decision-making accuracy (modelling human error) and a built-in notion of a target solution which may typically be at odds with the solution which is optimal in terms of formalisable fitness. Using the AT, plausible evaluations of alternative designs for the IES can be done, allowing for (and examining the effects of) different levels of user error. We describe such an AT for evaluating an IES for very large scale planning.

Refinement of the Clinical Scenario Evaluation Framework for Assessment of Competing Development Strategies with an Application to Multiple Sclerosis

When competing strategies for development programs, clinical trial designs, or data analysis methods exist, the alternatives need to be evaluated in a systematic way to facilitate informed decision making. Here we describe a refinement of the recently proposed clinical scenario evaluation framework for the assessment of competing strategies. The refinement is achieved by subdividing key elements previously proposed into new categories, distinguishing between quantities that can be estimated from preexisting data and those that cannot and between aspects under the control of the decision maker from those that are determined by external constraints. The refined framework is illustrated by an application to a design project for an adaptive seamless design for a clinical trial in progressive multiple sclerosis.

A clocking technique with power savings in virtex-based pipelined designs

This paper presents the evaluation in power consumption of a clocking technique for pipelined designs. The technique shows a dynamic power consumption saving of around 30% over a conventional global clocking mechanism. The results were obtained from a series of experiments of a systolic circuit implemented in Virtex-II devices. The conversion from a global-clocked pipelined design to the proposed technique is straightforward, preserving the original datapath design. The savings can be used immediately either as a power reduction benefit or to increase the frequency of operation of a design for the same power consumption.

Improving mW/MHz ratio in FPGAs pipelined designs

This paper presents a simple clocking technique to migrate classical synchronous pipelined designs to a synchronous functional-equivalent alternative system in the context of FPGAs. When the new pipelined design runs at the same throughput of the original design, around 30% better mW/MHz ratio was observed in Virtex-based FPGA circuits. The evaluation is done using a simple but representative and practical systolic design as an example. The technique in essence is a simple replacement of the clocking mechanism for the pipe-storage elements; however no extra design effort is needed. The results show that the proposed technique allows immediate power and area-time savings of existing designs rather than exploring potential benefits by a new logic design to the problem using the classic pipeline clocking mechanism.

Seamless phase II/III designs

In recent years, there has been a drive to save development costs and shorten time-to-market of new therapies. Research into novel trial designs to facilitate this goal has led to, amongst other approaches, the development of methodology for seamless phase II/III designs. Such designs allow treatment or dose selection at an interim analysis and comparative evaluation of efficacy with control, in the same study. Methods have gained much attention because of their potential advantages compared to conventional drug development programmes with separate trials for individual phases. In this article, we review the various approaches to seamless phase II/III designs based upon the group-sequential approach, the combination test approach and the adaptive Dunnett method. The objective of this article is to describe the approaches in a unified framework and highlight their similarities and differences to allow choice of an appropriate methodology by a trialist considering conducting such a trial.

Evaluation of Stress Patterns Produced by Implant-Retained Overdentures and Implant-Retained Fixed Partial Denture

The purposes of this study were to photoelastically measure the biomechanical behavior of 4 implants retaining different cantilevered bar mandibular overdenture designs and to compare a fixed partial denture (FPD). A photoelastic model of a human edentulous mandible was fabricated, which contained 4 screw-type implants (3.75 x 10 mm) embedded in the parasymphyseal area. An FPD and 3 overdenture designs with the following attachments were evaluated: 3 plastic Hader clips, 1 Hader clip with 2 posterior resilient cap attachments, and 3 ball/O-ring attachments. Vertical occlusal forces of 100 N were applied between the central incisor and unilaterally to the right and left second premolars and second molars. Stresses that developed in the supporting structure were monitored photoelastically and recorded photographically. The results showed that the anterior loading, the overdenture with 3 plastic Hader clips, displayed the largest stress concentration at the medium implant. With premolar loading, the FPD and overdenture with 3 plastic Hader clips displayed the highest stresses to the ipsilateral terminal implant. With molar loading, the overdenture with 3 ball/O-ring attachments displayed the most uniform stress distribution in the posterior edentulous ridge, with less overloading in the terminal implant. It was concluded that vertical forces applied to the bar-clip overdenture and FPD created immediate stress patterns of greater magnitude and concentration on the ipsilateral implants, whereas the ball/O-ring attachments transferred minimal stress to the implants. The increased cantilever in the FPD caused the highest stresses to the terminal implant.

A critical evaluation of bond strength tests for the assessment of bonding to Y-TZP

Objectives. To compare three different designs for measuring the bond strength between Y-TZP ceramic and a composite material, before and after ceramic surface treatment, evaluating the influence of the size of the adhesive interface for each design.Methods. 'Macro'tensile, microtensile, 'macro'shear, microshear, 'macro'push-out, and micropush-out tests were carried out. Two Y-TZP surface treatments were evaluated: silanization (sil) and tribochemical silica coating (30 mu m silica-modified Al2O3 particles + silanization) (TBS). Failure mode analysis of tested samples was also performed. Results. Both the surface treatment and the size of the bonded interface significantly affected the results (p = 0.00). Regardless of the type of surface treatment, the microtensile and microshear tests had higher values than their equivalent "macro" tests. However, the push-out test showed the highest values for the "macro" test. The tensile tests showed the greatest variability in results. The tribochemical silica coating method significantly increased bond strength for all tests.Significance. Different test designs can change the outcome for Y-TZP/cement interfaces, in terms of mean values and reliability (variability). The 'micro'tests expressed higher bond strengths than their equivalent 'macro'tests, with the exception of the push-out test (macro > micro). (C) 2015 Academy of Dental Materials. Published by Elsevier Ltd. All rights reserved.