Learning from failure--rationale and design for a study about discontinuation of randomized trials (DISCO study)

Background Randomized controlled trials (RCTs) may be discontinued because of apparent harm, benefit, or futility. Other RCTs are discontinued early because of insufficient recruitment. Trial discontinuation has ethical implications, because participants consent on the premise of contributing to new medical knowledge, Research Ethics Committees (RECs) spend considerable effort reviewing study protocols, and limited resources for conducting research are wasted. Currently, little is known regarding the frequency and characteristics of discontinued RCTs. Methods/Design Our aims are, first, to determine the prevalence of RCT discontinuation for specific reasons; second, to determine whether the risk of RCT discontinuation for specific reasons differs between investigator- and industry-initiated RCTs; third, to identify risk factors for RCT discontinuation due to insufficient recruitment; fourth, to determine at what stage RCTs are discontinued; and fifth, to examine the publication history of discontinued RCTs. We are currently assembling a multicenter cohort of RCTs based on protocols approved between 2000 and 2002/3 by 6 RECs in Switzerland, Germany, and Canada. We are extracting data on RCT characteristics and planned recruitment for all included protocols. Completion and publication status is determined using information from correspondence between investigators and RECs, publications identified through literature searches, or by contacting the investigators. We will use multivariable regression models to identify risk factors for trial discontinuation due to insufficient recruitment. We aim to include over 1000 RCTs of which an anticipated 150 will have been discontinued due to insufficient recruitment. Discussion Our study will provide insights into the prevalence and characteristics of RCTs that were discontinued. Effective recruitment strategies and the anticipation of problems are key issues in the planning and evaluation of trials by investigators, Clinical Trial Units, RECs and funding agencies. Identification and modification of barriers to successful study completion at an early stage could help to reduce the risk of trial discontinuation, save limited resources, and enable RCTs to better meet their ethical requirements.

Reduction of inappropriate medications among older nursing-home residents: a nurse-led, pre/post-design, intervention study

Background: Medication-related problems are common in the growing population of older adults and inappropriate prescribing is a preventable risk factor. Explicit criteria such as the Beers criteria provide a valid instrument for describing the rate of inappropriate medication (IM) prescriptions among older adults. Objective: To reduce IM prescriptions based on explicit Beers criteria using a nurse-led intervention in a nursing-home (NH) setting. Study Design: The pre/post-design included IM assessment at study start (pre-intervention), a 4-month intervention period, IM assessment after the intervention period (post-intervention) and a further IM assessment at 1-year follow-up. Setting: 204-bed inpatient NH in Bern, Switzerland. Participants: NH residents aged ≥60 years. Intervention: The intervention included four key intervention elements: (i) adaptation of Beers criteria to the Swiss setting; (ii) IM identification; (iii) IM discontinuation; and (iv) staff training. Main Outcome Measure: IM prescription at study start, after the 4-month intervention period and at 1-year follow-up. Results: The mean±SD resident age was 80.3±8.8 years. Residents were prescribed a mean±SD 7.8±4.0 medications. The prescription rate of IMs decreased from 14.5% pre-intervention to 2.8% post-intervention (relative risk [RR] = 0.2; 95% CI 0.06, 0.5). The risk of IM prescription increased nonstatistically significantly in the 1-year follow-up period compared with post-intervention (RR = 1.6; 95% CI 0.5, 6.1). Conclusions: This intervention to reduce IM prescriptions based on explicit Beers criteria was feasible, easy to implement in an NH setting, and resulted in a substantial decrease in IMs. These results underscore the importance of involving nursing staff in the medication prescription process in a long-term care setting.

Dopamine-related deficit in reward learning after catecholamine depletion in unmedicated, remitted subjects with bulimia nervosa

Disturbances in reward processing have been implicated in bulimia nervosa (BN). Abnormalities in processing reward-related stimuli might be linked to dysfunctions of the catecholaminergic neurotransmitter system, but findings have been inconclusive. A powerful way to investigate the relationship between catecholaminergic function and behavior is to examine behavioral changes in response to experimental catecholamine depletion (CD). The purpose of this study was to uncover putative catecholaminergic dysfunction in remitted subjects with BN who performed a reinforcement-learning task after CD. CD was achieved by oral alpha-methyl-para-tyrosine (AMPT) in 19 unmedicated female subjects with remitted BN (rBN) and 28 demographically matched healthy female controls (HC). Sham depletion administered identical capsules containing diphenhydramine. The study design consisted of a randomized, double-blind, placebo-controlled crossover, single-site experimental trial. The main outcome measures were reward learning in a probabilistic reward task analyzed using signal-detection theory. Secondary outcome measures included self-report assessments, including the Eating Disorder Examination-Questionnaire. Relative to healthy controls, rBN subjects were characterized by blunted reward learning in the AMPT-but not in placebo-condition. Highlighting the specificity of these findings, groups did not differ in their ability to perceptually distinguish between stimuli. Increased CD-induced anhedonic (but not eating disorder) symptoms were associated with a reduced response bias toward a more frequently rewarded stimulus. In conclusion, under CD, rBN subjects showed reduced reward learning compared with healthy control subjects. These deficits uncover disturbance of the central reward processing systems in rBN related to altered brain catecholamine levels, which might reflect a trait-like deficit increasing vulnerability to BN.

Radiation metabolomics. 3. Biomarker discovery in the urine of gamma-irradiated rats using a simplified metabolomics protocol of gas chromatography-mass spectrometry combined with random forests machine learning algorithm

Abstract Radiation metabolomics employing mass spectral technologies represents a plausible means of high-throughput minimally invasive radiation biodosimetry. A simplified metabolomics protocol is described that employs ubiquitous gas chromatography-mass spectrometry and open source software including random forests machine learning algorithm to uncover latent biomarkers of 3 Gy gamma radiation in rats. Urine was collected from six male Wistar rats and six sham-irradiated controls for 7 days, 4 prior to irradiation and 3 after irradiation. Water and food consumption, urine volume, body weight, and sodium, potassium, calcium, chloride, phosphate and urea excretion showed major effects from exposure to gamma radiation. The metabolomics protocol uncovered several urinary metabolites that were significantly up-regulated (glyoxylate, threonate, thymine, uracil, p-cresol) and down-regulated (citrate, 2-oxoglutarate, adipate, pimelate, suberate, azelaate) as a result of radiation exposure. Thymine and uracil were shown to derive largely from thymidine and 2'-deoxyuridine, which are known radiation biomarkers in the mouse. The radiation metabolomic phenotype in rats appeared to derive from oxidative stress and effects on kidney function. Gas chromatography-mass spectrometry is a promising platform on which to develop the field of radiation metabolomics further and to assist in the design of instrumentation for use in detecting biological consequences of environmental radiation release.

An innovative blended learning approach using virtual patients as preparation for skills laboratory training: perceptions of students and tutors

BACKGROUND Currently only a few reports exist on how to prepare medical students for skills laboratory training. We investigated how students and tutors perceive a blended learning approach using virtual patients (VPs) as preparation for skills training. METHODS Fifth-year medical students (N=617) were invited to voluntarily participate in a paediatric skills laboratory with four specially designed VPs as preparation. The cases focused on procedures in the laboratory using interactive questions, static and interactive images, and video clips. All students were asked to assess the VP design. After participating in the skills laboratory 310 of the 617 students were additionally asked to assess the blended learning approach through established questionnaires. Tutors' perceptions (N=9) were assessed by semi-structured interviews. RESULTS From the 617 students 1,459 VP design questionnaires were returned (59.1%). Of the 310 students 213 chose to participate in the skills laboratory; 179 blended learning questionnaires were returned (84.0%). Students provided high overall acceptance ratings of the VP design and blended learning approach. By using VPs as preparation, skills laboratory time was felt to be used more effectively. Tutors perceived students as being well prepared for the skills laboratory with efficient uses of time. CONCLUSION The overall acceptance of the blended learning approach was high among students and tutors. VPs proved to be a convenient cognitive preparation tool for skills training.

Implicit task sequence learning

Implicit task sequence learning (TSL) can be considered as an extension of implicit sequence learning which is typically tested with the classical serial reaction time task (SRTT). By design, in the SRTT there is a correlation between the sequence of stimuli to which participants must attend and the sequence of motor movements/key presses with which participants must respond. The TSL paradigm allows to disentangle this correlation and to separately manipulate the presences/absence of a sequence of tasks, a sequence of responses, and even other streams of information such as stimulus locations or stimulus-response mappings. Here I review the state of TSL research which seems to point at the critical role of the presence of correlated streams of information in implicit sequence learning. On a more general level, I propose that beyond correlated streams of information, a simple statistical learning mechanism may also be involved in implicit sequence learning, and that the relative contribution of these two explanations differ according to task requirements. With this differentiation, conflicting results can be integrated into a coherent framework.

Early adolescents' enjoyment experienced in learning situations and its relation to student achievement

While many studies confirm that positive emotions, including enjoyment, lead to better student achievement, less empirical evidence exists about possible mediator variables that link achievement to enjoyment. It is proposed that achievement and enjoyment form a circular dependency; enjoyment in learning leads to higher achievement but a degree of achievement is required to enjoy learning. This study provides insight into the reverse of the much studied enjoyment to achievement link and provides practical recommendations on how to use these findings. Founded in Control-value theory, which suggests that control and value cognitions are important variables that mediate the connection between enjoyment and achievement, this study explores the reciprocal achievement-cognition-enjoyment link. The reciprocal link was investigated by applying a one year longitudinal design to students of grade 6 and 7 (N = 356). This age group was chosen because early adolescence represents a critical period during which a strong decrease in positive learning emotions is observed. Part of the work involved identifying factors that might be responsible for this negative development. Results of cross-lagged path analysis identified reciprocal effects between student achievement and enjoyment with control and value cognitions functioning as partial mediators. High achievement goes with high control and value cognitions, which in turn positively affect enjoyment. However, cross-lagged correlations could only be partly confirmed. The results are discussed in terms of theoretical and practical implications.

Learning enjoyment in early adolescence

There is empirical evidence showing that positive emotional and motivational factors in formal learning contexts decrease at the stage of young adolescence. According to Stage-Environment-Fit Theory and Self-Determination Theory, this change should be explained by a non-fulfilment of students' needs. By combining two different methods (questionnaires and day-to-day diaries) and applying a longitudinal design, this study aimed to explore the change in and the determinants of habitual and actual learning enjoyment. The sample consisted of 356 students. Quantitative results indicated that learning enjoyment and classroom practices decreased between Grades 6 and 7. Path analyses revealed that classroom practices are the source of students' learning enjoyment, while self-efficacy functions as a partial mediator. Data from students' diaries showed that a teacher's neglect of students' needs for competence and relatedness were significant sources of impeded learning enjoyment. Practical implications suggest the relevance of adjusting learning conditions to the needs of young adolescents in order to provide a facilitating basis for learning enjoyment.

Sustainable Wastewater Management: Is it Possible to Regulate Micropollution in the Future by Learning from the Past? A Policy Analysis

This paper applies a policy analysis approach to the question of how to effectively regulate micropollution in a sustainable manner. Micropollution is a complex policy problem characterized by a huge number and diversity of chemical substances, as well as various entry paths into the aquatic environment. It challenges traditional water quality management by calling for new technologies in wastewater treatment and behavioral changes in industry, agriculture and civil society. In light of such challenges, the question arises as to how to regulate such a complex phenomenon to ensure water quality is maintained in the future? What can we learn from past experiences in water quality regulation? To answer these questions, policy analysis strongly focuses on the design and choice of policy instruments and the mix of such measures. In this paper, we review instruments commonly used in past water quality regulation. We evaluate their ability to respond to the characteristics of a more recent water quality problem, i.e., micropollution, in a sustainable way. This way, we develop a new framework that integrates both the problem dimension (i.e., causes and effects of a problem) as well as the sustainability dimension (e.g., long-term, cross-sectoral and multi-level) to assess which policy instruments are best suited to regulate micropollution. We thus conclude that sustainability criteria help to identify an appropriate instrument mix of end-of-pipe and source-directed measures to reduce aquatic micropollution.

The Role of BDNF, Leptin and Catecholamines in Reward Learning in Bulimia Nervosa

Background: A relationship between bulimia nervosa (BN) and reward-related behavior is supported by several lines of evidence. The dopaminergic dysfunctions in the processing of reward-related stimuli have been shown to be modulated by the neurotrophin brain derived neurotrophic factor (BDNF) and the hormone leptin. Methods: Using a randomized, double-blind, placebo-controlled, crossover design, a reward learning task was applied to study the behavior of 20 female subjects with remitted BN (rBN) and 27 female healthy controls under placebo and catecholamine depletion with alpha-methyl-para-tyrosine (AMPT). The plasma levels of BDNF and leptin were measured twice during the placebo and the AMPT condition, immediately before and 1 h after a standardized breakfast. Results: AMPT-induced differences in plasma BDNF levels were positively correlated with the AMPT-induced differences in reward learning in the whole sample (p = 0.05). Across conditions, plasma BDNF levels were higher in rBN subjects compared to controls (diagnosis effect; p = 0.001). Plasma BDNF and leptin levels were higher in the morning before compared to after a standardized breakfast across groups and conditions (time effect; p < 0.0001). The plasma leptin levels were higher under catecholamine depletion compared to placebo in the whole sample (treatment effect; p = 0.0004). Conclusions: This study reports on preliminary findings that suggest a catecholamine-dependent association of plasma BDNF and reward learning in subjects with rBN and controls. A role of leptin in reward learning is not supported by this study. However, leptin levels were sensitive to a depletion of catecholamine stores in both rBN and controls.

Endovascular treatment for acute ischemic stroke patients: implications and interpretation of IMS III, MR RESCUE, and SYNTHESIS EXPANSION trials: A report from the Working Group of International Congress of Interventional Neurology

OBJECTIVE The results of Interventional Management of Stroke (IMS) III, Magnetic Resonance and REcanalization of Stroke Clots Using Embolectomy (MR RESCUE), and SYNTHESIS EXPANSION trials are expected to affect the practice of endovascular treatment for acute ischemic stroke. The purpose of this report is to review the components of the designs and methods of these trials and to describe the influence of those components on the interpretation of trial results. METHODS A critical review of trial design and conduct of IMS III, MR RESCUE, and SYNTHESIS EXPANSION is performed with emphasis on patient selection, shortcomings in procedural aspects, and methodology of data ascertainment and analysis. The influence of each component is estimated based on published literature including multicenter clinical trials reporting on endovascular treatment for acute ischemic stroke and myocardial infarction. RESULTS We critically examined the time interval between symptom onset and treatment and rates of angiographic recanalization to differentiate between "endovascular treatment" and "parameter optimized endovascular treatment" as it relates to the IMS III, MR RESCUE, and SYNTHESIS EXPANSION trials. All the three trials failed to effectively test "parameter optimized endovascular treatment" due to the delay between symptom onset and treatment and less than optimal rates of recanalization. In all the three trials, the magnitude of benefit with endovascular treatment required to reject the null hypothesis was larger than could be expected based on previous studies. The IMS III and SYNTHESIS EXPANSION trials demonstrated that rates of symptomatic intracerebral hemorrhages subsequent to treatment are similar between IV thrombolytics and endovascular treatment in matched acute ischemic stroke patients. The trials also indirectly validated the superiority/equivalence of IV thrombolytics (compared with endovascular treatment) in patients with minor neurological deficits and those without large vessel occlusion on computed tomographic/magnetic resonance angiography. CONCLUSIONS The results do not support a large magnitude benefit of endovascular treatment in subjects randomized in all the three trials. The possibility that benefits of a smaller magnitude exist in certain patient populations cannot be excluded. Large magnitude benefits can be expected with implementation of "parameter optimized endovascular treatment" in patients with ischemic stroke who are candidates for IV thrombolytics.

Early adolescents’ enjoyment experienced in learning situations at school and its relation to student achievement

While many studies confirm that positive emotions, including enjoyment, lead to better student achievement, less empirical evidence exists about possible mediator variables that link achievement to enjoyment. It is proposed that achievement and enjoyment form a circular dependency; enjoyment in learning leads to higher achievement but a degree of achievement is required to enjoy learning. This study provides insight into the reverse of the much studied enjoyment to achievement link and provides practical recommendations on how to use these findings. Founded in Control-value theory, which suggests that control and value cognitions are important variables that mediate the connection between enjoyment and achievement, this study explores the reciprocal achievement-cognition-enjoyment link. The reciprocal link was investigated by applying a one year longitudinal design to students of grade 6 and 7 (N = 356). This age group was chosen because early adolescence represents a critical period during which a strong decrease in positive learning emotions is observed. Part of the work involved identifying factors that might be responsible for this negative development. Results of cross-lagged path analysis identified reciprocal effects between student achievement and enjoyment with control and value cognitions functioning as partial mediators. High achievement goes with high control and value cognitions, which in turn positively affect enjoyment. However, cross-lagged correlations could only be partly confirmed. The results are discussed in terms of theoretical and practical implications

Statistical Learning, Syllable Processing, and Speech Production in Healthy Hearing and Hearing-Impaired Preschool Children: A Mismatch Negativity Study

OBJECTIVES The objectives of the present study were to investigate temporal/spectral sound-feature processing in preschool children (4 to 7 years old) with peripheral hearing loss compared with age-matched controls. The results verified the presence of statistical learning, which was diminished in children with hearing impairments (HIs), and elucidated possible perceptual mediators of speech production. DESIGN Perception and production of the syllables /ba/, /da/, /ta/, and /na/ were recorded in 13 children with normal hearing and 13 children with HI. Perception was assessed physiologically through event-related potentials (ERPs) recorded by EEG in a multifeature mismatch negativity paradigm and behaviorally through a discrimination task. Temporal and spectral features of the ERPs during speech perception were analyzed, and speech production was quantitatively evaluated using speech motor maximum performance tasks. RESULTS Proximal to stimulus onset, children with HI displayed a difference in map topography, indicating diminished statistical learning. In later ERP components, children with HI exhibited reduced amplitudes in the N2 and early parts of the late disciminative negativity components specifically, which are associated with temporal and spectral control mechanisms. Abnormalities of speech perception were only subtly reflected in speech production, as the lone difference found in speech production studies was a mild delay in regulating speech intensity. CONCLUSIONS In addition to previously reported deficits of sound-feature discriminations, the present study results reflect diminished statistical learning in children with HI, which plays an early and important, but so far neglected, role in phonological processing. Furthermore, the lack of corresponding behavioral abnormalities in speech production implies that impaired perceptual capacities do not necessarily translate into productive deficits.

Addressing Multilevel Program Complexity by Evaluation Design

In this paper, we present the evaluation design for a complex multilevel program recently introduced in Switzerland. The evaluation embraces the federal level, the cantonal program level, and the project level where target groups are directly addressed. We employ Pawson and Tilley’s realist evaluation approach, in order to do justice to the varying context factors that impact the cantonal programs leading to varying effectiveness of the implemented activities. The application of the model to the canton of Uri shows that the numerous vertical and horizontal relations play a crucial role for the program’s effectiveness. As a general learning for the evaluation of complex programs, we state that there is a need to consider all affected levels of a program and that no monocausal effects can be singled out in programs where multiple interventions address the same problem. Moreover, considering all affected levels of a program can mean going beyond the borders of the actual program organization and including factors that do not directly interfere with the policy delivery as such. In particular, we found that the relationship between the cantonal and the federal level was a crucial organizational factor influencing the effectiveness of the cantonal program.