Clinical research projects at a German medical faculty: follow-up from ethical approval to publication and citation by others

BACKGROUND: Only data of published study results are available to the scientific community for further use such as informing future research and synthesis of available evidence. If study results are reported selectively, reporting bias and distortion of summarised estimates of effect or harm of treatments can occur. The publication and citation of results of clinical research conducted in Germany was studied. METHODS: The protocols of clinical research projects submitted to the research ethics committee of the University of Freiburg (Germany) in 2000 were analysed. Published full articles in several databases were searched and investigators contacted. Data on study and publication characteristics were extracted from protocols and corresponding publications. RESULTS: 299 study protocols were included. The most frequent study design was randomised controlled trial (141; 47%), followed by uncontrolled studies (61; 20%), laboratory studies (30; 10%) and non-randomised studies (29; 10%). 182 (61%) were multicentre studies including 97 (53%) international collaborations. 152 of 299 (51%) had commercial (co-)funding and 46 (15%) non-commercial funding. 109 of the 225 completed protocols corresponded to at least one full publication (total 210 articles); the publication rate was 48%. 168 of 210 identified publications (80%) were cited in articles indexed in the ISI Web of Science. The median was 11 citations per publication (range 0-1151). CONCLUSIONS: Results of German clinical research projects conducted are largely underreported. Barriers to successful publication need to be identified and appropriate measures taken. Close monitoring of projects until publication and adequate support provided to investigators may help remedy the prevailing underreporting of research.

Online Distance Education: Towards a Research Agenda

Online Distance Education: Towards a Research Agenda offers a systematic overview of the major issues, trends, and areas of priority in online distance education research. In each chapter, an international expert or team of experts provides an overview of one timely issue in online distance education, summarizing major research on the topic, discussing theoretical insights that guide the research, posing questions and directions for future research, and discussing the implications for distance education practice as a whole. Intended as a primary reference and guide for distance educators, researchers, and policymakers, Online Distance Education addresses aspects of distance education practice that have often been marginalized, including issues of cost and economics, concerns surrounding social justice, cultural bias, the need for faculty professional development, and the management and growth of learner communities. At once soundly empirical and thoughtfully reflective, yet also forward-looking and open to new approaches to online and distance teaching, this text is a solid resource for researchers in a rapidly expanding discipline.

Researcher allegiance in psychotherapy outcome research: an overview of reviews

Researcher allegiance (RA) is widely discussed as a risk of bias in psychotherapy outcome research. The relevance attached to RA bias is related to meta-analyses demonstrating an association of RA with treatment effects. However, recent meta-analyses have yielded mixed results. To provide more clarity on the magnitude and robustness of the RA-outcome association this article reports on a meta-meta-analysis summarizing all available meta-analytic estimates of the RA-outcome association. Random-effects methods were used. Primary study overlap was controlled. Thirty meta-analyses were included. The mean RA-outcome association was r=.262 (p=.002, I(2)=28.98%), corresponding to a moderate effect size. The RA-outcome association was robust across several moderating variables including characteristics of treatment, population, and the type of RA assessment. Allegiance towards the RA bias hypothesis moderated the RA-outcome association. The findings of this meta-meta-analysis suggest that the RA-outcome association is substantial and robust. Implications for psychotherapy outcome research are discussed.

TH2 cytokines from malignant cells suppress TH1 responses and enforce a global TH2 bias in leukemic cutaneous T-cell lymphoma

PURPOSE In leukemic cutaneous T-cell lymphoma (L-CTCL), malignant T cells accumulate in the blood and give rise to widespread skin inflammation. Patients have intense pruritus, increased immunoglobulin E (IgE), and decreased T-helper (TH)-1 responses, and most die from infection. Depleting malignant T cells while preserving normal immunity is a clinical challenge. L-CTCL has been variably described as a malignancy of regulatory, TH2 and TH17 cells. EXPERIMENTAL DESIGN We analyzed phenotype and cytokine production in malignant and benign L-CTCL T cells, characterized the effects of malignant T cells on healthy T cells, and studied the immunomodulatory effects of treatment modalities in patients with L-CTCL. RESULTS Twelve out of 12 patients with L-CTCL overproduced TH2 cytokines. Remaining benign T cells were also strongly TH2 biased, suggesting a global TH2 skewing of the T-cell repertoire. Culture of benign T cells away from the malignant clone reduced TH2 and enhanced TH1 responses, but separate culture had no effect on malignant T cells. Coculture of healthy T cells with L-CTCL T cells reduced IFNγ production and neutralizing antibodies to interleukin (IL)-4 and IL-13 restored TH1 responses. In patients, enhanced TH1 responses were observed following a variety of treatment modalities that reduced malignant T-cell burden. CONCLUSIONS A global TH2 bias exists in both benign and malignant T cells in L-CTCL and may underlie the infectious susceptibility of patients. TH2 cytokines from malignant cells strongly inhibited TH1 responses. Our results suggest that therapies that inhibit TH2 cytokine activity, by virtue of their ability to improve TH1 responses, may have the potential to enhance both anticancer and antipathogen responses.

Effects of study precision and risk of bias in networks of interventions: a network meta-epidemiological study

BACKGROUND Empirical research has illustrated an association between study size and relative treatment effects, but conclusions have been inconsistent about the association of study size with the risk of bias items. Small studies give generally imprecisely estimated treatment effects, and study variance can serve as a surrogate for study size. METHODS We conducted a network meta-epidemiological study analyzing 32 networks including 613 randomized controlled trials, and used Bayesian network meta-analysis and meta-regression models to evaluate the impact of trial characteristics and study variance on the results of network meta-analysis. We examined changes in relative effects and between-studies variation in network meta-regression models as a function of the variance of the observed effect size and indicators for the adequacy of each risk of bias item. Adjustment was performed both within and across networks, allowing for between-networks variability. RESULTS Imprecise studies with large variances tended to exaggerate the effects of the active or new intervention in the majority of networks, with a ratio of odds ratios of 1.83 (95% CI: 1.09,3.32). Inappropriate or unclear conduct of random sequence generation and allocation concealment, as well as lack of blinding of patients and outcome assessors, did not materially impact on the summary results. Imprecise studies also appeared to be more prone to inadequate conduct. CONCLUSIONS Compared to more precise studies, studies with large variance may give substantially different answers that alter the results of network meta-analyses for dichotomous outcomes.

Quantitative and qualitative research approaches to assess student well-being

Although there is dissimiliarity in theoretical research approaches to subjective well-being and to assessments of well-being, there is agreement regarding the value of well-being, especially among student populations. In the highly structured, achievement-oriented, non-optimal context of a classroom, individual well-being is a necessary pre-condition for learning. Among student populations well-being should not be construed as an achievement enhancer; but, rather, recognized and measured as an educational value of its own. However, it is necessary for the positive bias towards learning at least in highly structured, achievement-orientated, non-optional learning contexts like school [cf. Hascher, T. (2004). Wohlbefinden in der Schule. Münster: Waxmann]. How can it be measured? Since different research approaches lead to a variety of instruments, the following paper will focus on two ways of assessing well-being in school: a questionnaire on student well-being (N = 2014) 1 and a semi-structured daily diary about relevant emotional situations in school (N = 58, period 3 × 2 weeks). Both methods are introduced and their methodological quality is discussed in terms of reliability, validity and in terms of their usefulness for improving school practice. Furthermore, the research potential of combining quantitative and qualitative data on students’ well-being is addressed.

The accuracy of self-reported medical history: A preliminary analysis of the promise of internet-based research in Inflammatory Bowel Diseases

BACKGROUND AND AIMS: Internet-based surveys provide a potentially important tool for Inflammatory Bowel Disease (IBD) research. The advantages include low cost, large numbers of participants, rapid study completion and less extensive infrastructure than traditional methods. The aim was to determine the accuracy of patient self-reporting in internet-based IBD research and identify predictors of greater reliability. METHODS: 197 patients from a tertiary care center answered an online survey concerning personal medical history and an evaluation of disease specific knowledge. Self-reported medical details were compared with data abstracted from medical records. Agreement was assessed by kappa (κ) statistics. RESULTS: Participants responded correctly with excellent agreement (κ=0.96-0.97) on subtype of IBD and history of surgery. The agreement was also excellent for colectomy (κ=0.88) and small bowel resection (κ=0.91), moderate for abscesses and fistulas (κ=0.60 and 0.63), but poor regarding partial colectomy (κ=0.39). Time since last colonoscopy was self-reported with better agreement (κ=0.84) than disease activity. For disease location/extent, moderate agreements at κ=69% and 64% were observed for patients with Crohn's disease and ulcerative colitis, respectively. Subjects who scored higher than the average in the IBD knowledge assessment were significantly more accurate about disease location than their complementary group (74% vs. 59%, p=0.02). CONCLUSION: This study demonstrates that IBD patients accurately report their medical history regarding type of disease and surgical procedures. More detailed medical information is less reliably reported. Disease knowledge assessment may help in identifying the most accurate individuals and could therefore serve as validity criteria. Internet-based surveys are feasible with high reliability about basic disease features only. However, the participants in this study were engaged at a tertiary center, which potentially leads to a bias and compromises generalization to an unfiltered patient group.

Poor Reliability between Cochrane Reviewers and Blinded External Reviewers When Applying the Cochrane Risk of Bias Tool in Physical Therapy Trials

OBJECTIVES To test the inter-rater reliability of the RoB tool applied to Physical Therapy (PT) trials by comparing ratings from Cochrane review authors with those of blinded external reviewers. METHODS Randomized controlled trials (RCTs) in PT were identified by searching the Cochrane Database of Systematic Reviews for meta-analysis of PT interventions. RoB assessments were conducted independently by 2 reviewers blinded to the RoB ratings reported in the Cochrane reviews. Data on RoB assessments from Cochrane reviews and other characteristics of reviews and trials were extracted. Consensus assessments between the two reviewers were then compared with the RoB ratings from the Cochrane reviews. Agreement between Cochrane and blinded external reviewers was assessed using weighted kappa (κ). RESULTS In total, 109 trials included in 17 Cochrane reviews were assessed. Inter-rater reliability on the overall RoB assessment between Cochrane review authors and blinded external reviewers was poor (κ  =  0.02, 95%CI: -0.06, 0.06]). Inter-rater reliability on individual domains of the RoB tool was poor (median κ  = 0.19), ranging from κ  =  -0.04 ("Other bias") to κ  =  0.62 ("Sequence generation"). There was also no agreement (κ  =  -0.29, 95%CI: -0.81, 0.35]) in the overall RoB assessment at the meta-analysis level. CONCLUSIONS Risk of bias assessments of RCTs using the RoB tool are not consistent across different research groups. Poor agreement was not only demonstrated at the trial level but also at the meta-analysis level. Results have implications for decision making since different recommendations can be reached depending on the group analyzing the evidence. Improved guidelines to consistently apply the RoB tool and revisions to the tool for different health areas are needed.

Can eye movements bias memory recall?

A large body of research suggests that when we retrieve visual information from memory, we look back to the location where we encoded these objects. It has been proposed that the oculomotor trace we act out during encoding is stored in long-term memory, along other contents of the episodic representation. If memory recall triggers the eyes to revisit the location where the stimulus was encoded, is there also an effect in the reverse direction? Can eye movements trigger memory recall? In Experiment 1 participants encoded two faces at two different locations on the computer screen. Then, the average face (morph) of these two faces appeared in either of the two encoding locations and participants had to indicate whether it resembles more the first or second face. In Experiment 2 the morph appeared in a new location, but participants had to repeat one of the oculomotor traces that was used during encoding. Participants’ morph perception was influenced both by the location and the eye-movement it was presented with. Our results suggest that eye-movements can bias memory recall, but only in a short-lasting and rather fragile way.

Varying expectancies and attention bias in phobic and non-phobic individuals.

Phobic individuals display an attention bias to phobia-related information and biased expectancies regarding the likelihood of being faced with such stimuli. Notably, although attention and expectancy biases are core features in phobia and anxiety disorders, these biases have mostly been investigated separately and their causal impact has not been examined. We hypothesized that these biases might be causally related. Spider phobic and low spider fearful control participants performed a visual search task in which they specified whether the deviant animal in a search array was a spider or a bird. Shorter reaction times (RTs) for spiders than for birds in this task reflect an attention bias toward spiders. Participants' expectancies regarding the likelihood of these animals being the deviant in the search array were manipulated by presenting verbal cues. Phobics were characterized by a pronounced and persistent attention bias toward spiders; controls displayed slower RTs for birds than for spiders only when spider cues had been presented. More important, we found RTs for spider detections to be virtually unaffected by the expectancy cues in both groups, whereas RTs for bird detections showed a clear influence of the cues. Our results speak to the possibility that evolution has formed attentional systems that are specific to the detection of phylogenetically salient stimuli such as threatening animals; these systems may not be as penetrable to variations in (experimentally induced) expectancies as those systems that are used for the detection of non-threatening stimuli. In sum, our findings highlight the relation between expectancies and attention engagement in general. However, expectancies may play a greater role in attention engagement in safe environments than in threatening environments.

Evidence for an encounter expectancy bias in fear of spiders.

Whereas research has demonstrated that phobic or fearful individuals overestimate the likelihood of incurring aversive consequences from an encounter with feared stimuli, it has not yet been systematically investigated whether these individuals also overestimate the likelihood (i.e., the frequency) of such encounters. In the current study, spider-fearful and control participants were presented with background information that allowed them to estimate the overall likelihood that different kinds of animals (spiders, snakes, or birds) would be encountered. Spider-fearful participants systematically overestimated the likelihood of encountering a spider with respect to the likelihood of encountering a snake or a bird. No such expectancy bias was observed in control participants. The results thus strengthen our idea that there indeed exist two different types of expectancy bias in high fear and phobia that can be related to different components of the fear response. A conscientious distinction and examination of these two types of expectancy bias are of potential interest for therapeutic applications.

Neuroanatomy of intergroup bias: A white matter microstructure study of individual differences

Intergroup bias - the tendency to behave more positively towards an ingroup member than an outgroup member - is a powerful social force, for good and ill. And though it is widely demonstrated, intergroup bias is not universal, as it is characterized by significant individual differences. Recently, attention has begun to turn to whether neuroanatomy might explain these individual differences in intergroup bias. However, no research to date has examined whether white matter microstructure could help determine differences in behavior towards ingroup and outgroup members. In the current research, we examine intergroup bias with the third-party punishment paradigm and white matter integrity and connectivity strength as determined by diffusion tensor imaging (DTI). We found that both increased white matter integrity at the right temporal-parietal junction (TPJ) and connectivity strength between the right TPJ and the dorsomedial prefrontal cortex (DMPFC) were associated with increased impartiality in the third-party punishment paradigm, i.e., reduced intergroup bias. Further, consistent with the role that these brain regions play in the mentalizing network, we found that these effects were mediated by mentalizing processes. Participants with greater white matter integrity at the right TPJ and connectivity strength between the right TPJ and the DMPFC employed mentalizing processes more equally for ingroup and outgroup members, and this non-biased use of mentalizing was associated with increased impartiality. The current results help shed light on the mechanisms of bias and, potentially, on interventions that promote impartiality over intergroup bias.

An Assessment of the Risk of Bias in Randomized Controlled Trial Reports Published in Prosthodontic and Implant Dentistry Journals

PURPOSE The objective of this study was to assess the risk of bias of randomized controlled trials (RCTs) published in prosthodontic and implant dentistry journals. MATERIALS AND METHODS The last 30 issues of 9 journals in the field of prosthodontic and implant dentistry (Clinical Implant Dentistry and Related Research, Clinical Oral Implants Research, Implant Dentistry, International Journal of Oral & Maxillofacial Implants, International Journal of Periodontics and Restorative Dentistry, International Journal of Prosthodontics, Journal of Dentistry, Journal of Oral Rehabilitation, and Journal of Prosthetic Dentistry) were hand-searched for RCTs. Risk of bias was assessed using the Cochrane Collaboration's risk of bias tool and analyzed descriptively. RESULTS From the 3,667 articles screened, a total of 147 RCTs were identified and included. The number of published RCTs increased with time. The overall distribution of a high risk of bias assessment varied across the domains of the Cochrane risk of bias tool: 8% for random sequence generation, 18% for allocation concealment, 41% for masking, 47% for blinding of outcome assessment, 7% for incomplete outcome data, 12% for selective reporting, and 41% for other biases. CONCLUSION The distribution of high risk of bias for RCTs published in the selected prosthodontic and implant dentistry journals varied among journals and ranged from 8% to 47%, which can be considered as substantial.