Effect of standardized training on the reliability of the Cochrane risk of bias assessment tool: a study protocol

BACKGROUND The Cochrane risk of bias (RoB) tool has been widely embraced by the systematic review community, but several studies have reported that its reliability is low. We aim to investigate whether training of raters, including objective and standardized instructions on how to assess risk of bias, can improve the reliability of this tool. We describe the methods that will be used in this investigation and present an intensive standardized training package for risk of bias assessment that could be used by contributors to the Cochrane Collaboration and other reviewers. METHODS/DESIGN This is a pilot study. We will first perform a systematic literature review to identify randomized clinical trials (RCTs) that will be used for risk of bias assessment. Using the identified RCTs, we will then do a randomized experiment, where raters will be allocated to two different training schemes: minimal training and intensive standardized training. We will calculate the chance-corrected weighted Kappa with 95% confidence intervals to quantify within- and between-group Kappa agreement for each of the domains of the risk of bias tool. To calculate between-group Kappa agreement, we will use risk of bias assessments from pairs of raters after resolution of disagreements. Between-group Kappa agreement will quantify the agreement between the risk of bias assessment of raters in the training groups and the risk of bias assessment of experienced raters. To compare agreement of raters under different training conditions, we will calculate differences between Kappa values with 95% confidence intervals. DISCUSSION This study will investigate whether the reliability of the risk of bias tool can be improved by training raters using standardized instructions for risk of bias assessment. One group of inexperienced raters will receive intensive training on risk of bias assessment and the other will receive minimal training. By including a control group with minimal training, we will attempt to mimic what many review authors commonly have to do, that is-conduct risk of bias assessment in RCTs without much formal training or standardized instructions. If our results indicate that an intense standardized training does improve the reliability of the RoB tool, our study is likely to help improve the quality of risk of bias assessments, which is a central component of evidence synthesis.

Optogenetics: opsins and optical interfaces in neuroscience.

Optogenetics is defined as the integration of optics and genetics to control well-defined events within specified cells of living tissue. In this introduction, we focus on the basic techniques necessary for employing microbial opsins as optogenetic tools in mammalian brains. We provide a guide for the fundamentals of optogenetic application-selecting an opsin, implementing expression of opsins based on the neuroscientific experimental requirements, and adapting the corresponding optical hardware for delivery of light into mammalian brains.

Establishing a fiber-optic-based optical neural interface.

Selective expression of opsins in genetically defined neurons makes it possible to control a subset of neurons without affecting nearby cells and processes in the intact brain, but light must still be delivered to the target brain structure. Light scattering limits the delivery of light from the surface of the brain. For this reason, we have developed a fiber-optic-based optical neural interface (ONI), which allows optical access to any brain structure in freely moving mammals. The ONI system is constructed by modifying the small animal cannula system from PlasticsOne. The system for bilateral stimulation consists of a bilateral cannula guide that has been stereotactically implanted over the target brain region, a screw cap for securing the optical fiber to the animal's head, a fiber guard modified from the internal cannula adapter, and a bare fiber whose length is customized based on the depth of the target region. For unilateral stimulation, a single-fiber system can be constructed using unilateral cannula parts from PlasticsOne. We describe here the preparation of the bilateral ONI system and its use in optical stimulation of the mouse or rat brain. Delivery of opsin-expressing virus and implantation of the ONI may be conducted in the same surgical session; alternatively, with a transgenic animal no opsin virus is delivered during the surgery. Similar procedures are useful for deep or superficial injections (even for neocortical targets, although in some cases surface light-emitting diodes or cortex-apposed fibers can be used for the most superficial cortical targets).

Quality control for retinal OCT in multiple sclerosis: validation of the OSCAR-IB criteria.

BACKGROUND Retinal optical coherence tomography (OCT) permits quantification of retinal layer atrophy relevant to assessment of neurodegeneration in multiple sclerosis (MS). Measurement artefacts may limit the use of OCT to MS research. OBJECTIVE An expert task force convened with the aim to provide guidance on the use of validated quality control (QC) criteria for the use of OCT in MS research and clinical trials. METHODS A prospective multi-centre (n = 13) study. Peripapillary ring scan QC rating of an OCT training set (n = 50) was followed by a test set (n = 50). Inter-rater agreement was calculated using kappa statistics. Results were discussed at a round table after the assessment had taken place. RESULTS The inter-rater QC agreement was substantial (kappa = 0.7). Disagreement was found highest for judging signal strength (kappa = 0.40). Future steps to resolve these issues were discussed. CONCLUSION Substantial agreement for QC assessment was achieved with aid of the OSCAR-IB criteria. The task force has developed a website for free online training and QC certification. The criteria may prove useful for future research and trials in MS using OCT as a secondary outcome measure in a multi-centre setting.

School-age children show a bias toward fantasy classifications after playing a platform game

We investigated the influence of playing a video game on children’s ability to distinguish between fantasy and reality. School-age children played a platform game for 15 min and then performed a fantasy/reality distinction task in which they were to judge whether images (from the platform game and from other games) were fantasy images or reality images. Unlike those in the control group (who played a memory game), the children in the experimental group showed a response bias toward mistakenly classifying reality images from the video game as fantasy images (as determined by means of an analysis based on signal detection theory). We conclude that playing the video game exerted a short-term influence on children’s ability to distinguish between fantasy and reality.

How narcissistic self-construction sabotages their relationships: Accuracy and bias in partner perception

Trapped by their superordinate goal to maintain a grandiose self, narcissists navigate their relationships wishing to re-assure themselves of their specialness and superiority, using strategies bound to fail. Dyadic analyses of diary data (14 days, 83 couples) showed that narcissists focus on their partners’ shortcomings, becoming experts at detecting negative forms of support, while simultaneously minimizing their partner’s positive intentions. Partners of narcissists, in contrast, appear to have a positive bias in ongoing relationships and seem to compensate for some of the narcissists’ shortcomings. Narcissists’ focus on their own selfconstruction purposes also extends to their parenting roles. In a retrospective study, narcissistic mothers were found to demand superior performance, desiring to show-off their child, yet concurrently attributing their child’s success to themselves. They also exercise psychological control and role-reversal, requiring the child to cater to their needs, and to admire them, while simultaneously oblivious to their child’s needs and desires.

Brain systems underlying encounter expectancy bias in spider phobia.

Spider-phobic individuals are characterized by exaggerated expectancies to be faced with spiders (so-called encounter expectancy bias). Whereas phobic responses have been linked to brain systems mediating fear, little is known about how the recruitment of these systems relates to exaggerated expectancies of threat. We used fMRI to examine spider-phobic and control participants while they imagined visiting different locations in a forest after having received background information about the likelihood of encountering different animals (spiders, snakes, and birds) at these locations. Critically, imagined encounter expectancies modulated brain responses differently in phobics as compared with controls. Phobics displayed stronger negative modulation of activity in the lateral prefrontal cortex, precuneus, and visual cortex by encounter expectancies for spiders, relative to snakes or birds (within-participants analysis); these effects were not seen in controls. Between-participants correlation analyses within the phobic group further corroborated the hypothesis that these phobia-specific modulations may underlie irrationality in encounter expectancies (deviations of encounter expectancies from objective background information) in spider phobia; the greater the negative modulation a phobic participant displayed in the lateral prefrontal cortex, precuneus, and visual cortex, the stronger was her bias in encounter expectancies for spiders. Interestingly, irrationality in expectancies reflected in frontal areas relied on right rather than left hemispheric deactivations. Our data accord with the idea that expectancy biases in spider phobia may reflect deficiencies in cognitive control and contextual integration that are mediated by right frontal and parietal areas.

Varying expectancies and attention bias in phobic and non-phobic individuals.

Phobic individuals display an attention bias to phobia-related information and biased expectancies regarding the likelihood of being faced with such stimuli. Notably, although attention and expectancy biases are core features in phobia and anxiety disorders, these biases have mostly been investigated separately and their causal impact has not been examined. We hypothesized that these biases might be causally related. Spider phobic and low spider fearful control participants performed a visual search task in which they specified whether the deviant animal in a search array was a spider or a bird. Shorter reaction times (RTs) for spiders than for birds in this task reflect an attention bias toward spiders. Participants' expectancies regarding the likelihood of these animals being the deviant in the search array were manipulated by presenting verbal cues. Phobics were characterized by a pronounced and persistent attention bias toward spiders; controls displayed slower RTs for birds than for spiders only when spider cues had been presented. More important, we found RTs for spider detections to be virtually unaffected by the expectancy cues in both groups, whereas RTs for bird detections showed a clear influence of the cues. Our results speak to the possibility that evolution has formed attentional systems that are specific to the detection of phylogenetically salient stimuli such as threatening animals; these systems may not be as penetrable to variations in (experimentally induced) expectancies as those systems that are used for the detection of non-threatening stimuli. In sum, our findings highlight the relation between expectancies and attention engagement in general. However, expectancies may play a greater role in attention engagement in safe environments than in threatening environments.

Evidence for an encounter expectancy bias in fear of spiders.

Whereas research has demonstrated that phobic or fearful individuals overestimate the likelihood of incurring aversive consequences from an encounter with feared stimuli, it has not yet been systematically investigated whether these individuals also overestimate the likelihood (i.e., the frequency) of such encounters. In the current study, spider-fearful and control participants were presented with background information that allowed them to estimate the overall likelihood that different kinds of animals (spiders, snakes, or birds) would be encountered. Spider-fearful participants systematically overestimated the likelihood of encountering a spider with respect to the likelihood of encountering a snake or a bird. No such expectancy bias was observed in control participants. The results thus strengthen our idea that there indeed exist two different types of expectancy bias in high fear and phobia that can be related to different components of the fear response. A conscientious distinction and examination of these two types of expectancy bias are of potential interest for therapeutic applications.

Controlling for culture-specific response bias using ipsatization and response style indicators: Family orientation in seventeen cultures and two generations

Within-subject standardization (ipsatization) has been advocated as a possible means to control for culture-specific responding (e.g., Fisher, 2004). However, the consequences of different kinds of ipsatization procedures for the interpretation of mean differences remain unclear. The current study compared several ipsatization procedures with ANCOVA-style procedures using response style indicators for the construct of family orientation with data from 14 cultures and two generations from the Value-of-Children-(VOC)-Study (4135 dyads). Results showed that within-subject centering/standardizing across all Likert-scale items of the comprehensive VOC-questionnaire removed most of the original cross-cultural variation in family orientation and lead to a non-interpretable pattern of means in both generations. Within-subject centering/standardizing using a subset of 19 unrelated items lead to a decrease to about half of the original effect size and produced a theoretically meaningful pattern of means. A similar effect size and similar mean differences were obtained when using a measure of acquiescent responding based on the same set of items in an ANCOVA-style analysis. Additional models controlling for extremity and modesty performed worse, and combinations did not differ from the acquiescence-only model. The usefulness of different approaches to control for uniform response styles (scalar equivalence not given) in cross- cultural comparisons is discussed.

Exculpating victims and the reversal of hindsight bias

This experiment examines the role of the hindsight bias and of motivational forces such as the motive to believe in a just world as possible causes of the derogation of victims effect in the context of rape. The hindsight bias is the tendency of people to falsely believe that they would have predicted the outcome of an event once the outcome is known. Participants read descriptions of an interaction between a man and a woman that ended with one of four possible outcomes: The woman was raped with very severe consequences for her future life vs. rape with only minor consequences for her future life vs. no rape (assailant was forced to retreat by the strong defense of the victim) vs. no outcome information. To test motivational predictions the hindsight bias and the derogation effect were analyzed as a consequence of the sex of participants, the seriousness of the consequences of the rape, the belief in a just world and the acceptance of rape myths. Results supported the assumption that derogation effects are at least partly driven by hindsight bias and that motivational processes work via the hindsight bias. However, in this study we did not find a classical hindsight bias but a reversed hindsight bias: Especially female participants in the severe consequences of rape condition and those participants who did not accept rape myths rated the likelihood of rape in the rape outcome condition as smaller than participants in the no outcome information control group. They also derogated the victim less than participants in the no information control group. These effects were interpreted in terms of self-serving or in-group serving functions of the hindsight bias. Finally no support was found for the assumption that derogation effects are driven by the motive to believe in a just world.

Efficacy of patient-administered mechanical and/or chemical plaque control protocols in the management of peri-implant mucositis. A systematic review

AIM To systematically assess the efficacy of patient-administered mechanical and/or chemical plaque control protocols in the management of peri-implant mucositis (PM). MATERIAL AND METHODS Randomized (RCTs) and Controlled Clinical Trials (CCTs) were identified through an electronic search of three databases complemented by manual search. Identification, screening, eligibility and inclusion of studies was performed independently by two reviewers. Studies without professional intervention or with only mechanical debridement professionally administered were included. Quality assessment was performed by means of the Cochrane Collaboration's tool for assessing risk of bias. RESULTS Eleven RCTs with a follow-up from 3 to 24 months were included. Definition of PM was lacking or heterogeneously reported. Complete resolution of PM was not achieved in any study. One study reported 38% of patients with complete resolution of PM. Surrogate end-point outcomes of PM therapy were often reported. The choice of control interventions showed great variability. The efficacy of powered toothbrushes, a triclosan-containing toothpaste and adjunctive antiseptics remains to be established. High quality of methods and reporting was found in four studies. CONCLUSIONS Professionally- and patient-administered mechanical plaque control alone should be considered the standard of care in the management of PM. Therapy of PM is a prerequisite for the prevention of peri-implantitis.

Comparison of 2.5D and 3D Quantification of Femoral Head Coverage in Normal Control Subjects and Patients with Hip Dysplasia.

Hip dysplasia is characterized by insufficient femoral head coverage (FHC). Quantification of FHC is of importance as the underlying goal of the surgery to treat hip dysplasia is to restore a normal acetabular morphology and thereby to improve FHC. Unlike a pure 2D X-ray radiograph-based measurement method or a pure 3D CT-based measurement method, previously we presented a 2.5D method to quantify FHC from a single anteriorposterior (AP) pelvic radiograph. In this study, we first quantified and compared 3D FHC between a normal control group and a patient group using a CT-based measurement method. Taking the CT-based 3D measurements of FHC as the gold standard, we further quantified the bias, precision and correlation between the 2.5D measurements and the 3D measurements on both the control group and the patient group. Based on digitally reconstructed radiographs (DRRs), we investigated the influence of the pelvic tilt on the 2.5D measurements of FHC. The intraclass correlation coefficients (ICCs) for absolute agreement was used to quantify interobserver reliability and intraobserver reproducibility of the 2.5D measurement technique. The Pearson correlation coefficient, r, was used to determine the strength of the linear association between the 2.5D and the 3D measurements. Student's t-test was used to determine whether the differences between different measurements were statistically significant. Our experimental results demonstrated that both the interobserver reliability and the intraobserver reproducibility of the 2.5D measurement technique were very good (ICCs > 0.8). Regression analysis indicated that the correlation was very strong between the 2.5D and the 3D measurements (r = 0.89, p < 0.001). Student's t-test showed that there were no statistically significant differences between the 2.5D and the 3D measurements of FHC on the patient group (p > 0.05). The results of this study provided convincing evidence demonstrating the validity of the 2.5D measurements of FHC from a single AP pelvic radiograph and proved that it could serve as a surrogate for 3D CT-based measurements. Thus it may be possible to use this method to avoid a CT scan for the purpose of estimating 3D FHC in diagnosis and post-operative treatment evaluation of patients with hip dysplasia.

RETICULAR PSEUDODRUSEN ON INFRARED IMAGING ARE TOPOGRAPHICALLY DISTINCT FROM SUBRETINAL DRUSENOID DEPOSITS ON EN FACE OPTICAL COHERENCE TOMOGRAPHY.

PURPOSE: To evaluate the quantitative and topographic relationship between reticular pseudodrusen (RPD) on infrared reflectance (IR) and subretinal drusenoid deposits (SDD) on en face volumetric spectral domain optical coherence tomography. METHODS: Reticular pseudodrusen were marked on IR images by a masked observer. Subretinal drusenoid deposits were visualized on en face sections of spectral domain optical coherence tomography below the external limiting membrane and identified by a semiautomated technique. Control RPD lesions were generated in a random distribution for each IR image. Binary maps of control and experimental RPD and SDD were merged and analyzed in terms of topographic localization and quantitative drusen load comparison. RESULTS: A total of 54 eyes of 41 patients diagnosed with RPD were included in this study. The average number of RPD lesions on IR images was 320 ± 44.62 compared with 127 ± 26.02 SDD lesions on en face (P < 0.001). The majority of RPD lesions did not overlap with SDD lesions and were located >30 μm away (92%). The percentage of total SDD lesions overlapping RPD was 2.91 ± 0.87% compared with 1.73 ± 0.68% overlapping control RPD lesions (P < 0.05). The percentage of total SDD lesions between 1 and 3 pixels of the nearest RPD lesion was 5.08 ± 1.40% compared with 3.33 ± 1.07% between 1 and 3 pixels of the nearest control RPD lesion (P < 0.05). CONCLUSION: This study identified significantly more RPD lesions on IR compared with SDD lesions on en face spectral domain optical coherence tomography and found that a large majority of SDD (>90% of lesions) were >30 μm away from the nearest RPD. Together, our findings indicate that RPD and SDD are two entities that are only occasionally topographically associated, suggesting that at some stage in their development, they may be pathologically related.

Internet-based interpretation bias modification for social anxiety: A pilot study

BACKGROUND AND OBJECTIVES: The biased interpretation of ambiguous social situations is considered a maintaining factor of Social Anxiety Disorder (SAD). Studies on the modification of interpretation bias have shown promising results in laboratory settings. The present study aims at pilot-testing an Internet-based training that targets interpretation and judgmental bias. METHOD: Thirty-nine individuals meeting diagnostic criteria for SAD participated in an 8-week, unguided program. Participants were presented with ambiguous social situations, were asked to choose between neutral, positive, and negative interpretations, and were required to evaluate costs of potential negative outcomes. Participants received elaborate automated feedback on their interpretations and judgments. RESULTS: There was a pre-to-post-reduction of the targeted cognitive processing biases (d = 0.57-0.77) and of social anxiety symptoms (d = 0.87). Furthermore, results showed changes in depression and general psychopathology (d = 0.47-0.75). Decreases in cognitive biases and symptom changes did not correlate. The results held stable accounting for drop-outs (26%) and over a 6-week follow-up period. Forty-five percent of the completer sample showed clinical significant change and almost half of the participants (48%) no longer met diagnostic criteria for SAD. LIMITATIONS: As the study lacks a control group, results lend only preliminary support to the efficacy of the intervention. Furthermore, the mechanism of change remained unclear. CONCLUSION: First results promise a beneficial effect of the program for SAD patients. The treatment proved to be feasible and acceptable. Future research should evaluate the intervention in a randomized-controlled setting.