Bias in research

The aim of this article is to outline types of ‘bias’ across research designs, and consider strategies to minimise bias. Evidence-based nursing, defined as the “process by which evidence, nursing theory, and clinical expertise are critically evaluated and considered, in conjunction with patient involvement, to provide the delivery of optimum nursing care,”1 is central to the continued development of the nursing professional. Implementing evidence into practice requires nurses to critically evaluate research, in particular assessing the rigour in which methods were undertaken and factors that may have biased findings.

Resolving questions about bias in real and hypothetical referenda

Despite 10 years of research on behavior in hypothetical referenda, conflict remains in the literature on whether or not the mechanism generates biased responses compared to real referenda, and the nature and source of any such bias. Almost all previous inquiry in respect of this issue has concentrated on bias at the aggregate level. This paper reports a series of three experiments which focuses on bias at the individual level and how this can translate to bias at the aggregate level. The authors argue that only an individual approach to hypothetical bias is consistent with the concept of incentive compatibility. The results of these experiments reflect these previous conflicting findings but go on to show that individual hypothetical bias is a robust result driven by the differing influence of pure self-interest and other-regarding preferences in real and hypothetical situations, rather than by a single behavioral theory such as free riding. In a hypothetical situation these preferences cause yea-saying and non-demand revealing voting. This suggests that investigation of individual respondents in other hypothetical one-shot binary choices may also provide us with insights into aggregate behavior in these situations.

Recruitment bias and clinical characterstics of participants with severe cerebral palsy in a cross-sectional survey

Aim.  This article is a report of recruitment bias in a sample of 5–25-year-old patients with severe cerebral palsy.

Background.  The way in which study participants are recruited into research can be a source of bias.

Method.  A cross-sectional survey of 5–25-year-old patients with severe cerebral palsy using standardized questionnaires with parents/carers was undertaken in 2007/2008. A case register was used as the sampling frame, and 260 families were approached: 178/260 (68%) responded and 82/260 families never replied (non-respondents). Among responders: 127/178 (71%) opted in to the study, but only 123/127 were assessed, and 82/178 were opted out (or refused). Multivariable logistic regression giving odds ratios was used to study the association between participant characteristics and study outcomes (responders vs. non-responders; opting in vs. opting out; assessed vs. eligible, but not assessed).

Results.  Responders (compared with non-responders) were significantly more likely to have a family member with cerebral palsy who was male and resident in more affluent areas. Families who opted in (compared with those opting out and refusing) were more likely to have a family member with cerebral palsy and intellectual impairment and to reside in certain geographical areas. Families who were actually assessed (compared with all eligible, but not assessed) were more likely to have a family member with cerebral palsy and intellectual impairment.

Conclusion.  Several sources of bias were identified during recruitment for this study. This has implications for the interpretation and conclusions of surveys of people with disabilities and complex needs.

Catalysing open innovation through publicly funded R&D: A Comparison of University and Company-based research centres

Public funding of university and company-based R&D centres of excellence is widespread both in core and more peripheral regions. What is less well-known is whether these R&D centres can catalyse multi-directional, multi-actor and iterative innovation. Based on data from a real-time monitoring study, this article explores the development of 18 R&D centres’ external connections. University-based R&D centres establish more new connections than company-based centres and are more likely to be interacting with small or micro-firms. However, there is a general bias towards links with larger firms; micro, small and medium-sized enterprises also are less likely to be involved in collaborative R&D with research centres than other types of relationships. The results suggest the potential for R&D centres to act as a catalyst for open innovation but emphasise the need to ensure that the focus of the R&D being conducted is relevant to the needs of smaller firms.

Common Ingroups and Complex Identities: Routes to Reducing Bias in Multiple Category Contexts

We tested the hypothesis that evaluative bias in common ingroup contexts versus crossed categorization contexts can be associated with two distinct underlying processes. We reasoned that in common ingroup contexts, self-categorization, but not perceived complexity, would be positively related to intergroup bias. In contrast, in crossed categorization contexts, perceived complexity, but not self-categorization, would be negatively related to intergroup bias. In two studies, and in line with predictions, we found that while self-categorization and intergroup bias were related in common ingroup contexts, this was not the case in crossed categorization contexts. Moreover, we found that perceived category complexity, and not self-categorization, predicted bias in crossed categorization contexts. We discuss the implications of these findings for models of social categorization and intergroup bias.

'Changing attitudes with a little imagination': Imagined contact effects on young children's intergroup bias

The current research tested a recent development in social psychology, namely 'imagined contact', among young children (n = 123, 5 to 10 years). Children imagined interacting with a physically disabled child, or did not take part in this activity (the control group). Compared with the control group, children who engaged in 'imagined contact' subsequently showed reduced intergroup bias in their general attitude and ratings of warmth and competence. Imagined contact also led to more positive intended friendship behavior towards the disabled, but only among 5 – 6 year olds. This provides partial support for our hypothesis that younger children, perhaps as a result of their lack of outgroup experience, are more likely to benefit from imagined contact. Implications for the development of attitudes towards the disabled, imagined contact theory and the development of classroom-based prejudice-reduction techniques based on imagined contact are discussed.

Attentional bias to food-related visual cues: is there a role in obesity?

The incentive sensitisation model of obesity suggests that modification of the dopaminergic associated reward systems in the brain may result in increased awareness of food-related visual cues present in the current food environment. Having a heightened awareness of these visual food cues may impact on food choices and eating behaviours with those being most aware of or demonstrating greater attention to food-related stimuli potentially being at greater risk of overeating and subsequent weight gain. To date, research related to attentional responses to visual food cues has been both limited and conflicting. Such inconsistent findings may in part be explained by the use of different methodological approaches to measure attentional bias and the impact of other factors such as hunger levels, energy density of visual food cues and individual eating style traits that may influence visual attention to food-related cues outside of weight status alone. This review examines the various methodologies employed to measure attentional bias with a particular focus on the role that attentional processing of food-related visual cues may have in obesity. Based on the findings of this review, it appears that it may be too early to clarify the role visual attention to food-related cues may have in obesity. Results however highlight the importance of considering the most appropriate methodology to use when measuring attentional bias and the characteristics of the study populations targeted while interpreting results to date and in designing future studies.

In and out of home care decisions: The influence of confirmation bias in developing decision supportive reasoning

The aims of this study were to identify the themes Social Workers regard as important in supporting decisions to remove children from, or return them to, the care of their parents. To further elicit underlying hypotheses that are discernible in interpretation of evidence. A case study, comprising a two-part vignette with a questionnaire, recorded demographic information, child welfare attitudes and risk assessments, using scales derived from standardised instruments, was completed by 202 Social Workers in Northern Ireland. There were two manipulated variables, mother’s attitude to removal and child’s attitude to reunification2 years later. In this paper we use data derived from respondents’ qualitative comments explaining their reasoning for in and out of home care decisions. Some 60.9% of respondent’s chose the parental care option at part one, with 94% choosing to have the child remain in foster care at part two. The manipulated variables were found to have no significant statistical effect. However, three underlying hypotheses were found to underpin decisions; (a)child rescue, (b) kinship defence and (c) a hedged position on calculation of risk subject to further assessment. Reasoning strategies utilised by social workers to support their decision making suggest that they tend to selectively interpret information either positively or negatively to support pre-existing underlying hypotheses. This finding is in keeping with the literature on ‘confirmation bias.’ The research further draws attention to the need to incorporate open questions in quantitative studies, to help guard against surface reading of data, which often does not ‘speak for itself.’

Failure of a numerical quality assessment scale to identify potential risk of bias in a systematic review: a comparison study

BACKGROUND: Assessing methodological quality of primary studies is an essential component of systematic reviews. Following a systematic review which used a domain based system [United States Preventative Services Task Force (USPSTF)] to assess methodological quality, a commonly used numerical rating scale (Downs and Black) was also used to evaluate the included studies and comparisons were made between quality ratings assigned using the two different methods. Both tools were used to assess the 20 randomized and quasi-randomized controlled trials examining an exercise intervention for chronic musculoskeletal pain which were included in the review. Inter-rater reliability and levels of agreement were determined using intraclass correlation coefficients (ICC). Influence of quality on pooled effect size was examined by calculating the between group standardized mean difference (SMD).

RESULTS: Inter-rater reliability indicated at least substantial levels of agreement for the USPSTF system (ICC 0.85; 95% CI 0.66, 0.94) and Downs and Black scale (ICC 0.94; 95% CI 0.84, 0.97). Overall level of agreement between tools (ICC 0.80; 95% CI 0.57, 0.92) was also good. However, the USPSTF system identified a number of studies (n = 3/20) as "poor" due to potential risks of bias. Analysis revealed substantially greater pooled effect sizes in these studies (SMD -2.51; 95% CI -4.21, -0.82) compared to those rated as "fair" (SMD -0.45; 95% CI -0.65, -0.25) or "good" (SMD -0.38; 95% CI -0.69, -0.08).

CONCLUSIONS: In this example, use of a numerical rating scale failed to identify studies at increased risk of bias, and could have potentially led to imprecise estimates of treatment effect. Although based on a small number of included studies within an existing systematic review, we found the domain based system provided a more structured framework by which qualitative decisions concerning overall quality could be made, and was useful for detecting potential sources of bias in the available evidence.

Alcohol attention bias in adolescent social drinkers: an eye tracking study

Rationale
Previous research on attention bias in nondependent social drinkers has focused on adult samples with limited focus on the presence of attention bias for alcohol cues in adolescent social drinkers.
Objectives
The aim of this study was to examine the presence of alcohol attention bias in adolescents and the relationship of this cognitive bias to alcohol use and alcohol-related expectancies.
Methods
Attention bias in adolescent social drinkers and abstainers was measured using an eye tracker during exposure to alcohol and neutral cues. Questionnaires measured alcohol use and explicit alcohol expectancies.
Results
Adolescent social drinkers spent significantly more time fixating to alcohol stimuli compared to controls. Total fixation time to alcohol stimuli varied in accordance with level of alcohol consumption and was significantly associated with more positive alcohol expectancies. No evidence for automatic orienting to alcohol stimuli was found in adolescent social drinkers.
Conclusion
Attention bias in adolescent social drinkers appears to be underpinned by controlled attention suggesting that whilst participants in this study displayed alcohol attention bias comparable to that reported in adult studies, the bias has not developed to the point of automaticity. Initial fixations appeared to be driven by alternative attentional processes which are discussed further.