Improving precision and reducing bias in biological surveys: estimating false-negative error rates

The use of presence/absence data in wildlife management and biological surveys is widespread. There is a growing interest in quantifying the sources of error associated with these data. We show that false-negative errors (failure to record a species when in fact it is present) can have a significant impact on statistical estimation of habitat models using simulated data. Then we introduce an extension of logistic modeling, the zero-inflated binomial (ZIB) model that permits the estimation of the rate of false-negative errors and the correction of estimates of the probability of occurrence for false-negative errors by using repeated. visits to the same site. Our simulations show that even relatively low rates of false negatives bias statistical estimates of habitat effects. The method with three repeated visits eliminates the bias, but estimates are relatively imprecise. Six repeated visits improve precision of estimates to levels comparable to that achieved with conventional statistics in the absence of false-negative errors In general, when error rates are less than or equal to50% greater efficiency is gained by adding more sites, whereas when error rates are >50% it is better to increase the number of repeated visits. We highlight the flexibility of the method with three case studies, clearly demonstrating the effect of false-negative errors for a range of commonly used survey methods.

Attentional bias toward fear-related stimuli: An investigation with nonselected children and adults and children with anxiety disorders

Research investigating anxiety-related attentional bias for emotional information in anxious and nonanxious children has been equivocal with regard to whether a bias for fear-related stimuli is unique to anxious children or is common to children in general. Moreover, recent cognitive theories have proposed that an attentional bias for objectively threatening stimuli may be common to all individuals, with this effect enhanced in anxious individuals. The current study investigated whether an attentional bias toward fear-related pictures could be found in nonselected children (n = 105) and adults (n = 47) and whether a sample of clinically anxious children (n = 23) displayed an attentional bias for fear-related pictures over and above that expected for nonselected children. Participants completed a dot-probe task that employed fear-related, neutral, and pleasant pictures. As expected, both adults and children showed a stronger attentional bias toward fear-related pictures than toward pleasant pictures. Consistent with some findings in the childhood domain, the extent of the attentional bias toward fear-related pictures did not differ significantly between anxious children and nonselected children. However, compared with nonselected children, anxious children showed a stronger attentional bias overall toward affective picture stimuli. (C) 2004 Elsevier Inc. All rights reserved.

Differences in mail and telephone responses to self-rated health: use of multiple imputation in correcting for response bias

Objectives: To estimate differences in self-rated health by mode of administration and to assess the value of multiple imputation to make self-rated health comparable for telephone and mail. Methods: In 1996, Survey 1 of the Australian Longitudinal Study on Women's Health was answered by mail. In 1998, 706 and 11,595 mid-age women answered Survey 2 by telephone and mail respectively. Self-rated health was measured by the physical and mental health scores of the SF-36. Mean change in SF-36 scores between Surveys 1 and 2 were compared for telephone and mail respondents to Survey 2, before and after adjustment for socio-demographic and health characteristics. Missing values and SF-36 scores for telephone respondents at Survey 2 were imputed from SF-36 mail responses and telephone and mail responses to socio-demographic and health questions. Results: At Survey 2, self-rated health improved for telephone respondents but not mail respondents. After adjustment, mean changes in physical health and mental health scores remained higher (0.4 and 1.6 respectively) for telephone respondents compared with mail respondents (-1.2 and 0.1 respectively). Multiple imputation yielded adjusted changes in SF-36 scores that were similar for telephone and mail respondents. Conclusions and Implications: The effect of mode of administration on the change in mental health is important given that a difference of two points in SF-36 scores is accepted as clinically meaningful. Health evaluators should be aware of and adjust for the effects of mode of administration on self-rated health. Multiple imputation is one method that may be used to adjust SF-36 scores for mode of administration bias.

Attentional bias to pictures of fear-relevant animals in a dot probe task

Attentional bias to fear-relevant animals was assessed in 69 participants not preselected on self-reported anxiety with the use of a dot probe task showing pictures of snakes, spiders, mushrooms, and flowers. Probes that replaced the fear-relevant stimuli (snakes and spiders) were found faster than probes that replaced the non-fear-relevant stimuli, indicating an attentional bias in the entire sample. The bias was not correlated with self-reported state or trait anxiety or with general fearfulness. Participants reporting higher levels of spider fear showed an enhanced bias to spiders, but the bias remained significant in low scorers. The bias to snake pictures was not related to snake fear and was significant in high and low scorers. These results indicate preferential processing of fear-relevant stimuli in an unselected sample.

Cognitive asymmetry in employee emotional reactions to leadership behaviors

This article is predicated on the idea that leaders shape workplace affective events. Based on Affective Events Theory (AET), I argue that leaders are sources of employee positive and negative emotions at work. Certain leader behaviors displayed during interactions with their employees are the sources of these affective events. The second theoretical underpinning of the article is the Asymmetry Effect of emotion. Consistent with this theory, employees are more likely to recall negative incidents than positive incidents. In a qualitative study, evidence that these processes exist in the workplace was found. Leader behaviors were sources of positive or negative emotional responses in employees; employees recalled more negative incidents than positive incidents, and they recalled them more intensely and in more detail than positive incidents. Consequently, leaders may need to exercise their emotional intelligence to generate emotional uplifts to overcome the hassles in the workplace that employees seem to remember so vividly. (c) 2006 Elsevier Inc. All rights reserved.

Correcting for numerator/denominator bias when assessing changing inequalites in occupational class mortality, Australia 1981-2002

Objective Comparisons of the changing patterns of inequalities in occupational mortality provide one way to monitor the achievement of equity goals. However, previous comparisons have not corrected for numerator/denominator bias, which is a consequence of the different ways in which occupational details are recorded on death certificates and on census forms. The objective of this study was to measure the impact of this bias on mortality rates and ratios over time. Methods Using data provided by the Australian Bureau of Statistics, we examined the evidence for bias over the period 1981-2002, and used imputation methods to adjust for this bias. We compared unadjusted with imputed rates of mortality for manual/non-manual workers. Findings Unadjusted data indicate increasing inequality in the age-adjusted rates of mortality for manual/non-manual workers during 1981-2002, Imputed data suggest that there have been modest fluctuations in the ratios of mortality for manual/non-manual workers during this time, but with evidence that inequalities have increased only in recent years and are now at historic highs. Conclusion We found that imputation for missing data leads to changes in estimates of inequalities related to social class in mortality for some years but not for others. Occupational class comparisons should be imputed or otherwise adjusted for missing data on census or death certificates.

Bias, precision and heritability of self-reported and clinically measured height in Australian twins

Many studies of quantitative and disease traits in human genetics rely upon self-reported measures. Such measures are based on questionnaires or interviews and are often cheaper and more readily available than alternatives. However, the precision and potential bias cannot usually be assessed. Here we report a detailed quantitative genetic analysis of stature. We characterise the degree of measurement error by utilising a large sample of Australian twin pairs (857 MZ, 815 DZ) with both clinical and self-reported measures of height. Self-report height measurements are shown to be more variable than clinical measures. This has led to lowered estimates of heritability in many previous studies of stature. In our twin sample the heritability estimate for clinical height exceeded 90%. Repeated measures analysis shows that 2-3 times as many self-report measures are required to recover heritability estimates similar to those obtained from clinical measures. Bivariate genetic repeated measures analysis of self-report and clinical height measures showed an additive genetic correlation > 0.98. We show that the accuracy of self-report height is upwardly biased in older individuals and in individuals of short stature. By comparing clinical and self-report measures we also showed that there was a genetic component to females systematically reporting their height incorrectly; this phenomenon appeared to not be present in males. The results from the measurement error analysis were subsequently used to assess the effects of error on the power to detect linkage in a genome scan. Moderate reduction in error (through the use of accurate clinical or multiple self-report measures) increased the effective sample size by 22%; elimination of measurement error led to increases in effective sample size of 41%.

Precision-recall operating characteristic (P-ROC) curves in imprecise environments

Traditionally, machine learning algorithms have been evaluated in applications where assumptions can be reliably made about class priors and/or misclassification costs. In this paper, we consider the case of imprecise environments, where little may be known about these factors and they may well vary significantly when the system is applied. Specifically, the use of precision-recall analysis is investigated and compared to the more well known performance measures such as error-rate and the receiver operating characteristic (ROC). We argue that while ROC analysis is invariant to variations in class priors, this invariance in fact hides an important factor of the evaluation in imprecise environments. Therefore, we develop a generalised precision-recall analysis methodology in which variation due to prior class probabilities is incorporated into a multi-way analysis of variance (ANOVA). The increased sensitivity and reliability of this approach is demonstrated in a remote sensing application.