Capturing expert knowledge for threatened species assessments: a case study using NatureServe conservation status ranks

Assessments for assigning the conservation status of threatened species that are based purely on subjective judgements become problematic because assessments can be influenced by hidden assumptions, personal biases and perceptions of risks, making the assessment process difficult to repeat. This can result in inconsistent assessments and misclassifications, which can lead to a lack of confidence in species assessments. It is almost impossible to Understand an expert's logic or visualise the underlying reasoning behind the many hidden assumptions used throughout the assessment process. In this paper, we formalise the decision making process of experts, by capturing their logical ordering of information, their assumptions and reasoning, and transferring them into a set of decisions rules. We illustrate this through the process used to evaluate the conservation status of species under the NatureServe system (Master, 1991). NatureServe status assessments have been used for over two decades to set conservation priorities for threatened species throughout North America. We develop a conditional point-scoring method, to reflect the current subjective process. In two test comparisons, 77% of species' assessments using the explicit NatureServe method matched the qualitative assessments done subjectively by NatureServe staff. Of those that differed, no rank varied by more than one rank level under the two methods. In general, the explicit NatureServe method tended to be more precautionary than the subjective assessments. The rank differences that emerged from the comparisons may be due, at least in part, to the flexibility of the qualitative system, which allows different factors to be weighted on a species-by-species basis according to expert judgement. The method outlined in this study is the first documented attempt to explicitly define a transparent process for weighting and combining factors under the NatureServe system. The process of eliciting expert knowledge identifies how information is combined and highlights any inconsistent logic that may not be obvious in Subjective decisions. The method provides a repeatable, transparent, and explicit benchmark for feedback, further development, and improvement. (C) 2004 Elsevier SAS. All rights reserved.

Jurors' responses to expert witness testimony: The effects of gender stereotypes

The present study investigated whether the impact of expert testimony was influenced by the congruency between the gender of the expert and the gender orientation of the case. Participants (N = 62) read a trial transcript involving a price-fixing allegation in either a male or female oriented domain. Within the case, the gender of the expert was manipulated. As predicted, the impact of the expert (e.g. damage awards) was greater when the gender of the expert and domain of the case were congruent as opposed to incongruent. Results also indicated that the impact of gender-domain congruency was particularly pronounced following group discussion. In addition, there was evidence that this effect was mediated through participants' evaluations of the expert witness.

An expert system on design of liquid-retaining structures with blackboard architecture

The design of liquid-retaining structures involves many decisions to be made by the designer based on rules of thumb, heuristics, judgement, codes of practice and previous experience. Structural design problems are often ill structured and there is a need to develop programming environments that can incorporate engineering judgement along with algorithmic tools. Recent developments in artificial intelligence have made it possible to develop an expert system that can provide expert advice to the user in the selection of design criteria and design parameters. This paper introduces the development of an expert system in the design of liquid-retaining structures using blackboard architecture. An expert system shell, Visual Rule Studio, is employed to facilitate the development of this prototype system. It is a coupled system combining symbolic processing with traditional numerical processing. The expert system developed is based on British Standards Code of Practice BS8007. Explanations are made to assist inexperienced designers or civil engineering students to learn how to design liquid-retaining structures effectively and sustainably in their design practices. The use of this expert system in disseminating heuristic knowledge and experience to practitioners and engineering students is discussed.

Do expert drivers have a reduced illusion of superiority?

It is well established that people tend to rate themselves as better than average across many domains. To maintain these illusions, it is suggested that people distort feedback about their own and others' performance. This study examined expert/novice differences in self-ratings when people compared themselves with others of the same level of expertise and background as themselves. Given that a key expert characteristic is increased self-monitoring, we predicted that experts in a domain may have a reduced illusion of superiority because they are more aware of their actual ability. We compared expert police drivers with novice police drivers and found that this prediction was not supported. Expert police drivers rated themselves as superior to equally qualified drivers, to the same degree as novices, Cohen's d = .03 ns. Despite their extensive additional training and experience, experts still appear to be as susceptible to illusions of superiority Lis everyone else. (C) 2004 Elsevier Ltd. All rights reserved.

Assessing the impacts of grazing levels on bird density in woodland habitat: a Bayesian approach using expert opinion

Many studies on birds focus on the collection of data through an experimental design, suitable for investigation in a classical analysis of variance (ANOVA) framework. Although many findings are confirmed by one or more experts, expert information is rarely used in conjunction with the survey data to enhance the explanatory and predictive power of the model. We explore this neglected aspect of ecological modelling through a study on Australian woodland birds, focusing on the potential impact of different intensities of commercial cattle grazing on bird density in woodland habitat. We examine a number of Bayesian hierarchical random effects models, which cater for overdispersion and a high frequency of zeros in the data using WinBUGS and explore the variation between and within different grazing regimes and species. The impact and value of expert information is investigated through the inclusion of priors that reflect the experience of 20 experts in the field of bird responses to disturbance. Results indicate that expert information moderates the survey data, especially in situations where there are little or no data. When experts agreed, credible intervals for predictions were tightened considerably. When experts failed to agree, results were similar to those evaluated in the absence of expert information. Overall, we found that without expert opinion our knowledge was quite weak. The fact that the survey data is quite consistent, in general, with expert opinion shows that we do know something about birds and grazing and we could learn a lot faster if we used this approach more in ecology, where data are scarce. Copyright (c) 2005 John Wiley & Sons, Ltd.

Probing expert anticipation with the temporal occlusion paradigm: Experimental investigations of some methodological issues

Two experiments were conducted to examine whether the conclusions drawn regarding the timing of anticipatory information pick-up from temporal occlusion studies are influenced by whether (a) the viewing period is of variable or fixed duration and (b) the task is a laboratory-based one with simple responses or a natural one requiring a coupled, interceptive movement response. Skilled and novice tennis players either made pencil-and-paper predictions of service direction (Experiment 1) or attempted to hit return strokes (Experiment 2) to tennis serves while their vision was temporally occluded in either a traditional progressive mode (where more information was revealed in each subsequent occlusion condition) or a moving window mode (where the visual display was only available for a fixed duration with this window shifted to different phases of the service action). Conclusions regarding the timing of information pick-up were generally consistent across display mode and across task setting lending support to the veracity and generalisability of findings regarding perceptual expertise in existing laboratory-based progressive temporal occlusion studies.

User dyads in software testing: bypassing the need for expert observers

This paper arises out of a research study into the online help facilities provided in popular software applications such as word processors. Its particular focus is on experimental methods of evaluating the effectiveness and usability of those facilities. Focus groups, questionnaires, and online surveys had already been used in other phases of the study, but it was judged that these approaches would be unsuitable for measuring effectiveness and usability because they are susceptible to respondents' subjectivity. Direct observation of people working on set word-processing tasks was ruled out initially because of a lack of trained observers; it would have taken too long for the investigator to observe a large enough sample by himself. Automatic recording of users' actions was also rejected, as it would have demanded equipment and/or software that was not available and seemed too expensive to acquire. The approach and techniques described here were an attempt to overcome these difficulties by using observers drawn from the same population of students that provided the test subjects; as a by-product, this may also have enhanced the acceptability (and hence possibly the validity) of the experiments by reducing the exam pressure perceived by participants.

Global standard for the composition of infant formula: Recommendations of an ESPGHAN coordinated international expert group

The Codex Alimentarius Commission of the Food and Agriculture Organization of the United Nations (FAO) and the World Health Organization (WHO) develops food standards, guidelines and related texts for protecting consumer health and ensuring fair trade practices globally. The major part of the world's population lives in more than 160 countries that are members of the Codex Alimentarius. The Codex Standard on Infant Formula was adopted in 1981 based on scientific knowledge available in the 1970s and is currently being revised. As part of this process, the Codex Committee on Nutrition and Foods for Special Dietary Uses asked the ESPGHAN Committee on Nutrition to initiate a consultation process with the international scientific community to provide a proposal on nutrient levels in infant formulae, based on scientific analysis and taking into account existing scientific reports on the subject. ESPGHAN accepted the request and, in collaboration with its sister societies in the Federation of International Societies on Pediatric Gastroenterology, Hepatology and Nutrition, invited highly qualified experts in the area of infant nutrition to form an International Expert Group (IEG) to review the issues raised. The group arrived at recommendations on the compositional requirements for a global infant formula standard which are reported here.

Preliminary findings of a systematic review and expert opinion workshop on Biosecurity on cattle farms in the UK

In this paper risk factors for the introduction of IBR, BVD, Salmonella and Johne's disease to cattle farms are reported. Two sources of information were used: literature was searched systematically and an expert opinion workshop was held. The findings from both indicate that direct contact between cattle is an important risk factor. Indirect and occasional contact is considered of less importance. Therefore, in the development of biosecurity programmes for cattle farms emphasis should be put on preventing direct contact with cattle from outside the herd.

A framework for systematically improving occupational therapy expert opinions on work capacity

Aim: To present an evidence-based framework to improve the quality of occupational therapy expert opinions on work capacity for litigation, compensation and insurance purposes. Methods: Grounded theory methodology was used to collect and analyse data from a sample of 31 participants, comprising 19 occupational therapists, 6 medical specialists and 6 lawyers. A focused semistructured interview was completed with each participant. In addition, 20 participants verified the key findings. Results: The framework is contextualised within a medicolegal system requiring increasing expertise. The framework consists of (i) broad professional development strategies and principles, and (ii) specific strategies and principles for improving opinions through reporting and assessment practices. Conclusions: The synthesis of the participants' recommendations provides systematic guidelines for improving occupational therapy expert opinion on work capacity.