A little learning is a dangerous thing: an experimental demonstration of ignorance-driven inference

Studies of ignorance-driven decision making have been employed to analyse when ignorance should prove advantageous on theoretical grounds or else they have been employed to examine whether human behaviour is consistent with an ignorance-driven inference strategy (e. g., the recognition heuristic). In the current study we examine whether-under conditions where such inferences might be expected-the advantages that theoretical analyses predict are evident in human performance data. A single experiment shows that, when asked to make relative wealth judgements, participants reliably use recognition as a basis for their judgements. Their wealth judgements under these conditions are reliably more accurate when some of the target names are unknown than when participants recognize all of the names (a "less-is-more effect"). These results are consistent across a number of variations: the number of options given to participants and the nature of the wealth judgement. A basic model of recognition-based inference predicts these effects.

When does ignorance make us smart? Additional factors guiding heuristic inference

“Fast & frugal” heuristics represent an appealing way of implementing bounded rationality and decision-making under pressure. The recognition heuristic is the simplest and most fundamental of these heuristics. Simulation and experimental studies have shown that this ignorance-driven heuristic inference can prove superior to knowledge based inference (Borges, Goldstein, Ortman & Gigerenzer, 1999; Goldstein & Gigerenzer, 2002) and have shown how the heuristic could develop from ACT-R’s forgetting function (Schooler & Hertwig, 2005). Mathematical analyses also demonstrate that, under certain conditions, a “less-is-more effect” will always occur (Goldstein & Gigerenzer, 2002). The further analyses presented in this paper show, however, that these conditions may constitute a special case and that the less-is-more effect in decision-making is subject to the moderating influence of the number of options to be considered and the framing of the question.

Hyperresolution information and hyperresolution ignorance in modelling the hydrology of the land surface

There is a strong drive towards hyperresolution earth system models in order to resolve finer scales of motion in the atmosphere. The problem of obtaining more realistic representation of terrestrial fluxes of heat and water, however, is not just a problem of moving to hyperresolution grid scales. It is much more a question of a lack of knowledge about the parameterisation of processes at whatever grid scale is being used for a wider modelling problem. Hyperresolution grid scales cannot alone solve the problem of this hyperresolution ignorance. This paper discusses these issues in more detail with specific reference to land surface parameterisations and flood inundation models. The importance of making local hyperresolution model predictions available for evaluation by local stakeholders is stressed. It is expected that this will be a major driving force for improving model performance in the future. Keith BEVEN, Hannah CLOKE, Florian PAPPENBERGER, Rob LAMB, Neil HUNTER

Consumer welfare and the loss induced by withholding information: The case of BSE in Italy

The paper develops a measure of consumer welfare losses associated with withholding it formation about a possible link between BSE and vCJD. The Cost of Ignorance (COI) is measured by comparing the utility of the informed choice with the utility of the uninformed choice, under conditions of improved information. Unlike previous work that is largely based on a single equation demand model, the measure is obtained retrieving a cost,function from a dynamic Almost Ideal Demand System. The estimated perceived loss for Italian consumers due to delayed information ranges from 12 percent to 54 percent of total meat expenditure, depending on the month assumed to embody correct beliefs about the safety level of beef.

Challenges of linking scientific knowledge to river basin management policy: AquaTerra as a case study

The EU Project AquaTerra generates knowledge about the river-soil-sediment-groundwater system and delivers scientific information of value for river basin management. In this article, the use and ignorance of scientific knowledge in decision making is explored by a theoretical review. We elaborate on the 'two-communities theory', which explains the problems of the policy-science interface by relating and comparing the different cultures, contexts, and languages of researchers and policy makers. Within AquaTerra, the EUPOL subproject examines the policy-science interface with the aim of achieving a good connection between the scientific output of the project and EU policies. We have found two major barriers, namely language and resources, as well as two types of relevant relationships: those between different research communities and those between researchers and policy makers. (c) 2007 Elsevier Ltd. All rights reserved.

The need of sustainable buildings construction in the Kingdom of Bahrain

This thesis is aimed to initiate implementing sustainable building construction in the kingdom of Bahrain, i.e. Building-Integration PhotoVoltaic (BIPV) or Wind Energy (BIWE). It highlights the main constrains that discourage such modern concept in building and construction. Three groups have been questioned using a questionnaire. These are the policy and decision makers, the leading consultants and the contractors. The main constrains of the dissemination of BIVP and BIWE, according to the policy and decision makers, are: lack of knowledge and awareness of the public in sustainable technology, low cost of electricity, low cost of gas and oil and difficulty in applying local environmental taxes. The consultants had attributed the constrains to ignorance of life cycle cost of PV and Wind turbines systems, lack of education and knowledge in sustainable design, political system, shortage of markets importing sustainable technologies and client worries in profitability and pay-back period. The contractors are found to be very enthusiastic and ready to take over any sustainable building project and prefer to have a construction manger to coordinate between the design and contracting team. Design and Build is found the favorable procurement method in Bahrain for conducting BIPV or BIWE projects.

Optimal maintenance policies under different operational schedules

In the reliability literature, maintenance time is usually ignored during the optimization of maintenance policies. In some scenarios, costs due to system failures may vary with time, and the ignorance of maintenance time will lead to unrealistic results. This paper develops maintenance policies for such situations where the system under study operates iteratively at two successive states: up or down. The costs due to system failure at the up state consist of both business losses & maintenance costs, whereas those at the down state only include maintenance costs. We consider three models: Model A, B, and C: Model A makes only corrective maintenance (CM). Model B performs imperfect preventive maintenance (PM) sequentially, and CM. Model C executes PM periodically, and CM; this PM can restore the system as good as the state just after the latest CM. The CM in this paper is imperfect repair. Finally, the impact of these maintenance policies is illustrated through numerical examples.

Deciding the price of fame

Previous studies of ignorance-driven decision-making have either analyzed when ignorance should prove advantageous on theoretical grounds, or else they have examined whether human behavior is consistent with an ignorance driven inference strategy (e.g., the recognition heuristic). The current study merges these research goals by examining whether – under conditions where ignorance driven inference might be expected – the type of advantages theoretical analyses predict are evident in human performance data. A single experiment shows that, when asked to make relative wealth judgments, participants reliably use recognition as a basis for their judgments. Their wealth judgments under these conditions are reliably more accurate when some of the target names are unknown than when participants recognize all the names (the “less-is-more effect”). these data are robust against a number of variations on the size of the pool from which participants have to choose and the nature of the wealth judgment.

Electronic voting systems in undergraduate teaching

One of the major differences undergraduates experience during the transition to university is the style of teaching. In schools and colleges most students study key stage 5 subjects in relatively small informal groups where teacher–pupil interaction is encouraged and two-way feedback occurs through question and answer type delivery. On starting in HE students are amazed by the sizes of the classes. For even a relatively small chemistry department with an intake of 60-70 students, biologists, pharmacists, and other first year undergraduates requiring chemistry can boost numbers in the lecture hall to around 200 or higher. In many universities class sizes of 400 are not unusual for first year groups where efficiency is crucial. Clearly the personalised classroom-style delivery is not practical and it is a brave student who shows his ignorance by venturing to ask a question in front of such an audience. In these environments learning can be a very passive process, the lecture acts as a vehicle for the conveyance of information and our students are expected to reinforce their understanding by ‘self-study’, a term, the meaning of which, many struggle to understand. The use of electronic voting systems (EVS) in such situations can vastly change the students’ learning experience from a passive to a highly interactive process. This principle has already been demonstrated in Physics, most notably in the work of Bates and colleagues at Edinburgh.1 These small hand-held devices, similar to those which have become familiar through programmes such as ‘Who Wants to be a Millionaire’ can be used to provide instant feedback to students and teachers alike. Advances in technology now allow them to be used in a range of more sophisticated settings and comprehensive guides on use have been developed for even the most techno-phobic staff.

On reliability analysis of multi-categorical forecasts

Reliability analysis of probabilistic forecasts, in particular through the rank histogram or Talagrand diagram, is revisited. Two shortcomings are pointed out: Firstly, a uniform rank histogram is but a necessary condition for reliability. Secondly, if the forecast is assumed to be reliable, an indication is needed how far a histogram is expected to deviate from uniformity merely due to randomness. Concerning the first shortcoming, it is suggested that forecasts be grouped or stratified along suitable criteria, and that reliability is analyzed individually for each forecast stratum. A reliable forecast should have uniform histograms for all individual forecast strata, not only for all forecasts as a whole. As to the second shortcoming, instead of the observed frequencies, the probability of the observed frequency is plotted, providing and indication of the likelihood of the result under the hypothesis that the forecast is reliable. Furthermore, a Goodness-Of-Fit statistic is discussed which is essentially the reliability term of the Ignorance score. The discussed tools are applied to medium range forecasts for 2 m-temperature anomalies at several locations and lead times. The forecasts are stratified along the expected ranked probability score. Those forecasts which feature a high expected score turn out to be particularly unreliable.

Estimating reliability and resolution of probability forecasts through decomposition of the empirical score

References (20)Cited By (1)Export CitationAboutAbstract Proper scoring rules provide a useful means to evaluate probabilistic forecasts. Independent from scoring rules, it has been argued that reliability and resolution are desirable forecast attributes. The mathematical expectation value of the score allows for a decomposition into reliability and resolution related terms, demonstrating a relationship between scoring rules and reliability/resolution. A similar decomposition holds for the empirical (i.e. sample average) score over an archive of forecast–observation pairs. This empirical decomposition though provides a too optimistic estimate of the potential score (i.e. the optimum score which could be obtained through recalibration), showing that a forecast assessment based solely on the empirical resolution and reliability terms will be misleading. The differences between the theoretical and empirical decomposition are investigated, and specific recommendations are given how to obtain better estimators of reliability and resolution in the case of the Brier and Ignorance scoring rule.

Best practice in the training, appointment and remuneration of members of dispute boards for large infrastructure projects

This paper reports part of a qualitative study into evolving practice in the implementation of the Dispute Adjudication Board (DAB) construction dispute resolution technique, a variant of the Dispute Review Board (DRB) concept used in the US and Canada. Data was collected through a focus group interview of 20 highly experienced dispute resolution practitioners from engineering and the law. The group was assembled from members of FIDIC-NET with direct experience of project DABs. The part reported here concerns practice and procedure for establishing DABs. The main findings are that: constitution of the DABs is often delayed because of either project owners' ignorance of the DAB process or deterrence by the cost of the DABs; such owners also tend to insist on appointing DAB members from local engineers and lawyers without sufficient understanding of the DAB process; rates of remuneration of DAB members vary widely; the training provision for DAB membership and advocacy skills is inadequate; the process of selecting candidates for DAB membership and negotiating the tripartite agreement between each member and the contractual parties needs to be navigated with great care to avoid raising ethical problems. The research contribution is threefold. First, it highlights the importance of realistic fees for DAB members within a standard framework in achieving timely establishment of a board that works well as a team. Second, it illustrates the use of qualitative focus group interview to study the impact of new contract terms from multiple stakeholder perspectives. Finally, it identifies areas where further research is needed.

Towards improving the framework for probabilistic forecast evaluation

The evaluation of forecast performance plays a central role both in the interpretation and use of forecast systems and in their development. Different evaluation measures (scores) are available, often quantifying different characteristics of forecast performance. The properties of several proper scores for probabilistic forecast evaluation are contrasted and then used to interpret decadal probability hindcasts of global mean temperature. The Continuous Ranked Probability Score (CRPS), Proper Linear (PL) score, and IJ Good’s logarithmic score (also referred to as Ignorance) are compared; although information from all three may be useful, the logarithmic score has an immediate interpretation and is not insensitive to forecast busts. Neither CRPS nor PL is local; this is shown to produce counter intuitive evaluations by CRPS. Benchmark forecasts from empirical models like Dynamic Climatology place the scores in context. Comparing scores for forecast systems based on physical models (in this case HadCM3, from the CMIP5 decadal archive) against such benchmarks is more informative than internal comparison systems based on similar physical simulation models with each other. It is shown that a forecast system based on HadCM3 out performs Dynamic Climatology in decadal global mean temperature hindcasts; Dynamic Climatology previously outperformed a forecast system based upon HadGEM2 and reasons for these results are suggested. Forecasts of aggregate data (5-year means of global mean temperature) are, of course, narrower than forecasts of annual averages due to the suppression of variance; while the average “distance” between the forecasts and a target may be expected to decrease, little if any discernible improvement in probabilistic skill is achieved.