Eliciting and estimating valid subjective probabilities: An experimental investigation of the Exchangeability Method.

Using a laboratory experiment, we investigate whether incentive compatibility affects subjective probabilities elicited via the exchangeability method (EM), an elicitation technique consisting of several chained questions. We hypothesize that subjects who are aware of the chaining strategically behave and provide invalid subjective probabilities, while subjects who are not aware of the chaining state their real beliefs and provide valid subjective probabilities. The validity of subjective probabilities is investigated using de Finetti's notion of coherence, under which probability estimates are valid if and only if they obey all axioms of probability theory.
Four experimental treatments are designed and implemented. Subjects are divided into two initial treatment groups: in the first, they are provided with real monetary incentives, and in the second, they are not. Each group is further sub-divided into two treatment groups, in the first, the chained structure of the experimental design is made clear to the subjects, while, in the second, the chained structure is hidden by randomizing the elicitation questions.
Our results suggest that subjects provided with monetary incentives and randomized questions provide valid subjective probabilities because they are not aware of the chaining which undermines the incentive compatibility of the exchangeability method.

Does climate change information affect stated risks of pine beetle impacts on forests? An application of the exchangeability method

Risks are an essential feature of future climate change impacts. We explore whether knowledge that climate change might be the source of increasing pine beetle impacts on public or private forests affects stated risk estimates of damage, elicited using the exchangeability method. We find that across subjects the difference between public and private forest status does not influence stated risks, but the group told that global warming is the cause of pine beetle damage has significantly higher risk perceptions than the group not given this information.

How many bad apples are in a bunch? An experimental investigation of perceived pesticide residue risks

Subjective risks of having contaminated apples elicited via the Exchangeability Method (EM) are examined in this study. In particular, as the experimental design allows us to investigate the validity of elicited risk measures, we examine the magnitude of differences between valid and invalid observations. In addition, using an econometric model, we also explore the effect of consumers’ socioeconomic status and attitudes toward food safety on subjects’ perceptions of pesticide residues in apples. Results suggest first, that consumers do not expect an increase in the number of apples containing only one pesticide residue, but, rather, in the number of those apples with traces of multiple residues. Second, we find that valid subjective risk measures do not significantly diverge from invalid ones, indicative of little effect of internal validity on the actual magnitude of subjective risks. Finally, we show that subjective risks depend on age, education, a subject’s ties to the apple industry, and consumer association membership.