Optimal Correction for Guessing in Multiple-Choice Tests

Building on Item Response Theory we introduce students’ optimal behavior in multiple-choice tests. Our simulations indicate that the optimal penalty is relatively high, because although correction for guessing discriminates against risk-averse subjects, this effect is small compared with the measurement error that the penalty prevents. This result obtains when knowledge is binary or partial, under different normalizations of the score, when risk aversion is related to knowledge and when there is a pass-fail break point. We also find that the mean degree of difficulty should be close to the mean level of knowledge and that the variance of difficulty should be high.

On the strategic equivalence of multiple-choice test scoring rules

A disadvantage of multiple-choice tests is that students have incentives to guess. To discourage guessing, it is common to use scoring rules that either penalize wrong answers or reward omissions. These scoring rules are considered equivalent in psychometrics, although experimental evidence has not always been consistent with this claim. We model students' decisions and show, first, that equivalence holds only under risk neutrality and, second, that the two rules can be modified so that they become equivalent even under risk aversion. This paper presents the results of a field experiment in which we analyze the decisions of subjects taking multiple-choice exams. The evidence suggests that differences between scoring rules are due to risk aversion as theory predicts. We also find that the number of omitted items depends on the scoring rule, knowledge, gender and other covariates.

Intermediate Macroeconomics : Self-evaluation exercises

This resource can be particularly helpful to students taking the Intermediate Macroeconomics course, which corresponds to the second year of the current Degree in Economics at the University of the Basque Country UPV/ EHU. The precise content of this resource is a collection of eight chapters of multiple-choice questions. For each question the user is asked to guess which the correct answer is. Finally, the tool will return all the correct answers for the whole test, thereby allowing the user to check the validity of his/her answers. A remarkable feature of the tool is that it has been edited in three versions, for the three languages (Spanish, Basque and English) in which the subject is taught at the UPV/EHU.