Sequential anomaly detection in the presence of noise and limited feedback

This paper describes a methodology for detecting anomalies from sequentially observed and potentially noisy data. The proposed approach consists of two main elements: 1) filtering, or assigning a belief or likelihood to each successive measurement based upon our ability to predict it from previous noisy observations and 2) hedging, or flagging potential anomalies by comparing the current belief against a time-varying and data-adaptive threshold. The threshold is adjusted based on the available feedback from an end user. Our algorithms, which combine universal prediction with recent work on online convex programming, do not require computing posterior distributions given all current observations and involve simple primal-dual parameter updates. At the heart of the proposed approach lie exponential-family models which can be used in a wide variety of contexts and applications, and which yield methods that achieve sublinear per-round regret against both static and slowly varying product distributions with marginals drawn from the same exponential family. Moreover, the regret against static distributions coincides with the minimax value of the corresponding online strongly convex game. We also prove bounds on the number of mistakes made during the hedging step relative to the best offline choice of the threshold with access to all estimated beliefs and feedback signals. We validate the theory on synthetic data drawn from a time-varying distribution over binary vectors of high dimensionality, as well as on the Enron email dataset. © 1963-2012 IEEE.

Collective action and individual choice: rethinking how we regulate narcotics and antibiotics.

Governments across the globe have squandered treasure and imprisoned millions of their own citizens by criminalising the use and sale of recreational drugs. But use of these drugs has remained relatively constant, and the primary victims are the users themselves. Meanwhile, antimicrobial drugs that once had the power to cure infections are losing their ability to do so, compromising the health of people around the world. The thesis of this essay is that policymakers should stop wasting resources trying to fight an unwinnable and morally dubious war against recreational drug users, and start shifting their attention to the serious threat posed by our collective misuse of antibiotics.

Genes, race, and the ethics of belief.

A Troublesome Inheritance, by Nicholas Wade, should be read by anyone interested in race and recent human evolution. Wade deserves credit for challenging the popular dog-ma that biological differences between groups either don't exist or cannot ex-plain the relative success of different groups at different tasks. Wade's work should be read alongside another re-cent book, The 10,000 Year Explosion: How Civilization Accelerated Human Evolution, by Gregory Cochran and Henry Harpending. Together, these books represent a ma-jor turning point in the public debate about the speed with which relatively isolated groups can evolve: both books suggest that small genetic differences between members of different groups can have large impacts on their abilities and propensities, which in turn affect the outcomes of the societies in which they live.

Public goods and procreation.

Procreation is the ultimate public goods problem. Each new child affects the welfare of many other people, and some (but not all) children produce uncompensated value that future people will enjoy. This essay addresses challenges that arise if we think of procreation and parenting as public goods. These include whether individual choices are likely to lead to a socially desirable outcome, and whether changes in laws, social norms, or access to genetic engineering and embryo selection might improve the aggregate outcome of our reproductive choices.

What's wrong with factory farming?

© The Author 2014.Factory farming continues to grow around the world as a low-cost way of producing animal products for human consumption. However, many of the practices associated with intensive animal farming have been criticized by public health professionals and animal welfare advocates. The aim of this essay is to raise three independent moral concerns with factory farming, and to explain why the practices associated with factory farming flourish despite the cruelty inflicted on animals and the public health risks imposed on people. I conclude that the costs of factory farming as it is currently practiced far outweigh the benefits, and offer a few suggestions for how to improve the situation for animals and people.