Sources of selection bias in evaluating social programs: An interpretation of conventional measures and evidence on the effectiveness of matching as a program evaluation method

This paper decomposes the conventional measure of selection bias in observational studies into three components. The first two components are due to differences in the distributions of characteristics between participant and nonparticipant (comparison) group members: the first arises from differences in the supports, and the second from differences in densities over the region of common support. The third component arises from selection bias precisely defined. Using data from a recent social experiment, we find that the component due to selection bias, precisely defined, is smaller than the first two components. However, selection bias still represents a substantial fraction of the experimental impact estimate. The empirical performance of matching methods of program evaluation is also examined. We find that matching based on the propensity score eliminates some but not all of the measured selection bias, with the remaining bias still a substantial fraction of the estimated impact. We find that the support of the distribution of propensity scores for the comparison group is typically only a small portion of the support for the participant group. For values outside the common support, it is impossible to reliably estimate the effect of program participation using matching methods. If the impact of participation depends on the propensity score, as we find in our data, the failure of the common support condition severely limits matching compared with random assignment as an evaluation estimator.

A method for distance determination in proteins using a designed metal ion binding site and site-directed spin labeling: evaluation with T4 lysozyme.

The use of molecular genetics to introduce both a metal ion binding site and a nitroxide spin label into the same protein opens the use of paramagnetic metalnitroxyl interactions to estimate intramolecular distances in a wide variety of proteins. In this report, a His-Xaa3-His metal ion binding motif was introduced at the N terminus of the long interdomain helix of T4 lysozyme (Lys-65 --> His/Gln-69 --> His) of three mutants, each containing a single nitroxide-labeled cysteine residue at position 71, 76, or 80. The results show that Cu(II)-induced relaxation effects on the nitroxide can be quantitatively analyzed in terms of interspin distance in the range of 10-25 A using Redfield theory, as first suggested by Leigh [Leigh, J.S. (1970) J. Chem. Phys. 52, 2608-2612]. Of particular interest is the observation that distances can be determined both under rigid lattice conditions in frozen solution and in the presence of motion of the spins at room temperature under physiological conditions. The method should be particularly attractive for investigating structure in membrane proteins that are difficult to crystallize. In the accompanying paper, the technique is applied to a polytopic membrane protein, lactose permease.