A partial dependence factorial analysis to deal with selection bias in observational studis

This thesis presents a creative and practical approach to dealing with the problem of selection bias. Selection bias may be the most important vexing problem in program evaluation or in any line of research that attempts to assert causality. Some of the greatest minds in economics and statistics have scrutinized the problem of selection bias, with the resulting approaches – Rubin’s Potential Outcome Approach(Rosenbaum and Rubin,1983; Rubin, 1991,2001,2004) or Heckman’s Selection model (Heckman, 1979) – being widely accepted and used as the best fixes. These solutions to the bias that arises in particular from self selection are imperfect, and many researchers, when feasible, reserve their strongest causal inference for data from experimental rather than observational studies. The innovative aspect of this thesis is to propose a data transformation that allows measuring and testing in an automatic and multivariate way the presence of selection bias. The approach involves the construction of a multi-dimensional conditional space of the X matrix in which the bias associated with the treatment assignment has been eliminated. Specifically, we propose the use of a partial dependence analysis of the X-space as a tool for investigating the dependence relationship between a set of observable pre-treatment categorical covariates X and a treatment indicator variable T, in order to obtain a measure of bias according to their dependence structure. The measure of selection bias is then expressed in terms of inertia due to the dependence between X and T that has been eliminated. Given the measure of selection bias, we propose a multivariate test of imbalance in order to check if the detected bias is significant, by using the asymptotical distribution of inertia due to T (Estadella et al. 2005) , and by preserving the multivariate nature of data. Further, we propose the use of a clustering procedure as a tool to find groups of comparable units on which estimate local causal effects, and the use of the multivariate test of imbalance as a stopping rule in choosing the best cluster solution set. The method is non parametric, it does not call for modeling the data, based on some underlying theory or assumption about the selection process, but instead it calls for using the existing variability within the data and letting the data to speak. The idea of proposing this multivariate approach to measure selection bias and test balance comes from the consideration that in applied research all aspects of multivariate balance, not represented in the univariate variable- by-variable summaries, are ignored. The first part contains an introduction to evaluation methods as part of public and private decision process and a review of the literature of evaluation methods. The attention is focused on Rubin Potential Outcome Approach, matching methods, and briefly on Heckman’s Selection Model. The second part focuses on some resulting limitations of conventional methods, with particular attention to the problem of how testing in the correct way balancing. The third part contains the original contribution proposed , a simulation study that allows to check the performance of the method for a given dependence setting and an application to a real data set. Finally, we discuss, conclude and explain our future perspectives.

The impact of grants in the agriculture sector in Albania: a counterfactual approach

The objective of this study is to measure the impact of the national subsidy scheme on the olive and fruit sector in two regions of Albania, Shkodra and Fier. From the methodological point of view, we use a non- parametric approach based on the propensity score matching. This method overcomes problem of the missing data, by creating a counterfactual scenario. In the first step, the conditional probability to participate in the program was computed. Afterwards, different matching estimators were applied to establish whether the subsidies have affected sectors performance. One of the strengths of this study stays in the data. Cross-sectional primary data was gathered through about 250 interviews.. We have not found empirical evidence of significant effects of government aid program on production. Differences in production found between beneficiaries and non-beneficiaries disappear after adjustment by the conditional probability of participating into the program. This suggests that subsidized farmers would have performed better than the subsidized households even in the absence of production grants, revealing program self-selection. On the other hand, the scheme has affected positively the farm structure increasing the area under cultivation, but yields has not increased for beneficiaries compared to non beneficiaries. These combined results shed light on the reason of the missed impact. It could be reasonable to believe that the new plantation, in particular in the case of olives, has not yet reached full production. Therefore, we have reasons to believe on positive impacts in the future. Concerning some qualitative results, the extension of area under cultivation is strongly conditioned by the small farm size. This together with a thin land market makes extremely difficult the expansion beyond farm boundaries.