Structure Discovery in Nonparametric Regression through Compositional Kernel Search

Despite its importance, choosing the structural form of the kernel in nonparametric regression remains a black art. We define a space of kernel structures which are built compositionally by adding and multiplying a small number of base kernels. We present a method for searching over this space of structures which mirrors the scientific discovery process. The learned structures can often decompose functions into interpretable components and enable long-range extrapolation on time-series datasets. Our structure search method outperforms many widely used kernels and kernel combination methods on a variety of prediction tasks.

Automatic construction and natural-language description of nonparametric regression models

Copyright © 2014, Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved. This paper presents the beginnings of an automatic statistician, focusing on regression problems. Our system explores an open-ended space of statistical models to discover a good explanation of a data set, and then produces a detailed report with figures and natural- language text. Our approach treats unknown regression functions non- parametrically using Gaussian processes, which has two important consequences. First, Gaussian processes can model functions in terms of high-level properties (e.g. smoothness, trends, periodicity, changepoints). Taken together with the compositional structure of our language of models this allows us to automatically describe functions in simple terms. Second, the use of flexible nonparametric models and a rich language for composing them in an open-ended manner also results in state- of-the-art extrapolation performance evaluated over 13 real time series data sets from various domains.

Improved combinations of parametric and nonparametric Regression estimators

This paper provides a systematic and unified treatment of the developments in the area of kernel estimation in econometrics and statistics. Both the estimation and hypothesis testing issues are discussed for the nonparametric and semiparametric regression models. A discussion on the choice of windowwidth is also presented.

Application of Local Rank Tests for Nonparametric Regression

Let Y_i = f(x_i) + E_i\ (1\le i\le n) with given covariates x_1\lt x_2\lt \cdots\lt x_n , an unknown regression function f and independent random errors E_i with median zero. It is shown how to apply several linear rank test statistics simultaneously in order to test monotonicity of f in various regions and to identify its local extrema.

Efficiency Bounds for Estimating Linear Functionals of Nonparametric Regression Models with Endogenous Regressors

Consider a nonparametric regression model Y=mu*(X) + e, where the explanatory variables X are endogenous and e satisfies the conditional moment restriction E[e|W]=0 w.p.1 for instrumental variables W. It is well known that in these models the structural parameter mu* is 'ill-posed' in the sense that the function mapping the data to mu* is not continuous. In this paper, we derive the efficiency bounds for estimating linear functionals E[p(X)mu*(X)] and int_{supp(X)}p(x)mu*(x)dx, where p is a known weight function and supp(X) the support of X, without assuming mu* to be well-posed or even identified.

Canonical solution groups of a homomorphism : manipulator kinematics, nonparametric regression and distributed object systems

The kinematic mapping of a rigid open-link manipulator is a homomorphism between Lie groups. The homomorphisrn has solution groups that act on an inverse kinematic solution element. A canonical representation of solution group operators that act on a solution element of three and seven degree-of-freedom (do!) dextrous manipulators is determined by geometric analysis. Seven canonical solution groups are determined for the seven do! Robotics Research K-1207 and Hollerbach arms. The solution element of a dextrous manipulator is a collection of trivial fibre bundles with solution fibres homotopic to the Torus. If fibre solutions are parameterised by a scalar, a direct inverse funct.ion that maps the scalar and Cartesian base space coordinates to solution element fibre coordinates may be defined. A direct inverse pararneterisation of a solution element may be approximated by a local linear map generated by an inverse augmented Jacobian correction of a linear interpolation. The action of canonical solution group operators on a local linear approximation of the solution element of inverse kinematics of dextrous manipulators generates cyclical solutions. The solution representation is proposed as a model of inverse kinematic transformations in primate nervous systems. Simultaneous calibration of a composition of stereo-camera and manipulator kinematic models is under-determined by equi-output parameter groups in the composition of stereo-camera and Denavit Hartenberg (DH) rnodels. An error measure for simultaneous calibration of a composition of models is derived and parameter subsets with no equi-output groups are determined by numerical experiments to simultaneously calibrate the composition of homogeneous or pan-tilt stereo-camera with DH models. For acceleration of exact Newton second-order re-calibration of DH parameters after a sequential calibration of stereo-camera and DH parameters, an optimal numerical evaluation of DH matrix first order and second order error derivatives with respect to a re-calibration error function is derived, implemented and tested. A distributed object environment for point and click image-based tele-command of manipulators and stereo-cameras is specified and implemented that supports rapid prototyping of numerical experiments in distributed system control. The environment is validated by a hierarchical k-fold cross validated calibration to Cartesian space of a radial basis function regression correction of an affine stereo model. Basic design and performance requirements are defined for scalable virtual micro-kernels that broker inter-Java-virtual-machine remote method invocations between components of secure manageable fault-tolerant open distributed agile Total Quality Managed ISO 9000+ conformant Just in Time manufacturing systems.

Some Identification Issues in Nonparametric Linear Models with Endogenous Regressors

In applied work economists often seek to relate a given response variable y to some causal parameter mu* associated with it. This parameter usually represents a summarization based on some explanatory variables of the distribution of y, such as a regression function, and treating it as a conditional expectation is central to its identification and estimation. However, the interpretation of mu* as a conditional expectation breaks down if some or all of the explanatory variables are endogenous. This is not a problem when mu* is modelled as a parametric function of explanatory variables because it is well known how instrumental variables techniques can be used to identify and estimate mu*. In contrast, handling endogenous regressors in nonparametric models, where mu* is regarded as fully unknown, presents di±cult theoretical and practical challenges. In this paper we consider an endogenous nonparametric model based on a conditional moment restriction. We investigate identification related properties of this model when the unknown function mu* belongs to a linear space. We also investigate underidentification of mu* along with the identification of its linear functionals. Several examples are provided in order to develop intuition about identification and estimation for endogenous nonparametric regression and related models.

Parametric & nonparametric approaches to event studies: an application to a hotel’s market value

The main objective of this paper is twofold: on the one hand, to analyse the impact that the announcement of the opening of a new hotel has on the performance of its chain by carrying out an event study, and on the other hand, to compare the results of two different approaches to this method: a parametric specification based on the autoregressive conditional heteroskedasticity models to estimate the market model, and a nonparametric approach, which implies employing Theil’s nonparametric regression technique, which in turn, leads to the so-called complete nonparametric approach to event studies. The results that the empirical application arrives at are noteworthy as, on average, the reaction to such news releases is highly positive, both approaches reaching the same level of significance. However, a word of caution must be said when one is not only interested in detecting whether the market reacts, but also in obtaining an exhaustive calculation of the abnormal returns to further examine its determining factors.

Estimação da contribuição de múltiplas fontes harmônicas utilizando regressão não paramétrica

Este trabalho apresenta uma nova metodologia para estimar a contribuição harmônica de múltiplas cargas geradoras de harmônicos na distorção de tensão de um sistema elétrico. Essa metodologia cria modelos estatísticos que descrevem o comportamento da tensão harmônica de um sistema elétrico qualquer em função da corrente harmônica das cargas presentes nele, de tal forma, que seja possível avaliar o impacto das cargas geradoras de harmônicos nos níveis de distorção harmônica de tensão do sistema elétrico em análise. A criação desses modelos é realizada com base no método estatístico chamado de regressão polinomial local de kernel, que é um método de regressão não paramétrica, cuja característica principal é criar modelos não condicionados a uma família específica de curvas de regressão, ou seja, os dados são os únicos responsáveis pelo formato do modelo. Uma vez criado o modelo, estima-se a tensão harmônica que as cargas provocaram no período em análise e, por fim, avalia-se seu valor em relação à medida.

Recipients' Satisfaction with Locally Procured Food Aid Rations: Comparative Evidence from a Three Country Matched Survey

Using survey data from natural experiments in three countries that simultaneously received food aid sourced locally and from the United States, we test the hypothesis that locally-sourced commodities are more culturally appropriate and thus preferred over traditional food aid commodities sourced from the donor country. We use a semi-nonparametric regression method to estimate recipients' satisfaction with these commodities across a range of criteria. We establish that recipients of locally procured rations are generally more satisfied with the commodities they receive than are recipients of US-sourced foods. This pattern is especially pronounced among less-well-off recipients. (C) 2013 Elsevier Ltd. All rights reserved.