Sparse modeling using orthogonal forward regression with PRESS statistic and regularization

The paper introduces an efficient construction algorithm for obtaining sparse linear-in-the-weights regression models based on an approach of directly optimizing model generalization capability. This is achieved by utilizing the delete-1 cross validation concept and the associated leave-one-out test error also known as the predicted residual sums of squares (PRESS) statistic, without resorting to any other validation data set for model evaluation in the model construction process. Computational efficiency is ensured using an orthogonal forward regression, but the algorithm incrementally minimizes the PRESS statistic instead of the usual sum of the squared training errors. A local regularization method can naturally be incorporated into the model selection procedure to further enforce model sparsity. The proposed algorithm is fully automatic, and the user is not required to specify any criterion to terminate the model construction procedure. Comparisons with some of the existing state-of-art modeling methods are given, and several examples are included to demonstrate the ability of the proposed algorithm to effectively construct sparse models that generalize well.

A robust nonlinear identification algorithm using PRESS statistic and forward regression

This letter introduces a new robust nonlinear identification algorithm using the Predicted REsidual Sums of Squares (PRESS) statistic and for-ward regression. The major contribution is to compute the PRESS statistic within a framework of a forward orthogonalization process and hence construct a model with a good generalization property. Based on the properties of the PRESS statistic the proposed algorithm can achieve a fully automated procedure without resort to any other validation data set for iterative model evaluation.

Automatic nonlinear predictive model-construction algorithm using forward regression and the PRESS statistic

An automatic nonlinear predictive model-construction algorithm is introduced based on forward regression and the predicted-residual-sums-of-squares (PRESS) statistic. The proposed algorithm is based on the fundamental concept of evaluating a model's generalisation capability through crossvalidation. This is achieved by using the PRESS statistic as a cost function to optimise model structure. In particular, the proposed algorithm is developed with the aim of achieving computational efficiency, such that the computational effort, which would usually be extensive in the computation of the PRESS statistic, is reduced or minimised. The computation of PRESS is simplified by avoiding a matrix inversion through the use of the orthogonalisation procedure inherent in forward regression, and is further reduced significantly by the introduction of a forward-recursive formula. Based on the properties of the PRESS statistic, the proposed algorithm can achieve a fully automated procedure without resort to any other validation data set for iterative model evaluation. Numerical examples are used to demonstrate the efficacy of the algorithm.

The zooarchaeology of medieval Christendom: ideology, the treatment of animals and the making of medieval Europe

The formation of Christendom – of Europe – was associated with a standardized worldview expressing dominion over the natural world. While some sections of medieval society, specifically monasteries and the aristocratic class, appear to have developed this paradigm, there is also evidence for heterogeneity in practice and belief. Zooarchaeologists have accumulated vast quantities of data from medieval contexts which has enabled the ecological signatures of specific social groups to be identified, and how these developed from the latter centuries of the first millennium ad. It is possible from this to consider whether trends in animal exploitation can be associated with the Christian world view of dominion, and with the very idea of what it meant to be Christian. This may enable zooarchaeologists to situate the ecological trends of the Middle Ages within the context of Europeanization, and the consolidation of a Christian society.

Ideology and the by-passing of the planning system: case studies of Canary Wharf, London and The Globe, Stockholm

This paper explores the relationship between political ideology and planning in Britain and Sweden, with particular emphasis on the by-passing of the planning system. The prevailing ideology in each country over the last ten years is outlined and the impact on planning identified. The argument is then given in greater depth through case studies of two major projects. For Britain, this involves setting out the main features of Thatcherism and the way that this has changed the purposes underlying planning and created a diversified planning system. This is followed by a case study of Canary Wharf. For Sweden, the consensus culture and the emphasis on participation and decentralisation are discussed. The new planning legislation of 1987 is outlined. These aspects are then contrasted with the fiscal crisis and the development of 'negotiation planning'. These themes are illustrated by a case study of the Globe in Stockholm.