Sparse multioutput radial basis function network construction using combined locally regularised orthogonal least square and D-optimality experimental design

A construction algorithm for multioutput radial basis function (RBF) network modelling is introduced by combining a locally regularised orthogonal least squares (LROLS) model selection with a D-optimality experimental design. The proposed algorithm aims to achieve maximised model robustness and sparsity via two effective and complementary approaches. The LROLS method alone is capable of producing a very parsimonious RBF network model with excellent generalisation performance. The D-optimality design criterion enhances the model efficiency and robustness. A further advantage of the combined approach is that the user only needs to specify a weighting for the D-optimality cost in the combined RBF model selecting criterion and the entire model construction procedure becomes automatic. The value of this weighting does not influence the model selection procedure critically and it can be chosen with ease from a wide range of values.

Sparse model identification using orthogonal forward regression with basis pursuit and D-optimality

An efficient model identification algorithm for a large class of linear-in-the-parameters models is introduced that simultaneously optimises the model approximation ability, sparsity and robustness. The derived model parameters in each forward regression step are initially estimated via the orthogonal least squares (OLS), followed by being tuned with a new gradient-descent learning algorithm based on the basis pursuit that minimises the l(1) norm of the parameter estimate vector. The model subset selection cost function includes a D-optimality design criterion that maximises the determinant of the design matrix of the subset to ensure model robustness and to enable the model selection procedure to automatically terminate at a sparse model. The proposed approach is based on the forward OLS algorithm using the modified Gram-Schmidt procedure. Both the parameter tuning procedure, based on basis pursuit, and the model selection criterion, based on the D-optimality that is effective in ensuring model robustness, are integrated with the forward regression. As a consequence the inherent computational efficiency associated with the conventional forward OLS approach is maintained in the proposed algorithm. Examples demonstrate the effectiveness of the new approach.

Experimental design and model construction algorithms for radial basis function networks

New construction algorithms for radial basis function (RBF) network modelling are introduced based on the A-optimality and D-optimality experimental design criteria respectively. We utilize new cost functions, based on experimental design criteria, for model selection that simultaneously optimizes model approximation, parameter variance (A-optimality) or model robustness (D-optimality). The proposed approaches are based on the forward orthogonal least-squares (OLS) algorithm, such that the new A-optimality- and D-optimality-based cost functions are constructed on the basis of an orthogonalization process that gains computational advantages and hence maintains the inherent computational efficiency associated with the conventional forward OLS approach. The proposed approach enhances the very popular forward OLS-algorithm-based RBF model construction method since the resultant RBF models are constructed in a manner that the system dynamics approximation capability, model adequacy and robustness are optimized simultaneously. The numerical examples provided show significant improvement based on the D-optimality design criterion, demonstrating that there is significant room for improvement in modelling via the popular RBF neural network.

Pose and Structure Recovery using Active Models

A new formulation of a pose refinement technique using ``active'' models is described. An error term derived from the detection of image derivatives close to an initial object hypothesis is linearised and solved by least squares. The method is particularly well suited to problems involving external geometrical constraints (such as the ground-plane constraint). We show that the method is able to recover both the pose of a rigid model, and the structure of a deformable model. We report an initial assessment of the performance and cost of pose and structure recovery using the active model in comparison with our previously reported ``passive'' model-based techniques in the context of traffic surveillance. The new method is more stable, and requires fewer iterations, especially when the number of free parameters increases, but shows somewhat poorer convergence.

The relationship between diffuse spectral reflectance of the soil and its cation exchange capacity is scale-dependent

Diffuse reflectance spectroscopy (DRS) is increasingly being used to predict numerous soil physical, chemical and biochemical properties. However, soil properties and processes vary at different scales and, as a result, relationships between soil properties often depend on scale. In this paper we report on how the relationship between one such property, cation exchange capacity (CEC), and the DRS of the soil depends on spatial scale. We show this by means of a nested analysis of covariance of soils sampled on a balanced nested design in a 16 km × 16 km area in eastern England. We used principal components analysis on the DRS to obtain a reduced number of variables while retaining key variation. The first principal component accounted for 99.8% of the total variance, the second for 0.14%. Nested analysis of the variation in the CEC and the two principal components showed that the substantial variance components are at the > 2000-m scale. This is probably the result of differences in soil composition due to parent material. We then developed a model to predict CEC from the DRS and used partial least squares (PLS) regression do to so. Leave-one-out cross-validation results suggested a reasonable predictive capability (R2 = 0.71 and RMSE = 0.048 molc kg− 1). However, the results from the independent validation were not as good, with R2 = 0.27, RMSE = 0.056 molc kg− 1 and an overall correlation of 0.52. This would indicate that DRS may not be useful for predictions of CEC. When we applied the analysis of covariance between predicted and observed we found significant scale-dependent correlations at scales of 50 and 500 m (0.82 and 0.73 respectively). DRS measurements can therefore be useful to predict CEC if predictions are required, for example, at the field scale (50 m). This study illustrates that the relationship between DRS and soil properties is scale-dependent and that this scale dependency has important consequences for prediction of soil properties from DRS data

Data assimilation for marine monitoring and prediction: The MERCATOR operational assimilation systems and the MERSEA developments

During the past 15 years, a number of initiatives have been undertaken at national level to develop ocean forecasting systems operating at regional and/or global scales. The co-ordination between these efforts has been organized internationally through the Global Ocean Data Assimilation Experiment (GODAE). The French MERCATOR project is one of the leading participants in GODAE. The MERCATOR systems routinely assimilate a variety of observations such as multi-satellite altimeter data, sea-surface temperature and in situ temperature and salinity profiles, focusing on high-resolution scales of the ocean dynamics. The assimilation strategy in MERCATOR is based on a hierarchy of methods of increasing sophistication including optimal interpolation, Kalman filtering and variational methods, which are progressively deployed through the Syst`eme d’Assimilation MERCATOR (SAM) series. SAM-1 is based on a reduced-order optimal interpolation which can be operated using ‘altimetry-only’ or ‘multi-data’ set-ups; it relies on the concept of separability, assuming that the correlations can be separated into a product of horizontal and vertical contributions. The second release, SAM-2, is being developed to include new features from the singular evolutive extended Kalman (SEEK) filter, such as three-dimensional, multivariate error modes and adaptivity schemes. The third one, SAM-3, considers variational methods such as the incremental four-dimensional variational algorithm. Most operational forecasting systems evaluated during GODAE are based on least-squares statistical estimation assuming Gaussian errors. In the framework of the EU MERSEA (Marine EnviRonment and Security for the European Area) project, research is being conducted to prepare the next-generation operational ocean monitoring and forecasting systems. The research effort will explore nonlinear assimilation formulations to overcome limitations of the current systems. This paper provides an overview of the developments conducted in MERSEA with the SEEK filter, the Ensemble Kalman filter and the sequential importance re-sampling filter.

Harmonic force fields from scaled SCF calculations: Program ASYM40

We report an extended version of our normal coordinate program ASYM40, which may be used to transform Cartesian force constants from ab initio calculations to a force field in nonredundant internal (symmetry) coordinates. When experimental data are available, scale factors for the theoretical force field may then be optimized by least-squares refinement. The alternative of refining an empirical force field to fit a wide variety of data, as with the previous version ASYM20, has been retained. We compare the results of least-squares refinement of the full harmonic force field with least-squares refinement of only the scale factors for an SCF calculated force field and conclude that the latter approach may be useful for large molecules where more sophisticated calculations are impractical. The refinement of scale factors for a theoretical force field is also useful when there are only limited spectroscopic data. The program will accept ab initio calculated force fields from any program that presents Cartesian force constants as output. The program is available through Quantum Chemistry Program Exchange.

Vibrational energy levels of water

Several quartic force fields and a full sextic anharmonic force field for H,O have been determined from high-quality ab initio calculations, the highest at the aug-cc-pVQZ CCSD(T) level of theory. These force fields have been used to determine vibrational excited state band origins up to 15 000 cm - ’ above the zero-point level, using both a perturbation-resonancea pproach and a variational approach. An optimisedq uartic force field hasb eeno btained by least squares refinement of our best ab initio results to fit the observed overtone levels of 5 symmetrically substituted isotopomers of water (Hi60, Hi70, HisO, D,O, and T,O) with an rms error of less than 10 cm-‘, using the perturbation-resonancem odel for the vibrational calculation. Predicatel east squaresr efinement was usedt o provide a loose constraint of the refined force field to the ab initio results. The results obtained prove the viability of the perturbation-resonancem odel for usei n larger molecular systemsa nd also highlight someo f its weaknesse

Anharmonic force field of acetylene

The harmonic and anharmonic force field of acetylene has been determined in a least-squares calculation from recently determined data on the spectroscopic constants of various isotopic species (including the vibrational l-doubling constant). A general quadratic and cubic force field was used, but a constrained quartic force field containing only 8 of the 23 possible quartic constants. The results are discussed and compared with earlier work.

Vibration–rotation variational calculations: precise results on HCN up to 25 000 cm−1

Variation calculations of the vibration–rotation energy levels of many isotopomers of HCN are reported, for J=0, 1, and 2, extending up to approximately 8 quanta of each of the stretching vibrations and 14 quanta of the bending mode. The force field, which is represented as a polynomial expansion in Morse coordinates for the bond stretches and even powers of the angle bend, has been refined by least squares to fit simultaneously all observed data on the Σ and Π state vibrational energies, and the Σ state rotational constants, for both HCN and DCN. The observed vibrational energies are fitted to roughly ±0.5 cm−1, and the rotational constants to roughly ±0.0001 cm−1. The force field has been used to predict the vibration rotation spectra of many isotopomers of HCN up to 25 000 cm−1. The results are consistent with the axis‐switching assignments of some weak overtone bands reported recently by Jonas, Yang, and Wodtke, and they also fit and provide the assignment for recent observations by Romanini and Lehmann of very weak absorption bands above 20 000 cm−1.

The anharmonic force field of HCN and HCP

The quadratic, cubic, and quartic force field of HCN has been calculated by a least squares refinement to fit the most recent observed data on the vibration-rotation constants of HCN, DCN and H13CN. All of the observed parameters are fitted within their standard errors of observation. The corresponding parameters for other isotopic species are calculated. For HCP and DCP the more limited data available have been fitted to an anharmonic force field using constraints based on comparison with HCN. Using this force field the zero-point rotational constants B0 have been corrected to obtain the equilibrium constants Be, and hence the equilibrium structure has been determined to be re(CH) = 1•0692(7)A, and re(CP) = 1•5398(2)A.

Vibration-rotation spectra and the harmonic force field of HOCl

Vibration-rotation spectra of HOCl have been measured at a resolution of 0.05 cm−1 to determine vibration rotation constants, and 35–37 Cl isotope shifts in the vibration frequencies. The spectrum of DOCl has also been recorded, and a preliminary analysis for the band origins has been made. The vibrational frequency data and centrifugal distortion constants have been used to determine the harmonic force field in a least-squares refinement; the force field obtained also gives a good fit to data on the vibrational contributions to the inertial defect. The equilibrium rotational constants of HOCl have been obtained, and an equilibrium structure has been estimated.

Nitrous acid: vibrational frequency shifts due to 15N substitution, and the harmonic force field

Vibration rotation spectra of HO15 NO and DO15 NO have been measured at a resolution of 0•04 cm-1 to determine the isotopic shifts in the vibrational band origins. These have been used together with recently determined data on the vibrational band origins, Coriolis constants, and centrifugal distorition constants, to determine the harmonic force field of both cis and trans nitrous acid in least squares refinement calculations. The results are discussed in relation to recent ab initio calculations, the inertia defects, and the torsional potential function.

C---H local modes in cyclobutene, part I: FTIR studies, 600 to 10000 cm–1

The vibrational structure of C---H stretching states in gas-phase cyclobutene was studied using FTIR spectroscopy in the range 700–9000 cm−1. The structure was modelled using two effective vibrational Hamiltonians, one for each type of C---H bond present, consisting of local mode basis functions subject to coupling with symmetrically equivalent bonds and to Fermi resonances with suitable low frequency vibrations. Best-fit model parameters were determined using least-squares routines and the model predictions are compared to the observed band positions and intensities. Some discussion is given of the relevance of the observed couplings to intramolecular vibrational redistribution (IVR) which results in the observation of statistical behaviour in cyclobutene isomerization induced by excitation of C---H stretching overtones in the visible region.

Vibration-rotation spectra of 13C containing acetylene: anharmonic resonances

High resolution vibration-rotation spectra of 13C2H2 were recorded in a number of regions from 2000 to 5200 cm−1 at Doppler or pressure limited resolution. In these spectral ranges cold and hot bands involving the bending-stretching combination levels have been analyzed up to high J values. Anharmonic quartic resonances for the combination levels ν1 + mν4 + nν5, ν2 + mν4 + (n + 2) ν5 and ν3 + (m − 1) ν4 + (n + 1) ν5 have been studied, and the l-type resonances within each polyad have been explicitly taken into account in the analysis of the data. The least-squares refinement provides deperturbed values for band origins and rotational constants, obtained by fitting rotation lines only up to J ≈ 20 with root mean square errors of ≈ 0.0003 cm−1. The band origins allowed us to determine a number of the anharmonicity constants xij0.