Internal model control of nonlinear systems through the inversion of recurrent neural networks

Recurrent neural networks can be used for both the identification and control of nonlinear systems. This paper takes a previously derived set of theoretical results about recurrent neural networks and applies them to the task of providing internal model control for a nonlinear plant. Using the theoretical results, we show how an inverse controller can be produced from a neural network model of the plant, without the need to train an additional network to perform the inverse control.

The REFLEX project: Comparing different algorithms and implementations for the inversion of a terrestrial ecosystem model against eddy covariance data

We describe a model-data fusion (MDF) inter-comparison project (REFLEX), which compared various algorithms for estimating carbon (C) model parameters consistent with both measured carbon fluxes and states and a simple C model. Participants were provided with the model and with both synthetic net ecosystem exchange (NEE) of CO2 and leaf area index (LAI) data, generated from the model with added noise, and observed NEE and LAI data from two eddy covariance sites. Participants endeavoured to estimate model parameters and states consistent with the model for all cases over the two years for which data were provided, and generate predictions for one additional year without observations. Nine participants contributed results using Metropolis algorithms, Kalman filters and a genetic algorithm. For the synthetic data case, parameter estimates compared well with the true values. The results of the analyses indicated that parameters linked directly to gross primary production (GPP) and ecosystem respiration, such as those related to foliage allocation and turnover, or temperature sensitivity of heterotrophic respiration, were best constrained and characterised. Poorly estimated parameters were those related to the allocation to and turnover of fine root/wood pools. Estimates of confidence intervals varied among algorithms, but several algorithms successfully located the true values of annual fluxes from synthetic experiments within relatively narrow 90% confidence intervals, achieving >80% success rate and mean NEE confidence intervals <110 gC m−2 year−1 for the synthetic case. Annual C flux estimates generated by participants generally agreed with gap-filling approaches using half-hourly data. The estimation of ecosystem respiration and GPP through MDF agreed well with outputs from partitioning studies using half-hourly data. Confidence limits on annual NEE increased by an average of 88% in the prediction year compared to the previous year, when data were available. Confidence intervals on annual NEE increased by 30% when observed data were used instead of synthetic data, reflecting and quantifying the addition of model error. Finally, our analyses indicated that incorporating additional constraints, using data on C pools (wood, soil and fine roots) would help to reduce uncertainties for model parameters poorly served by eddy covariance data.

On an alleged truth/falsity asymmetry in context shifting experiments

Keith DeRose has argued that context shifting experiments should be designed in a specific way in order to accommodate what he calls a ‘truth/falsity asymmetry’. I explain and critique DeRose's reasons for proposing this modification to contextualist methodology, drawing on recent experimental studies of DeRose's bank cases as well as experimental findings about the verification of affirmative and negative statements. While DeRose's arguments for his particular modification to contextualist methodology fail, the lesson of his proposal is that there is good reason to pay close attention to several subtle aspects of the design of context shifting experiments.

Oppositely charged polyelectrolytes: complex formation and effects of chain asymmetry

The formation of complexes in solutions of oppositely charged polyions has been studied by Monte Carlo simulations. The amount as well as the length, and thus, the absolute charge of one of the polyions have been varied. There is an increasing tendency to form large clusters as the excess of one kind of polyion decreases. When all polyions have the same length, this tendency reaches a maximum near, but off, equivalent amounts of the two types of polyions. When one kind of polyion is made shorter, the propensity to form large clusters decreases and the fluctuations in cluster charge increases. Simple free-energy expressions have been formulated on the basis of a set of simple rules that help rationalize the observations. By calculating cluster distributions in both grand canonical and canonical ensembles, it has been possible to show the extent of finite-size effects in the simulations.

The tropopause inversion layer in models and analyses

Recent high-resolution radiosonde climatologies have revealed a tropopause inversion layer (TIL) in the extratropics: temperature strongly increases just above a sharp local cold point tropopause. Here, it is asked to what extent a TIL exists in current general circulation models (GCMs) and meteorological analyses. Only a weak hint of a TIL exists in NCEP/NCAR reanalysis data. In contrast, the Canadian Middle Atmosphere Model (CMAM), a comprehensive GCM, exhibits a TIL of realistic strength. However, in data assimilation mode CMAM exhibits a much weaker TIL, especially in the Southern Hemisphere where only coarse satellite data are available. The discrepancy between the analyses and the GCM is thus hypothesized to be mainly due to data assimilation acting to smooth the observed strong curvature in temperature around the tropopause. This is confirmed in the reanalysis where the stratification around the tropopause exhibits a strong discontinuity at the start of the satellite era.

Orographic drag associated with lee waves trapped at an inversion

The drag produced by 2D orographic gravity waves trapped at a temperature inversion and waves propagating in the stably stratified layer existing above are explicitly calculated using linear theory, for a two-layer atmosphere with neutral static stability near the surface, mimicking a well-mixed boundary layer. For realistic values of the flow parameters, trapped lee wave drag, which is given by a closed analytical expression, is comparable to propagating wave drag, especially in moderately to strongly non-hydrostatic conditions. In resonant flow, both drag components substantially exceed the single-layer hydrostatic drag estimate used in most parametrization schemes. Both drag components are optimally amplified for a relatively low-level inversion and Froude numbers Fr ≈ 1. While propagating wave drag is maximized for approximately hydrostatic flow, trapped lee wave drag is maximized for l_2 a = O(1) (where l_2 is the Scorer parameter in the stable layer and a is the mountain width). This roughly happens when the horizontal scale of trapped lee waves matches that of the mountain slope. The drag behavior as a function of Fr for l_2 H = 0.5 (where H is the inversion height) and different values of l2a shows good agreement with numerical simulations. Regions of parameter space with high trapped lee wave drag correlate reasonably well with those where lee wave rotors were found to occur in previous nonlinear numerical simulations including frictional effects. This suggests that trapped lee wave drag, besides giving a relevant contribution to low-level drag exerted on the atmosphere, may also be useful to diagnose lee rotor formation.

Variation, asymmetry and working memory in the process of second language acquisition

Calls for understanding the interface between L2 linguistic knowledge and development (Gregg 1996; Carroll 2001; Towell 2003) provide a context for analysing the role of memory (Paradis 2004), specifically working memory (Baddeley 1986, 2003) in L2 development. Miyake and Friedman (1998) have claimed that Working Memory (WM) may be the key to L2 acquisition, especially in explaining individual variation in L2 acquisition. Recent findings found a robust connection between greater working memory (WM) capacity and rapid, successful acquisition of L2 vocabulary, reading and oral fluency (Service 1992; Harrington and Sawyer 1992; Fortkamp 1999). This study adds to the growing body of research by investigating correlations between WM and variation in grammatical development, focusing on asymmetries in processing L2 English wh-constructions in an immersion setting.