Temporal difference models describe higher-order learning in humans.

The ability to use environmental stimuli to predict impending harm is critical for survival. Such predictions should be available as early as they are reliable. In pavlovian conditioning, chains of successively earlier predictors are studied in terms of higher-order relationships, and have inspired computational theories such as temporal difference learning. However, there is at present no adequate neurobiological account of how this learning occurs. Here, in a functional magnetic resonance imaging (fMRI) study of higher-order aversive conditioning, we describe a key computational strategy that humans use to learn predictions about pain. We show that neural activity in the ventral striatum and the anterior insula displays a marked correspondence to the signals for sequential learning predicted by temporal difference models. This result reveals a flexible aversive learning process ideally suited to the changing and uncertain nature of real-world environments. Taken with existing data on reward learning, our results suggest a critical role for the ventral striatum in integrating complex appetitive and aversive predictions to coordinate behaviour.

An investigation of higher-order multi-objective optimisation for 3D aerodynamic shape design

We investigate the performance of different variants of a suitably tailored Tabu Search optimisation algorithm on a higher-order design problem. We consider four objective func- tions to describe the performance of a compressor stator row, subject to a number of equality and inequality constraints. The same design problem has been previously in- vestigated through single-, bi- and three-objective optimisation studies. However, in this study we explore the capabilities of enhanced variants of our Multi-objective Tabu Search (MOTS) optimisation algorithm in the context of detailed 3D aerodynamic shape design. It is shown that with these enhancements to the local search of the MOTS algorithm we can achieve a rapid exploration of complicated design spaces, but there is a trade-off be- tween speed and the quality of the trade-off surface found. Rapidly explored design spaces reveal the extremes of the objective functions, but the compromise optimum areas are not very well explored. However, there are ways to adapt the behaviour of the optimiser and maintain both a very efficient rate of progress towards the global optimum Pareto front and a healthy number of design configurations lying on the trade-off surface and exploring the compromise optimum regions. These compromise solutions almost always represent the best qualitative balance between the objectives under consideration. Such enhancements to the effectiveness of design space exploration make engineering design optimisation with multiple objectives and robustness criteria ever more practicable and attractive for modern advanced engineering design. Finally, new research questions are addressed that highlight the trade-offs between intelligence in optimisation algorithms and acquisition of qualita- tive information through computational engineering design processes that reveal patterns and relations between design parameters and objective functions, but also speed versus optimum quality. © 2012 AIAA.

Aeroacoustic source measurement methods for characterizing the sound generated by ducted flow devices with higher-order modes.

The International Organization for Standardization (ISO) method 5136 is widely used in industry and academia to determine the sound power radiated into a duct by fans and other flow devices. The method involves placing the device at the center of a long cylindrical duct with anechoic terminations at each end to eliminate reflections. A single off-axis microphone is used on the inlet and outlet sides that can theoretically capture the plane-wave mode amplitudes but this does not provide enough information to fully account for higher-order modes. In this study, the "two-port" source model is formulated to include higher-order modes and applied for the first three modes. This requires six independent surface pressure measurements on each side or "port." The resulting experimental set-up is much shorter than the ISO rig and does not require anechoic terminations. An array of six external loudspeaker sources is used to characterize the passive part of the two-port model and the set-up provides a framework to account for transmission of higher-order modes through a fan. The relative importance of the higher-order modes has been considered and their effect on inaccuracies when using the ISO method to find source sound power has been analyzed.

Finite Element studies on indentation size effect using a higher order strain gradient theory

In this work, a Finite Element implementation of a higher order strain gradient theory (due to Fleck and Hutchinson, 2001) has been used within the framework of large deformation elasto-viscoplasticity to study the indentation of metals with indenters of various geometries. Of particular interest is the indentation size effect (ISE) commonly observed in experiments where the hardness of a range of materials is found to be significantly higher at small depths of indentation but reduce to a lower, constant value at larger depths. That the ISE can be explained by strain gradient plasticity is well known but this work aims to qualitatively compare a gamut of experimental observations on this effect with predictions from a higher order strain gradient theory. Results indicate that many of the experimental observations are qualitatively borne out by our simulations. However, areas exist where conflicting experimental results make assessment of numerical predictions difficult. © 2012 Elsevier Ltd. All rights reserved.

Local Frustration Determines Molecular and Macroscopic Helix Structures

The effect of displaying cytochromes from an amyloid fibre is modelled as perturbation of -strands in a bilayer of helical -sheets, thereby explaining the spiral morphology of decorated amyloid and the dynamic response of morphology to cytochrome conformation. The morphology of the modelled fibre, which consists of minimal energy assemblies of rigid building blocks containing two anisotropic interacting units, depends primarily on the rigid constraints between units rather than the soft interactions between them. The framework is a discrete version of the bilayered frustration principle that drives morphology in Bauhinia seedpods. We show that self-assembly of frustrated long range structures can occur if the building blocks themselves are internally frustrated, e.g. amyloid morphology is governed by the conformation of the misfolded protein nucleating the fibre. Our model supports the idea that any peptide sequence can form amyloid if bilayers can form first, albeit stabilised by additional material such as chaperones or cytochromes. Analysis of experimentally derived amyloid structures supports our conclusions and suggests a range of frustration effects, which natural amyloid fibres may exploit. From this viewpoint, amyloid appears as a molecular example of a more general universal bilayered frustration principle, which may have profound implications for materials design using fibrous systems. Our model provides quantitative guidance for such applications. The relevance to longer length scales was proved by designing the morphology of a series of macroscopic magnetic stacks. Finally, this work leads to the idea of mixing controlled morphologically defined species to generate higher-order assembly and complex functional behaviour. The systematic kinking of decorated fibres and the nested frustration of the Bauhinia seed pod are two outstanding examples.

Slow peaking and low-gain designs for global stabilization of nonlinear systems

This paper presents an analysis of the slow-peaking phenomenon, a pitfall of low-gain designs that imposes basic limitations to large regions of attraction in nonlinear control systems. The phenomenon is best understood on a chain of integrators perturbed by a vector field up(x, u) that satisfies p(x, 0) = 0. Because small controls (or low-gain designs) are sufficient to stabilize the unperturbed chain of integrators, it may seem that smaller controls, which attenuate the perturbation up(x, u) in a large compact set, can be employed to achieve larger regions of attraction. This intuition is false, however, and peaking may cause a loss of global controllability unless severe growth restrictions are imposed on p(x, u). These growth restrictions are expressed as a higher order condition with respect to a particular weighted dilation related to the peaking exponents of the nominal system. When this higher order condition is satisfied, an explicit control law is derived that achieves global asymptotic stability of x = 0. This stabilization result is extended to more general cascade nonlinear systems in which the perturbation p(x, v) v, v = (ξ, u) T, contains the state ξ and the control u of a stabilizable subsystem ξ = a(ξ, u). As an illustration, a control law is derived that achieves global stabilization of the frictionless ball-and-beam model.