Temporal difference models describe higher-order learning in humans.

The ability to use environmental stimuli to predict impending harm is critical for survival. Such predictions should be available as early as they are reliable. In pavlovian conditioning, chains of successively earlier predictors are studied in terms of higher-order relationships, and have inspired computational theories such as temporal difference learning. However, there is at present no adequate neurobiological account of how this learning occurs. Here, in a functional magnetic resonance imaging (fMRI) study of higher-order aversive conditioning, we describe a key computational strategy that humans use to learn predictions about pain. We show that neural activity in the ventral striatum and the anterior insula displays a marked correspondence to the signals for sequential learning predicted by temporal difference models. This result reveals a flexible aversive learning process ideally suited to the changing and uncertain nature of real-world environments. Taken with existing data on reward learning, our results suggest a critical role for the ventral striatum in integrating complex appetitive and aversive predictions to coordinate behaviour.

An investigation of higher-order multi-objective optimisation for 3D aerodynamic shape design

We investigate the performance of different variants of a suitably tailored Tabu Search optimisation algorithm on a higher-order design problem. We consider four objective func- tions to describe the performance of a compressor stator row, subject to a number of equality and inequality constraints. The same design problem has been previously in- vestigated through single-, bi- and three-objective optimisation studies. However, in this study we explore the capabilities of enhanced variants of our Multi-objective Tabu Search (MOTS) optimisation algorithm in the context of detailed 3D aerodynamic shape design. It is shown that with these enhancements to the local search of the MOTS algorithm we can achieve a rapid exploration of complicated design spaces, but there is a trade-off be- tween speed and the quality of the trade-off surface found. Rapidly explored design spaces reveal the extremes of the objective functions, but the compromise optimum areas are not very well explored. However, there are ways to adapt the behaviour of the optimiser and maintain both a very efficient rate of progress towards the global optimum Pareto front and a healthy number of design configurations lying on the trade-off surface and exploring the compromise optimum regions. These compromise solutions almost always represent the best qualitative balance between the objectives under consideration. Such enhancements to the effectiveness of design space exploration make engineering design optimisation with multiple objectives and robustness criteria ever more practicable and attractive for modern advanced engineering design. Finally, new research questions are addressed that highlight the trade-offs between intelligence in optimisation algorithms and acquisition of qualita- tive information through computational engineering design processes that reveal patterns and relations between design parameters and objective functions, but also speed versus optimum quality. © 2012 AIAA.

Aeroacoustic source measurement methods for characterizing the sound generated by ducted flow devices with higher-order modes.

The International Organization for Standardization (ISO) method 5136 is widely used in industry and academia to determine the sound power radiated into a duct by fans and other flow devices. The method involves placing the device at the center of a long cylindrical duct with anechoic terminations at each end to eliminate reflections. A single off-axis microphone is used on the inlet and outlet sides that can theoretically capture the plane-wave mode amplitudes but this does not provide enough information to fully account for higher-order modes. In this study, the "two-port" source model is formulated to include higher-order modes and applied for the first three modes. This requires six independent surface pressure measurements on each side or "port." The resulting experimental set-up is much shorter than the ISO rig and does not require anechoic terminations. An array of six external loudspeaker sources is used to characterize the passive part of the two-port model and the set-up provides a framework to account for transmission of higher-order modes through a fan. The relative importance of the higher-order modes has been considered and their effect on inaccuracies when using the ISO method to find source sound power has been analyzed.

Finite Element studies on indentation size effect using a higher order strain gradient theory

In this work, a Finite Element implementation of a higher order strain gradient theory (due to Fleck and Hutchinson, 2001) has been used within the framework of large deformation elasto-viscoplasticity to study the indentation of metals with indenters of various geometries. Of particular interest is the indentation size effect (ISE) commonly observed in experiments where the hardness of a range of materials is found to be significantly higher at small depths of indentation but reduce to a lower, constant value at larger depths. That the ISE can be explained by strain gradient plasticity is well known but this work aims to qualitatively compare a gamut of experimental observations on this effect with predictions from a higher order strain gradient theory. Results indicate that many of the experimental observations are qualitatively borne out by our simulations. However, areas exist where conflicting experimental results make assessment of numerical predictions difficult. © 2012 Elsevier Ltd. All rights reserved.

A review on slip models for gas microflows

Accurate modeling of gas microflow is crucial for the microfluidic devices in MEMS. Gas microflows through these devices are often in the slip and transition flow regimes, characterized by the Knudsen number of the order of 10-2∼100. An increasing number of researchers now dedicate great attention to the developments in the modeling of non-equilibrium boundary conditions in the gas microflows, concentrating on the slip model. In this review, we present various slip models obtained from different theoretical, computational and experimental studies for gas microflows. Correct descriptions of the Knudsen layer effect are of critical importance in modeling and designing of gas microflow systems and in predicting their performances. Theoretical descriptions of the gas-surface interaction and gas-surface molecular interaction models are introduced to describe the boundary conditions. Various methods and techniques for determination of the slip coefficients are reviewed. The review presents the considerable success in the implementation of various slip boundary conditions to extend the Navier-Stokes (N-S) equations into the slip and transition flow regimes. Comparisons of different values and formulations of the first- and second-order slip coefficients and models reveal the discrepancies arising from different definitions in the first-order slip coefficient and various approaches to determine the second-order slip coefficient. In addition, no consensus has been reached on the correct and generalized form of higher-order slip expression. The influences of specific effects, such as effective mean free path of the gas molecules and viscosity, surface roughness, gas composition and tangential momentum accommodation coefficient, on the hybrid slip models for gas microflows are analyzed and discussed. It shows that although the various hybrid slip models are proposed from different viewpoints, they can contribute to N-S equations for capturing the high Knudsen number effects in the slip and transition flow regimes. Future studies are also discussed for improving the understanding of gas microflows and enabling us to exactly predict and actively control gas slip. © Springer-Verlag 2012.