Risk-sensitive optimal feedback control accounts for sensorimotor behavior under uncertainty.

Many aspects of human motor behavior can be understood using optimality principles such as optimal feedback control. However, these proposed optimal control models are risk-neutral; that is, they are indifferent to the variability of the movement cost. Here, we propose the use of a risk-sensitive optimal controller that incorporates movement cost variance either as an added cost (risk-averse controller) or as an added value (risk-seeking controller) to model human motor behavior in the face of uncertainty. We use a sensorimotor task to test the hypothesis that subjects are risk-sensitive. Subjects controlled a virtual ball undergoing Brownian motion towards a target. Subjects were required to minimize an explicit cost, in points, that was a combination of the final positional error of the ball and the integrated control cost. By testing subjects on different levels of Brownian motion noise and relative weighting of the position and control cost, we could distinguish between risk-sensitive and risk-neutral control. We show that subjects change their movement strategy pessimistically in the face of increased uncertainty in accord with the predictions of a risk-averse optimal controller. Our results suggest that risk-sensitivity is a fundamental attribute that needs to be incorporated into optimal feedback control models.

Learning optimal adaptation strategies in unpredictable motor tasks.

Picking up an empty milk carton that we believe to be full is a familiar example of adaptive control, because the adaptation process of estimating the carton's weight must proceed simultaneously with the control process of moving the carton to a desired location. Here we show that the motor system initially generates highly variable behavior in such unpredictable tasks but eventually converges to stereotyped patterns of adaptive responses predicted by a simple optimality principle. These results suggest that adaptation can become specifically tuned to identify task-specific parameters in an optimal manner.

Optimal H2 order-one reduction by solving eigenproblems for polynomial equations

A method is given for solving an optimal H2 approximation problem for SISO linear time-invariant stable systems. The method, based on constructive algebra, guarantees that the global optimum is found; it does not involve any gradient-based search, and hence avoids the usual problems of local minima. We examine mostly the case when the model order is reduced by one, and when the original system has distinct poles. This case exhibits special structure which allows us to provide a complete solution. The problem is converted into linear algebra by exhibiting a finite-dimensional basis for a certain space, and can then be solved by eigenvalue calculations, following the methods developed by Stetter and Moeller. The use of Buchberger's algorithm is avoided by writing the first-order optimality conditions in a special form, from which a Groebner basis is immediately available. Compared with our previous work the method presented here has much smaller time and memory requirements, and can therefore be applied to systems of significantly higher McMillan degree. In addition, some hypotheses which were required in the previous work have been removed. Some examples are included.

Risk-sensitive optimal feedback control accounts for sensorimotor behavior under uncertainty

Many aspects of human motor behavior can be understood using optimality principles such as optimal feedback control. However, these proposed optimal control models are risk-neutral; that is, they are indifferent to the variability of the movement cost. Here, we propose the use of a risk-sensitive optimal controller that incorporates movement cost variance either as an added cost (risk-averse controller) or as an added value (risk-seeking controller) to model human motor behavior in the face of uncertainty. We use a sensorimotor task to test the hypothesis that subjects are risk-sensitive. Subjects controlled a virtual ball undergoing Brownian motion towards a target. Subjects were required to minimize an explicit cost, in points, that was a combination of the final positional error of the ball and the integrated control cost. By testing subjects on different levels of Brownian motion noise and relative weighting of the position and control cost, we could distinguish between risk-sensitive and risk-neutral control. We show that subjects change their movement strategy pessimistically in the face of increased uncertainty in accord with the predictions of a risk-averse optimal controller. Our results suggest that risk-sensitivity is a fundamental attribute that needs to be incorporated into optimal feedback control models. © 2010 Nagengast et al.

Multi-objective foundation optimization and its application to pile reuse

Pile reuse has become an increasingly popular option in foundation design, mainly due to its potential cost and environmental benefits and the problem of underground congestion in urban areas. However, key geotechnical concerns remain regarding the behavior of reused piles and the modeling of foundation systems involving old and new piles to support building loads of the new structure. In this paper, a design and analysis tool for pile reuse projects will be introduced. The tool allows coupling of superstructure stiffness with the foundation model, and includes an optimization algorithm to obtain the best configuration of new piles to work alongside reused piles. Under the concept of Pareto Optimality, multi-objective optimization analyses can also reveal the relationship between material usage and the corresponding foundation performance, providing a series of reuse options at various foundation costs. The components of this analysis tool will be discussed and illustrated through a case history in London, where 110 existing piles are reused at a site to support the proposed new development. The case history reveals the difficulties faced by foundation reuse in urban areas and demonstrates the application of the design tool to tackle these challenges. © ASCE 2011.

Comparing crowding in human and ideal observers.

A visual target is more difficult to recognize when it is surrounded by other, similar objects. This breakdown in object recognition is known as crowding. Despite a long history of experimental work, computational models of crowding are still sparse. Specifically, few studies have examined crowding using an ideal-observer approach. Here, we compare crowding in ideal observers with crowding in humans. We derived an ideal-observer model for target identification under conditions of position and identity uncertainty. Simulations showed that this model reproduces the hallmark of crowding, namely a critical spacing that scales with viewing eccentricity. To examine how well the model fits quantitatively to human data, we performed three experiments. In Experiments 1 and 2, we measured observers' perceptual uncertainty about stimulus positions and identities, respectively, for a target in isolation. In Experiment 3, observers identified a target that was flanked by two distractors. We found that about half of the errors in Experiment 3 could be accounted for by the perceptual uncertainty measured in Experiments 1 and 2. The remainder of the errors could be accounted for by assuming that uncertainty (i.e., the width of internal noise distribution) about stimulus positions and identities depends on flanker proximity. Our results provide a mathematical restatement of the crowding problem and support the hypothesis that crowding behavior is a sign of optimality rather than a perceptual defect.

CLF based designs with robustness to dynamic input uncertainties

The problem of robust stabilization of nonlinear systems in the presence of input uncertainties is of great importance in practical implementation. Stabilizing control laws may not be robust to this type of uncertainty, especially if cancellation of nonlinearities is used in the design. By exploiting a connection between robustness and optimality, "domination redesign" of the control Lyapunov function (CLF) based Sontag's formula has been shown to possess robustness to static and dynamic input uncertainties. In this paper we provide a sufficient condition for the domination redesign to apply. This condition relies on properties of local homogeneous approximations of the system and of the CLF. We show that an inverse optimal control law may not exist when these conditions are violated and illustrate how these conditions may guide the choice of a CLF which is suitable for domination redesign. © 1999 Elsevier Science B.V. All rights reserved.

Constructive Nonlinear Control

In this book several streams of nonlinear control theory are merged and di- rected towards a constructive solution of the feedback stabilization problem. Analytic, geometric and asymptotic concepts are assembled as design tools for a wide variety of nonlinear phenomena and structures. Di®erential-geometric concepts reveal important structural properties of nonlinear systems, but al- low no margin for modeling errors. To overcome this de¯ciency, we combine them with analytic concepts of passivity, optimality and Lyapunov stability. In this way geometry serves as a guide for construction of design procedures, while analysis provides robustness tools which geometry lacks.

On the effects of turbulence modelling in design optimisation for high-lift devices

Aerodynamic shape optimisation is being increasingly utilised as a design tool in the aerospace industry. In order to provide accurate results, design optimisation methods rely on the accuracy of the underlying CFD methods applied to obtain aerodynamic forces for a given configuration. Previous studies of the authors have highlighted that the variation of the order of accuracy of the CFD solver with a fixed turbulence model affects the resulting optimised airfoil shape for a single element airfoil. The accuracy of the underlying CFD model is even more relevant in the context of high-lift configurations where an accurate prediction of flow is challenging due to the complex flow physics involving transition and flow separation phenomena. This paper explores the effect of the fidelity of CFD results for a range of turbulence models within the context of the computational design of aircraft configurations. The NLR7301 multi-element airfoil (main wing and flap) is selected as the baseline configuration, because of the wealth of experimental an computational results available for this configuration. An initial validation study is conducted in order to establish optimal mesh parameters. A bi-objective shape optimisation problem is then formulated, by trying to reveal the trade-off between lift and drag coefficients at high angles of attack. Optimisation of the airfoil shape is performed with Spalart-Allmaras, k - ω SST and k - o realisable models. The results indicate that there is consistent and complementary impact to the optimum level achieved from all the three different turbulence models considered in the presented case study. Without identifying particular superiority of any of the turbu- lence models, we can say though that each of them expressed favourable influence towards different optimality routes. These observations lead to the exploration of new avenues for future research. © 2012 AIAA.

On the effects of turbulence modelling in design optimisation for high-lift devices

Aerodynamic shape optimisation is being increasingly utilised as a design tool in the aerospace industry. In order to provide accurate results, design optimisation methods rely on the accuracy of the underlying CFD methods applied to obtain aerodynamic forces for a given configuration. Previous studies of the authors have highlighted that the variation of the order of accuracy of the CFD solver with a fixed turbulence model affects the resulting optimised airfoil shape for a single element airfoil. The accuracy of the underlying CFD model is even more relevant in the context of high-lift configurations where an accurate prediction of flow is challenging due to the complex flow physics involving transition and flow separation phenomena. This paper explores the effect of the fidelity of CFD results for a range of turbulence models within the context of the computational design of aircraft configurations. The NLR7301 multi-element airfoil (main wing and flap) is selected as the baseline configuration, because of the wealth of experimental an computational results available for this configuration. An initial validation study is conducted in order to establish optimal mesh parameters. A bi-objective shape optimisation problem is then formulated, by trying to reveal the trade-off between lift and drag coefficients at high angles of attack. Optimisation of the airfoil shape is performed with Spalart-Allmaras, k - ω SST and k - ε realisable models. The results indicate that there is consistent and complementary impact to the optimum level achieved from all the three different turbulence models considered in the presented case study. Without identifying particular superiority of any of the turbu- lence models, we can say though that each of them expressed favourable influence towards different optimality routes. These observations lead to the exploration of new avenues for future research. © 2012 by the authors.

Multispacecraft refueling optimization considering the J2 perturbation and window constraints

The optimization of a near-circular low-Earth-orbit multispacecraft refueling problem is studied. The refueling sequence, service time, and orbital transfer time are used as design variables, whereas the mean mission completion time and mean propellant consumed by orbital maneuvers are used as design objectives. The J2 term of the Earth's nonspherical gravity perturbation and the constraints of rendezvous time windows are taken into account. A hybridencoding genetic algorithm, which uses normal fitness assignment to find the minimum mean propellant-cost solution and fitness assignment based on the concept of Pareto-optimality to find multi-objective optimal solutions, is presented. The proposed approach is demonstrated for a typical multispacecraft refueling problem. The results show that the proposed approach is effective, and that the J2 perturbation and the time-window constraints have considerable influences on the optimization results. For the problems in which the J2 perturbation is not accounted for, the optimal refueling order can be simply determined as a sequential order or as the order only based on orbitalplane differences. In contrast, for the problems that do consider the J2 perturbation, the optimal solutions obtained have a variety of refueling orders and use the drift of nodes effectively to reduce the propellant cost for eliminating orbital-plane differences. © 2013 by the American Institute of Aeronautics and Astronautics, Inc. All rights reserved.

Formal specification and refinement of a safe train control function

Motivated by the design and development challenges of the BART case study, an approach for developing and analyzing a formal model for reactive systems is presented. The approach makes use of a domain specific language for specifying control algorithms able to satisfy competing properties such as safety and optimality. The domain language, called SPC, offers several key abstractions such as the state, the profile, and the constraint to facilitate problem specification. Using a high-level program transformation system such as HATS being developed at the University of Nebraska at Omaha, specifications in this modelling language can be transformed to ML code. The resulting executable specification can be further refined by applying generic transformations to the abstractions provided by the domain language. Problem dependent transformations utilizing the domain specific knowledge and properties may also be applied. The result is a significantly more efficient implementation which can be used for simulation and gaining deeper insight into design decisions and various control policies. The correctness of transformations can be established using a rewrite-rule based induction theorem prover Rewrite Rule Laboratory developed at the University of New Mexico.

Adaptive fading Kalman filter with an application

A new adaptive state estimation algorithm, namely adaptive fading Kalman filter (AFKF), is proposed to solve the divergence problem of Kalman filter. A criterion function is constructed to measure the optimality of Kalman filter. The forgetting factor in AFKF is adaptively adjusted by minimizing the defined criterion function using measured outputs. The algorithm remains convergent and tends to be optimal in the presence of model errors. It has been successfully applied to the headbox of a paper-making machine for state estimation.

多移动机器人实时最优运动规划

研究多移动机器人的实时运动规划问题，提出了运动规划问题的体系结构，并将最优控制与智能决策相结合，建立实时专家系统，在其支持下，使机器人在时间—能量最优情况下完成规划策略。仿真结果表明该方法具有很强的实时性。

Feature Selection based on Rough Sets and Particle Swarm Optimization

X. Wang, J. Yang, X. Teng, W. Xia, and R. Jensen. Feature Selection based on Rough Sets and Particle Swarm Optimization. Pattern Recognition Letters, vol. 28, no. 4, pp. 459-471, 2007.