Second-Order Training of Adaptive Critics for Online Process Control

A new algorithm for training of nonlinear optimal neuro-controllers (in the form of the model-free, action-dependent, adaptive critic paradigm). Overcomes problems with existing stochastic backpropagation training: need for data storage, parameter shadowing and poor convergence, offering significant benefits for online applications.

Quantum control of photodissociation using intense, femtosecond pulses shaped with third order dispersion

We demonstrate the ability to control the molecular dissociation rate using femtosecond pulses shaped with third-order dispersion (TOD). Explicitly, a significant 50% enhancement in the dissociation yield for the low lying vibrational levels (v ∼ 6) of an H+2 ion-beam target was measured as a function of TOD. The underlying mechanism responsible for this enhanced dissociation was theoretically identified as non-adiabatic alignment induced by the pre-pulses situated on the leading edge of pulses shaped with negative TOD. This control scheme is expected to work in other molecules as it does not rely on specific characteristics of our test-case H+2 molecule.

A novel approach to dynamic modelling of polymer extrusion for improved process control

Polymer extrusion is a complex process and the availability of good dynamic models is key for improved system operation. Previous modelling attempts have failed adequately to capture the non-linearities of the process or prove too complex for control applications. This work presents a novel approach to the problem by the modelling of extrusion viscosity and pressure, adopting a grey box modelling technique that combines mechanistic knowledge with empirical data using a genetic algorithm approach. The models are shown to outperform those of a much higher order generated by a conventional black box technique while providing insight into the underlying processes at work within the extruder.

Dynamic control of laser-produced proton beams

The emission characteristics of intense laser driven protons are controlled using ultrastrong (of the order of 10(9) V/m) electrostatic fields varying on a few ps time scale. The field structures are achieved by exploiting the high potential of the target (reaching multi-MV during the laser interaction). Suitably shaped targets result in a reduction in the proton beam divergence, and hence an increase in proton flux while preserving the high beam quality. The peak focusing power and its temporal variation are shown to depend on the target characteristics, allowing for the collimation of the inherently highly divergent beam and the design of achromatic electrostatic lenses.

An agent-based control mechanism for WFQ in IP networks

This paper presents a new packet scheduling scheme called agent-based WFQ to control and maintain QoS parameters in virtual private networks (VPNs) within the confines of adaptive networks. Future networks are expected to be open heterogeneous environments consisting of more than one network operator. In this adaptive environment, agents act on behalf of users or third-party operators to obtain the best service for their clients and maintain those services through the modification of the scheduling scheme in routers and switches spanning the VPN. In agent-based WFQ, an agent on the router monitors the accumulated queuing delay for each service. In order to control and to keep the end-to-end delay within the bounds, the weights for services are adjusted dynamically by agents on the routers spanning the VPN. If there is an increase or decrease in queuing delay of a service, an agent on a downstream router informs the upstream routers to adjust the weights of their queues. This keeps the end-to-end delay of services within the specified bounds and offers better QoS compared to VPNs using static WFQ. This paper also describes the algorithm for agent-based WFQ, and presents simulation results. (C) 2003 Elsevier Science Ltd. All rights reserved.

A hierarchical physical model-based approach to predictive control of a thermal power plant for efficient plant-wide disturbance rejection

Extending the work presented in Prasad et al. (IEEE Proceedings on Control Theory and Applications, 147, 523-37, 2000), this paper reports a hierarchical nonlinear physical model-based control strategy to account for the problems arising due to complex dynamics of drum level and governor valve, and demonstrates its effectiveness in plant-wide disturbance handling. The strategy incorporates a two-level control structure consisting of lower-level conventional PI regulators and a higher-level nonlinear physical model predictive controller (NPMPC) for mainly set-point manoeuvring. The lower-level PI loops help stabilise the unstable drum-boiler dynamics and allow faster governor valve action for power and grid-frequency regulation. The higher-level NPMPC provides an optimal load demand (or set-point) transition by effective handling of plant-wide interactions and system disturbances. The strategy has been tested in a simulation of a 200-MW oil-fired power plant at Ballylumford in Northern Ireland. A novel approach is devized to test the disturbance rejection capability in severe operating conditions. Low frequency disturbances were created by making random changes in radiation heat flow on the boiler-side, while condenser vacuum was fluctuating in a random fashion on the turbine side. In order to simulate high-frequency disturbances, pulse-type load disturbances were made to strike at instants which are not an integral multiple of the NPMPC sampling period. Impressive results have been obtained during both types of system disturbances and extremely high rates of load changes, right across the operating range, These results compared favourably with those from a conventional state-space generalized predictive control (GPC) method designed under similar conditions.

Plant-wide predictive control for a thermal power plant based on a physical plant model

A constrained non-linear, physical model-based, predictive control (NPMPC) strategy is developed for improved plant-wide control of a thermal power plant. The strategy makes use of successive linearisation and recursive state estimation using extended Kalman filtering to obtain a linear state-space model. The linear model and a quadratic programming routine are used to design a constrained long-range predictive controller One special feature is the careful selection of a specific set of plant model parameters for online estimation, to account for time-varying system characteristics resulting from major system disturbances and ageing. These parameters act as nonstationary stochastic states and help to provide sufficient degrees-of-freedom to obtain unbiased estimates of controlled outputs. A 14th order non-linear plant model, simulating the dominant characteristics of a 200 MW oil-fired pou er plant has been used to test the NPMPC algorithm. The control strategy gives impressive simulation results, during large system disturbances and extremely high rate of load changes, right across the operating range. These results compare favourably to those obtained with the state-space GPC method designed under similar conditions.

Testing the role of expansion in the prospective control of locomotion

The constant bearing angle (CBA) strategy is a prospective strategy that permits the interception of moving objects. The purpose of the present study is to test this strategy. Participants were asked to walk through a virtual environment and to change, if necessary, their walking speed so as to intercept approaching targets. The targets followed either a rectilinear or a curvilinear trajectory and target size was manipulated both within trials (target size was gradually changed during the trial in order to bias expansion) and between trials (targets of different sizes were used). The curvature manipulation had a large effect on the kinematics of walking, which is in agreement with the CBA strategy. The target size manipulations also affected the kinematics of walking. Although these effects of target size are not predicted by the CBA strategy, quantitative comparisons of observed kinematics and the kinematics predicted by the CBA strategy showed good fits. Furthermore, predictions based on the CBA strategy were deemed superior to predictions based on a required velocity (V-REQ) model. The role of target size and expansion in the prospective control of walking is discussed.

Hybridization of a class of "second order" models of traffic flow

Despite the simultaneous progress of traffic modelling both on the macroscopic and microscopic front, recent works [E. Bourrel, J.B. Lessort, Mixing micro and macro representation of traffic flow: a hybrid model based on the LWR theory, Transport. Res. Rec. 1852 (2003) 193–200; D. Helbing, M. Treiber, Critical discussion of “synchronized flow”, Coop. Transport. Dyn. 1 (2002) 2.1–2.24; A. Hennecke, M. Treiber, D. Helbing, Macroscopic simulations of open systems and micro–macro link, in: D. Helbing, H.J. Herrmann, M. Schreckenberg, D.E. Wolf (Eds.), Traffic and Granular Flow ’99, Springer, Berlin, 2000, pp. 383–388] highlighted that one of the most promising way to simulate efficiently traffic flow on large road networks is a clever combination of both traffic representations: the hybrid modelling. Our focus in this paper is to propose two hybrid models for which the macroscopic (resp. mesoscopic) part is based on a class of second order model [A. Aw, M. Rascle, Resurection of second order models of traffic flow?, SIAM J. Appl. Math. 60 (2000) 916–938] whereas the microscopic part is a Follow-the Leader type model [D.C. Gazis, R. Herman, R.W. Rothery, Nonlinear follow-the-leader models of traffic flow, Oper. Res. 9 (1961) 545–567; R. Herman, I. Prigogine, Kinetic Theory of Vehicular Traffic, American Elsevier, New York, 1971]. For the first hybrid model, we define precisely the translation of boundary conditions at interfaces and for the second one we explain the synchronization processes. Furthermore, through some numerical simulations we show that the waves propagation is not disturbed and the mass is accurately conserved when passing from one traffic representation to another.

Neonatal control of sucking pressures

Human newborns appear to regulate sucking pressure when bottle feeding by employing, with similar precision, the same principle of control evidenced by adults in skilled behavior, such as reaching (Lee et al., 1998a). In particular, the present study of 12 full-term newborn infants indicated that the intraoral sucking pressures followed an internal dynamic prototype - an intrinsic tau-guide. The intrinsic tau-guide, a recent hypothesis of general tau theory is a time-varying quantity, tau(g), assumed to be generated within the nervous system. It corresponds to some quantity (e.g., electrical charge), chang ing with a constant second-order temporal derivative from a rest level to a goal level, in the sense that tau(g) equals tau of the gap between the quantity and its goal level at each time t. (tau of a gap is the rime-to-closure of the gap at the current closure-rate.) According to the hypoth esis, the infant senses tau(p), the tau of the gap between the current intraoral pressure and its goal level, and regulates intraoral pressure so that tau(p) and tau(g) remain coupled in a constant ratio, k; i.e., tau(p) = k tau(g). With k in the range 0-1, the tau-coupling would result in a bell-shaped rate of change pressure profile, as was, in fact, found. More specifically, the high mean r(2) values obtained when regressing tau(p) on tau(g), for both the increasing and decreasing suction periods of the infants' suck, supported a strong tau-coupling between tau(p) and tau(g). The mean k values were significantly higher In the Increasing suction period, indicating that the ending of the movement was more forceful, a finding which makes sense given the different functions of the two periods of the suck.

Order without law? An anatomy of Hamas security: The Executive Force (Tanfithya)

In the struggle to assert and consolidate its power, the Hamas movement of the Palestinian territories has devised several strategies for control. In recognition that control of security remains a key goal for any power-seeker, following its election victory in January 2006, Hamas entered into a fierce and ultimately successful conflict with Fatah for control of the Palestinian Authority Ministry of Interior and Palestinian Security Forces (PSF) in the Gaza Strip. One way in which Hamas was able to achieve this objective was through the creation of its own internal ‘police’ force called the Tanfithya (Executive Force or EF). This article details an anatomy of the EF and the implications of this force in terms of Hamas' confrontation with opponents and its attempts at governance. It also examines the extent to which the EF can be considered to be a model of Islamic policing and its impact on secular rivals in the Gaza Strip.