Optimal control of arrivals to queues with delayed queue length information

We consider discrete-time versions of two classical problems in the optimal control of admission to a queueing system: i) optimal routing of arrivals to two parallel queues and ii) optimal acceptance/rejection of arrivals to a single queue. We extend the formulation of these problems to permit a k step delay in the observation of the queue lengths by the controller. For geometric inter-arrival times and geometric service times the problems are formulated as controlled Markov chains with expected total discounted cost as the minimization objective. For problem i) we show that when k = 1, the optimal policy is to allocate an arrival to the queue with the smaller expected queue length (JSEQ: Join the Shortest Expected Queue). We also show that for this problem, for k greater than or equal to 2, JSEQ is not optimal. For problem ii) we show that when k = 1, the optimal policy is a threshold policy. There are, however, two thresholds m(0) greater than or equal to m(1) > 0, such that mo is used when the previous action was to reject, and mi is used when the previous action was to accept.

Continuous-time Single Network Adaptive Critic for Regulator Design of Nonlinear Control Affine Systems

An optimal control law for a general nonlinear system can be obtained by solving Hamilton-Jacobi-Bellman equation. However, it is difficult to obtain an analytical solution of this equation even for a moderately complex system. In this paper, we propose a continuoustime single network adaptive critic scheme for nonlinear control affine systems where the optimal cost-to-go function is approximated using a parametric positive semi-definite function. Unlike earlier approaches, a continuous-time weight update law is derived from the HJB equation. The stability of the system is analysed during the evolution of weights using Lyapunov theory. The effectiveness of the scheme is demonstrated through simulation examples.

Partially integrated guidance and control of an air-dropped guided munition with explicit trajectory fixing

An innovative partially integrated guidance and control (PIGC) technique is developed for trajectory fixing by considering six degree-of-freedom (Six-DOF) nonlinear engagement dynamics for successful interception of ground targets by guided munitions. This trajectory fixing algorithm gives closed form solution, where two different trajectories are designed in x - h and x - y planes separately using simple quadratic equations. In order to follow designed trajectories commanded pitch and yaw rates are generated in outer loop using dynamic inversion technique. In inner loop these body rates are tracked using faster dynamic inversion loop by generating the necessary control surface deflections. Simulation studies with actuator dynamics have been carried out to account for three dimensional (3D) engagement geometry to demonstrate the usefulness of PIGC technique.

Adaptive variable structure control law for a variable speed wind turbine

Presentado en el 13th WSEAS International Conference on Automatic Control, Modelling and Simulation, ACMOS'11