Adaptive Sleep-Wake Control using Reinforcement Learning in Sensor Networks

The aim in this paper is to allocate the `sleep time' of the individual sensors in an intrusion detection application so that the energy consumption from the sensors is reduced, while keeping the tracking error to a minimum. We propose two novel reinforcement learning (RL) based algorithms that attempt to minimize a certain long-run average cost objective. Both our algorithms incorporate feature-based representations to handle the curse of dimensionality associated with the underlying partially-observable Markov decision process (POMDP). Further, the feature selection scheme used in our algorithms intelligently manages the energy cost and tracking cost factors, which in turn assists the search for the optimal sleeping policy. We also extend these algorithms to a setting where the intruder's mobility model is not known by incorporating a stochastic iterative scheme for estimating the mobility model. The simulation results on a synthetic 2-d network setting are encouraging.

A zero charge-pump mismatch current tracking loop for reference spur reduction in PLLs

The charge-pump (CP) mismatch current is a dominant source of static phase error and reference spur in the nano-meter CMOS PLL implementations due to its worsened channel length modulation effect. This paper presents a charge-pump (CP) mismatch current reduction technique utilizing an adaptive body bias tuning of CP transistors and a zero CP mismatch current tracking PLL architecture for reference spur suppression. A chip prototype of the proposed circuit was implemented in 0.13 mu m CMOS technology. The frequency synthesizer consumes 8.2 mA current from a 13 V supply voltage and achieves a phase noise of -96.01 dBc/Hz @ 1 MHz offset from a 2.4 GHz RF carrier. The charge-pump measurements using the proposed calibration technique exhibited a mismatch current of less than 0.3 mu A (0.55%) over the VCO control voltage range of 0.3-1.0 V. The closed loop measurements show a minimized static phase error of within +/- 70 ps and a similar or equal to 9 dB reduction in reference spur level across the PLL output frequency range 2.4-2.5 GHz. The presented CP calibration technique compensates for the DC current mismatch and the mismatch due to channel length modulation effect and therefore improves the performance of CP-PLLs in nano-meter CMOS implementations. (C) 2015 Elsevier Ltd. All rights reserved.

Effective and Robust Generalized Predictive Speed Control of Induction Motor

14 p.

Sliding mode position control for real-time control of induction motors

A sliding mode position control for high-performance real-time applications of induction motors in developed in this work. The design also incorporates a simple flux estimator in order to avoid the flux sensors. Then, the proposed control scheme presents a low computational cost and therefore can be implemented easily in a real-time applications using a low cost DSP-processor. The stability analysis of the controller under parameter uncertainties and load disturbances in provided using Lyapunov stability theory. Finally, simulated and experimental results show that the proposed controller with the proposed observer provides a good trajectory tracking and that this scheme is robust with respect to plant parameter variations and external load disturbances.

A robust position control for induction machines

ICEM 2010

Control mechanisms in the human binocular oculomotor system

A study of human eye movements was made in order to elucidate the nature of the control mechanism in the binocular oculomotor system.

We first examined spontaneous eye movements during monocular and binocular fixation in order to determine the corrective roles of flicks and drifts. It was found that both types of motion correct fixational errors, although flicks are somewhat more active in this respect. Vergence error is a stimulus for correction by drifts but not by flicks, while binocular vertical discrepancy of the visual axes does not trigger corrective movements.

Second, we investigated the non-linearities of the oculomotor system by examining the eye movement responses to point targets moving in two dimensions in a subjectively unpredictable manner. Such motions consisted of hand-limited Gaussian random motion and also of the sum of several non-integrally related sinusoids. We found that there is no direct relationship between the phase and the gain of the oculomotor system. Delay of eye movements relative to target motion is determined by the necessity of generating a minimum afferent (input) signal at the retina in order to trigger corrective eye movements. The amplitude of the response is a function of the biological constraints of the efferent (output) portion of the system: for target motions of narrow bandwidth, the system responds preferentially to the highest frequency; for large bandwidth motions, the system distributes the available energy equally over all frequencies. Third, the power spectra of spontaneous eye movements were compared with the spectra of tracking eye movements for Gaussian random target motions of varying bandwidths. It was found that there is essentially no difference among the various curves. The oculomotor system tracks a target, not by increasing the mean rate of impulses along the motoneurons of the extra-ocular muscles, but rather by coordinating those spontaneous impulses which propagate along the motoneurons during stationary fixation. Thus, the system operates at full output at all times.

Fourth, we examined the relative magnitude and phase of motions of the left and the right visual axes during monocular and binocular viewing. We found that the two visual axes move vertically in perfect synchronization at all frequencies for any viewing condition. This is not true for horizontal motions: the amount of vergence noise is highest for stationary fixation and diminishes for tracking tasks as the bandwidth of the target motion increases. Furthermore, movements of the occluded eye are larger than those of the seeing eye in monocular viewing. This effect is more pronounced for horizontal motions, for stationary fixation, and for lower frequencies.

Finally, we have related our findings to previously known facts about the pertinent nerve pathways in order to postulate a model for the neurological binocular control of the visual axes.

Evaluation of NRA tracking studies. Future projects and technical development

Fish tracking is a valuable technique for the provision of detailed information on the behaviour patterns of individual fish especially during estuarine and riverine migration. 2. Tracking studies help in the provision of a comprehensive description of the variety offish behaviour patterns in response to factors such as water flow, obstructions and water quality. 3. There are advantages to be gained by complementing fish tracking studies with data collected from fish counters and vice versa. 4. An overall evaluation of NRA fish tracking projects is presented in the wider context of NRA strategic research objectives. 5. The requirement for future development of tracking equipment, improved data analysis techniques, better communication and more immediate report preparation is identified. 6. Individual project evaluation is given for NRA (or the appropriate Water Authority predecessor) tracking studies conducted on the Ribble estuary, the River Tamar, River Torridge, Rivers Test and Itchen, River Lodden, the Welsh River Dee, River Glaslyn, River Taff, River Tawe, River Tywi, River Usk, Rivers Avon and Stour and the River Frome. 7. An outline for future strategic research is provided which identifies particular areas for study:- i) Identification of environmental factors which control the entry of fish into rivers. ii) Improvement of the understanding of the relationship between water flow and upstream movement of salmonids. iii) Examination of the detailed movements and behaviour of fish in relation to obstructions. iv) Closer definition of water quality requirements for salmonid fish. v) Definition of habitat preferences of salmonids in rivers. vi) Subsidiary topics such as the movements of non-salmonid fish and the downstream migration of kelts and juvenile salmonids.

Naturalistic approaches to sensorimotor control.

Human sensorimotor control has been predominantly studied using fixed tasks performed under laboratory conditions. This approach has greatly advanced our understanding of the mechanisms that integrate sensory information and generate motor commands during voluntary movement. However, experimental tasks necessarily restrict the range of behaviors that are studied. Moreover, the processes studied in the laboratory may not be the same processes that subjects call upon during their everyday lives. Naturalistic approaches thus provide an important adjunct to traditional laboratory-based studies. For example, wearable self-contained tracking systems can allow subjects to be monitored outside the laboratory, where they engage spontaneously in natural everyday behavior. Similarly, advances in virtual reality technology allow laboratory-based tasks to be made more naturalistic. Here, we review naturalistic approaches, including perspectives from psychology and visual neuroscience, as well as studies and technological advances in the field of sensorimotor control.

A vision-based remote control

This Chapter presents a vision-based system for touch-free interaction with a display at a distance. A single camera is fixed on top of the screen and is pointing towards the user. An attention mechanism allows the user to start the interaction and control a screen pointer by moving their hand in a fist pose directed at the camera. On-screen items can be chosen by a selection mechanism. Current sample applications include browsing video collections as well as viewing a gallery of 3D objects, which the user can rotate with their hand motion. We have included an up-to-date review of hand tracking methods, and comment on the merits and shortcomings of previous approaches. The proposed tracker uses multiple cues, appearance, color, and motion, for robustness. As the space of possible observation models is generally too large for exhaustive online search, we select models that are suitable for the particular tracking task at hand. During a training stage, various off-the-shelf trackers are evaluated. From this data differentmethods of fusing them online are investigated, including parallel and cascaded tracker evaluation. For the case of fist tracking, combining a small number of observers in a cascade results in an efficient algorithm that is used in our gesture interface. The system has been on public display at conferences where over a hundred users have engaged with it. © 2010 Springer-Verlag Berlin Heidelberg.

Thermal energy minimisation in papermaking via MD control approach

This paper reports the application of Advanced Process Control (APC) techniques for improving the thermal energy efficiency of a paperboard-making process by regulating the Machine Direction (MD) profile of the basis weight and moisture content of the paper-board. A Model Predictive Controller (MPC) is designed so that the sheet moisture and basis weight tracking errors along with variations of the sheet moisture and basis weight are reduced. Also, the drainage is maximised through improved wet-end stability which can facilitate driving the sheet moisture set-point closer to its upper specification limit over time. It is shown that the proposed strategy can result in reducing steam usage by 8-10%. A simulation study based on a UK board machine is presented to show the effectiveness of the proposed technique. © 2011 Intl Journal of Adv Mechatr.

Towards robust part tracking in an automated manufacturing process using RFID

Automated Identification and in particular, Radio Frequency Identification (RFID) promises to assist with the automation of mass customised production processes. RFID has long been used to gather a history or trace of part movements, but the use of it as an integral part of the control process is yet to be fully exploited. Such use places stringent demands on the quality of the sensor data and the method used to interpret that data. in particular, this paper focuses on the issue of correctly identifying, tracking and dealing with aggregated objects with the use of RFID. The presented approach is evaluated in the context of a laboratory manufacturing system that produces customised gift boxes. Copyright © 2005 IFAC.

A neuro-inspired method for data rate limited feedback control

The nervous system implements a networked control system in which the plants take the form of limbs, the controller is the brain, and neurons form the communication channels. Unlike standard networked control architectures, there is no periodic sampling, and the fundamental units of communication contain little numerical information. This paper describes a novel communication channel, modeled after spiking neurons, in which the transmitter integrates an input signal and sends out a spike when the integral reaches a threshold value. The reciever then filters the sequence of spikes to approximately reconstruct the input signal. It is shown that for appropriate choices of channel parameters, stable feedback control over these spiking channels is possible. Furthermore, good tracking performance can be achieved. The data rate of the channel increases linearly with the size of the inputs. Thus, when placed in a feedback loop, small loop gains imply a low data rate. ©2010 IEEE.

Feedback control of impact dynamics: The bouncing ball revisited

We study the the design of a tracking controller for the popular bouncing ball model: the continuous-time actuation of a table is used to control the impacts of the table with a bouncing ball. The proposed control law uses the impact times as the sole feedback information. We show that the acceleration of the table at impact plays no role in the stability analysis but is an important parameter for the robustness of the feedback system to model uncertainty, in particular to the uncertainty on the coefficient of restitution. © 2006 IEEE.

Collective motion: Bistability and trajectory tracking

This paper presents analysis and application of steering control laws for a network of self-propelled, planar particles. We explore together the two stably controlled group motions, parallel motion and circular motion, for modeling and design purposes. We show that a previously considered control law simultaneously stabilizes both parallel and circular group motion, leading to Instability and hysteresis. We also present behavior primitives that enable piecewise-linear network trajectory tracking.