SINGULARLY PERTURBED DISCOUNTED MARKOV CONTROL PROCESSES IN A GENERAL STATE SPACE

This paper studies the asymptotic optimality of discrete-time Markov decision processes (MDPs) with general state space and action space and having weak and strong interactions. By using a similar approach as developed by Liu, Zhang, and Yin [Appl. Math. Optim., 44 (2001), pp. 105-129], the idea in this paper is to consider an MDP with general state and action spaces and to reduce the dimension of the state space by considering an averaged model. This formulation is often described by introducing a small parameter epsilon > 0 in the definition of the transition kernel, leading to a singularly perturbed Markov model with two time scales. Our objective is twofold. First it is shown that the value function of the control problem for the perturbed system converges to the value function of a limit averaged control problem as epsilon goes to zero. In the second part of the paper, it is proved that a feedback control policy for the original control problem defined by using an optimal feedback policy for the limit problem is asymptotically optimal. Our work extends existing results of the literature in the following two directions: the underlying MDP is defined on general state and action spaces and we do not impose strong conditions on the recurrence structure of the MDP such as Doeblin's condition.

Improved low-voltage-ride-through capability of fixed-speed wind turbines using decentralised control of STATCOM with energy storage system

The design and implementation of a new control scheme for reactive power compensation, voltage regulation and transient stability enhancement for wind turbines equipped with fixed-speed induction generators (IGs) in large interconnected power systems is presented in this study. The low-voltage-ride-through (LVRT) capability is provided by extending the range of the operation of the controlled system to include typical post-fault conditions. A systematic procedure is proposed to design decentralised multi-variable controllers for large interconnected power systems using the linear quadratic (LQ) output-feedback control design method and the controller design procedure is formulated as an optimisation problem involving rank-constrained linear matrix inequality (LMI). In this study, it is shown that a static synchronous compensator (STATCOM) with energy storage system (ESS), controlled via robust control technique, is an effective device for improving the LVRT capability of fixed-speed wind turbines.

A new approach for modeling and control of nonlinear systems via norm-bounded linear differential inclusions

A systematic approach to model nonlinear systems using norm-bounded linear differential inclusions (NLDIs) is proposed in this paper. The resulting NLDI model is suitable for the application of linear control design techniques and, therefore, it is possible to fulfill certain specifications for the underlying nonlinear system, within an operating region of interest in the state-space, using a linear controller designed for this NLDI model. Hence, a procedure to design a dynamic output feedback controller for the NLDI model is also proposed in this paper. One of the main contributions of the proposed modeling and control approach is the use of the mean-value theorem to represent the nonlinear system by a linear parameter-varying model, which is then mapped into a polytopic linear differential inclusion (PLDI) within the region of interest. To avoid the combinatorial problem that is inherent of polytopic models for medium- and large-sized systems, the PLDI is transformed into an NLDI, and the whole process is carried out ensuring that all trajectories of the underlying nonlinear system are also trajectories of the resulting NLDI within the operating region of interest. Furthermore, it is also possible to choose a particular structure for the NLDI parameters to reduce the conservatism in the representation of the nonlinear system by the NLDI model, and this feature is also one important contribution of this paper. Once the NLDI representation of the nonlinear system is obtained, the paper proposes the application of a linear control design method to this representation. The design is based on quadratic Lyapunov functions and formulated as search problem over a set of bilinear matrix inequalities (BMIs), which is solved using a two-step separation procedure that maps the BMIs into a set of corresponding linear matrix inequalities. Two numerical examples are given to demonstrate the effectiveness of the proposed approach.

Relating network rigidity, time scale hierarchies, and expression noise in gene networks

Fluctuation-dissipation theorems can be used to predict characteristics of noise from characteristics of the macroscopic response of a system. In the case of gene networks, feedback control determines the "network rigidity," defined as resistance to slow external changes. We propose an effective Fokker-Planck equation that relates gene expression noise to topology and to time scales of the gene network. We distinguish between two situations referred to as normal and inverted time hierarchies. The noise can be buffered by network feedback in the first situation, whereas it can be topology independent in the latter.

Insulin analogues in the treatment of diabetes in pregnancy

Pregnancy affects both maternal and fetal metabolism, and even in non-diabetic women, it exerts a diabetogenic effect. Among pregnant women, 2% to 14% develop gestational diabetes. Pregnancy can also occur in women with preexisting diabetes, which may predispose the fetus to many alterations in organogenesis, restrict growth, and the mother, to some diabetes-related complications, such as retinopathy and nephropathy, or to acceleration of the course of these complications, if they are already present. Women with gestational diabetes generally start their treatment with diet and lifestyle changes; when these changes are not enough for optimal glycemic control, insulin therapy must then be considered. Women with type 2 diabetes using oral hypoglycemic agents are advised to change to insulin therapy. Those with preexisting type 1 diabetes should start intensive glycemic control. As basal insulin analogues have frequently been used off-label in pregnant women, there is a need to evaluate their safety and efficacy. The aim of this review is to report the use of both short- and long-acting insulin analogues during pregnancy and to enable clinicians, obstetricians, and endocrinologists to choose the best insulin treatment for their patients.

A system for classification of time-series data from industrial non-destructive device

This work proposes a system for classification of industrial steel pieces by means of magnetic nondestructive device. The proposed classification system presents two main stages, online system stage and off-line system stage. In online stage, the system classifies inputs and saves misclassification information in order to perform posterior analyses. In the off-line optimization stage, the topology of a Probabilistic Neural Network is optimized by a Feature Selection algorithm combined with the Probabilistic Neural Network to increase the classification rate. The proposed Feature Selection algorithm searches for the signal spectrogram by combining three basic elements: a Sequential Forward Selection algorithm, a Feature Cluster Grow algorithm with classification rate gradient analysis and a Sequential Backward Selection. Also, a trash-data recycling algorithm is proposed to obtain the optimal feedback samples selected from the misclassified ones.

A modified Primal-Dual Logarithmic-Barrier Method for solving the Optimal Power Flow problem with discrete and continuous control variables

The aim of solving the Optimal Power Flow problem is to determine the optimal state of an electric power transmission system, that is, the voltage magnitude and phase angles and the tap ratios of the transformers that optimize the performance of a given system, while satisfying its physical and operating constraints. The Optimal Power Flow problem is modeled as a large-scale mixed-discrete nonlinear programming problem. This paper proposes a method for handling the discrete variables of the Optimal Power Flow problem. A penalty function is presented. Due to the inclusion of the penalty function into the objective function, a sequence of nonlinear programming problems with only continuous variables is obtained and the solutions of these problems converge to a solution of the mixed problem. The obtained nonlinear programming problems are solved by a Primal-Dual Logarithmic-Barrier Method. Numerical tests using the IEEE 14, 30, 118 and 300-Bus test systems indicate that the method is efficient. (C) 2012 Elsevier B.V. All rights reserved.

Optimal mean-variance control for discrete-time linear systems with Markovian jumps and multiplicative noises

In this paper, we consider the stochastic optimal control problem of discrete-time linear systems subject to Markov jumps and multiplicative noises under two criteria. The first one is an unconstrained mean-variance trade-off performance criterion along the time, and the second one is a minimum variance criterion along the time with constraints on the expected output. We present explicit conditions for the existence of an optimal control strategy for the problems, generalizing previous results in the literature. We conclude the paper by presenting a numerical example of a multi-period portfolio selection problem with regime switching in which it is desired to minimize the sum of the variances of the portfolio along the time under the restriction of keeping the expected value of the portfolio greater than some minimum values specified by the investor. (C) 2011 Elsevier Ltd. All rights reserved.

Frequency and precision of feedback and the adaptive process of learning a dual motor task

This work investigated the effects of frequency and precision of feedback on the learning of a dual-motor task. One hundred and twenty adults were randomly assigned to six groups of different knowledge of results (KR), frequency (100%, 66% or 33%) and precision (specific or general) levels. In the stabilization phase, participants performed the dual task (combination of linear positioning and manual force control) with the provision of KR. Ten non-KR adaptation trials were performed for the same task, but with the introduction of an electromagnetic opposite traction force. The analysis showed a significant main effect for frequency of KR. The participants who received KR in 66% of the stabilization trials showed superior adaptation performance than those who received 100% or 33%. This finding reinforces that there is an optimal level of information, neither too high nor too low, for motor learning to be effective.

Manipulation of follicle development to ensure optimal oocyte quality and conception rates in cattle

Over the last several decades, a number of therapies have been developed that manipulate ovarian follicle growth to improve oocyte quality and conception rates in cattle. Various strategies have been proposed to improve the responses to reproductive biotechnologies following timed artificial insemination (TAI), superovulation (SOV) or ovum pickup (OPU) programmes. During TAI protocols, final follicular growth and size of the ovulatory follicle are key factors that may significantly influence oocyte quality, ovulation, the uterine environment and consequently pregnancy outcomes. Progesterone concentrations during SOV protocols influence follicular growth, oocyte quality and embryo quality; therefore, several adjustments to SOV protocols have been proposed depending on the animal category and breed. In addition, the success of in vitro embryo production is directly related to the number and quality of cumulus oocyte complexes harvested by OPU. Control of follicle development has a significant impact on the OPU outcome. This article discusses a number of key points related to the manipulation of ovarian follicular growth to maximize oocyte quality and improve conception rates following TAI and embryo transfer of in vivo-and in vitro-derived embryos in cattle.

Imperceptible electrical noise attenuates isometric plantar flexion force fluctuations with correlated reductions in postural sway

Optimal levels of noise stimulation have been shown to enhance the detection and transmission of neural signals thereby improving the performance of sensory and motor systems. The first series of experiments in the present study aimed to investigate whether subsensory electrical noise stimulation applied over the triceps surae (TS) in seated subjects decreases torque variability during a force-matching task of isometric plantar flexion and whether the same electrical noise stimulation decreases postural sway during quiet stance. Correlation tests were applied to investigate whether the noise-induced postural sway decrease is linearly predicted by the noise-induced torque variability decrease. A second series of experiments was conducted to investigate whether there are differences in torque variability between conditions in which the subsensory electrical noise is applied only to the TS, only to the tibialis anterior (TA) and to both TS and TA, during the force-matching task with seated subjects. Noise stimulation applied over the TS muscles caused a significant reduction in force variability during the maintained isometric force paradigm and also decreased postural oscillations during quiet stance. Moreover, there was a significant correlation between the reduction in force fluctuation and the decrease in postural sway with the electrical noise stimulation. This last result indicates that changes in plantar flexion force variability in response to a given subsensory random stimulation of the TS may provide an estimate of the variations in postural sway caused by the same subsensory stimulation of the TS. We suggest that the decreases in force variability and postural sway found here are due to stochastic resonance that causes an improved transmission of proprioceptive information. In the second series of experiments, the reduction in force variability found when noise was applied to the TA muscle alone did not reach statistical significance, suggesting that TS proprioception gives a better feedback to reduce force fluctuation in isometric plantar flexion conditions.

A New Control Architecture for Robust Controllers in Rear Electric Traction Passenger HEVs

It is well known that control systems are the core of electronic differential systems (EDSs) in electric vehicles (EVs)/hybrid HEVs (HEVs). However, conventional closed-loop control architectures do not completely match the needed ability to reject noises/disturbances, especially regarding the input acceleration signal incoming from the driver's commands, which makes the EDS (in this case) ineffective. Due to this, in this paper, a novel EDS control architecture is proposed to offer a new approach for the traction system that can be used with a great variety of controllers (e. g., classic, artificial intelligence (AI)-based, and modern/robust theory). In addition to this, a modified proportional-integral derivative (PID) controller, an AI-based neuro-fuzzy controller, and a robust optimal H-infinity controller were designed and evaluated to observe and evaluate the versatility of the novel architecture. Kinematic and dynamic models of the vehicle are briefly introduced. Then, simulated and experimental results were presented and discussed. A Hybrid Electric Vehicle in Low Scale (HELVIS)-Sim simulation environment was employed to the preliminary analysis of the proposed EDS architecture. Later, the EDS itself was embedded in a dSpace 1103 high-performance interface board so that real-time control of the rear wheels of the HELVIS platform was successfully achieved.

Phase-Locked loops lock-in range in Frequency Modulated-Atomic Force Microscope nonlinear control system

Since the mid 1980s the Atomic Force Microscope is one the most powerful tools to perform surface investigation, and since 1995 Non-Contact AFM achieved true atomic resolution. The Frequency-Modulated Atomic Force Microscope (FM-AFM) operates in the dynamic mode, which means that the control system of the FM-AFM must force the micro-cantilever to oscillate with constant amplitude and frequency. However, tip-sample interaction forces cause modulations in the microcantilever motion. A Phase-Locked loop (PLL) is used to demodulate the tip-sample interaction forces from the microcantilever motion. The demodulated signal is used as the feedback signal to the control system, and to generate both topographic and dissipation images. As a consequence, a proper design of the PLL is vital to the FM-AFM performance. In this work, using bifurcation analysis, the lock-in range of the PLL is determined as a function of the frequency shift (Q) of the microcantilever and of the other design parameters, providing a technique to properly design the PLL in the FM-AFM system. (C) 2011 Elsevier B.V. All rights reserved.

The Future REvascularization Evaluation in patients with Diabetes mellitus: Optimal management of Multivessel disease (FREEDOM) trial: Clinical and angiographic profile at study entry

Background The optimal revascularization strategy for diabetic patients with multivessel coronary artery disease (MVD) remains uncertain for lack of an adequately powered, randomized trial. The FREEDOM trial was designed to compare contemporary coronary artery bypass grafting (CABG) to percutaneous coronary intervention (PCI) with drug-eluting stents in diabetic patients with MVD against a background of optimal medical therapy. Methods A total of 1,900 diabetic participants with MVD were randomized to PCI or CABG worldwide from April 2005 to March 2010. FREEDOM is a superiority trial with a mean follow-up of 4.37 years (minimum 2 years) and 80% power to detect a 27.0% relative reduction. We present the baseline characteristics of patients screened and randomized, and provide a comparison with other MVD trials involving diabetic patients. Results The randomized cohort was 63.1 +/- 9.1 years old and 29% female, with a median diabetes duration of 10.2 +/- 8.9 years. Most (83%) had 3-vessel disease and on average took 5.5 +/- 1.7 vascular medications, with 32% on insulin therapy. Nearly all had hypertension and/or dyslipidemia, and 26% had a prior myocardial infarction. Mean hemoglobin A1c was 7.8 +/- 1.7 mg/dL, 29% had low-density lipoprotein <70 mg/dL, and mean systolic blood pressure was 134 +/- 20 mm Hg. The mean SYNTAX score was 26.2 with a symmetric distribution. FREEDOM trial participants have baseline characteristics similar to those of contemporary multivessel and diabetes trial cohorts. Conclusions The FREEDOM trial has successfully recruited a high-risk diabetic MVD cohort. Follow-up efforts include aggressive monitoring to optimize background risk factor control. FREEDOM will contribute significantly to the PCI versus CABG debate in diabetic patients with MVD. (Am Heart J 2012;164:591-9.)

OPTIMIZATION AND CONTROL OF A CONTINUOUS POLYMERIZATION REACTOR

This work studies the optimization and control of a styrene polymerization reactor. The proposed strategy deals with the case where, because of market conditions and equipment deterioration, the optimal operating point of the continuous reactor is modified significantly along the operation time and the control system has to search for this optimum point, besides keeping the reactor system stable at any possible point. The approach considered here consists of three layers: the Real Time Optimization (RTO), the Model Predictive Control (MPC) and a Target Calculation (TC) that coordinates the communication between the two other layers and guarantees the stability of the whole structure. The proposed algorithm is simulated with the phenomenological model of a styrene polymerization reactor, which has been widely used as a benchmark for process control. The complete optimization structure for the styrene process including disturbances rejection is developed. The simulation results show the robustness of the proposed strategy and the capability to deal with disturbances while the economic objective is optimized.