Singular Perturbation for the Discounted Continuous Control of Piecewise Deterministic Markov Processes

This paper deals with the expected discounted continuous control of piecewise deterministic Markov processes (PDMP`s) using a singular perturbation approach for dealing with rapidly oscillating parameters. The state space of the PDMP is written as the product of a finite set and a subset of the Euclidean space a""e (n) . The discrete part of the state, called the regime, characterizes the mode of operation of the physical system under consideration, and is supposed to have a fast (associated to a small parameter epsilon > 0) and a slow behavior. By using a similar approach as developed in Yin and Zhang (Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach, Applications of Mathematics, vol. 37, Springer, New York, 1998, Chaps. 1 and 3) the idea in this paper is to reduce the number of regimes by considering an averaged model in which the regimes within the same class are aggregated through the quasi-stationary distribution so that the different states in this class are replaced by a single one. The main goal is to show that the value function of the control problem for the system driven by the perturbed Markov chain converges to the value function of this limit control problem as epsilon goes to zero. This convergence is obtained by, roughly speaking, showing that the infimum and supremum limits of the value functions satisfy two optimality inequalities as epsilon goes to zero. This enables us to show the result by invoking a uniqueness argument, without needing any kind of Lipschitz continuity condition.

Control of nitrate recirculation flow in predenitrification systems

The control of the nitrate recirculation flow in a predenitrification system is addressed. An elementary mass balance analysis on the utilisation efficiency of the influent biodegradable COD (bCOD) for nitrate removal indicates that the control problem can be broken down into two parts: maintaining the anoxic zone anoxic (i.e. nitrate is present throughout the anoxic zone) and maximising the usage of influent soluble bCOD for denitrification. Simulation studies using the Simulation Benchmark developed in the European COST program show that both objectives can be achieved by maintaining the nitrate concentration at the outlet of the anoxic zone at around 2 mgN/L. This setpoint appears to be robust towards variations in the influent characteristics and sludge kinetics.

Distributed active traction control system applied to the RoboCup middle size league

This work addresses the problem of traction control in mobile wheeled robots in the particular case of the RoboCup Middle Size League (MSL). The slip control problem is formulated using simple friction models for ISePorto Team robots with a differential wheel configuration. Traction was also characterized experimentally in the MSL scenario for relevant game events. This work proposes a hierarchical traction control architecture which relies in local slip detection and control at each wheel, with relevant information being relayed to a higher level responsible for global robot motion control. A dedicated one axis control embedded hardware subsystem allowing complex local control, high frequency current sensing and odometric information procession was developed. This local axis control board is integrated in a distributed system using CAN bus communications. The slipping observer was implemented in the axis control hardware nodes integrated in the ISePorto robots and was used to control and detect loss of for traction. %and to detect the ball in the kicking device. An external vision system was used to perform a qualitative analysis of the slip detection and observer performance results are presented.

Self-scheduling and bidding strategies of thermal units with stochastic emission constraints

This paper is on the self-scheduling problem for a thermal power producer taking part in a pool-based electricity market as a price-taker, having bilateral contracts and emission-constrained. An approach based on stochastic mixed-integer linear programming approach is proposed for solving the self-scheduling problem. Uncertainty regarding electricity price is considered through a set of scenarios computed by simulation and scenario-reduction. Thermal units are modelled by variable costs, start-up costs and technical operating constraints, such as: forbidden operating zones, ramp up/down limits and minimum up/down time limits. A requirement on emission allowances to mitigate carbon footprint is modelled by a stochastic constraint. Supply functions for different emission allowance levels are accessed in order to establish the optimal bidding strategy. A case study is presented to illustrate the usefulness and the proficiency of the proposed approach in supporting biding strategies. (C) 2014 Elsevier Ltd. All rights reserved.

An efficient numerical scheme for solving multi-dimensional fractional optimal control problems with a quadratic performance index

The shifted Legendre orthogonal polynomials are used for the numerical solution of a new formulation for the multi-dimensional fractional optimal control problem (M-DFOCP) with a quadratic performance index. The fractional derivatives are described in the Caputo sense. The Lagrange multiplier method for the constrained extremum and the operational matrix of fractional integrals are used together with the help of the properties of the shifted Legendre orthonormal polynomials. The method reduces the M-DFOCP to a simpler problem that consists of solving a system of algebraic equations. For confirming the efficiency and accuracy of the proposed scheme, some test problems are implemented with their approximate solutions.

Autonomous underwater vehicle control using reinforcement learning policy search methods

Autonomous underwater vehicles (AUV) represent a challenging control problem with complex, noisy, dynamics. Nowadays, not only the continuous scientific advances in underwater robotics but the increasing number of subsea missions and its complexity ask for an automatization of submarine processes. This paper proposes a high-level control system for solving the action selection problem of an autonomous robot. The system is characterized by the use of reinforcement learning direct policy search methods (RLDPS) for learning the internal state/action mapping of some behaviors. We demonstrate its feasibility with simulated experiments using the model of our underwater robot URIS in a target following task

Training in flexible intensive insulin therapy improves quality of life, decreases the risk of hypoglycaemia and ameliorates poor metabolic control in patients with type 1 diabetes.

AIM: Intensified insulin therapy has evolved to be the standard treatment of type 1 diabetes. However, it has been reported to increase significantly the risk of hypoglycaemia. We studied the effect of structured group teaching courses in flexible insulin therapy (FIT) on psychological and metabolic parameters in patients with type 1 diabetes. METHODS: We prospectively followed 45 type 1 diabetic patients of our outpatient clinic participating in 5 consecutive FIT teaching courses at the University Hospital of Basel. These courses consist of 7 weekly ambulatory evening group sessions. Patients were studied before and 1, 6, and 18 months after the course. Main outcome measures were glycated haemoglobin (HbA1c), severe hypoglycaemic events, quality of life (DQoL), diabetes self-control (IPC-9) and diabetes knowledge (DWT). RESULTS: Quality of life, self-control and diabetes knowledge improved after the FIT courses (all p<0.001). The frequency of severe hypoglycaemic events decreased ten-fold from 0.33 episodes/6 months at baseline to 0.03 episodes/6 months after 18 months (p<0.05). Baseline HbA1c was 7.2+/-1.1% and decreased in the subgroup with HbA1c > or = 8% from 8.4% to 7.8% (p<0.05). CONCLUSIONS: In an unselected, but relatively well-controlled population of type 1 diabetes, a structured, but not very time consuming FIT teaching programme in the outpatient setting improves psychological well-being and metabolic parameters.

Eating and weight related cognitions in people with Schizophrenia: a case control study

ABSTRACT: BACKGROUND: Patients with antipsychotic-induced weight gain (WG) regularly report on unsuccessful dietary trials, which suggests strong biological weight gain drive that is extremely hard to overcome with thoughts, such that behaviour doesn't change despite some intent to change. The purpose of the present study was to assess cognitions specifically related to restrained eating in severely overweight patients with schizophrenia treated with antipsychotic drugs. METHODS: Forty outpatients with schizophrenia and 40 controls without psychiatric disability were included. Both groups were composed of one subgroup severely overweight (defined as a BMI > 28), and a comparison sample (BMI<28). The revised version of the Mizes Anorectic cognitive questionnaire (MAC-R) was used in this cross-sectional case-control study. RESULTS: Gender was significantly related to eating disorders cognition, women scoring higher than men. Patients with schizophrenia in general scored higher on the MAC-R total scale and on the MAC-R subscale 2, the latter score representing rigid weight regulation and fear of weight gain. When comparing the two groups of subjects with BMI < 28, it appeared that patients with schizophrenia also scored higher on MAC-R total scale, the subscales 2 and 3, the latter subscale 3, indicating altered self control and self-esteem. CONCLUSION: As is the case in weight gain of subjects without schizophrenia, the present results suggest that the cognitive distortions, as assessed by the MAC-R, may play an important role in weight gain also in patients with schizophrenia, and in weight gain associated with antipsychotic pharmacotherapy. Particular attention to these processes may help to improve the management of antipsychotic drugs induced weight gain

Transferring control demands across incidental learning tasks - Stronger sequence usage in serial reaction task after shortcut option in letter string checking

After incidentally learning about a hidden regularity, participants can either continue to solve the task as instructed or, alternatively, apply a shortcut. Past research suggests that the amount of conflict implied by adopting a shortcut seems to bias the decision for vs. against continuing instruction-coherent task processing. We explored whether this decision might transfer from one incidental learning task to the next. Theories that conceptualize strategy change in incidental learning as a learning-plus-decision phenomenon suggest that high demands to adhere to instruction-coherent task processing in Task 1 will impede shortcut usage in Task 2, whereas low control demands will foster it. We sequentially applied two established incidental learning tasks differing in stimuli, responses and hidden regularity (the alphabet verification task followed by the serial reaction task, SRT). While some participants experienced a complete redundancy in the task material of the alphabet verification task (low demands to adhere to instructions), for others the redundancy was only partial. Thus, shortcut application would have led to errors (high demands to follow instructions). The low control demand condition showed the strongest usage of the fixed and repeating sequence of responses in the SRT. The transfer results are in line with the learning-plus-decision view of strategy change in incidental learning, rather than with resource theories of self-control.

Assessing positive mental health in people with chronic physical health problems: correlations with socio-demographic variables and physical health status

Background: A holistic perspective on health implies giving careful consideration to the relationship between physical and mental health. In this regard the present study sought to determine the level of Positive Mental Health (PMH) among people with chronic physical health problems, and to examine the relationship between the observed levels of PMH and both physical health status and socio-demographic variables. Methods: The study was based on the Multifactor Model of Positive Mental Health (Lluch, 1999), which comprises six factors: Personal Satisfaction (F1), Prosocial Attitude (F2), Self-control (F3), Autonomy (F4), Problem-solving and Self-actualization (F5), and Interpersonal Relationship Skills (F6). The sample comprised 259 adults with chronic physical health problems who were recruited through a primary care center in the province of Barcelona (Spain). Positive mental health was assessed by means of the Positive Mental Health Questionnaire (Lluch, 1999). Results: Levels of PMH differed, either on the global scale or on specific factors, in relation to the following variables: age: global PMH scores decreased with age (r=-0.129; p=0.038); b) gender: men scored higher on F1 (t=2.203; p=0.028) and F4 (t=3.182; p=0.002), while women scored higher on F2 (t -3.086; p=0.002) and F6 (t=-2.744; p=0.007); c) number of health conditions: the fewer the number of health problems the higher the PMH score on F5 (r=-0.146; p=0.019); d) daily medication: polymedication patients had lower PMH scores, both globally and on various factors; e) use of analgesics: occasional use of painkillers was associated with higher PMH scores on F1 (t=-2.811; p=0.006). There were no significant differences in global PMH scores according to the type of chronic health condition. The only significant difference in the analysis by factors was that patients with hypertension obtained lower PMH scores on the factor Autonomy (t=2.165; p=0.032). Conclusions: Most people with chronic physical health problems have medium or high levels of PMH. The variables that adversely affect PMH are old age, polypharmacy and frequent consumption of analgesics. The type of health problem does not influence the levels of PMH. Much more extensive studies with samples without chronic pathology are now required in order to be able to draw more robust conclusions.

Recerca avaluativa sobre el programa “LÍMITS”

Des de la comunitat científica s’ha posat de manifest la necessitat d’avaluar els programes d’intervenció per a la millora de la parentalitat, especialment en el context de la infància i adolescència en risc. En aquesta recerca es presenten els resultats de l’avaluació del programa Límits aportant evidències d’eficàcia i efectivitat, que permeten identificar i descriure les seves fortaleses, així com també aquells elements que poden ser objecte de millora. El programa Límits és una proposta estructurada d’intervenció preventiva de caire selectiu amb grups de famílies de joves d’entre 14 i 18 anys que passen pel circuit de la justícia juvenil. El programa ha estat funcionant des del 2007, en diverses edicions, a tot el territori català aplegant una experiència i trajectòria remarcable que ha incidit en 351 persones i 245 famílies. El programa consta de vuit sessions en grup d’entre dotze i quinze participants, dinamitzat per dos monitors, en les que es treballen diferents estratègies a partir de l’abordatge de continguts relacionats amb les relacions i els lligams, la comunicació, els conflictes, l’establiment de normes i la disciplina. Per dur a terme l’avaluació del programa Límits s’ha partit d’un disseny quasi-experimental, pretest–postest aplicat a un grup programa (GP) i a grup col·laborador (GC) i de manera diferida (dos mesos després de la seva finalització) només al GP per constatar si s’han assolit els resultats previstos. Quan s’analitza l’evolució del GP s’observen millores en les habilitats d’autocontrol de les emocions, el reforç positiu i les relacions familiars. Tanmateix, des del punt de vista de les famílies no s’han observat canvis significatius en la millora de la percepció d’auto eficàcia del rol parental respecte el GC abans i després del programa. La percepció majoritària és que els objectius que planteja el programa són excessivament ambiciosos i en conseqüència, difícilment assolibles. Els responsables consideren que, en alguns casos, el perfil de famílies derivades al programa no és el més adequat perquè presenten problemàtiques molt més agudes a les desitjables per aquest tipus d’intervenció. Com a punts forts, es destaca que el programa és útil als ulls dels responsables i tècnics perquè genera una presa de consciència del problema i de la necessitat de canvi per part de les famílies. Els participants diuen transferir a la vida real algunes habilitats apreses especialment la comunicació i millora de les relacions familiars. Els tècnics aplicadors coincideixen amb la percepció de les famílies tot i declarar percentatges lleugerament inferiors. També és vist com un complement professional a la seva tasca que ajuda a fer un millor seguiment dels casos, i permet seguir treballant amb posterioritat amb les famílies.

Investigación evaluativa sobre el programa "LÍMITES"

Desde la comunidad científica se ha puesto de manifiesto la necesidad de evaluar los programas de intervención para la mejora de la parentalidad, especialmente en el contexto de la infancia y la adolescencia en riesgo. En esta investigación se presentan los resultados de la evaluación del programa Límites aportando evidencias de eficacia y efectividad, que permiten identificar y describir sus fortalezas, así como también aquellos elementos que pueden ser objeto de mejora. El programa Límites es una propuesta estructurada de intervención preventiva de carácter selectivo, con grupos de familias de jóvenes de entre 14 y 18 años que pasan por el circuito de la justicia juvenil. El programa ha estado funcionando desde 2007 en todo el territorio catalán, y ha incidido en un total de 351 personas y 245 familias. El programa consta de ocho sesiones en grupo en las que se trabajan contenidos relacionados con las relaciones y los vínculos, la comunicación, los conflictos, el establecimiento de normas y la disciplina. Para llevar a cabo la evaluación del programa Límites se ha partido de un diseño cuasi-experimental, pretest-postest aplicado a un grupo programa (GP) y grupo colaborador (GC) y de manera diferida (dos meses después de su finalización) sólo en el GP, para constatar si se han alcanzado los resultados previstos. Cuando se analiza la evolución del GP se observan mejoras en las habilidades de autocontrol de las emociones, el refuerzo positivo y las relaciones familiares. Sin embargo, desde el punto de vista de las familias no se han observado cambios significativos en la mejora de la percepción de auto eficacia del rol parental respecto al GC antes y después del programa. La percepción mayoritaria es que los objetivos que plantea el programa son excesivamente ambiciosos y en consecuencia, difícilmente alcanzables. Los responsables consideran que, en algunos casos, el perfil de familias derivadas al programa no es el más adecuado puesto que presenten problemáticas mucho más agudas a las deseables para este tipo de intervención. Como puntos fuertes, se destaca que el programa es útil a los ojos de los responsables y técnicos porque genera una toma de conciencia del problema y de la necesidad de cambio por parte de las familias. Los participantes dicen transferir a la vida real algunas habilidades aprendidas, especialmente la comunicación y mejora de las relaciones familiares. Los técnicos aplicadores coinciden con la percepción de las familias, a pesar de declarar porcentajes ligeramente inferiores. También es visto como un complemento profesional a su tarea que ayuda a hacer un mejor seguimiento de los casos, y permite seguir trabajando con posterioridad con las familias.

Mathematical modeling and optimal control of malaria

Malaria continues to infect millions and kill hundreds of thousands of people worldwide each year, despite over a century of research and attempts to control and eliminate this infectious disease. Challenges such as the development and spread of drug resistant malaria parasites, insecticide resistance to mosquitoes, climate change, the presence of individuals with subpatent malaria infections which normally are asymptomatic and behavioral plasticity in the mosquito hinder the prospects of malaria control and elimination. In this thesis, mathematical models of malaria transmission and control that address the role of drug resistance, immunity, iron supplementation and anemia, immigration and visitation, and the presence of asymptomatic carriers in malaria transmission are developed. A within-host mathematical model of severe Plasmodium falciparum malaria is also developed. First, a deterministic mathematical model for transmission of antimalarial drug resistance parasites with superinfection is developed and analyzed. The possibility of increase in the risk of superinfection due to iron supplementation and fortification in malaria endemic areas is discussed. The model results calls upon stakeholders to weigh the pros and cons of iron supplementation to individuals living in malaria endemic regions. Second, a deterministic model of transmission of drug resistant malaria parasites, including the inflow of infective immigrants, is presented and analyzed. The optimal control theory is applied to this model to study the impact of various malaria and vector control strategies, such as screening of immigrants, treatment of drug-sensitive infections, treatment of drug-resistant infections, and the use of insecticide-treated bed nets and indoor spraying of mosquitoes. The results of the model emphasize the importance of using a combination of all four controls tools for effective malaria intervention. Next, a two-age-class mathematical model for malaria transmission with asymptomatic carriers is developed and analyzed. In development of this model, four possible control measures are analyzed: the use of long-lasting treated mosquito nets, indoor residual spraying, screening and treatment of symptomatic, and screening and treatment of asymptomatic individuals. The numerical results show that a disease-free equilibrium can be attained if all four control measures are used. A common pitfall for most epidemiological models is the absence of real data; model-based conclusions have to be drawn based on uncertain parameter values. In this thesis, an approach to study the robustness of optimal control solutions under such parameter uncertainty is presented. Numerical analysis of the optimal control problem in the presence of parameter uncertainty demonstrate the robustness of the optimal control approach that: when a comprehensive control strategy is used the main conclusions of the optimal control remain unchanged, even if inevitable variability remains in the control profiles. The results provide a promising framework for the design of cost-effective strategies for disease control with multiple interventions, even under considerable uncertainty of model parameters. Finally, a separate work modeling the within-host Plasmodium falciparum infection in humans is presented. The developed model allows re-infection of already-infected red blood cells. The model hypothesizes that in severe malaria due to parasite quest for survival and rapid multiplication, the Plasmodium falciparum can be absorbed in the already-infected red blood cells which accelerates the rupture rate and consequently cause anemia. Analysis of the model and parameter identifiability using Markov chain Monte Carlo methods is presented.

Development of the endocrine pancreas and novel strategies for β-cell mass restoration and diabetes therapy

Diabetes mellitus represents a serious public health problem owing to its global prevalence in the last decade. The causes of this metabolic disease include dysfunction and/or insufficient number of β cells. Existing diabetes mellitus treatments do not reverse or control the disease. Therefore, β-cell mass restoration might be a promising treatment. Several restoration approaches have been developed: inducing the proliferation of remaining insulin-producing cells, de novo islet formation from pancreatic progenitor cells (neogenesis), and converting non-β cells within the pancreas to β cells (transdifferentiation) are the most direct, simple, and least invasive ways to increase β-cell mass. However, their clinical significance is yet to be determined. Hypothetically, β cells or islet transplantation methods might be curative strategies for diabetes mellitus; however, the scarcity of donors limits the clinical application of these approaches. Thus, alternative cell sources for β-cell replacement could include embryonic stem cells, induced pluripotent stem cells, and mesenchymal stem cells. However, most differentiated cells obtained using these techniques are functionally immature and show poor glucose-stimulated insulin secretion compared with native β cells. Currently, their clinical use is still hampered by ethical issues and the risk of tumor development post transplantation. In this review, we briefly summarize the current knowledge of mouse pancreas organogenesis, morphogenesis, and maturation, including the molecular mechanisms involved. We then discuss two possible approaches of β-cell mass restoration for diabetes mellitus therapy: β-cell regeneration and β-cell replacement. We critically analyze each strategy with respect to the accessibility of the cells, potential risk to patients, and possible clinical outcomes.

An examination of the role of personality and self-regulation in the gambling behaviours of late adolescents and emerging adults

The purposes of this study were: a) to examine the role of personality and selfregulation in the gambling behaviour participation of late adolescents and emerging adults. In particular, the present study examined i f certain personality traits were more prevalent in high-risk gamblers than in young people considered low or at-risk gamblers; and, b) to examine i f the ability to self-regulate helped distinguish differences among the three groups of gamblers (low-risk, at-risk, and high-risk gamblers). A sample of late adolescents and emerging adults (N = 100) attending Brock University, completed a survey that assessed current gambling behaviour (both frequency and consequence experience), personality, self-esteem, and self-regulation. It was found that high-risk gamblers had lower scores on the personality dimensions Emotionality, Conscientiousness (especially on its Prudence facet), and Honesty-Humility (especially on its Fairness, Greed Avoidance, and Modesty facets) than at-risk or low-risk gamblers and higher scores on impulsive sensation seeking and impulsivity than at-risk or low-risk gamblers. Similarly, high-risk gamblers reported lower levels of self-regulation than both at-risk and low-risk gamblers. The findings from this study support past research which suggests that young people who gamble at problematic levels differ on many personality traits and often have more difficulty self-regulating than young people who do not participate at problematic levels. Findings may aid in the development of intervention and prevention programs that utilize specific self-regulation techniques with a young gambling population.