Numerical solution of optimal control problems with constant control delays

We investigate a class of optimal control problems that exhibit constant exogenously given delays in the control in the equation of motion of the differential states. Therefore, we formulate an exemplary optimal control problem with one stock and one control variable and review some analytic properties of an optimal solution. However, analytical considerations are quite limited in case of delayed optimal control problems. In order to overcome these limits, we reformulate the problem and apply direct numerical methods to calculate approximate solutions that give a better understanding of this class of optimization problems. In particular, we present two possibilities to reformulate the delayed optimal control problem into an instantaneous optimal control problem and show how these can be solved numerically with a stateof- the-art direct method by applying Bock’s direct multiple shooting algorithm. We further demonstrate the strength of our approach by two economic examples.

Differentiating the Multipoint Expected Improvement for Optimal Batch Design

This work deals with parallel optimization of expensive objective functions which are modelled as sample realizations of Gaussian processes. The study is formalized as a Bayesian optimization problem, or continuous multi-armed bandit problem, where a batch of q > 0 arms is pulled in parallel at each iteration. Several algorithms have been developed for choosing batches by trading off exploitation and exploration. As of today, the maximum Expected Improvement (EI) and Upper Confidence Bound (UCB) selection rules appear as the most prominent approaches for batch selection. Here, we build upon recent work on the multipoint Expected Improvement criterion, for which an analytic expansion relying on Tallis’ formula was recently established. The computational burden of this selection rule being still an issue in application, we derive a closed-form expression for the gradient of the multipoint Expected Improvement, which aims at facilitating its maximization using gradient-based ascent algorithms. Substantial computational savings are shown in application. In addition, our algorithms are tested numerically and compared to state-of-the-art UCB-based batchsequential algorithms. Combining starting designs relying on UCB with gradient-based EI local optimization finally appears as a sound option for batch design in distributed Gaussian Process optimization.

Adaptive Algorithms for Personalized Diabetes Treatment

Dynamic systems, especially in real-life applications, are often determined by inter-/intra-variability, uncertainties and time-varying components. Physiological systems are probably the most representative example in which population variability, vital signal measurement noise and uncertain dynamics render their explicit representation and optimization a rather difficult task. Systems characterized by such challenges often require the use of adaptive algorithmic solutions able to perform an iterative structural and/or parametrical update process towards optimized behavior. Adaptive optimization presents the advantages of (i) individualization through learning of basic system characteristics, (ii) ability to follow time-varying dynamics and (iii) low computational cost. In this chapter, the use of online adaptive algorithms is investigated in two basic research areas related to diabetes management: (i) real-time glucose regulation and (ii) real-time prediction of hypo-/hyperglycemia. The applicability of these methods is illustrated through the design and development of an adaptive glucose control algorithm based on reinforcement learning and optimal control and an adaptive, personalized early-warning system for the recognition and alarm generation against hypo- and hyperglycemic events.

An Actor-Critic based controller for glucose regulation in type 1 diabetes

A novel adaptive approach for glucose control in individuals with type 1 diabetes under sensor-augmented pump therapy is proposed. The controller, is based on Actor-Critic (AC) learning and is inspired by the principles of reinforcement learning and optimal control theory. The main characteristics of the proposed controller are (i) simultaneous adjustment of both the insulin basal rate and the bolus dose, (ii) initialization based on clinical procedures, and (iii) real-time personalization. The effectiveness of the proposed algorithm in terms of glycemic control has been investigated in silico in adults, adolescents and children under open-loop and closed-loop approaches, using announced meals with uncertainties in the order of ±25% in the estimation of carbohydrates. The results show that glucose regulation is efficient in all three groups of patients, even with uncertainties in the level of carbohydrates in the meal. The percentages in the A+B zones of the Control Variability Grid Analysis (CVGA) were 100% for adults, and 93% for both adolescents and children. The AC based controller seems to be a promising approach for the automatic adjustment of insulin infusion in order to improve glycemic control. After optimization of the algorithm, the controller will be tested in a clinical trial.

Consensus Document of the International Union of Angiology (IUA)-2013. Current concept on the management of arterio-venous management

Arterio-venous malformations (AVMs) are congenital vascular malformations (CVMs) that result from birth defects involving the vessels of both arterial and venous origins, resulting in direct communications between the different size vessels or a meshwork of primitive reticular networks of dysplastic minute vessels which have failed to mature to become 'capillary' vessels termed "nidus". These lesions are defined by shunting of high velocity, low resistance flow from the arterial vasculature into the venous system in a variety of fistulous conditions. A systematic classification system developed by various groups of experts (Hamburg classification, ISSVA classification, Schobinger classification, angiographic classification of AVMs,) has resulted in a better understanding of the biology and natural history of these lesions and improved management of CVMs and AVMs. The Hamburg classification, based on the embryological differentiation between extratruncular and truncular type of lesions, allows the determination of the potential of progression and recurrence of these lesions. The majority of all AVMs are extra-truncular lesions with persistent proliferative potential, whereas truncular AVM lesions are exceedingly rare. Regardless of the type, AV shunting may ultimately result in significant anatomical, pathophysiological and hemodynamic consequences. Therefore, despite their relative rarity (10-20% of all CVMs), AVMs remain the most challenging and potentially limb or life-threatening form of vascular anomalies. The initial diagnosis and assessment may be facilitated by non- to minimally invasive investigations such as duplex ultrasound, magnetic resonance imaging (MRI), MR angiography (MRA), computerized tomography (CT) and CT angiography (CTA). Arteriography remains the diagnostic gold standard, and is required for planning subsequent treatment. A multidisciplinary team approach should be utilized to integrate surgical and non-surgical interventions for optimum care. Currently available treatments are associated with significant risk of complications and morbidity. However, an early aggressive approach to elimiate the nidus (if present) may be undertaken if the benefits exceed the risks. Trans-arterial coil embolization or ligation of feeding arteries where the nidus is left intact, are incorrect approaches and may result in proliferation of the lesion. Furthermore, such procedures would prevent future endovascular access to the lesions via the arterial route. Surgically inaccessible, infiltrating, extra-truncular AVMs can be treated with endovascular therapy as an independent modality. Among various embolo-sclerotherapy agents, ethanol sclerotherapy produces the best long term outcomes with minimum recurrence. However, this procedure requires extensive training and sufficient experience to minimize complications and associated morbidity. For the surgically accessible lesions, surgical resection may be the treatment of choice with a chance of optimal control. Preoperative sclerotherapy or embolization may supplement the subsequent surgical excision by reducing the morbidity (e.g. operative bleeding) and defining the lesion borders. Such a combined approach may provide an excellent potential for a curative result. Conclusion. AVMs are high flow congenital vascular malformations that may occur in any part of the body. The clinical presentation depends on the extent and size of the lesion and can range from an asymptomatic birthmark to congestive heart failure. Detailed investigations including duplex ultrasound, MRI/MRA and CT/CTA are required to develop an appropriate treatment plan. Appropriate management is best achieved via a multi-disciplinary approach and interventions should be undertaken by appropriately trained physicians.

Placebo effect characteristics observed in a single, international, longitudinal study in Huntington's disease

BACKGROUND Classically, clinical trials are based on the placebo-control design. Our aim was to analyze the placebo effect in Huntington's disease. METHODS Placebo data were obtained from an international, longitudinal, placebo-controlled trial for Huntington's disease (European Huntington's Disease Initiative Study Group). One-hundred and eighty patients were evaluated using the Unified Huntington Disease Rating Scale over 36 months. A placebo effect was defined as an improvement of at least 50% over baseline scores in the Unified Huntington Disease Rating Scale, and clinically relevant when at least 10% of the population met it. RESULTS Only behavior showed a significant placebo effect, and the proportion of the patients with placebo effect ranged from 16% (first visit) to 41% (last visit). Nondepressed patients with better functional status were most likely to be placebo-responders over time. CONCLUSIONS In Huntington's disease, behavior seems to be more vulnerable to placebo than overall motor function, cognition, and function

The subcostal artery perforator flap; an anatomical study

BACKGROUND: Based on a previous clinical case report in which the pedicled subcostal artery perforator flap allowed for the closure of a large defect of the lumbar region, the present study was designed to investigate the anatomy of the subcostal artery perforator flap and to evaluate its potential for wider clinical use. METHODS: A series of 14 human cadavers was studied and 28 subcostal artery perforator flaps were dissected. The location of the perforator vessel was charted against anatomical landmarks. Measurements included the perforator calibre, pedicle length, and flap size following methylene blue injection. The findings were compared by Doppler sonography in 15 volunteers. RESULTS: The subcostal artery perforator was present in all dissected specimens and in all volunteers. Its calibre measured in mean 2mm. The location was constant at the lateral border of the latissimus dorsi muscle and between 1 and 3cm below the lower rib end. The pedicle length reached a mean of 10.5cm when dissected up to the border of the erector spinae musculature. The vascular supply covered a mean flap size of 10x14cm. The in vivo investigations confirmed the constant perforator location from the anatomical landmarks. CONCLUSION: This anatomical study reveals a considerable potential for the clinical use of the subcostal artery perforator flap for defect coverage in the lumbar area, due to its constant and reliable anatomy. Doppler sonography can be helpful in preoperative assessment of the size and the position of the subcostal perforator, thus allowing for an optimal flap design.

Hyperaldosteronism in pregnancy

Aldosterone is a key regulator of electrolyte and water homeostasis and plays a central role in blood pressure regulation. Hormonal changes during pregnancy, among them increased progesterone and aldosterone production, lead to the required plasma volume expansion of the maternal body as an accommodation mechanism for fetus growth. This review discusses the regulation of aldosterone production by aldosterone synthase (CYP11B2); the impact on aldosterone secretion due to the presence of a chimeric gene originating from a crossover between CYP11B1 and CYP11B2 in glucocorticoid remediable aldosteronism (GRA) - the inherited form of hypertension; enhanced aldosterone production in aldosterone-producing adenoma (APA); and idiopathic hyperaldosteronism (IHA). Features of hyperaldosteronism are also found in patients with apparent mineralocorticoid excess (AME), in which glucocorticoids exacerbate activation of the mineralocorticoid receptor (MR) because of a defect in the 11beta-hydroxysteroid dehydrogenase type 2 enzyme. Regulation of aldosterone production and tissue-specific activation of the mineralocorticoid receptor are prerequisites for optimal control of body fluids and blood pressure during pregnancy and contribute largely to the wellbeing of the mother-to-be.

Optimization of Schwinger pair production in colliding laser pulses

Recent studies of Schwinger pair production have demonstrated that the asymptotic particle spectrum is extremely sensitive to the applied field profile. We extend the idea of the dynamically assisted Schwinger effect from single pulse profiles to more realistic field configurations to be generated in an all-optical experiment searching for pair creation. We use the quantum kinetic approach to study the particle production and employ a multi-start method, combined with optimal control theory, to determine a set of parameters for which the particle yield in the forward direction in momentum space is maximized. We argue that this strategy can be used to enhance the signal of pair production on a given detector in an experimental setup.

The inverse problem for Schwinger pair production

The production of electron–positron pairs in time-dependent electric fields (Schwinger mechanism) depends non-linearly on the applied field profile. Accordingly, the resulting momentum spectrum is extremely sensitive to small variations of the field parameters. Owing to this non-linear dependence it is so far unpredictable how to choose a field configuration such that a predetermined momentum distribution is generated. We show that quantum kinetic theory along with optimal control theory can be used to approximately solve this inverse problem for Schwinger pair production. We exemplify this by studying the superposition of a small number of harmonic components resulting in predetermined signatures in the asymptotic momentum spectrum. In the long run, our results could facilitate the observation of this yet unobserved pair production mechanism in quantum electrodynamics by providing suggestions for tailored field configurations.