Personalized Tuning of a Reinforcement Learning Control Algorithm for Glucose Regulation

Artificial pancreas is in the forefront of research towards the automatic insulin infusion for patients with type 1 diabetes. Due to the high inter- and intra-variability of the diabetic population, the need for personalized approaches has been raised. This study presents an adaptive, patient-specific control strategy for glucose regulation based on reinforcement learning and more specifically on the Actor-Critic (AC) learning approach. The control algorithm provides daily updates of the basal rate and insulin-to-carbohydrate (IC) ratio in order to optimize glucose regulation. A method for the automatic and personalized initialization of the control algorithm is designed based on the estimation of the transfer entropy (TE) between insulin and glucose signals. The algorithm has been evaluated in silico in adults, adolescents and children for 10 days. Three scenarios of initialization to i) zero values, ii) random values and iii) TE-based values have been comparatively assessed. The results have shown that when the TE-based initialization is used, the algorithm achieves faster learning with 98%, 90% and 73% in the A+B zones of the Control Variability Grid Analysis for adults, adolescents and children respectively after five days compared to 95%, 78%, 41% for random initialization and 93%, 88%, 41% for zero initial values. Furthermore, in the case of children, the daily Low Blood Glucose Index reduces much faster when the TE-based tuning is applied. The results imply that automatic and personalized tuning based on TE reduces the learning period and improves the overall performance of the AC algorithm.

Towards End-User Driven Power Saving Control in Android devices

Abstract. During the last decade mobile communications increasingly became part of people's daily routine. Such usage raises new challenges regarding devices' battery lifetime management when using most popular wireless access technologies, such as IEEE 802.11. This paper investigates the energy/delay trade-off of using an end-user driven power saving approach, when compared with the standard IEEE 802.11 power saving algorithms. The assessment was conducted in a real testbed using an Android mobile phone and high-precision energy measurement hardware. The results show clear energy benefits of employing user-driven power saving techniques, when compared with other standard approaches.

Resisting the power of temptations: the right prefrontal cortex and self-control.

Imagine you are overweight and you spot your favorite pastry in the storefront of a bakery. How do you manage to resist this temptation? Or to give other examples, how do you manage to restrain yourself from overspending or succumbing to sexual temptations? The present article summarizes two recent studies stressing the fundamental importance of inhibition in the process of decision making. Based on the results of these studies, we dare to claim that the capacity to resist temptation depends on the activity level of the right prefrontal cortex (PFC).

Pulse-shaping assisted multidimensional coherent electronic spectroscopy

Understanding nuclear and electronic dynamics of molecular systems has advanced considerably by probing their nonlinear responses with a suitable sequence of pulses. Moreover, the ability to control crucial parameters of the excitation pulses, such as duration, sequence, frequency, polarization, slowly varying envelope, or carrier phase, has led to a variety of advanced time-resolved spectroscopic methodologies. Recently, two-dimensional electronic spectroscopy with ultrashort pulses has become a more and more popular tool since it allows to obtain information on energy and coherence transfer phenomena, line broadening mechanisms, or the presence of quantum coherences in molecular complexes. Here, we present a high fidelity two-dimensional electronic spectroscopy setup designed for molecular systems in solution. It incorporates the versatility of pulse-shaping methods to achieve full control on the amplitude and phase of the individual exciting and probing pulses. Selective and precise amplitude- and phase-modulation is shown and applied to investigate electronic dynamics in several reference molecular systems.