An Actor-Critic based controller for glucose regulation in type 1 diabetes

A novel adaptive approach for glucose control in individuals with type 1 diabetes under sensor-augmented pump therapy is proposed. The controller, is based on Actor-Critic (AC) learning and is inspired by the principles of reinforcement learning and optimal control theory. The main characteristics of the proposed controller are (i) simultaneous adjustment of both the insulin basal rate and the bolus dose, (ii) initialization based on clinical procedures, and (iii) real-time personalization. The effectiveness of the proposed algorithm in terms of glycemic control has been investigated in silico in adults, adolescents and children under open-loop and closed-loop approaches, using announced meals with uncertainties in the order of ±25% in the estimation of carbohydrates. The results show that glucose regulation is efficient in all three groups of patients, even with uncertainties in the level of carbohydrates in the meal. The percentages in the A+B zones of the Control Variability Grid Analysis (CVGA) were 100% for adults, and 93% for both adolescents and children. The AC based controller seems to be a promising approach for the automatic adjustment of insulin infusion in order to improve glycemic control. After optimization of the algorithm, the controller will be tested in a clinical trial.

Sugar concentration influences decision making in <i>Apis mellifera</i> L. workers during early-stage honey storage behaviour

Decision making in honeybees is based on in- formation which is acquired and processed in order to make choices between two or more al- ternatives. These choices lead to the expression of optimal behaviour strategies such as floral constancy. Optimal foraging strategies such as floral constancy improve a colony’s chances of survival, however to our knowledge, there has been no research on decision making based on optimal storage strategies. Here we show, using diagnostic radioentomology, that decision mak- ing in storer bees is influenced by nectar sugar concentrations and that, within 48 hours of col- lection, honeybees workers store carbohydrates in groups of cells with similar sugar concentra- tions in a nonrandom way. This behaviour, as evidenced by patchy spatial cell distributions, would help to hasten the ripening process by reducing the distance between cells of similar sugar concentrations. Thus, colonies which ex- hibit optimal storage strategies such as these would have an evolutionary advantage and im- prove colony survival expectations over less efficient colonies and it should be plausible to select colonies that exhibit these preferred traits.

Optimization of Schwinger pair production in colliding laser pulses

Recent studies of Schwinger pair production have demonstrated that the asymptotic particle spectrum is extremely sensitive to the applied field profile. We extend the idea of the dynamically assisted Schwinger effect from single pulse profiles to more realistic field configurations to be generated in an all-optical experiment searching for pair creation. We use the quantum kinetic approach to study the particle production and employ a multi-start method, combined with optimal control theory, to determine a set of parameters for which the particle yield in the forward direction in momentum space is maximized. We argue that this strategy can be used to enhance the signal of pair production on a given detector in an experimental setup.

The inverse problem for Schwinger pair production

The production of electron–positron pairs in time-dependent electric fields (Schwinger mechanism) depends non-linearly on the applied field profile. Accordingly, the resulting momentum spectrum is extremely sensitive to small variations of the field parameters. Owing to this non-linear dependence it is so far unpredictable how to choose a field configuration such that a predetermined momentum distribution is generated. We show that quantum kinetic theory along with optimal control theory can be used to approximately solve this inverse problem for Schwinger pair production. We exemplify this by studying the superposition of a small number of harmonic components resulting in predetermined signatures in the asymptotic momentum spectrum. In the long run, our results could facilitate the observation of this yet unobserved pair production mechanism in quantum electrodynamics by providing suggestions for tailored field configurations.

Patches of Bare Ground as a Staple Commodity for Declining Ground-Foraging Insectivorous Farmland Birds

Conceived to combat widescale biodiversity erosion in farmland, agri-environment schemes have largely failed to deliver their promises despite massive financial support. While several common species have shown to react positively to existing measures, rare species have continued to decline in most European countries. Of particular concern is the status of insectivorous farmland birds that forage on the ground. We modelled the foraging habitat preferences of four declining insectivorous bird species (hoopoe, wryneck, woodlark, common redstart) inhabiting fruit tree plantations, orchards and vineyards. All species preferred foraging in habitat mosaics consisting of patches of grass and bare ground, with an optimal, species-specific bare ground coverage of 30–70% at the foraging patch scale. In the study areas, birds thrived in intensively cultivated farmland where such ground vegetation mosaics existed. Not promoted by conventional agri-environment schemes until now, patches of bare ground should be implemented throughout grassland in order to prevent further decline of insectivorous farmland birds.

Statistical inference for the optimal approximating model

In the setting of high-dimensional linear models with Gaussian noise, we investigate the possibility of confidence statements connected to model selection. Although there exist numerous procedures for adaptive (point) estimation, the construction of adaptive confidence regions is severely limited (cf. Li in Ann Stat 17:1001–1008, 1989). The present paper sheds new light on this gap. We develop exact and adaptive confidence regions for the best approximating model in terms of risk. One of our constructions is based on a multiscale procedure and a particular coupling argument. Utilizing exponential inequalities for noncentral χ2-distributions, we show that the risk and quadratic loss of all models within our confidence region are uniformly bounded by the minimal risk times a factor close to one.

A Normative Theory of Forgetting: Lessons from the Fruit Fly

Recent experiments revealed that the fruit fly Drosophila melanogaster has a dedicated mechanism for forgetting: blocking the G-protein Rac leads to slower and activating Rac to faster forgetting. This active form of forgetting lacks a satisfactory functional explanation. We investigated optimal decision making for an agent adapting to a stochastic environment where a stimulus may switch between being indicative of reward or punishment. Like Drosophila, an optimal agent shows forgetting with a rate that is linked to the time scale of changes in the environment. Moreover, to reduce the odds of missing future reward, an optimal agent may trade the risk of immediate pain for information gain and thus forget faster after aversive conditioning. A simple neuronal network reproduces these features. Our theory shows that forgetting in Drosophila appears as an optimal adaptive behavior in a changing environment. This is in line with the view that forgetting is adaptive rather than a consequence of limitations of the memory system.

Distortion-free enhancement of terahertz signals measured by electro-optic sampling. I. Theory

We present three methods for the distortion-free enhancement of THz signals measured by electro-optic sampling in zinc blende-type detector crystals, e.g., ZnTe or GaP. A technique commonly used in optically heterodyne-detected optical Kerr effect spectroscopy is introduced, which is based on two measurements at opposite optical biases near the zero transmission point in a crossed polarizer detection geometry. In contrast to other techniques for an undistorted THz signal enhancement, it also works in a balanced detection scheme and does not require an elaborate procedure for the reconstruction of the true signal as the two measured waveforms are simply subtracted to remove distortions. We study three different approaches for setting an optical bias using the Jones matrix formalism and discuss them also in the framework of optical heterodyne detection. We show that there is an optimal bias point in realistic situations where a small fraction of the probe light is scattered by optical components. The experimental demonstration will be given in the second part of this two-paper series [J. Opt. Soc. Am. B, doc. ID 204877 (2014, posted online)].