An Actor-Critic based controller for glucose regulation in type 1 diabetes

A novel adaptive approach for glucose control in individuals with type 1 diabetes under sensor-augmented pump therapy is proposed. The controller, is based on Actor-Critic (AC) learning and is inspired by the principles of reinforcement learning and optimal control theory. The main characteristics of the proposed controller are (i) simultaneous adjustment of both the insulin basal rate and the bolus dose, (ii) initialization based on clinical procedures, and (iii) real-time personalization. The effectiveness of the proposed algorithm in terms of glycemic control has been investigated in silico in adults, adolescents and children under open-loop and closed-loop approaches, using announced meals with uncertainties in the order of ±25% in the estimation of carbohydrates. The results show that glucose regulation is efficient in all three groups of patients, even with uncertainties in the level of carbohydrates in the meal. The percentages in the A+B zones of the Control Variability Grid Analysis (CVGA) were 100% for adults, and 93% for both adolescents and children. The AC based controller seems to be a promising approach for the automatic adjustment of insulin infusion in order to improve glycemic control. After optimization of the algorithm, the controller will be tested in a clinical trial.

GoCARB in the Context of an Artificial Pancreas

Background: In an artificial pancreas (AP), the meals are either manually announced or detected and their size estimated from the blood glucose level. Both methods have limitations, which result in suboptimal postprandial glucose control. The GoCARB system is designed to provide the carbohydrate content of meals and is presented within the AP framework. Method: The combined use of GoCARB with a control algorithm is assessed in a series of 12 computer simulations. The simulations are defined according to the type of the control (open or closed loop), the use or not-use of GoCARB and the diabetics’ skills in carbohydrate estimation. Results: For bad estimators without GoCARB, the percentage of the time spent in target range (70-180 mg/dl) during the postprandial period is 22.5% and 66.2% for open and closed loop, respectively. When the GoCARB is used, the corresponding percentages are 99.7% and 99.8%. In case of open loop, the time spent in severe hypoglycemic events (<50 mg/dl) is 33.6% without the GoCARB and is reduced to 0.0% when the GoCARB is used. In case of closed loop, the corresponding percentage is 1.4% without the GoCARB and is reduced to 0.0% with the GoCARB. Conclusion: The use of GoCARB improves the control of postprandial response and glucose profiles especially in the case of open loop. However, the most efficient regulation is achieved by the combined use of the control algorithm and the GoCARB.

Population pharmacokinetics of sevoflurane in conjunction with the AnaConDa: toward target-controlled infusion of volatiles into the breathing system

BACKGROUND: The Anesthetic Conserving Device (AnaConDa) uncouples delivery of a volatile anesthetic (VA) from fresh gas flow (FGF) using a continuous infusion of liquid volatile into a modified heat-moisture exchanger capable of adsorbing VA during expiration and releasing adsorbed VA during inspiration. It combines the simplicity and responsiveness of high FGF with low agent expenditures. We performed in vitro characterization of the device before developing a population pharmacokinetic model for sevoflurane administration with the AnaConDa, and retrospectively testing its performance (internal validation). MATERIALS AND METHODS: Eighteen females and 20 males, aged 31-87, BMI 20-38, were included. The end-tidal concentrations were varied and recorded together with the VA infusion rates into the device, ventilation and demographic data. The concentration-time course of sevoflurane was described using linear differential equations, and the most suitable structural model and typical parameter values were identified. The individual pharmacokinetic parameters were obtained and tested for covariate relationships. Prediction errors were calculated. RESULTS: In vitro studies assessed the contribution of the device to the pharmacokinetic model. In vivo, the sevoflurane concentration-time courses on the patient side of the AnaConDa were adequately described with a two-compartment model. The population median absolute prediction error was 27% (interquartile range 13-45%). CONCLUSION: The predictive performance of the two-compartment model was similar to that of models accepted for TCI administration of intravenous anesthetics, supporting open-loop administration of sevoflurane with the AnaConDa. Further studies will focus on prospective testing and external validation of the model implemented in a target-controlled infusion device.

Use of a computerized closed-loop sodium nitroprusside titration system for antihypertensive treatment after open heart surgery

This study evaluates the clinical applicability of administering sodium nitroprusside by a closed-loop titration system compared with a manually adjusted system. The mean arterial pressure (MAP) was registered every 10 and 30 sec during the first 150 min after open heart surgery in 20 patients (group 1: computer regulation) and in ten patients (group 2: manual regulation). The results (16,343 and 2,912 data points in groups 1 and 2, respectively), were then analyzed in four time frames and five pressure ranges to indicate clinical efficacy. Sixty percent of the measured MAP in both groups was within the desired +/- 10% during the first 10 min. Thereafter until the end of observation, the MAP was maintained within +/- 10% of the desired set-point 90% of the time in group 1 vs. 60% of the time in group 2. One percent and 11% of data points were +/- 20% from the set-point in groups 1 and 2, respectively (p less than .05, chi-square test). The computer-assisted therapy provided better control of MAP, was safe to use, and helped to reduce nursing demands.

Innate-like control of human iNKT cell autoreactivity via the hypervariable CDR3beta loop

Invariant Natural Killer T cells (iNKT) are a versatile lymphocyte subset with important roles in both host defense and immunological tolerance. They express a highly conserved TCR which mediates recognition of the non-polymorphic, lipid-binding molecule CD1d. The structure of human iNKT TCRs is unique in that only one of the six complementarity determining region (CDR) loops, CDR3beta, is hypervariable. The role of this loop for iNKT biology has been controversial, and it is unresolved whether it contributes to iNKT TCR:CD1d binding or antigen selectivity. On the one hand, the CDR3beta loop is dispensable for iNKT TCR binding to CD1d molecules presenting the xenobiotic alpha-galactosylceramide ligand KRN7000, which elicits a strong functional response from mouse and human iNKT cells. However, a role for CDR3beta in the recognition of CD1d molecules presenting less potent ligands, such as self-lipids, is suggested by the clonal distribution of iNKT autoreactivity. We demonstrate that the human iNKT repertoire comprises subsets of greatly differing TCR affinity to CD1d, and that these differences relate to their autoreactive functions. These functionally different iNKT subsets segregate in their ability to bind CD1d-tetramers loaded with the partial agonist alpha-linked glycolipid antigen OCH and structurally different endogenous beta-glycosylceramides. Using surface plasmon resonance with recombinant iNKT TCRs and different ligand-CD1d complexes, we demonstrate that the CDR3beta sequence strongly impacts on the iNKT TCR affinity to CD1d, independent of the loaded CD1d ligand. Collectively our data reveal a crucial role for CDR3beta for the function of human iNKT cells by tuning the overall affinity of the iNKT TCR to CD1d. This mechanism is relatively independent of the bound CD1d ligand and thus forms the basis of an inherent, CDR3beta dependent functional hierarchy of human iNKT cells.

Closed-loop control of mean arterial blood pressure during surgery with alfentanil: clinical evaluation of a novel model-based predictive controller

BACKGROUND: In contrast to hypnosis, there is no surrogate parameter for analgesia in anesthetized patients. Opioids are titrated to suppress blood pressure response to noxious stimulation. The authors evaluated a novel model predictive controller for closed-loop administration of alfentanil using mean arterial blood pressure and predicted plasma alfentanil concentration (Cp Alf) as input parameters. METHODS: The authors studied 13 healthy patients scheduled to undergo minor lumbar and cervical spine surgery. After induction with propofol, alfentanil, and mivacurium and tracheal intubation, isoflurane was titrated to maintain the Bispectral Index at 55 (+/- 5), and the alfentanil administration was switched from manual to closed-loop control. The controller adjusted the alfentanil infusion rate to maintain the mean arterial blood pressure near the set-point (70 mmHg) while minimizing the Cp Alf toward the set-point plasma alfentanil concentration (Cp Alfref) (100 ng/ml). RESULTS: Two patients were excluded because of loss of arterial pressure signal and protocol violation. The alfentanil infusion was closed-loop controlled for a mean (SD) of 98.9 (1.5)% of presurgery time and 95.5 (4.3)% of surgery time. The mean (SD) end-tidal isoflurane concentrations were 0.78 (0.1) and 0.86 (0.1) vol%, the Cp Alf values were 122 (35) and 181 (58) ng/ml, and the Bispectral Index values were 51 (9) and 52 (4) before surgery and during surgery, respectively. The mean (SD) absolute deviations of mean arterial blood pressure were 7.6 (2.6) and 10.0 (4.2) mmHg (P = 0.262), and the median performance error, median absolute performance error, and wobble were 4.2 (6.2) and 8.8 (9.4)% (P = 0.002), 7.9 (3.8) and 11.8 (6.3)% (P = 0.129), and 14.5 (8.4) and 5.7 (1.2)% (P = 0.002) before surgery and during surgery, respectively. A post hoc simulation showed that the Cp Alfref decreased the predicted Cp Alf compared with mean arterial blood pressure alone. CONCLUSION: The authors' controller has a similar set-point precision as previous hypnotic controllers and provides adequate alfentanil dosing during surgery. It may help to standardize opioid dosing in research and may be a further step toward a multiple input-multiple output controller.

A pentasymmetric open channel blocker for Cys-loop receptor channels.

γ-Aminobutyric acid type A receptors (GABAA receptors) are chloride ion channels composed of five subunits, mediating fast synaptic and tonic inhibition in the mammalian brain. These receptors show near five-fold symmetry that is most pronounced in the second trans-membrane domain M2 lining the Cl- ion channel. To take advantage of this inherent symmetry, we screened a variety of aromatic anions with matched symmetry and found an inhibitor, pentacyanocyclopentdienyl anion (PCCP-) that exhibited all characteristics of an open channel blocker. Inhibition was strongly dependent on the membrane potential. Through mutagenesis and covalent modification, we identified the region α1V256-α1T261 in the rat recombinant GABAA receptor to be important for PCCP- action. Introduction of positive charges into M2 increased the affinity for PCCP- while PCCP- prevented the access of a positively charged molecule into M2. Interestingly, other anion selective cys-loop receptors were also inhibited by PCCP-, among them the Drosophila RDL GABAA receptor carrying an insecticide resistance mutation, suggesting that PCCP- could serve as an insecticide.