Personalized Tuning of a Reinforcement Learning Control Algorithm for Glucose Regulation

Artificial pancreas is in the forefront of research towards the automatic insulin infusion for patients with type 1 diabetes. Due to the high inter- and intra-variability of the diabetic population, the need for personalized approaches has been raised. This study presents an adaptive, patient-specific control strategy for glucose regulation based on reinforcement learning and more specifically on the Actor-Critic (AC) learning approach. The control algorithm provides daily updates of the basal rate and insulin-to-carbohydrate (IC) ratio in order to optimize glucose regulation. A method for the automatic and personalized initialization of the control algorithm is designed based on the estimation of the transfer entropy (TE) between insulin and glucose signals. The algorithm has been evaluated in silico in adults, adolescents and children for 10 days. Three scenarios of initialization to i) zero values, ii) random values and iii) TE-based values have been comparatively assessed. The results have shown that when the TE-based initialization is used, the algorithm achieves faster learning with 98%, 90% and 73% in the A+B zones of the Control Variability Grid Analysis for adults, adolescents and children respectively after five days compared to 95%, 78%, 41% for random initialization and 93%, 88%, 41% for zero initial values. Furthermore, in the case of children, the daily Low Blood Glucose Index reduces much faster when the TE-based tuning is applied. The results imply that automatic and personalized tuning based on TE reduces the learning period and improves the overall performance of the AC algorithm.

The prospect of applying chemical elicitors and plant strengtheners to enhance the biological control of crop pests

An imminent food crisis reinforces the need for novel strategies to increase crop yields worldwide. Effective control of pest insects should be part of such strategies, preferentially with reduced negative impact on the environment and optimal protection and utilization of existing biodiversity. Enhancing the presence and efficacy of native biological control agents could be one such strategy. Plant strengthener is a generic term for several commercially available compounds or mixtures of compounds that can be applied to cultivated plants in order to ‘boost their vigour, resilience and performance’. Studies into the consequences of boosting plant resistance against pests and diseases on plant volatiles have found a surprising and dramatic increase in the plants' attractiveness to parasitic wasps. Here, we summarize the results from these studies and present new results from assays that illustrate the great potential of two commercially available resistance elicitors. We argue that plant strengtheners may currently be the best option to enhance the attractiveness of cultivated plants to biological control agents. Other options, such as the genetic manipulation of the release of specific volatiles may offer future solutions, but in most systems, we still miss fundamental knowledge on which key attractants should be targeted for this approach.

Self-control in social decision making: A neurobiological perspective

Self-control is defined as the process in which thoughts, emotions, or prepotent responses are inhibited to efficiently enact a more focal goal. Self-control not only allows for more adaptive individual decision making but also promotes adaptive social decision making. In this chapter, we examine a burgeoning area of interdisciplinary research: the neuroscience of self-control in social decision making. We examine research on self-control in complex social contexts examined from a social neuroscience perspective. We review correlational evidence from neuroimaging studies and causal evidence from neuromodulation studies (i.e., brain stimulation). We specifically highlight research that shows that self-control involves the lateral prefrontal cortex (PFC) across a number of social domains and behaviors. Research has also begun to directly integrate nonsocial with social forms of self-control, showing that the basic neurobiological processes involved in stopping a motor response appear to be involved in social contexts that require self-control. Further, neural traits, such as baseline activation in the lateral PFC, can explain sources of individual differences in self-control capacity. We explore whether techniques that change brain functioning could target neural mechanisms related to self-control capacity to potentially enhance self-control in social behavior. Finally, we discuss several research questions ripe for examination. We broadly suggest that future research can now turn to exploring how neural traits and situational affordances interact to impact self-control in social decision making in order to continue to elucidate the processes that allow people to maintain and realize stable goals in a dynamic and often uncertain social environment.

Dyadic action control in overweight and obese couples: Effectiveness of a randomized controlled trial to promote physical activity.

BACKGROUND: Enhancing physical activity in overweight and obese individuals is an important means to promote health in this target population. The Health Action Process Approach (HAPA), which was the theoretical framework of this study, focuses on individual self-regulation variables for successful health behavior change. One key self-regulation variable of this model is action control with its three subfacets awareness of intentions, self-monitoring and regulatory effort. The social context of individuals, however, is usually neglected in common health behavior change theories. In order to integrate social influences into the HAPA, this randomized controlled trial investigated the effectiveness of a dyadic conceptualization of action control for promoting physical activity. METHODS/DESIGN: This protocol describes the design of a single-blind randomized controlled trial, which comprises four experimental groups: a dyadic action control group, an individual action control group and two control groups. Participants of this study are overweight or obese, heterosexual adult couples who intend to increase their physical activity. Blocking as means of a gender-balanced randomization is used to allocate couples to conditions and partners to either being the target person of the intervention or to the partner condition. The ecological momentary intervention takes place in the first 14 days after baseline assessment and is followed by another 14 days diary phase without intervention. Follow-ups are one month and six months later. Subsequent to the six-months follow-up another 14 days diary phase takes place.The main outcome measures are self-reported and accelerometer-assessed physical activity. Secondary outcome measures are Body Mass Index (BMI), aerobic fitness and habitual physical activity. DISCUSSION: This is the first study examining a dyadic action control intervention in comparison to an individual action control condition and two control groups applying a single-blind randomized control trial. Challenges with running couples studies as well as advantages and disadvantages of certain design-related decisions are discussed. This RCT was funded by the Swiss National Science Foundation (PP00P1_133632/1) and was registered on 27/04/2012 at http://www.isrctn.com/ISRCTN15705531.

Messung dispositioneller Selbstkontroll-Kapazität: Eine deutsche Adaptation der Kurzform der Self-Control Scale (SCS-K-D)

Self-control is defined as the overriding or modification of one’s own response tendencies. Dispositional self control capacity is positively linked to various kinds of adaptive behavior. In order to economically measure self-control capacity in German-speaking samples, the brief version of the Self-Control Scale by Tangney, Baumeister and Boone (2004) was adapted into German. The translated entire Self-Control Scale consisting of 36 items was administered to university students (N = 316, study 1) and secondary school students (N = 335, study 2). The brief version consisting of 13 items, which were included in the entire scale, proved to be one-dimensional, reliable, and valid in terms of expected correlations with criteria. The comparison between the brief and the entire scale showed that the costs of the more economical brief measure with regard to reliability and validity are low.

Quality Control for SP Performance Regarding Patient Portrayal in a High-Stakes OSCE

Introduction Since the quality of patient portrayal of standardized patients (SPs) during an Objective Structured Clinical Exam (OSCE) has a major impact on the reliability and validity of the exam, quality control should be initiated. Literature about quality control of SP’s performance focuses on feedback [1, 2] or completion of checklists [3, 4]. Since we did not find a published instrument meeting our needs for the assessment of patient portrayal, we developed such an instrument after being inspired by others [5] and used it in our high-stakes exam. Methods SP trainers from all five Swiss medical faculties collected and prioritized quality criteria for patient portrayal. Items were revised with the partners twice, based on experiences during OSCEs. The final instrument contains 14 criteria for acting (i.e. adequate verbal and non-verbal expression) and standardization (i.e. verbatim delivery of the first sentence). All partners used the instrument during a high-stakes OSCE. Both, SPs and trainers were introduced to the instrument. The tool was used in training (more than 100 observations) and during the exam (more than 250 observations). FAIR_OSCE The list of items to assess the quality of the simulation by SPs was primarily developed and used to provide formative feedback to the SPs in order to help them to improve their performance. It was therefore named “Feedbackstruckture for the Assessment of Interactive Role play in Objective Structured Clinical Exams (FAIR_OSCE). It was also used to assess the quality of patient portrayal during the exam. The results were calculated for each of the five faculties individually. Formative evaluation was given to the five faculties with individual feedback without revealing results of other faculties other than overall results. Results High quality of patient portrayal during the exam was documented. More than 90% of SP performances were rated to be completely correct or sufficient. An increase in quality of performance between training and exam was noted. In example the rate of completely correct reaction in medical tests increased from 88% to 95%. 95% completely correct reactions together with 4% sufficient reactions add up to 99% of the reactions meeting the requirements of the exam. SP educators using the instrument reported an augmentation of SPs performance induced by the use of the instrument. Disadvantages mentioned were high concentration needed to explicitly observe all criteria and cumbersome handling of the paper-based forms. Conclusion We were able to document a very high quality of SP performance in our exam. The data also indicate that our training is effective. We believe that the high concentration needed using the instrument is well invested, considering the observed augmentation of performance. The development of an iPad based application for the form is planned to address the cumbersome handling of the paper.

A Dyadic Action Control Trial in Overweight and Obese Couples (DYACTIC)

BACKGROUND: Enhancing physical activity in overweight and obese individuals is an important means to promote health in this target population. The Health Action Process Approach (HAPA), which was the theoretical framework of this study, focuses on individual self-regulation variables for successful health behavior change. One key self-regulation variable of this model is action control with its three subfacets awareness of intentions, self-monitoring and regulatory effort. The social context of individuals, however, is usually neglected in common health behavior change theories. In order to integrate social influences into the HAPA, this randomized controlled trial investigated the effectiveness of a dyadic conceptualization of action control for promoting physical activity. METHODS/DESIGN: This protocol describes the design of a single-blind randomized controlled trial, which comprises four experimental groups: a dyadic action control group, an individual action control group and two control groups. Participants of this study are overweight or obese, heterosexual adult couples who intend to increase their physical activity. Blocking as means of a gender-balanced randomization is used to allocate couples to conditions and partners to either being the target person of the intervention or to the partner condition. The ecological momentary intervention takes place in the first 14 days after baseline assessment and is followed by another 14 days diary phase without intervention. Follow-ups are one month and six months later. Subsequent to the six-months follow-up another 14 days diary phase takes place.The main outcome measures are self-reported and accelerometer-assessed physical activity. Secondary outcome measures are Body Mass Index (BMI), aerobic fitness and habitual physical activity. DISCUSSION: This is the first study examining a dyadic action control intervention in comparison to an individual action control condition and two control groups applying a single-blind randomized control trial. Challenges with running couples studies as well as advantages and disadvantages of certain design-related decisions are discussed. This RCT was funded by the Swiss National Science Foundation (PP00P1_133632/1) and was registered on 27/04/2012 at http://www.isrctn.com/ISRCTN15705531.

Higher order parametric excitation modes for spaceborne quadrupole mass spectrometers

This paper describes a technique to significantly improve upon the mass peak shape and mass resolution of spaceborne quadrupolemass spectrometers (QMSs) through higher order auxiliary excitation of the quadrupole field. Using a novel multiresonant tank circuit, additional frequency components can be used to drive modulating voltages on the quadrupole rods in a practical manner, suitable for both improved commercial applications and spaceflight instruments. Auxiliary excitation at frequencies near twice that of the fundamental quadrupole RF frequency provides the advantages of previously studied parametric excitation techniques, but with the added benefit of increased sensed excitation amplitude dynamic range and the ability to operate voltage scan lines through the center of upper stability islands. Using a field programmable gate array, the amplitudes and frequencies of all QMS signals are digitally generated and managed, providing a robust and stable voltage control system. These techniques are experimentally verified through an interface with a commercial Pfeiffer QMG422 quadrupole rod system. When operating through the center of a stability island formed from higher order auxiliary excitation, approximately 50% and 400% improvements in 1% mass resolution and peak stability were measured, respectively, when compared with traditional QMS operation. Although tested with a circular rod system, the presented techniques have the potential to improve the performance of both circular and hyperbolic rod geometry QMS sensors.

Fine control of drug delivery for cochlear implant applications

Cochlear implants are neuroprostheses that are inserted into the inner ear to directly electrically stimulate the auditory nerve, thus replacing lost cochlear receptors, the hair cells. The reduction of the gap between electrodes and nerve cells will contribute to technological solutions simultaneously increasing the frequency resolution, the sound quality and the amplification of the signal. Recent findings indicate that neurotrophins (NTs) such as brain derived neurotrophic factor (BDNF) stimulate the neurite outgrowth of auditory nerve cells by activating Trk receptors on the cellular surface (1–3). Furthermore, small-size TrkB receptor agonists such as di-hydroxyflavone (DHF) are now available, which activate the TrkB receptor with similar efficiency as BDNF, but are much more stable (4). Experimentally, such molecules are currently used to attract nerve cells towards, for example, the electrodes of cochlear implants. This paper analyses the scenarios of low dose aspects of controlled release of small-size Trk receptor agonists from the coated CI electrode array into the inner ear. The control must first ensure a sufficient dose for the onset of neurite growth. Secondly, a gradient in concentration needs to be maintained to allow directive growth of neurites through the perilymph-filled gap towards the electrodes of the implant. We used fluorescein as a test molecule for its molecular size similarity to DHF and investigated two different transport mechanisms of drug dispensing, which both have the potential to fulfil controlled low-throughput drug-deliverable requirements. The first is based on the release of aqueous fluorescein into water through well-defined 60-μm size holes arrays in a membrane by pure osmosis. The release was both simulated using the software COMSOL and observed experimentally. In the second approach, solid fluorescein crystals were encapsulated in a thin layer of parylene (PPX), hence creating random nanometer-sized pinholes. In this approach, the release occurred due to subsequent water diffusion through the pinholes, dissolution of the fluorescein and then release by out-diffusion. Surprisingly, the release rate of solid fluorescein through the nanoscopic scale holes was found to be in the same order of magnitude as for liquid fluorescein release through microscopic holes.

A multinational case-control study on childhood brain tumours, anthropogenic factors, birth characteristics and prenatal exposures: A validation of interview data.

Little is known about the aetiology of childhood brain tumours. We investigated anthropometric factors (birth weight, length, maternal age), birth characteristics (e.g. vacuum extraction, preterm delivery, birth order) and exposures during pregnancy (e.g. maternal: smoking, working, dietary supplement intake) in relation to risk of brain tumour diagnosis among 7-19 year olds. The multinational case-control study in Denmark, Sweden, Norway and Switzerland (CEFALO) included interviews with 352 (participation rate=83.2%) eligible cases and 646 (71.1%) population-based controls. Interview data were complemented with data from birth registries and validated by assessing agreement (Cohen's Kappa). We used conditional logistic regression models matched on age, sex and geographical region (adjusted for maternal age and parental education) to explore associations between birth factors and childhood brain tumour risk. Agreement between interview and birth registry data ranged from moderate (Kappa=0.54; worked during pregnancy) to almost perfect (Kappa=0.98; birth weight). Neither anthropogenic factors nor birth characteristics were associated with childhood brain tumour risk. Maternal vitamin intake during pregnancy was indicative of a protective effect (OR 0.75, 95%-CI: 0.56-1.01). No association was seen for maternal smoking during pregnancy or working during pregnancy. We found little evidence that the considered birth factors were related to brain tumour risk among children and adolescents.

A case-control study of tea/coffee consumption and lung cancer risk

Background. Despite the increasing attention to the effects of dietary factors on lung cancer risk, epidemiological research on the role of black/green tea and coffee intake and lung cancer risk is scarce. The purpose of this study was to explore the following three hypotheses: (1) the preventive (protective) effect from lung cancer is higher in green tea than in black tea and coffee consumption. (2) brewed tea (either black or green) daily drinkers have lower odds of lung cancer than non-drinkers of brewed tea (3) regular black and green tea have more preventive effect against lung cancer than decaffeinated teas due to the synergistic effect of caffeine and other tea components. ^ Methods. Data on 1,088 lung cancer cases and 1,127 controls from an ongoing epidemiological study of lung cancer by the Department of Epidemiology of the University of Texas M.D. Anderson Cancer were analyzed. Multiple logistic regressions were performed for testing associations between frequency of specific types of tea/coffee consumption and the risk of lung cancer. ^ Results. We observed that more than a cup a week of green tea and decaffeinated black tea were significantly associated with reduced odds of lung cancer by 64% for green tea (adjusted OR = 0.44; 95% CI = 0.31–0.64), 36% for decaffeinated black tea (OR = 0.64; 95% CI = 0.45–0.90), when compared with non-drinkers and those who drank less than a cup a week. On the other hand, increasing intake of regular coffee (more than 3 cups a day) was associated with a 30% higher odds ratio of lung cancer (OR = 1.30; 95% CI = 1.01–1.09). No association was found between regular black tea, decaffeinated coffee consumption and the odds ratio of lung cancer. However, when drinkers of other tea/coffee beverages were excluded from each model in order to explore the independent effect of each type of tea/coffee, green tea and decaffeinated black tea-lung cancer associations remained but no association was observed for drinkers of regular coffee. ^ Conclusion. We report the chemopreventive effects of more than a cup a week of green tea and decaffeinated black tea on lung cancer. ^

Financial performance drivers and strategic control: The case of cancer treatment centers

Strategic control is defined as the use of qualitative and quantitative tools for the evaluation of strategic organizational performance. Most research in strategic planning has focused on strategy formulation and implementation, but little work has been done on strategic performance evaluation particularly in the area of cancer research. The objective of this study was to identify strategic control approaches and financial performance metrics used by major cancer centers in the country as an initial step in expanding the theory and practice behind strategic organizational performance. Focusing on hospitals which share similar mandate and resource constraints was expected to improve measurement precision. The results indicate that most cancer centers use a wide selection of evaluation tools, but sophisticated analytical approaches were less common. In addition, there was evidence that high-performing centers tend to invest a larger degree of resources in the area of strategic performance analysis than centers showing lower financial results. The conclusions point to the need for incorporating higher degree of analytical power in order to improve the tracking of strategic performance. This study is one of the first to concentrate in the area of strategic control.^

Genetic variability and the hypothalamic control of energy balance

Background. Obesity is a major health problem throughout the industrialized world. Despite numerous attempts to curtail the rapid growth of obesity, its incidence continues to rise. Therefore, it is crucial to better understand the etiology of obesity beyond the concept of energy balance.^ Aims. The first aim of this study was to first investigate the relationship between eating behaviors and body size. The second goal was to identify genetic variation associated with eating behaviors. Thirdly, this study aimed to examine the joint relationships between eating behavior, body size and genetic variation.^ Methods. This study utilized baseline data ascertained in young adults from the Training Interventions and Genetics of Exercise (TIGER) Study. Variables assessed included eating behavior (Emotional Eating Scale, Eating Attitudes Test-26, and the Block98 Food Frequency Questionnaire), body size (body mass index, waist and hip circumference, waist/hip ratio, and percent body fat), genetic variation in genes implicated related to the hypothalamic control of energy balance, and appropriate covariates (age, gender, race/ethnicity, smoking status, and physical activity. For the genetic association analyses, genotypes were collapsed by minor allele frequency, and haplotypes were estimated for each gene. Additionally, Bayesian networks were constructed in order to determine the relationships between genetic variation, eating behavior and body size.^ Results. We report that the EAT-26 score, Caloric intake, percent fat, fiber intake, HEAT index, and daily servings of vegetables, meats, grains, and fats were significantly associated with at least one body size measure. Multiple SNPs in 17 genes and haplotypes from 12 genes were tested for their association with body size. Variation within both DRD4 and HTR2A was found to be associated with EAT-26 score. In addition, variation in the ghrelin gene (GHRL) was significantly associated with daily Caloric intake. A significant interaction between daily servings of grains and the HEAT index and variation within the leptin receptor gene (LEPR) was shown to influence body size.^ Conclusion. This study has shown that there is a substantial genetic component to eating behavior and that genetic variation interacts with eating behavior to influence body size.^

Dietary patterns and risk of pancreatic cancer in a hospital-based case-control study

Background. It is important to understand the association between diet and risk of pancreatic cancer in order to better understand the etiology of pancreatic cancer.^ Objectives. Describe the dietary patterns of cases of adenocarcinoma of the pancreas and non-cancer controls and evaluate the odds of having a healthy eating pattern among cases and non-cancer controls.^ Design and Methods. An ongoing hospital-based case-control study was conducted in Houston, Texas from 2000-2008 with 678 pancreatic adenocarcinoma cases and 724 controls. Participants completed a food frequency questionnaire and a risk factor questionnaire. Dietary patterns were derived by principal component analysis and associations between dietary patterns and pancreatic cancer risk were assessed using unconditional logistic regression.^ Results. Two dietary patterns were derived: fruit-vegetable and high fat-meat. There were no statistically significant associations between the fruit-vegetable pattern and pancreatic cancer. An inverse association was seen between the high fat-meat pattern and pancreatic cancer risk when comparing those in the upper intake quintile to those scoring in the lowest quintile after adjusting for demographic and risk factor variables (OR=0.67, p=0.03). In sex-stratified analysis adjusted for demographic and risk factor variables, females scoring in the upper intake quintile of the fruit-vegetable pattern had a 49% lower risk of pancreatic cancer compared to females scoring in the lowest quintile (OR=0.51, p=0.03). An inverse relationship was also seen for the high fat-meat pattern when comparing females in the upper intake quintile to females in the lowest quintile (OR=0.50, p=0.03). In males, neither dietary pattern was significantly associated with pancreatic cancer.^ Conclusions. The current findings for the fruit-vegetable pattern are similar to those of previous studies and support the hypothesis that there is an inverse association between a “healthy” diet (comprised of fruits, vegetables, and whole grains) and risk of having pancreatic cancer (in females only). However, the inverse relationship with the high fat-meat pattern and risk of pancreatic cancer is contrary to other results. Further research on dietary patters and pancreatic cancer risk may lead to better understanding of the etiologic cause of pancreatic cancer.^

Leukemia and occupational exposure to electromagnetic fields: An incident case-control study

The existence of an association between leukemia and electromagnetic fields (EMF) is still controversial. The results of epidemiologic studies of leukemia in occupational groups with exposure to EMF are inconsistent. Weak associations have been seen in a few studies. EMF assessment is lacking in precision. Reported dose-response relationships have been based on qualitative levels of exposure to EMF without regard to duration of employment or EMF intensity on the jobs. Furthermore, potential confounding factors in the associations were not often well controlled. The current study is an analysis of the data collected from an incident case-control study. The primary objective was to test the hypothesis that occupational exposure to EMF is associated with leukemia, including total leukemia (TL), myelogenous leukemia (MYELOG) and acute non-lymphoid leukemia (ANLL). Potential confounding factors: occupational exposure to benzene, age, smoking, alcohol consumption, and previous medical radiation exposures were controlled in multivariate logistic regression models. Dose-response relationships were estimated by cumulative occupational exposure to EMF, taking into account duration of employment and EMF intensity on the jobs. In order to overcome weaknesses of most previous studies, special efforts were made to improve the precision of EMF assessment. Two definitions of EMF were used and result discrepancies using the two definitions were observed. These difference raised a question as to whether the workers at jobs with low EMF exposure should be considered as non-exposed in future studies. In addition, the current study suggested use of lifetime cumulative EMF exposure estimates to determine dose-response relationship. The analyses of the current study suggest an association between ANLL and employment at selected jobs with high EMF exposure. The existence of an association between three types of leukemia and broader categories of occupational EMF exposure, is still undetermined. If an association does exist between occupational EMF exposure and leukemia, the results of the current study suggest that EMF might only be a potential factor in the promotion of leukemia, but not its initiation. ^