A stochastic approximation algorithm with step size adaptation

Plakhov, A.Y.; Cruz, P., (2004) 'A stochastic approximation algorithm with step size adaptation', Journal of Mathematical Science 120(1) pp.964-973 RAE2008

Exploiting the Transients of Adaptation for RoQ Attacks on Internet Resources

In this paper, we expose an unorthodox adversarial attack that exploits the transients of a system's adaptive behavior, as opposed to its limited steady-state capacity. We show that a well orchestrated attack could introduce significant inefficiencies that could potentially deprive a network element from much of its capacity, or significantly reduce its service quality, while evading detection by consuming an unsuspicious, small fraction of that element's hijacked capacity. This type of attack stands in sharp contrast to traditional brute-force, sustained high-rate DoS attacks, as well as recently proposed attacks that exploit specific protocol settings such as TCP timeouts. We exemplify what we term as Reduction of Quality (RoQ) attacks by exposing the vulnerabilities of common adaptation mechanisms. We develop control-theoretic models and associated metrics to quantify these vulnerabilities. We present numerical and simulation results, which we validate with observations from real Internet experiments. Our findings motivate the need for the development of adaptation mechanisms that are resilient to these new forms of attacks.

Friendly Virtual Machine: Leveraging a Feedback-Control Model for Application Adaptation

With the increased use of "Virtual Machines" (VMs) as vehicles that isolate applications running on the same host, it is necessary to devise techniques that enable multiple VMs to share underlying resources both fairly and efficiently. To that end, one common approach is to deploy complex resource management techniques in the hosting infrastructure. Alternately, in this paper, we advocate the use of self-adaptation in the VMs themselves based on feedback about resource usage and availability. Consequently, we define a "Friendly" VM (FVM) to be a virtual machine that adjusts its demand for system resources, so that they are both efficiently and fairly allocated to competing FVMs. Such properties are ensured using one of many provably convergent control rules, such as AIMD. By adopting this distributed application-based approach to resource management, it is not necessary to make assumptions about the underlying resources nor about the requirements of FVMs competing for these resources. To demonstrate the elegance and simplicity of our approach, we present a prototype implementation of our FVM framework in User-Mode Linux (UML)-an implementation that consists of less than 500 lines of code changes to UML. We present an analytic, control-theoretic model of FVM adaptation, which establishes convergence and fairness properties. These properties are also backed up with experimental results using our prototype FVM implementation.

A Model of Cerebellar Adaptation of Grip Forces During Lifting

We investigated adaptive neural control of precision grip forces during object lifting. A model is presented that adjusts reactive and anticipatory grip forces to a level just above that needed to stabilize lifted objects in the hand. The model obeys priciples of cerebellar structure and function by using slip sensations as error signals to adapt phasic motor commands to tonic force generators associated with output synergies controlling grip aperture. The learned phasic commands are weight and texture-dependent. Simulations of the new curcuit model reproduce key aspects of experimental observations of force application. Over learning trials, the onset of grip force buildup comes to lead the load force buildup, and the rate-of-rise of grip force, but not load force, scales inversely with the friction of the gripped object.

Adaptation of Dopamine Neurons' Mismatch Sensitivity Is not Compatible With Reinforcement Learning Theory

Recent electrophysical data inspired the claim that dopaminergic neurons adapt their mismatch sensitivities to reflect variances of expected rewards. This contradicts reward prediction error theory and most basal ganglia models. Application of learning principles points to a testable alternative interpretation-of the same data-that is compatible with existing theory.

Grid Cell Hexagonal Patterns Formed by Fast Self-Organized Learning within Entorhinal Cortex

Grid cells in the dorsal segment of the medial entorhinal cortex (dMEC) show remarkable hexagonal activity patterns, at multiple spatial scales, during spatial navigation. How these hexagonal patterns arise has excited intense interest. It has previously been shown how a selforganizing map can convert firing patterns across entorhinal grid cells into hippocampal place cells that are capable of representing much larger spatial scales. Can grid cell firing fields also arise during navigation through learning within a self-organizing map? A neural model is proposed that converts path integration signals into hexagonal grid cell patterns of multiple scales. This GRID model creates only grid cell patterns with the observed hexagonal structure, predicts how these hexagonal patterns can be learned from experience, and can process biologically plausible neural input and output signals during navigation. These results support a unified computational framework for explaining how entorhinal-hippocampal interactions support spatial navigation.

Dual-layer frequency-selective grid polarizers on thin-film substrates for THz applications

Dual-layer frequency-selective subwavelength grid polarizers on thin-film dielectric substrates are proposed for THz and sub-THz applications. The dual-layer grids possess enhanced (squared) polarizing efficiency at a sequence of discrete frequencies in reflection and within extended frequency bands in transmission as compared to conventional single grids.

Optimisation of Smart Grid performance using centralised and distributed control techniques

A massive change is currently taking place in the manner in which power networks are operated. Traditionally, power networks consisted of large power stations which were controlled from centralised locations. The trend in modern power networks is for generated power to be produced by a diverse array of energy sources which are spread over a large geographical area. As a result, controlling these systems from a centralised controller is impractical. Thus, future power networks will be controlled by a large number of intelligent distributed controllers which must work together to coordinate their actions. The term Smart Grid is the umbrella term used to denote this combination of power systems, artificial intelligence, and communications engineering. This thesis focuses on the application of optimal control techniques to Smart Grids with a focus in particular on iterative distributed MPC. A novel convergence and stability proof for iterative distributed MPC based on the Alternating Direction Method of Multipliers is derived. Distributed and centralised MPC, and an optimised PID controllers' performance are then compared when applied to a highly interconnected, nonlinear, MIMO testbed based on a part of the Nordic power grid. Finally, a novel tuning algorithm is proposed for iterative distributed MPC which simultaneously optimises both the closed loop performance and the communication overhead associated with the desired control.

Grid integration of wave energy & generic modelling of ocean devices for power system studies

The work presented in this thesis covers four major topics of research related to the grid integration of wave energy. More specifically, the grid impact of a wave farm on the power quality of its local network is investigated. Two estimation methods were developed regarding the flicker level Pst generated by a wave farm in relation to its rated power as well as in relation to the impedance angle ψk of the node in the grid to which it is connected. The electrical design of a typical wave farm design is also studied in terms of minimum rating for three types of costly pieces of equipment, namely the VAr compensator, the submarine cables and the overhead line. The power losses dissipated within the farm's electrical network are also evaluated. The feasibility of transforming a test site into a commercial site of greater rated power is investigated from the perspective of power quality and of cables and overhead line thermal loading. Finally, the generic modelling of ocean devices, referring here to both wave and tidal current devices, is investigated.

Redox remodelling in diaphragm muscle adaptation to chronic sustained hypoxia

Chronic sustained hypoxia (CH) induces functional weakness, atrophy, and mitochondrial remodelling in the diaphragm muscle. Animal models of CH present with changes similar to patients with respiratory-related disease, thus, elucidating the molecular mechanisms driving these adaptations is clinically important. We hypothesize that ROS are pivotal in diaphragm muscle adaptation to CH. C57BL6/J mice were exposed to CH (FiO2=0.1) for one, three, and six weeks. Sternohyoid (upper airway dilator), extensor digitorum longus (EDL), and soleus were studied as reference muscles as well as the diaphragm. The diaphragm was profiled using a redox proteomics approach followed by mass spectrometry. Following this, redox-modified metabolic enzyme activities and atrophy signalling were assessed using spectrophotometric assays and ELISA. Diaphragm isotonic performance was assessed after six weeks of CH ± chronic antioxidant supplementation. Protein carbonyl and free thiol content in the diaphragm were increased and decreased respectively after six weeks of CH – indicative of protein oxidation. These changes were temporally modulated and muscle specific. Extensive remodelling of metabolic proteins occurred and the stress reached the cross-bridge. Metabolic enzyme activities in the diaphragm were, for the most part, decreased by CH and differential muscle responses were observed. Redox sensitive chymotrypsin-like proteasome activity of the diaphragm was increased and atrophy signalling was observed through decreased phospho-FOXO3a and phospho-mTOR. Phospho-p38 MAPK content was increased and this was attenuated by antioxidant treatment. Hypoxia decreased power generating capacity of the diaphragm and this was restored by N-acetyl-cysteine (NAC) but not by tempol. Redox remodelling is pivotal for diaphragm adaptation to chronic sustained hypoxia. Muscle changes are dependent on duration of the hypoxia stimulus, activity profile of the muscle, and molecular composition of the muscle. The working respiratory muscles and slow oxidative fibres are particularly susceptible. NAC (antioxidant) may be useful as an adjunct therapy in respiratory-related diseases characterised by hypoxic stress.

Physical function, psychosocial adaptation, and hardiness post stroke

Introduction: Stroke is a chronic condition that significantly impacts on morbidity and mortality (Balanda et al. 2010). Globally, the complexity of stroke is well documented and more recently, in Ireland, as part of the National Survey of Stroke Survivors (Horgan et al. 2014). There are a number of factors that are known to influence adaptation post stroke. However, there is a lack of research to explain the variability in how survivors adapt post stroke. Hardiness is a broad personality trait that leads to better outcome. This study investigated the influence of hardiness and physical function on psychosocial adaptation post stroke. Methods: A quantitative cross-sectional, correlational, exploratory study was conducted between April and November 2013. The sample consisted of stroke survivors (n=100) who were recruited from three hospital outpatient departments and completed a questionnaire package. Results: The mean age of participants was 76 years (range 70-80), over half (56%) of the participants achieved the maximum score of 20 on the Barthel Index indicating independence in activities of daily living. The median number of days since stroke onset was 91 days (range 74-128). The total mean score and standard deviation for hardiness was 1.89 (0.4) as measured by the Dispositional Resilience Scale, indicating medium hardiness (possible range 0-3). Psychosocial adaptation was measured using the Psychosocial Adjustment to Illness Scale, the total weighted mean and standard deviation was 0.54 (0.3) indicating a satisfactory level of psychosocial adaptation (possible range 0-3). A hierarchical multiple linear regression was performed which contained 6 independent variables (hardiness, living arrangement, and length of hospital stay, number of days since stroke onset, physical function and self-rated recovery). Findings demonstrated that physical function (p<0.001) and hardiness (p=0.008) were significantly related to psychosocial adaptation. Altogether, 65% of the variation in psychosocial adaptation can be explained by the combined effect of the independent variables. Physical functioning had the highest unique contribution (11%) to explain the variance in psychosocial adaptation while self-rated recovery, hardiness, and living arrangements contributed 3% each. Conclusion: This research provides important information regarding factors that influence psychosocial adaptation post stroke at 3 months. Physical function significantly contributed to psychosocial adaptation post stroke. The personality trait of hardiness provides insight into how behaviour influenced adaptation post stroke. While hardiness also had a strong relationship with psychosocial adaptation, further research is necessary to fully comprehend this process.

Vulnerability and adaptation to climate change in Guam – a case-study of the perceptions, attitudes, behaviors, and knowledge of a small rural community towards their watershed

This thesis argues that examining the attitudes, perceptions, behaviors, and knowledge of a community towards their specific watershed can reveal their social vulnerability to climate change. Understanding and incorporating these elements of the human dimension in coastal zone management will lead to efficient and effective strategies that safeguard the natural resources for the benefit of the community. By having healthy natural resources, ecological and community resilience to climate change will increase, thus decreasing vulnerability. In the Pacific Ocean, climate and SLR are strongly modulated by the El Niño Southern Oscillation. SLR is three times the global average in the Western Pacific Ocean (Merrifield and Maltrud 2011; Merrifield 2011). Changes in annual rainfall in the Western North Pacific sub‐region from 1950-2010 show that islands in the east are getting much less than in the past, while the islands in the west are getting slightly more rainfall (Keener et al. 2013). For Guam, a small island owned by the United States and located in the Western Pacific Ocean, these factors mean that SLR is higher than any other place in the world and will most likely see increased precipitation. Knowing this, the social vulnerability may be examined. Thus, a case-study of the community residing in the Manell and Geus watersheds was conducted on the island of Guam. Measuring their perceptions, attitudes, knowledge, and behaviors should bring to light their vulnerability to climate change. In order to accomplish this, a household survey was administered from July through August 2010. Approximately 350 surveys were analysed using SPSS. To supplement this quantitative data, informal interviews were conducted with the elders of the community to glean traditional ecological knowledge about perceived climate change. A GIS analysis was conducted to understand the physical geography of the Manell and Geus watersheds. This information about the human dimension is valuable to CZM managers. It may be incorporated into strategic watershed plans, to better administer the natural resources within the coastal zone. The research conducted in this thesis is the basis of a recent watershed management plan for the Guam Coastal Management Program (see King 2014).

A widespread chromosomal inversion polymorphism contributes to a major life-history transition, local adaptation, and reproductive isolation.

The role of chromosomal inversions in adaptation and speciation is controversial. Historically, inversions were thought to contribute to these processes either by directly causing hybrid sterility or by facilitating the maintenance of co-adapted gene complexes. Because inversions suppress recombination when heterozygous, a recently proposed local adaptation mechanism predicts that they will spread if they capture alleles at multiple loci involved in divergent adaptation to contrasting environments. Many empirical studies have found inversion polymorphisms linked to putatively adaptive phenotypes or distributed along environmental clines. However, direct involvement of an inversion in local adaptation and consequent ecological reproductive isolation has not to our knowledge been demonstrated in nature. In this study, we discovered that a chromosomal inversion polymorphism is geographically widespread, and we test the extent to which it contributes to adaptation and reproductive isolation under natural field conditions. Replicated crosses between the prezygotically reproductively isolated annual and perennial ecotypes of the yellow monkeyflower, Mimulus guttatus, revealed that alternative chromosomal inversion arrangements are associated with life-history divergence over thousands of kilometers across North America. The inversion polymorphism affected adaptive flowering time divergence and other morphological traits in all replicated crosses between four pairs of annual and perennial populations. To determine if the inversion contributes to adaptation and reproductive isolation in natural populations, we conducted a novel reciprocal transplant experiment involving outbred lines, where alternative arrangements of the inversion were reciprocally introgressed into the genetic backgrounds of each ecotype. Our results demonstrate for the first time in nature the contribution of an inversion to adaptation, an annual/perennial life-history shift, and multiple reproductive isolating barriers. These results are consistent with the local adaptation mechanism being responsible for the distribution of the two inversion arrangements across the geographic range of M. guttatus and that locally adaptive inversion effects contribute directly to reproductive isolation. Such a mechanism may be partially responsible for the observation that closely related species often differ by multiple chromosomal rearrangements.

Climate change, water resources, and the politics of adaptation in the Middle East and North Africa

Through an examination of global climate change models combined with hydrological data on deteriorating water quality in the Middle East and North Africa (MENA), we elucidate the ways in which the MENA countries are vulnerable to climate-induced impacts on water resources. Adaptive governance strategies, however, remain a low priority for political leaderships in the MENA region. To date, most MENA governments have concentrated the bulk of their resources on large-scale supply side projects such as desalination, dam construction, inter-basin water transfers, tapping fossil groundwater aquifers, and importing virtual water. Because managing water demand, improving the efficiency of water use, and promoting conservation will be key ingredients in responding to climate-induced impacts on the water sector, we analyze the political, economic, and institutional drivers that have shaped governance responses. While the scholarly literature emphasizes the importance of social capital to adaptive governance, we find that many political leaders and water experts in the MENA rarely engage societal actors in considering water risks. We conclude that the key capacities for adaptive governance to water scarcity in MENA are underdeveloped. © 2010 Springer Science+Business Media B.V.

Dynamic evolution of the alpha (α) and beta (β) keratins has accompanied integument diversification and the adaptation of birds into novel lifestyles.

BACKGROUND: Vertebrate skin appendages are constructed of keratins produced by multigene families. Alpha (α) keratins are found in all vertebrates, while beta (β) keratins are found exclusively in reptiles and birds. We have studied the molecular evolution of these gene families in the genomes of 48 phylogenetically diverse birds and their expression in the scales and feathers of the chicken. RESULTS: We found that the total number of α-keratins is lower in birds than mammals and non-avian reptiles, yet two α-keratin genes (KRT42 and KRT75) have expanded in birds. The β-keratins, however, demonstrate a dynamic evolution associated with avian lifestyle. The avian specific feather β-keratins comprise a large majority of the total number of β-keratins, but independently derived lineages of aquatic and predatory birds have smaller proportions of feather β-keratin genes and larger proportions of keratinocyte β-keratin genes. Additionally, birds of prey have a larger proportion of claw β-keratins. Analysis of α- and β-keratin expression during development of chicken scales and feathers demonstrates that while α-keratins are expressed in these tissues, the number and magnitude of expressed β-keratin genes far exceeds that of α-keratins. CONCLUSIONS: These results support the view that the number of α- and β-keratin genes expressed, the proportion of the β-keratin subfamily genes expressed and the diversification of the β-keratin genes have been important for the evolution of the feather and the adaptation of birds into multiple ecological niches.