REGAL : a regularization based algorithm for reinforcement learning in weakly communicating MDPs

We provide an algorithm that achieves the optimal regret rate in an unknown weakly communicating Markov Decision Process (MDP). The algorithm proceeds in episodes where, in each episode, it picks a policy using regularization based on the span of the optimal bias vector. For an MDP with S states and A actions whose optimal bias vector has span bounded by H, we show a regret bound of ~ O(HS p AT ). We also relate the span to various diameter-like quantities associated with the MDP, demonstrating how our results improve on previous regret bounds.

Distributed DSTATCOMs for distribution line enhancement

Distribution feeder voltage reinforcement by multiple site reactive power compensation systems has recently been reported by many researchers. However, voltage control by multiple DSTATCOMs across a distribution feeder may introduce control interactions and/or voltage instability. This paper addresses these control interaction issues and proposes a control scheme that alleviates interactions among controllers. The proposed control scheme also enhances proper sharing of reactive power among DSTATCOMs. A mathematical model of a distribution system with any number of DSTATCOMs is developed to investigate the performance of the control system. This mathematical model is used to conduct eigenvalue analysis to develop the criterion for controller design. The proposed control scheme is tested in time domain on a sample radial distribution feeder installed with multiple DSTATCOMs and test results are presented.

Controlling cell-material interactions with polymer nanocomposites by use of surface modifying additives

Polymer nanocomposites (NC) are fabricated by incorporating well dispersed nanoscale particles within a polymer matrix. This study focuses on elastomeric polyurethane (PU) based nanocomposites, containing organically modified silicates (OMS), as bioactive materials. Nanocomposites incorporating chlorhexidine diacetate as an organic modifier (OM) were demonstrated to be antibacterial with a dose dependence related to both the silicate loading and the loading of OM. When the non-antibacterial OM dodecylamine was used, both cell and platelet adhesion were decreased on the nanocomposite surface. These results suggest that OM is released from the polymer and can impact on cell behaviour at the interface. Nanocomposites have potential use as bioactive materials in a range of biomedical applications.

Evolutionary design of bone scaffolds with reference to material selection

The favourable scaffold for bone tissue engineering should have desired characteristic features, such as adequate mechanical strength and three-dimensional open porosity, which guarantee a suitable environment for tissue regeneration. In fact, the design of such complex structures like bone scaffolds is a challenge for investigators. One of the aims is to achieve the best possible mechanical strength-degradation rate ratio. In this paper we attempt to use numerical modelling to evaluate material properties for designing bone tissue engineering scaffold fabricated via the fused deposition modelling technique. For our studies the standard genetic algorithm was used, which is an efficient method of discrete optimization. For the fused deposition modelling scaffold, each individual strut is scrutinized for its role in the architecture and structural support it provides for the scaffold, and its contribution to the overall scaffold was studied. The goal of the study was to create a numerical tool that could help to acquire the desired behaviour of tissue engineered scaffolds and our results showed that this could be achieved efficiently by using different materials for individual struts. To represent a great number of ways in which scaffold mechanical function loss could proceed, the exemplary set of different desirable scaffold stiffness loss function was chosen. © 2012 John Wiley & Sons, Ltd.

Submarine deposition of volcaniclastic material from the 1995-2005 eruptions of Soufriere Hills volcano, Montserrat

Soufrière Hills volcano, Montserrat, has been erupting since 1995. During the current eruption, a large part of the material produced by the volcano has been transported into the sea, modifying the morphology of the submarine flanks of the volcano. We present a unique set of swath bathymetric data collected offshore from Montserrat in 1999, 2002 and 2005. From 1999 to 2002, pyroclastic flows associated with numerous dome collapses entered the sea to produce 100 Mm3 deposit. From 2002 to 2005, the 290 Mm3 submarine deposit is mainly from the 12–13 July 2003 collapse. These data allow us to estimate that, by May 2005, at least 482 Mm3 of material had been deposited on the sea floor since 1995. We compare on-land characteristics and volumes of dome collapse events with the submarine deposits and propose a new analysis of their emplacement on the submarine flanks of the volcano. The deposition mechanism shows a slope dependence, with the maximum thickness of deposit before the break in the slope, probably because of the type of the dense granular flow involved. We conclude that from 1995 to 2005 more than 75% of the erupted volume entered the sea.

Revised reinforcement sensitivity theory : the impact of FFFS and stress on driving

This study investigated the effect of a fear-based personality trait, as conceptualised in Gray’s revised reinforcement sensitivity theory (RST) by the strength of the fight/flight/freeze system (FFFS), on young people’s driving simulator performance under induced psychosocial stress. Seventy-one young drivers completed the Jackson-5 questionnaire of RST traits, followed by a psychosocial stress or relaxation induction procedure (random allocation to groups) and then a city driving simulator task. Some support was found for the hypothesis that higher FFFS sensitivity would result in poorer driving performance under stress, in terms of significantly poorer hazard responses, possibly due to an increased attentional focus on the aversive cues inherent in the stress induction leaving reduced attentional capacity for the driving task. These results suggest that stress may lead to riskier driving behaviour in individuals with fearful RST personality styles.

Measurement of structural changes to a food material during dehydration

Rates of dehydration/rehydration are important quality parameters for dried products. Theoretically, if there are no adverse effects on the integrity of the tissue structure, it should absorb water to the same moisture content of the initial product before drying.The purpose of this work is to semi-automate the process of detection of cell structure boundaries as a food is dehydrated and rehydrated. This will enable food materials researchers to quantify changes to material’s structure as these processes take place. Images of potato cells as they were dehydrated and rehydrated were taken using an electron microscope. Cell boundaries were detected using an image processing algorithm. Average cell area and perimeter at each stage of dehydration were calculated and plotted versus time. The results show that the algorithm can successfully identify cell boundaries.

Nagelschmidtite bioceramics with osteostimulation properties : material chemistry activating osteogenic genes and WNT signalling pathway of human bone marrow stromal cells

Bioactive materials with osteostimulation properties are of great importance to promote osteogenic differentiation of human bone marrow stromal cells (hBMSCs) for potential bone regeneration. We have recently synthesized nagelschmidtite (NAGEL, Ca7Si2P2O16) ceramic powders which showed excellent apatite-mineralization ability. The aim of this study was to investigate the interaction of hBMSCs with NAGEL bioceramic bulks and their ionic extracts, and to explore the osteostimulation properties of NAGEL bioceramics and the possible molecular mechanism. The cell attachment, proliferation, bone-related gene expression (ALP, OPN and OCN) and WNT signalling pathways (WNT3a, FZD6, AXIN2 and CTNNB) of hBMSCs cultured on NAGEL bioceramic disks were systematically studied. We further investigated the biological effects of ionic products from NAGEL powders on cell proliferation and osteogenic differentiation of hBMSCs by culturing cells with NAGEL extracts. Furthermore, the effect of NAGEL bioceramics on the osteogenic differentiation in hBMSCs was also investigated with the addition of cardamonin, a WNT inhibitor. The results showed that NAGEL bioceramic disks supported the attachment and proliferation of hBMSCs, and significantly enhanced the bone-related gene expression and WNT signalling pathway of hBMSCs, compared to conventional beta-tricalcium phosphate (β-TCP) bioceramic disks and blank controls. The ionic products from NAGEL powders also significantly promoted the proliferation, bone and WNT-related gene expression of hBMSCs. It was also identified that NAGEL bioceramics could bypass the action of the WNT inhibitor (10 μM) to stimulate the selected osteogenic genes in hBMSCs. Our results suggest that NAGEL bioceramics possess excellent in vitro osteostimulation properties. The possible mechanism for the osteostimulation may be directly related to the released Si, Ca and P-containing ionic products from NAGEL bioceramics which activate bone-related gene expression and WNT signalling pathway of hBMSCs. The present study suggests that NAGEL bioceramics are a potential bone regeneration material with significant osteostimulation capacity.

A multi-stage history for carbonaceous material in extraterrestrial chondritic porous aggregate W7029*A and a new cosmothermometer

A new set of primitive extraterrestrial materials collected in the Earth's stratosphere include Chondritic Porous Aggregates (CPA's) [1]. CPAs have a complex and variable mineralogy [1-3] that include 'organic compounds' [4,5] and poorly graphitised carbon (PGC)[6]. This study presents a continuation of our detailed Analytical Electron Microscope study on carbon-rich CPA W7029*A from the JSC Cosmic Dust Collection. This CPA is an uncontaminated sample that survived atmospheric entry without appreciable alteration [7] and which contains ~44% carbonaceous material. The carbonaceous composition of selected particles was confirmed by Electron Energy Loss Spectroscopy and Selected Area Electron Diffraction (SAED). Possible carbonaceous contaminants introduced by specimen preparation techniques are easily recognised from indigenous CPA carbon particles [8] and do not bias our interpretations.

Whole life cycle costing and quality satisfaction : public housing floor material

Most commonly, residents are always arguing about the satisfaction of sustainability and quality of their high rise residential property. This paper aim is to maintain the best quality satisfaction of the floor materials by introducing the whole life cycle costing approach to the property manager of the public housing in Johor. This paper looks into the current situation of floor material of two public housings in Johor, Malaysia and testing the whole life cycle costing approach towards them. The cost figures may be implemented to justify higher investments, for examples, in the quality or flexibility of building solutions through a long-term cost reduction. The calculation and the literature review are conducted. The questionnaire surveys of two public housings were conducted to make clear the occupants’ evaluation about the actual quality conditions of the floor material in their house. As a result, the quality of floor material based on the whole life cycle costing approach is one of the best among their previous decision making tool that was applied. Practitioners can benefit from this paper as it provides information on calculating the whole life costing and making the decisions for floor material selection for their properties.

Optimal distribution network reinforcement considering load growth, line loss, and reliability

In this paper, a new comprehensive planning methodology is proposed for implementing distribution network reinforcement. The load growth, voltage profile, distribution line loss, and reliability are considered in this procedure. A time-segmentation technique is employed to reduce the computational load. Options considered range from supporting the load growth using the traditional approach of upgrading the conventional equipment in the distribution network, through to the use of dispatchable distributed generators (DDG). The objective function is composed of the construction cost, loss cost and reliability cost. As constraints, the bus voltages and the feeder currents should be maintained within the standard level. The DDG output power should not be less than a ratio of its rated power because of efficiency. A hybrid optimization method, called modified discrete particle swarm optimization, is employed to solve this nonlinear and discrete optimization problem. A comparison is performed between the optimized solution based on planning of capacitors along with tap-changing transformer and line upgrading and when DDGs are included in the optimization.

A Material Reverie

excerpt: from soil and stone is a work consisting of fifty drawings on paper organised in a grid. Each drawing is small, only 19 by 14 centimetres, and set out in portrait format. They each reference, either explicitly or abstractly, natural phenomena. These include plant forms, pollens, seeds, pods, and leaf shapes and each is painted with a dizzying and liquid array of techniques and technical finesse. Colour is used sparingly but tellingly, and all are generously and wetly composed, with each seeming to flow into the necessary rightness of composition. Within the overall work the feel is sometimes of the archive, a personal kind where pressed flowers are stumbled upon within a book. At other times they seem to image the stellar as one confronts the immensity of some planet suspended in the void. Again, as a recurring theme in Reynolds’ oeuvre, the notion of the taxonomy is sounded. The drawings are laid out to display difference and reveal through contrast essence. It is a mapping that illuminates a generous plentitude.

Damage assessment in reinforced concrete flexural members using modal strain energy based method

Damage assessment (damage detection, localization and quantification) in structures and appropriate retrofitting will enable the safe and efficient function of the structures. In this context, many Vibration Based Damage Identification Techniques (VBDIT) have emerged with potential for accurate damage assessment. VBDITs have achieved significant research interest in recent years, mainly due to their non-destructive nature and ability to assess inaccessible and invisible damage locations. Damage Index (DI) methods are also vibration based, but they are not based on the structural model. DI methods are fast and inexpensive compared to the model-based methods and have the ability to automate the damage detection process. DI method analyses the change in vibration response of the structure between two states so that the damage can be identified. Extensive research has been carried out to apply the DI method to assess damage in steel structures. Comparatively, there has been very little research interest in the use of DI methods to assess damage in Reinforced Concrete (RC) structures due to the complexity of simulating the predominant damage type, the flexural crack. Flexural cracks in RC beams distribute non- linearly and propagate along all directions. Secondary cracks extend more rapidly along the longitudinal and transverse directions of a RC structure than propagation of existing cracks in the depth direction due to stress distribution caused by the tensile reinforcement. Simplified damage simulation techniques (such as reductions in the modulus or section depth or use of rotational spring elements) that have been extensively used with research on steel structures, cannot be applied to simulate flexural cracks in RC elements. This highlights a big gap in knowledge and as a consequence VBDITs have not been successfully applied to damage assessment in RC structures. This research will address the above gap in knowledge and will develop and apply a modal strain energy based DI method to assess damage in RC flexural members. Firstly, this research evaluated different damage simulation techniques and recommended an appropriate technique to simulate the post cracking behaviour of RC structures. The ABAQUS finite element package was used throughout the study with properly validated material models. The damaged plasticity model was recommended as the method which can correctly simulate the post cracking behaviour of RC structures and was used in the rest of this study. Four different forms of Modal Strain Energy based Damage Indices (MSEDIs) were proposed to improve the damage assessment capability by minimising the numbers and intensities of false alarms. The developed MSEDIs were then used to automate the damage detection process by incorporating programmable algorithms. The developed algorithms have the ability to identify common issues associated with the vibration properties such as mode shifting and phase change. To minimise the effect of noise on the DI calculation process, this research proposed a sequential order of curve fitting technique. Finally, a statistical based damage assessment scheme was proposed to enhance the reliability of the damage assessment results. The proposed techniques were applied to locate damage in RC beams and slabs on girder bridge model to demonstrate their accuracy and efficiency. The outcomes of this research will make a significant contribution to the technical knowledge of VBDIT and will enhance the accuracy of damage assessment in RC structures. The application of the research findings to RC flexural members will enable their safe and efficient performance.