A neural network based automatic generation control design through reinforcement learning

This paper presents the design and implementation of a learning controller for the Automatic Generation Control (AGC) in power systems based on a reinforcement learning (RL) framework. In contrast to the recent RL scheme for AGC proposed by us, the present method permits handling of power system variables such as Area Control Error (ACE) and deviations from scheduled frequency and tie-line flows as continuous variables. (In the earlier scheme, these variables have to be quantized into finitely many levels). The optimal control law is arrived at in the RL framework by making use of Q-learning strategy. Since the state variables are continuous, we propose the use of Radial Basis Function (RBF) neural networks to compute the Q-values for a given input state. Since, in this application we cannot provide training data appropriate for the standard supervised learning framework, a reinforcement learning algorithm is employed to train the RBF network. We also employ a novel exploration strategy, based on a Learning Automata algorithm,for generating training samples during Q-learning. The proposed scheme, in addition to being simple to implement, inherits all the attractive features of an RL scheme such as model independent design, flexibility in control objective specification, robustness etc. Two implementations of the proposed approach are presented. Through simulation studies the attractiveness of this approach is demonstrated.

Dimethyl sulfoxide induced structural transformations and non-monotonic concentration dependence of conformational fluctuation around active site of lysozyme

Experimental studies have observed significant changes in both structure and function of lysozyme (and other proteins) on addition of a small amount of dimethyl sulfoxide (DMSO) in aqueous solution. Our atomistic molecular dynamic simulations of lysozyme in water-DMSO reveal the following sequence of changes on increasing DMSO concentration. (i) At the initial stage (around 5% DMSO concentration) protein's conformational flexibility gets markedly suppressed. From study of radial distribution functions, we attribute this to the preferential solvation of exposed protein hydrophobic residues by the methyl groups of DMSO. (ii) In the next stage (10-15% DMSO concentration range), lysozome partially unfolds accompanied by an increase both in fluctuation and in exposed protein surface area. (iii) Between 15-20% concentration ranges, both conformational fluctuation and solvent accessible protein surface area suddenly decrease again indicating the formation of an intermediate collapse state. These results are in good agreement with near-UV circular dichroism (CD) and fluorescence studies. We explain this apparently surprising behavior in terms of a structural transformation which involves clustering among the methyl groups of DMSO. (iv) Beyond 20% concentration of DMSO, the protein starts its final sojourn towards the unfolding state with further increase in conformational fluctuation and loss in native contacts. Most importantly, analysis of contact map and fluctuation near the active site reveal that both partial unfolding and conformational fluctuations are centered mostly on the hydrophobic core of active site of lysozyme. Our results could offer a general explanation and universal picture of the anomalous behavior of protein structure-function observed in the presence of cosolvents (DMSO, ethanol, tertiary butyl alcohol, dioxane) at their low concentrations. (C) 2012 American Institute of Physics. [http://dx.doi.org/10.1063/1.3694268]

Structure and Mechanistic Insights into Novel Iron-mediated Moonlighting Functions of Human J-protein Cochaperone, Dph4

J-proteins are obligate cochaperones of Hsp70s and stimulate their ATPase activity via the J-domain. Although the functions of J-proteins have been well understood in the context of Hsp70s, their additional co-evolved ``physiological functions'' are still elusive. We report here the solution structure and mechanism of novel iron-mediated functional roles of human Dph4, a type III J-protein playing a vital role in diphthamide biosynthesis and normal development. The NMR structure of Dph4 reveals two domains: a conserved J-domain and a CSL-domain connected via a flexible linker-helix. The linker-helix modulates the conformational flexibility between the two domains, regulating thereby the protein function. Dph4 exhibits a unique ability to bind iron in tetrahedral coordination geometry through cysteines of its CSL-domain. The oxidized Fe-Dph4 shows characteristic UV-visible and electron paramagnetic resonance spectral properties similar to rubredoxins. Iron-bound Dph4 (Fe-Dph4) also undergoes oligomerization, thus potentially functioning as a transient ``iron storage protein,'' thereby regulating the intracellular iron homeostasis. Remarkably, Fe-Dph4 exhibits vital redox and electron carrier activity, which is critical for important metabolic reactions, including diphthamide biosynthesis. Further, we observed that Fe-Dph4 is conformationally better poised to perform Hsp70-dependent functions, thus underlining the significance of iron binding in Dph4. Yeast Jjj3, a functional ortholog of human Dph4 also shows a similar iron-binding property, indicating the conserved nature of iron sequestration across species. Taken together, our findings provide invaluable evidence in favor of additional co-evolved specialized functions of J-proteins, previously not well appreciated.

Changing resonator geometry to boost sound power decouples size and song frequency in a small insect

Despite their small size, some insects, such as crickets, can produce high amplitude mating songs by rubbing their wings together. By exploiting structural resonance for sound radiation, crickets broadcast species-specific songs at a sharply tuned frequency. Such songs enhance the range of signal transmission, contain information about the signaler's quality, and allow mate choice. The production of pure tones requires elaborate structural mechanisms that control and sustain resonance at the species-specific frequency. Tree crickets differ sharply from this scheme. Although they use a resonant system to produce sound, tree crickets can produce high amplitude songs at different frequencies, varying by as much as an octave. Based on an investigation of the driving mechanism and the resonant system, using laser Doppler vibrometry and finite element modeling, we show that it is the distinctive geometry of the crickets' forewings (the resonant system) that is responsible for their capacity to vary frequency. The long, enlarged wings enable the production of high amplitude songs; however, as a mechanical consequence of the high aspect ratio, the resonant structures have multiple resonant modes that are similar in frequency. The drive produced by the singing apparatus cannot, therefore, be locked to a single frequency, and different resonant modes can easily be engaged, allowing individual males to vary the carrier frequency of their songs. Such flexibility in sound production, decoupling body size and song frequency, has important implications for conventional views of mate choice, and offers inspiration for the design of miniature, multifrequency, resonant acoustic radiators.

Analysis of Parameter Values in the van der Waals and Platteeuw Theory for Methane Hydrates Using Monte Carlo Molecular Simulations

The van der Waals and Platteuw (vdVVP) theory has been successfully used to model the thermodynamics of gas hydrates. However, earlier studies have shown that this could be due to the presence of a large number of adjustable parameters whose values are obtained through regression with experimental data. To test this assertion, we carry out a systematic and rigorous study of the performance of various models of vdWP theory that have been proposed over the years. The hydrate phase equilibrium data used for this study is obtained from Monte Carlo molecular simulations of methane hydrates. The parameters of the vdWP theory are regressed from this equilibrium data and compared with their true values obtained directly from simulations. This comparison reveals that (i) methane-water interactions beyond the first cage and methane-methane interactions make a significant contribution to the partition function and thus cannot be neglected, (ii) the rigorous Monte Carlo integration should be used to evaluate the Langmuir constant instead of the spherical smoothed cell approximation, (iii) the parameter values describing the methane-water interactions cannot be correctly regressed from the equilibrium data using the vdVVP theory in its present form, (iv) the regressed empty hydrate property values closely match their true values irrespective of the level of rigor in the theory, and (v) the flexibility of the water lattice forming the hydrate phase needs to be incorporated in the vdWP theory. Since methane is among the simplest of hydrate forming molecules, the conclusions from this study should also hold true for more complicated hydrate guest molecules.

Mesh Simplification Based on Edge Collapsing Could Improve Computational Efficiency in Near Infrared Optical Tomographic Imaging

The diffusion equation-based modeling of near infrared light propagation in tissue is achieved by using finite-element mesh for imaging real-tissue types, such as breast and brain. The finite-element mesh size (number of nodes) dictates the parameter space in the optical tomographic imaging. Most commonly used finite-element meshing algorithms do not provide the flexibility of distinct nodal spacing in different regions of imaging domain to take the sensitivity of the problem into consideration. This study aims to present a computationally efficient mesh simplification method that can be used as a preprocessing step to iterative image reconstruction, where the finite-element mesh is simplified by using an edge collapsing algorithm to reduce the parameter space at regions where the sensitivity of the problem is relatively low. It is shown, using simulations and experimental phantom data for simple meshes/domains, that a significant reduction in parameter space could be achieved without compromising on the reconstructed image quality. The maximum errors observed by using the simplified meshes were less than 0.27% in the forward problem and 5% for inverse problem.

Probabilistic Shared Cache Management (PriSM)

Effective sharing of the last level cache has a significant influence on the overall performance of a multicore system. We observe that existing solutions control cache occupancy at a coarser granularity, do not scale well to large core counts and in some cases lack the flexibility to support a variety of performance goals. In this paper, we propose Probabilistic Shared Cache Management (PriSM), a framework to manage the cache occupancy of different cores at cache block granularity by controlling their eviction probabilities. The proposed framework requires only simple hardware changes to implement, can scale to larger core count and is flexible enough to support a variety of performance goals. We demonstrate the flexibility of PriSM, by computing the eviction probabilities needed to achieve goals like hit-maximization, fairness and QOS. PriSM-HitMax improves performance by 18.7% over LRU and 11.8% over previously proposed schemes in a sixteen core machine. PriSM-Fairness improves fairness over existing solutions by 23.3% along with a performance improvement of 19.0%. PriSM-QOS successfully achieves the desired QOS targets.

A generalized geo-hazard warning system

An automated geo-hazard warning system is the need of the hour. It is integration of automation in hazard evaluation and warning communication. The primary objective of this paper is to explain a geo-hazard warning system based on Internet-resident concept and available cellular mobile infrastructure that makes use of geo-spatial data. The functionality of the system is modular in architecture having input, understanding, expert, output and warning modules. Thus, the system provides flexibility in integration between different types of hazard evaluation and communication systems leading to a generalized hazard warning system. The developed system has been validated for landslide hazard in Indian conditions. It has been realized through utilization of landslide causative factors, rainfall forecast from NASA's TRMM (Tropical Rainfall Measuring Mission) and knowledge base of landslide hazard intensity map and invokes the warning as warranted. The system evaluated hazard commensurate with expert evaluation within 5-6 % variability, and the warning message permeability has been found to be virtually instantaneous, with a maximum time lag recorded as 50 s, minimum of 10 s. So it could be concluded that a novel and stand-alone system for dynamic hazard warning has been developed and implemented. Such a handy system could be very useful in a densely populated country where people are unaware of the impending hazard.

Ovarian developmental variation in the primitively eusocial wasp Ropalidia marginata suggests a gateway to worker ontogeny and the evolution of sociality

Social insects are characterized by reproductive caste differentiation of colony members into one or a small number of fertile queens and a large number of sterile workers. The evolutionary origin and maintenance of such sterile workers remains an enduring puzzle in insect sociobiology. Here, we studied ovarian development in over 600 freshly eclosed, isolated, virgin female Ropalidia marginata wasps, maintained in the laboratory. The wasps differed greatly both in the time taken to develop their ovaries and in the magnitude of ovarian development despite having similar access to resources. All females started with no ovarian development at day zero, and the percentage of individuals with at least one oocyte at any stage of development increased gradually across age, reached 100% at 100. days and decreased slightly thereafter. Approximately 40% of the females failed to develop ovaries within the average ecological lifespan of the species. Age, body size and adult feeding rate, when considered together, were the most important factors governing ovarian development. We suggest that such flexibility and variation in the potential and timing of reproductive development may physiologically predispose females to accept worker roles and thus provide a gateway to worker ontogeny and the evolution of sociality.

Intrinsically disordered proteins and conformational noise Implications in cancer

Intrinsically disordered proteins, IDPs, are proteins that lack a rigid 3D structure under physiological conditions, at least in vitro. Despite the lack of structure, IDPs play important roles in biological processes and transition from disorder to order upon binding to their targets. With multiple conformational states and rapid conformational dynamics, they engage in myriad and often ``promiscuous'' interactions. These stochastic interactions between IDPs and their partners, defined here as conformational noise, is an inherent characteristic of IDP interactions. The collective effect of conformational noise is an ensemble of protein network configurations, from which the most suitable can be explored in response to perturbations, conferring protein networks with remarkable flexibility and resilience. Moreover, the ubiquitous presence of IDPs as transcriptional factors and, more generally, as hubs in protein networks, is indicative of their role in propagation of transcriptional (genetic) noise. As effectors of transcriptional and conformational noise, IDPs rewire protein networks and unmask latent interactions in response to perturbations. Thus, noise-driven activation of latent pathways could underlie state-switching events such as cellular transformation in cancer. To test this hypothesis, we created a model of a protein network with the topological characteristics of a cancer protein network and tested its response to a perturbation in presence of IDP hubs and conformational noise. Because numerous IDPs are found to be epigenetic modifiers and chromatin remodelers, we hypothesize that they could further channel noise into stable, heritable genotypic changes.

USHA: unified software and hardware architecture for video decoding

Video decoders used in emerging applications need to be flexible to handle a large variety of video formats and deliver scalable performance to handle wide variations in workloads. In this paper we propose a unified software and hardware architecture for video decoding to achieve scalable performance with flexibility. The light weight processor tiles and the reconfigurable hardware tiles in our architecture enable software and hardware implementations to co-exist, while a programmable interconnect enables dynamic interconnection of the tiles. Our process network oriented compilation flow achieves realization agnostic application partitioning and enables seamless migration across uniprocessor, multi-processor, semi hardware and full hardware implementations of a video decoder. An application quality of service aware scheduler monitors and controls the operation of the entire system. We prove the concept through a prototype of the architecture on an off-the-shelf FPGA. The FPGA prototype shows a scaling in performance from QCIF to 1080p resolutions in four discrete steps. We also demonstrate that the reconfiguration time is short enough to allow migration from one configuration to the other without any frame loss.

Packing in molten globules and native states

Close packing of hydrophobic residues in the protein interior is an important determinant of protein stability. Cavities introduced by large to small substitutions are known to destabilize proteins. Conversely, native states of proteins and protein fragments can be stabilized by filling in existing cavities. Molten globules (MGs) were initially used to describe a state of protein which has well-defined secondary structure but little or no tertiary packing. Subsequent studies have shown that MGs do have some degree of native-like topology and specific packing. Wet molten globules (WMGs) with hydrated cores and considerably decreased packing relative to the native state have been studied extensively. Recently there has been renewed interest in identification and characterization of dry molten globules (DMGs). These are slightly expanded forms of the native state which show increased conformational flexibility, native-like main-chain hydrogen bonding and dry interiors. The generality of occurrence of DMGs during protein unfolding and the extent and nature of packing in DMGs remain to be elucidated. Packing interactions in native proteins and MGs can be probed through mutations. Next generation sequencing technologies make it possible to determine relative populations of mutants in a large pool. When this is coupled to phenotypic screens or cell-surface display, it becomes possible to rapidly examine large panels of single-site or multi-site mutants. From such studies, residue specific contributions to protein stability and function can be estimated in a highly parallelized fashion. This complements conventional biophysical methods for characterization of packing in native states and molten globules.

Microscopic dynamics of nanoparticle monolayers at air-water interface

We present results of surface mechanical and particle tracking measurements of nanoparticles trapped at the air-water interface as a function of their areal density. We monitor both the surface pressure (II) and isothermal compression modulus (epsilon) as well as the dynamics of nanoparticle clusters, using fluorescence confocal microscopy while they are compressed to very high density near the two dimensional close packing density Phi similar to 0.82. We observe non-monotonic variation in both epsilon and the dynamic heterogeneity, characterized by the dynamical susceptibility chi(4) with Phi, in such high density monolayers. We provide insight into the underlying nature of such transitions in close packed high density nanoparticle monolayers in terms of the morphology and flexibility of these soft colloidal particles.. We discuss the significance our results in the context of related studies on two dimensional granular or colloidal systems. (C) 2013 Elsevier Inc. All rights reserved.

Fluoranthene based derivatives for detection of trace explosive Nitroaromatics

A series of fluoranthene derivatives (F1-F5) varied with nature and type of substituents were synthesized via Diels-Alder reaction followed by in situ decarbonylation. The solid state structures have been established through single crystal X-ray diffraction (XRD). The presence of extended conjugation and having two alkyloxy chains on phenyl rings induces flexibility to orient opposite to each other and interacts with another fluoranthene unit with weak pi-pi interactions and show unique supramolecular arrangements. The envisaged photophysical and DFT studies demonstrated that HOMO-LUMO levels were effectively tuned by different substituents with an optical band gap from 3.44 to 3.88 eV provoked to examine as sensitive fluorescent chemosensors for the detection of nitroaromatic compounds (NACs). The sensitivity toward the detection of NACs was evaluated through fluorescence quenching in solution (aqueous and non-aqueous) and solid state (vapor and contact mode). Fluorescence studies demonstrated that electron transfer occurs from the electron rich fluoranthene fluorophores to the electron deficient NACs by the dominant static quenching mechanism and the quenching process is reversible. It was found that the detection sensitivity increases with extent of conjugation on fluoranthene unit. The contact mode approach using thin layer silica chromatographic plates exhibits a femtogram (1.15 fg/cm(2)) detection limit for trinitrotoluene (TNT) and picric acid (PA), while the solution state fluorescence quenching shows for PA detection at the 2-20 ppb level. The sensing performance of fluoranthene thin films to NACs in aqueous solution reveals that fluorophores are highly selective towards the detection of PA. The smart performances of thin film fluorophores with high photostability have great advantage than those of conjugated polymers with superior sensitive detection of PA in groundwater.

Influence of crack parameters on wavelet energy correlated damage index

This paper illustrates a Wavelet Coefficient based approach using experiments to understand the sensitivity of ultrasonic signals due to parametric variation of a crack configuration in a metal plate. A PZT patch sensor/actuator system integrated to a metal plate with through-thickness crack is used. The proposed approach uses piezoelectric patches, which can be used to both actuate and sense the ultrasonic signals. While this approach leads to more flexibility and reduced cost for larger scalability of the sensor/actuator network, the complexity of the signals increases as compared to what is encountered in conventional ultrasonic NDE problems using selective wave modes. A Damage Index (DI) has been introduced, which is function of wavelet coefficient. Experiments have been carried out for various crack sizes, crack orientations and band-limited tone-burst signal through FIR filter. For a 1 cm long crack interrogated with 20 kHz tone-burst signal, the Damage Index (DI) for the horizontal crack orientation increases by about 70% with respect to that for 135 degrees oriented crack and it increases by about 33% with respect to the vertically oriented crack. The detailed results reported in this paper is a step forward to developing computational schemes for parametric identification of damage using sensor/actuator network and ultrasonic wave.