Two timescale convergent Q-learning for sleep-scheduling in wireless sensor networks

In this paper, we consider an intrusion detection application for Wireless Sensor Networks. We study the problem of scheduling the sleep times of the individual sensors, where the objective is to maximize the network lifetime while keeping the tracking error to a minimum. We formulate this problem as a partially-observable Markov decision process (POMDP) with continuous stateaction spaces, in a manner similar to Fuemmeler and Veeravalli (IEEE Trans Signal Process 56(5), 2091-2101, 2008). However, unlike their formulation, we consider infinite horizon discounted and average cost objectives as performance criteria. For each criterion, we propose a convergent on-policy Q-learning algorithm that operates on two timescales, while employing function approximation. Feature-based representations and function approximation is necessary to handle the curse of dimensionality associated with the underlying POMDP. Our proposed algorithm incorporates a policy gradient update using a one-simulation simultaneous perturbation stochastic approximation estimate on the faster timescale, while the Q-value parameter (arising from a linear function approximation architecture for the Q-values) is updated in an on-policy temporal difference algorithm-like fashion on the slower timescale. The feature selection scheme employed in each of our algorithms manages the energy and tracking components in a manner that assists the search for the optimal sleep-scheduling policy. For the sake of comparison, in both discounted and average settings, we also develop a function approximation analogue of the Q-learning algorithm. This algorithm, unlike the two-timescale variant, does not possess theoretical convergence guarantees. Finally, we also adapt our algorithms to include a stochastic iterative estimation scheme for the intruder's mobility model and this is useful in settings where the latter is not known. Our simulation results on a synthetic 2-dimensional network setting suggest that our algorithms result in better tracking accuracy at the cost of only a few additional sensors, in comparison to a recent prior work.

A Reactive Intermediate, Ni-5(C6H4N3)(6)(CO)(4)], in the Formation of Nonameric Clusters of Nickel, Ni-9(C6H4N3)(12)(CO)(6)] and Ni-9(C6H4N3)(12)(CO)(6)].2(C3H7NO)

Three new molecular compounds, Ni-5(bta)(6)(CO)(4)], I, Ni-9(bta)(12)(CO)(6)], II, Ni-9(bta)(12)(CO)(6)]. 2(C3H7NO), III, (bta = benzotriazole) were prepared employing solvothermal reactions. Of these, I have pentanuclear nickel, whereas II and III have nonanuclear nickel species. The structures are formed by the connectivity between the nickel and benzotriazole giving rise to the 5- and 9-membered nickel clusters. The structures are stabilised by extensive pi aEuro broken vertical bar pi and C-H... pi interactions. Compound II and III are solvotamorphs as they have the same 9-membered nickel clusters and have different solvent molecules. To the best of our knowledge, the compounds I-III represent the first examples of the same transition element existing in two distinct coordination environment in this class of compounds. The studies reveal that compound I is reactive and could be an intermediate in the preparation of II and III. Thermal studies indicate that the compounds are stable upto 350(a similar to)C and at higher temperatures (similar to 800(a similar to)C) the compounds decompose into NiO. Magnetic studies reveal that II is anti-ferromagnetic.

Mapping Post-translational Modifications of Mammalian Testicular Specific Histone Variant TH2B in Tetraploid and Haploid Germ Cells and Their Implications on the Dynamics of Nucleosome Structure

Histones regulate a variety of chromatin templated events by their post-translational modifications (PTMs). Although there are extensive reports on the PTMs of canonical histones, the information on the histone variants remains very scanty. Here, we report the identification of different PTMs, such as acetylation, methylation, and phosphorylation of a major mammalian histone variant TH2B. Our mass spectrometric analysis has led to the identification of both conserved and unique modifications across tetraploid spermatocytes and haploid spermatids. We have also computationally derived the 3-dimensional model of a TH2B containing nucleosome in order to study the spatial orientation of the PTMs identified and their effect on nucleosome stability and DNA binding potential. From our nucleosome model, it is evident that substititution of specific amino acid residues in TH2B results in both differential histone-DNA and histone-histone contacts. Furthermore, we have also observed that acetylation on the N-terminal tail of TH2B weakens the interactions with the DNA. These results provide direct evidence that, similar to somatic H2B, the testis specific histone TH2B also undergoes multiple PTMs, suggesting the possibility of chromatin regulation by such covalent modifications in mammalian male germ cells.

Sunlight-Induced Covalent Marriage of Two Triply Interlocked Pd-6 Cages and Their Facile Thermal Separation

A template-free triply interlocked Pd-6 cage (2) was synthesized by two-component self-assembly of cis-blocked 90 degrees acceptor cis-(tmen)Pd(NO3)(2) (M) and 1,3,5-tris((E)-2-(pyridin-3-yl)vinyl)benzene (L). Assembly 2 was characterized by H-1 NMR and ESI-MS, and the structure was confirmed by X-ray crystallography, which revealed a parallel conformation of the olefin double bonds belonging to the adjacent cages in the solid state at a distance of 3.656 angstrom, thereby indicating the feasibility of 2+2] photochemical reaction. Two adjacent interlocked cages were covalently married together by intermolecular 2+2] cycloaddition in a single crystal-to-single crystal fashion upon exposure to sunlight/UV irradiation. Most surprisingly, the covalently married pair was easily separated thermally in aqueous medium under mild reaction conditions.

Significant photocytotoxic effect of an iron(III) complex of a Schiff base ligand derived from vitamin B-6 and thiosemicarbazide in visible light

Iron(III)-Schiff base complexes, namely, Fe(tsc-py)(2)](NO3) (1), Fe(tsc-acpy)(2)](NO3) (2) and Fe(tsc-VB6)(2)](NO3) (3), where tsc-py, tsc-acpy and tsc-VB6 are the respective Schiff bases derived from thiosemicarbazide (tsc) and pyridine-2-aldehyde (tsc-py), 2-acetyl pyridine (tsc-acpy) and vitamin B-6 (pyridoxal, tsc-VB6), have been prepared, structurally characterized and their photocytotoxicity studied in cancer HeLa cells. The single crystal X-ray structures of the complexes 1 and 2 show a distorted octahedral geometry formed by the FeN4S2 core. The low-spin and 1 : 1 electrolytic complexes display a broad absorption band in the visible region. Complexes 1 and 2, without any VB6 moiety are not cytotoxic under light or dark conditions. Complex 3 is significantly photocytotoxic under visible light of 400-700 nm giving an IC50 value of 22.5 mu M in HeLa cells with no dark toxicity (IC50 > 100 mu M). The photo-induced cell death is attributable to apoptotic pathways involving photo-assisted generation of intracellular ROS. The observed photocytotoxicity of complex 3 could be the result of its better photosensitizing property combined with its enhanced uptake into cancer cells via a VB6 transporting membrane carrier (VTC) mediated diffusion pathway due to the presence of the VB6 moiety compared to the two non-vitamin B-6 analogues, complexes 1 and 2.

The Self-Association of Graphane Is Driven by London Dispersion and Enhanced Orbital Interactions

We investigated the nature of the cohesive energy between graphane sheets via multiple CH center dot center dot center dot HC interactions, using density functional theory (DFT) including dispersion correction (Grimmes D3 approach) computations of n]graphane sigma dimers (n = 6-73). For comparison, we also evaluated the binding between graphene sheets that display prototypical pi/pi interactions. The results were analyzed using the block-localized wave function (BLW) method, which is a variant of ab initio valence bond (VB) theory. BLW interprets the intermolecular interactions in terms of frozen interaction energy (Delta E-F) composed of electrostatic and Pauli repulsion interactions, polarization (Delta E-pol), charge-transfer interaction (Delta E-CT), and dispersion effects (Delta E-disp). The BLW analysis reveals that the cohesive energy between graphane sheets is dominated by two stabilizing effects, namely intermolecular London dispersion and two-way charge transfer energy due to the sigma CH -> sigma*(HC) interactions. The shift of the electron density around the nonpolar covalent C-H bonds involved in the intermolecular interaction decreases the C-H bond lengths uniformly by 0.001 angstrom. The Delta E-CT term, which accounts for similar to 15% of the total binding energy, results in the accumulation of electron density in the interface area between two layers. This accumulated electron density thus acts as an electronic glue for the graphane layers and constitutes an important driving force in the self-association and stability of graphane under ambient conditions. Similarly, the double faced adhesive tape style of charge transfer interactions was also observed among graphene sheets in which it accounts for similar to 18% of the total binding energy. The binding energy between graphane sheets is additive and can be expressed as a sum of CH center dot center dot center dot HC interactions, or as a function of the number of C-H bonds.

Girsanov Transformation-Based Reliability Modeling and Testing of Actively Controlled Structures

The problem of estimation of the time-variant reliability of actively controlled structural dynamical systems under stochastic excitations is considered. Monte Carlo simulations, reinforced with Girsanov transformation-based sampling variance reduction, are used to tackle the problem. In this approach, the external excitations are biased by an additional artificial control force. The conflicting objectives of the two control forces-one designed to reduce structural responses and the other to promote limit-state violations (but to reduce sampling variance)-are noted. The control for variance reduction is fashioned after design-point oscillations based on a first-order reliability method. It is shown that for structures that are amenable to laboratory testing, the reliability can be estimated experimentally with reduced testing times by devising a procedure based on the ideas of the Girsanov transformation. Illustrative examples include studies on a building frame with a magnetorheologic damper-based isolation system subject to nonstationary random earthquake excitations. (C) 2014 American Society of Civil Engineers.

Disappearance of electron-hole asymmetry in nanoparticles of Nd1-xCaxMnO3(x=0.6, 0.4): magnetization and electron paramagnetic resonance evidence

We study and compare magnetic and electron paramagnetic resonance behaviors of bulk and nanoparticles of Nd1-xCaxMnO3 in hole doped (x = 0.4; NCMOH) and electron doped (x = 0.6; NCMOE) samples. NCMOH in bulk form shows a complex temperature dependence of magnetization M(T), with a charge ordering transition at similar to 250 K, an antiferromagnetic (AFM) transition at similar to 150 K, and a transition to a canted AFM phase/mixed phase at similar to 80 K. Bulk NCMOE behaves quite differently with just a charge ordering transition at similar to 280 K, thus providing a striking example of the so called electron-hole asymmetry. While our magnetization data on bulk samples are consistent with the earlier reports, the new results on the nanoparticles bring out drastic effects of size reduction. They show that M(T) behaviors of the two nanosamples are essentially similar in addition to the absence of the charge order in them thus providing strong evidence for vanishing of the electron-hole asymmetry in nanomanganites. This conclusion is further corroborated by electron paramagnetic resonance studies which show that the large difference in the ``g'' values and their temperature dependences found for the two bulk samples disappears as they approach a common behavior in the corresponding nanosamples. (C) 2015 AIP Publishing LLC.

Specificity of the ModA11, ModA12 and ModD1 epigenetic regulator N-6-adenine DNA methyltransferases of Neisseria meningitidis

Phase variation (random ON/OFF switching) of gene expression is a common feature of host-adapted pathogenic bacteria. Phase variably expressed N-6-adenine DNA methyltransferases (Mod) alter global methylation patterns resulting in changes in gene expression. These systems constitute phase variable regulons called phasevarions. Neisseria meningitidis phasevarions regulate genes including virulence factors and vaccine candidates, and alter phenotypes including antibiotic resistance. The target site recognized by these Type III N-6-adenine DNA methyltransferases is not known. Single molecule, real-time (SMRT) methylome analysis was used to identify the recognition site for three key N. meningitidis methyltransferases: ModA11 (exemplified by M.NmeMC58I) (5'-CGY(m6)AG-3'), ModA12 (exemplified by M.Nme77I, M.Nme18I and M.Nme579II) (5'-AC(m6)ACC-3') and ModD1 (exemplified by M.Nme579I) (5'-CC(m6)AGC-3'). Restriction inhibition assays and mutagenesis confirmed the SMRT methylome analysis. The ModA11 site is complex and atypical and is dependent on the type of pyrimidine at the central position, in combination with the bases flanking the core recognition sequence 5'-CGY(m6)AG-3'. The observed efficiency of methylation in the modA11 strain (MC58) genome ranged from 4.6% at 5'-GCGC(m6)AGG-3' sites, to 100% at 5'-ACGT(m6)AGG-3' sites. Analysis of the distribution of modified sites in the respective genomes shows many cases of association with intergenic regions of genes with altered expression due to phasevarion switching.

Two player game variant of the Erdos-Szekeres problem

The classical Erdos-Szekeres theorem states that a convex k-gon exists in every sufficiently large point set. This problem has been well studied and finding tight asymptotic bounds is considered a challenging open problem. Several variants of the Erdos-Szekeres problem have been posed and studied in the last two decades. The well studied variants include the empty convex k-gon problem, convex k-gon with specified number of interior points and the chromatic variant. In this paper, we introduce the following two player game variant of the Erdos-Szekeres problem: Consider a two player game where each player playing in alternate turns, place points in the plane. The objective of the game is to avoid the formation of the convex k-gon among the placed points. The game ends when a convex k-gon is formed and the player who placed the last point loses the game. In our paper we show a winning strategy for the player who plays second in the convex 5-gon game and the empty convex 5-gon game by considering convex layer configurations at each step. We prove that the game always ends in the 9th step by showing that the game reaches a specific set of configurations.

Contrasting Electronic Requirements for C-H Binding and C-H Activation in d(6) Half-Sandwich Complexes of Rhenium and Tungsten

A computational study of the interaction half-sandwich metal fragments (metal=Re/W, electron count=d(6)), containing linear nitrosyl (NO+), carbon monoxide (CO), trifluorophosphine (PF3), N-heterocyclic carbene (NHC) ligands with alkanes are conducted using density functional theory employing the hybrid meta-GGA functional (M06). Electron deficiency on the metal increases with the ligand in the order NHC < CO < PF3 < NO+. Electron-withdrawing ligands like NO+ lead to more stable alkane complexes than NHC, a strong electron donor. Energy decomposition analysis shows that stabilization is due to orbital interaction involving charge transfer from the alkane to the metal. Reactivity and dynamics of the alkane fragment are facilitated by electron donors on the metal. These results match most of the experimental results known for CO and PF3 complexes. The study suggests activation of alkane in metal complexes to be facile with strong donor ligands like NHC. (C) 2015 Wiley Periodicals, Inc.

Dual Stress and Thermally Driven Mechanical Properties of the Same Organic Crystal: 2,6-Dichlorobenzylidene-4-fluoro-3-nitroaniline

An elastic organic crystal, 2,6-dichlorobenzylidine-4-fluoro-3-nitroaniline (DFNA), which also shows thermosalient behavior, is studied. The presence of these two distinct properties in the same crystal is unusual and unprecedented because they follow respectively from isotropy and anisotropy in the crystal packing. Therefore, while both properties lead from the crystal structure, the mechanisms for bending and thermosalience are quite independent of one another. Crystals of the low-temperature (a) form of the title compound are bent easily without any signs of fracture with the application of deforming stress, and this bending is within the elastic limit. The crystal structure of the a-form was determined (P2(1)/c, Z = 4, a = 3.927(7) angstrom, b = 21.98(4) angstrom, c = 15.32(3) angstrom). There is an irreversible phase transition at 138 degrees C of this form to the high-temperature beta-form followed by melting at 140 degrees C. Variable-temperature X-ray powder diffraction was used to investigate the structural changes across the phase transition and, along with an FTIR study, establishes the structure of the beta-form. A possible rationale for strain build-up is given. Thermosalient behavior arises from anisotropic changes in the three unit cell parameters across the phase transition, notably an increase in the b axis parameter from 21.98 to 22.30 angstrom. A rationale is provided for the existence of both elasticity and thermosalience in the same crystal. FTIR studies across the phase transition reveal important mechanistic insights: (i) increased pi...pi repulsions along 100] lead to expansion along the a axis; (ii) change in alignment of C-Cl and NO2 groups result from density changes; and (iii) competition between short-range repulsive (pi...pi) interactions and long-range attractive dipolar interactions (C-Cl and NO2) could lie at the origin of the existence of two distinctive properties.

Halogen Bonding and Chalcogen Bonding in 4,7-Dibromo-5, 6-dinitro-2,1,3-benzothiadiazole

An organic solid, 4,7-dibromo-5,6-dinitro-2,1,3-benzothiadiazole, has been designed to serve as an illustrative example to quantitatively evaluate the relative merits of halogen and chalcogen bonding in terms of charge density features. The compound displays two polymorphic modifications, one crystallizing in a non-centrosymmetric space group (Z' = 1) and the other in a centrosymmetric space group with two molecules in the asymmetric unit (Z' = 2). Topological analysis based on QTAIM clearly brings out the dominance of the chalcogen bond over the halogen bond along with an indication that halogen bonds are more directional compared to chalcogen bonds. The cohesive energies calculated with the absence of both strong and weak hydrogen bonds as well as stacking interaction are indicative of the stabilities associated with the polymorphic forms.

A Variant of the Hadwiger-Debrunner (p, q)-Problem in the Plane

Let X be a convex curve in the plane (say, the unit circle), and let be a family of planar convex bodies such that every two of them meet at a point of X. Then has a transversal of size at most . Suppose instead that only satisfies the following ``(p, 2)-condition'': Among every p elements of , there are two that meet at a common point of X. Then has a transversal of size . For comparison, the best known bound for the Hadwiger-Debrunner (p, q)-problem in the plane, with , is . Our result generalizes appropriately for if is, for example, the moment curve.

A finite variant of the Toom Model

We present results for a finite variant of the one-dimensional Toom model with closed boundaries. We show that the steady state distribution is not of product form, but is nonetheless simple. In particular, we give explicit formulas for the densities and some nearest neighbour correlation functions. We also give exact results for eigenvalues and multiplicities of the transition matrix using the theory of R-trivial monoids in joint work with A. Schilling, B. Steinberg and N. M. Thiery.