Subgeometric rates of convergence for a class of continuous-time Markov process

Let (Phi(t))(t is an element of R+) be a Harris ergodic continuous-time Markov process on a general state space, with invariant probability measure pi. We investigate the rates of convergence of the transition function P-t(x, (.)) to pi; specifically, we find conditions under which r(t) vertical bar vertical bar P-t (x, (.)) - pi vertical bar vertical bar -> 0 as t -> infinity, for suitable subgeometric rate functions r(t), where vertical bar vertical bar - vertical bar vertical bar denotes the usual total variation norm for a signed measure. We derive sufficient conditions for the convergence to hold, in terms of the existence of suitable points on which the first hitting time moments are bounded. In particular, for stochastically ordered Markov processes, explicit bounds on subgeometric rates of convergence are obtained. These results are illustrated in several examples.

Species Fractionation In Atomic Chains From Mechanically Stretched Alloys.

Bettini et al (2006 Nat. Nanotechnol. 1 182-5) reported the first experimental realization of linear atomic chains (LACs) composed of different atoms (Au and Ag). The different contents of Au and Ag were observed in the chains from what was found in the bulk alloys, which raises the question of what the wire composition is, if it is in equilibrium with a bulk alloy. In this work we address the thermodynamic driving force for species fractionation in LACs under tension, and we present the density-functional theory results for Ag-Au chain alloys. A pronounced stabilization of the wires with an alternating Ag-Au sequence is observed, which could be behind the experimentally observed Au enrichment in LACs from alloys with high Ag content.

Linearization of Chains and Sideward Movement

360

Interleukin-22 forms dimers that are recognized by two interleukin-22R1 receptor chains

Interleukin-22 (IL-22) is a class 2 cytokine whose primary structure is similar to that of interleukin 10 (IL-10) and interferon-gamma (IFN-gamma). IL-22 induction during acute phase immune response indicates its involvement in mechanisms of inflammation. Structurally different from IL-10 and a number of other members of IL-10 family, which form intertwined inseparable V-shaped dimers of two identical polypeptide chains, a single polypeptide chain of IL-22 folds on itself in a relatively globular structure. Here we present evidence, based on native gel electrophoresis, glutaraldehyde cross-linking, dynamic light scattering, and small angle x-ray scattering experiments, that human IL-22 forms dimers and tetramers in solution under protein concentrations assessable by these experiments. Unexpectedly, low-resolution molecular shape of IL-22 dimers is strikingly similar to that of IL-10 and other intertwined cytokine dimeric forms. Furthermore, we determine an ab initio molecular shape of the IL-22/IL-22R1 complex which reveals the V-shaped IL-22 dimer interacting with two cognate IL-22R1 molecules. Based on this collective evidence, we argue that dimerization might be a common mechanism of all class 2 cytokines for the molecular recognition with their respective membrane receptor. We also speculate that the IL-22 tetramer formation could represent a way to store the cytokine in nonactive form at high concentrations that could be readily converted into functionally active monomers and dimers upon interaction with the cognate cellular receptors.

Bayesian online algorithms for learning in discrete Hidden Markov Models

We propose and analyze two different Bayesian online algorithms for learning in discrete Hidden Markov Models and compare their performance with the already known Baldi-Chauvin Algorithm. Using the Kullback-Leibler divergence as a measure of generalization we draw learning curves in simplified situations for these algorithms and compare their performances.

Formation of atomic carbon chains from graphene nanoribbons

The formation of one-dimensional carbon chains from graphene nanoribbons is investigated using ab initio molecular dynamics. We show under what conditions it is possible to obtain a linear atomic chain via pulling of the graphene nanoribbons. The presence of dimers composed of two-coordinated carbon atoms at the edge of the ribbons is necessary for the formation of the linear chains, otherwise there is simply the full rupture of the structure. The presence of Stone-Wales defects close to these dimers may lead to the formation of longer chains. The local atomic configuration of the suspended atoms indicates the formation of single and triple bonds, which is a characteristic of polyynes.

Defect-induced effects on carrier migration through one-dimensional poly(para-phenylenevinylene) chains

Defects in one-dimensional (1D) systems can be intrinsically distinct from its three-dimensional counterparts, and polymer films are good candidates for showing both extremes that are difficult to individuate in the experimental data. We study theoretically the impact of simple hydrogen and oxygen defects on the electron transport properties of one-dimensional poly(para-phenylenevinylene) chains through a multiscale technique, starting from classical structural simulations for crystalline films to extensive ab initio calculations within density functional theory for the defects in single crystalline-constrained chains. The most disruptive effect on carrier transport comes from conjugation breaking imposed by the overcoordination of a carbon atom in the vinyl group independently from the chemical nature of the defect. The particular case of the [C=O] (keto-defect) shows in addition unexpected electron-hole separation, suggesting that the experimentally detected photoluminescence bleaching and photoconductivity enhancement could be due to exciton dissociation caused by the 1D characteristics of the defect.

Renyi entropy and parity oscillations of anisotropic spin-s Heisenberg chains in a magnetic field

Using the density matrix renormalization group, we investigate the Renyi entropy of the anisotropic spin-s Heisenberg chains in a z-magnetic field. We considered the half-odd-integer spin-s chains, with s = 1/2, 3/2, and 5/2, and periodic and open boundary conditions. In the case of the spin-1/2 chain we were able to obtain accurate estimates of the new parity exponents p(alpha)((p)) and p(alpha)((o)) that gives the power-law decay of the oscillations of the alpha-Renyi entropy for periodic and open boundary conditions, respectively. We confirm the relations of these exponents with the Luttinger parameter K, as proposed by Calabrese et al. [Phys. Rev. Lett. 104, 095701 (2010)]. Moreover, the predicted periodicity of the oscillating term was also observed for some nonzero values of the magnetization m. We show that for s > 1/2 the amplitudes of the oscillations are quite small and get accurate estimates of p(alpha)((p)) and p(alpha)((o)) become a challenge. Although our estimates of the new universal exponents p(alpha)((p)) and p(alpha)((o)) for the spin-3/2 chain are not so accurate, they are consistent with the theoretical predictions.

Ground-state functional for quantum spin chains with bond defects

We have developed a nonlocal functional of the exchange interaction for the ground-state energy of quantum spin chains described by the Heisenberg Hamiltonian. An alternating chain is used to obtain the correlation energy and a local unit-cell approximation is defined in the context of the density-functional theory. The agreement with our exact numerical data, for small chains, is significantly better than a previous formulation, even for chains with several ferromagnetic or antiferromagnetic bond defects. The results can be particularly relevant in the study of finite spin-1/2 Heisenberg chains, with exchange couplings changing, magnitude, or even sign, from bond-to-bond.

Knowledge and information flows in supply chains: A study on pharmaceutical companies

A great deal of attention in the supply chain management literature is devoted to study material and demand information flows and their coordination. But in many situations, supply chains may convey information from different nature, they may be an important channel companies have to deliver knowledge, or specifically, technical information to the market. This paper studies the technical flow and highlights its particular requirements. Drawing upon a qualitative field research, it studies pharmaceutical companies, since those companies face a very specific challenge: consumers do not have discretion over their choices, ethical drugs must be prescribed by physicians to be bought and used by final consumers. Technical information flow is rich, and must be redundant and early delivered at multiple points. Thus, apart from the regular material channel where products and order information flow, those companies build a specialized information channel, developed to communicate to those who need it to create demand. Conclusions can be extended to supply chains where products and services are complex and decision makers must be clearly informed about technology-related information. (C) 2009 Elsevier B.V. All rights reserved.

The Policy Iteration Algorithm for Average Continuous Control of Piecewise Deterministic Markov Processes

The main goal of this paper is to apply the so-called policy iteration algorithm (PIA) for the long run average continuous control problem of piecewise deterministic Markov processes (PDMP`s) taking values in a general Borel space and with compact action space depending on the state variable. In order to do that we first derive some important properties for a pseudo-Poisson equation associated to the problem. In the sequence it is shown that the convergence of the PIA to a solution satisfying the optimality equation holds under some classical hypotheses and that this optimal solution yields to an optimal control strategy for the average control problem for the continuous-time PDMP in a feedback form.

THE VANISHING DISCOUNT APPROACH FOR THE AVERAGE CONTINUOUS CONTROL OF PIECEWISE DETERMINISTIC MARKOV PROCESSES

This work is concerned with the existence of an optimal control strategy for the long-run average continuous control problem of piecewise-deterministic Markov processes (PDMPs). In Costa and Dufour (2008), sufficient conditions were derived to ensure the existence of an optimal control by using the vanishing discount approach. These conditions were mainly expressed in terms of the relative difference of the alpha-discount value functions. The main goal of this paper is to derive tractable conditions directly related to the primitive data of the PDMP to ensure the existence of an optimal control. The present work can be seen as a continuation of the results derived in Costa and Dufour (2008). Our main assumptions are written in terms of some integro-differential inequalities related to the so-called expected growth condition, and geometric convergence of the post-jump location kernel associated to the PDMP. An example based on the capacity expansion problem is presented, illustrating the possible applications of the results developed in the paper.

On the Filtering Problem for Continuous-Time Markov Jump Linear Systems with no Observation of the Markov Chain

We consider in this paper the optimal stationary dynamic linear filtering problem for continuous-time linear systems subject to Markovian jumps in the parameters (LSMJP) and additive noise (Wiener process). It is assumed that only an output of the system is available and therefore the values of the jump parameter are not accessible. It is a well known fact that in this setting the optimal nonlinear filter is infinite dimensional, which makes the linear filtering a natural numerically, treatable choice. The goal is to design a dynamic linear filter such that the closed loop system is mean square stable and minimizes the stationary expected value of the mean square estimation error. It is shown that an explicit analytical solution to this optimal filtering problem is obtained from the stationary solution associated to a certain Riccati equation. It is also shown that the problem can be formulated using a linear matrix inequalities (LMI) approach, which can be extended to consider convex polytopic uncertainties on the parameters of the possible modes of operation of the system and on the transition rate matrix of the Markov process. As far as the authors are aware of this is the first time that this stationary filtering problem (exact and robust versions) for LSMJP with no knowledge of the Markov jump parameters is considered in the literature. Finally, we illustrate the results with an example.

Generalized Coupled Algebraic Riccati Equations for Discrete-time Markov Jump with Multiplicative Noise Systems

In this paper we consider the existence of the maximal and mean square stabilizing solutions for a set of generalized coupled algebraic Riccati equations (GCARE for short) associated to the infinite-horizon stochastic optimal control problem of discrete-time Markov jump with multiplicative noise linear systems. The weighting matrices of the state and control for the quadratic part are allowed to be indefinite. We present a sufficient condition, based only on some positive semi-definite and kernel restrictions on some matrices, under which there exists the maximal solution and a necessary and sufficient condition under which there exists the mean square stabilizing solution fir the GCARE. We also present a solution for the discounted and long run average cost problems when the performance criterion is assumed be composed by a linear combination of an indefinite quadratic part and a linear part in the state and control variables. The paper is concluded with a numerical example for pension fund with regime switching.

Linear minimum mean square filter for discrete-time linear systems with Markov jumps and multiplicative noises

In this paper we obtain the linear minimum mean square estimator (LMMSE) for discrete-time linear systems subject to state and measurement multiplicative noises and Markov jumps on the parameters. It is assumed that the Markov chain is not available. By using geometric arguments we obtain a Kalman type filter conveniently implementable in a recurrence form. The stationary case is also studied and a proof for the convergence of the error covariance matrix of the LMMSE to a stationary value under the assumption of mean square stability of the system and ergodicity of the associated Markov chain is obtained. It is shown that there exists a unique positive semi-definite solution for the stationary Riccati-like filter equation and, moreover, this solution is the limit of the error covariance matrix of the LMMSE. The advantage of this scheme is that it is very easy to implement and all calculations can be performed offline. (c) 2011 Elsevier Ltd. All rights reserved.