Supercritical age-dependent branching Markov processes and their scaling limits

This paper studies the long-time behavior of the empirical distribution of age and normalized position of an age-dependent supercritical branching Markov process. The motion of each individual during its life is a random function of its age. It is shown that the empirical distribution of the age and the normalized position of all individuals alive at time t converges as t -> infinity to a deterministic product measure.

An actor-critic algorithm with function approximation for discounted cost constrained Markov decision processes

We develop in this article the first actor-critic reinforcement learning algorithm with function approximation for a problem of control under multiple inequality constraints. We consider the infinite horizon discounted cost framework in which both the objective and the constraint functions are suitable expected policy-dependent discounted sums of certain sample path functions. We apply the Lagrange multiplier method to handle the inequality constraints. Our algorithm makes use of multi-timescale stochastic approximation and incorporates a temporal difference (TD) critic and an actor that makes a gradient search in the space of policy parameters using efficient simultaneous perturbation stochastic approximation (SPSA) gradient estimates. We prove the asymptotic almost sure convergence of our algorithm to a locally optimal policy. (C) 2010 Elsevier B.V. All rights reserved.

Electrical switching studies on Ge-Te-Tl chalcogenide glasses: Effect of thallium on the composition dependence of switching voltages

Bulk Ge(17)Te83_,JI glasses (05x.5_13), have been found to exhibit memory type electrical switching. The switching voltages (also known as threshold voltage V-th) of Ge17Te83-xTlx glasses are found to decrease with increasing thallium content. The rate of decrease of Vtry is greater at lower concentrations and \textbackslashid, falls at a slower rate for higher thallium concentrations (x 6). The addition of thallium to the Ge-Te network fragments the covalent network and introduces ionic nature to it; the reduction in network connectivity leads to the decrease in switching voltages with thallium content. The decrease in the glass transition temperatures of Ge17Te83-xTlx glasses with increasing thallium concentration supports the idea of decrease in network connectivity with TI addition. The more metallic nature of TI also contributes to the observed reduction in the switching voltages of Ge17Te83-xTlx glasses with TI content. Further, there is an interesting correlation seen between the threshold voltage V-th and the average bond energy, as a function of TI content. In addition, the switching voltages of Ge17Te83-xTlx glasses have been found to decrease with sample thickness almost linearly. The set-reset studies indicate that the Ge17Te83-xTl2 sample can be switched for more than 10 cycles, whereas other glasses could not be reset beyond two switching cycles. (C) 2010 Elsevier B.V. All rights reserved.

A Comparative Study of Electrical Switching Behavior of Certain Tellurium based Chalcogenide Thin Films for Phase Change Memory (PCM) Applications

This work describes the electrical switching behavior of three telluride based amorphous chalcogenide thin film samples, Al-Te, Ge-Se-Te and Ge-Te-Si. These amorphous thin films are made using bulk glassy ingots, prepared by conventional melt quenching technique, using flash evaporation technique; while Al-Te sample has been coated in coplanar electrode geometry, Ge-Se-Te and Ge-Te-Si samples have been deposited with sandwich electrodes. It is observed that all the three samples studied, exhibit memory switching behavior in thin film form, with Ge-Te-Si sample exhibiting a faster switching characteristic. The difference seen in the switching voltages of the three samples studied has been understood on the basis of difference in device geometry and thickness. Scanning electron microscopic image of switched region of a representative Ge15Te81Si4 sample shows a structural change and formation of crystallites in the electrode region, which is responsible for making a conducting channel between the two electrodes during switching.

Comparative-Study of Photonic Switching architectures

The basic photonic switching elements of practical importance are outlined. A detailed comparative study of photonic switching architectures is presented both for guided wave fabrics and free-space fabrics. The required equations for comparative study are obtained, after considering the parameters like bend losses, effects of waveguide crossings, etc. The potential areas of application of photonic switching are pointed out.

Low threshold ovonic switching in a-Si:H/InSb heterostructures

a-Si:H/InSb structures have been fabricated by glow discharge deposition of a-Si on bulk InSb substrates in hydrogen atmosphere. The structure shows interesting switching properties, toggling between a high resistance and a conducting state with OFF to ON resistance ratio of 10(6) at remarkably low threshold voltages of 0.3 V at room temperature. The low threshold voltage for this structure, as compared to the higher switching threshold of about 30 V for other a-Si based structures, has been achieved by the use of InSb as a substrate, capable of high carrier injection. (C) 1997 Published by Elsevier Science Ltd.

Multiscale stochastic approximation for parametric optimization of hidden Markov models

A two-time scale stochastic approximation algorithm is proposed for simulation-based parametric optimization of hidden Markov models, as an alternative to the traditional approaches to ''infinitesimal perturbation analysis.'' Its convergence is analyzed, and a queueing example is presented.

Residence time distribution for a class of Gaussian Markov processes

We study the distribution of residence time or equivalently that of "mean magnetization" for a family of Gaussian Markov processes indexed by a positive parameter alpha. The persistence exponent for these processes is simply given by theta=alpha but the residence time distribution is nontrivial. The shape of this distribution undergoes a qualitative change as theta increases, indicating a sharp change in the ergodic properties of the process. We develop two alternate methods to calculate exactly but recursively the moments of the distribution for arbitrary alpha. For some special values of alpha, we obtain closed form expressions of the distribution function. [S1063-651X(99)03306-1].

Stability of degenerate diffusions with state-dependent switching

This paper deals with the ergodic properties of hybrid systems modelled by diffusion processes with state-dependent switching. We investigate the sufficient conditions expressed in terms of the parameters of the underlying process which would ensure the existence of a unique invariant probability and stability in distribution of the flow. It turns out that the conditions would depend on certain averaging mechanisms over the states of the discrete component of the hybrid system. (C) 1999 Academic Press.

A current error space vector based hysteresis controller with constant switching frequency and simple online boundary computation for VSI fed IM drive

This paper proposes a simple current error space vector based hysteresis controller for two-level inverter fed Induction Motor (IM) drives. This proposed hysteresis controller retains all advantages of conventional current error space vector based hysteresis controllers like fast dynamic response, simple to implement, adjacent voltage vector switching etc. The additional advantage of this proposed hysteresis controller is that it gives a phase voltage frequency spectrum exactly similar to that of a constant switching frequency space vector pulse width modulated (SVPWM) inverter. In this proposed hysteresis controller the boundary is computed online using estimated stator voltages along alpha and beta axes thus completely eliminating look up tables used for obtaining parabolic hysteresis boundary proposed in. The estimation of stator voltage is carried out using current errors along alpha and beta axes and steady state model of induction motor. The proposed scheme is simple and capable of taking inverter upto six step mode operation, if demanded by drive system. The proposed hysteresis controller based inverter fed drive scheme is simulated extensively using SIMULINK toolbox of MATLAB for steady state and transient performance. The experimental verification for steady state performance of the proposed scheme is carried out on a 3.7kW IM.

Polarization switching studies in ferroelectric glycine phosphite single crystals

Glycine Phosphite [NH3CH2COOH3PO3], abbreviated as GPI, undergoes a para-ferroelectric phase transition from the monoclinic symmetry P2(1)/a to P2(1) at 224.7 K. We report here a systematic study of the polarization switching process in this crystal. Growth of these crystals from aqueous solution has been undertaken employing both solvent evaporation and slow cooling methods. Hysteresis loop measurements along the polar b-axis yielded a spontaneous polarization value of 0.5 muC/cm(2) and a coercive field of 2.5 kV/cm. Conventional Merz technique was employed for polarization switching studies, wherein bipolar square pulses were applied to the sample to induce domain reversal. The transient switching pulse that flows through the sample on application of the field was recorded. The maximum switching time required for domain switching was measured both as a function of electric field and temperature. The experimentally observed switching curves were fitted with the model based on the Pulvari-Kuebler theory of nucleation and growth of domains. From the experimental data, the values of mobility and activation field were obtained. It was observed that switching process in this crystal is predominantly governed by the forward growth of domain walls in the high field region. However, switching process in GPI crystal was found to be slower than that found in other glycine based ferroelectric crystals.

Reversible and irreversible switching processes in pure and lanthanum modified lead zirconate thin films

The mechanism of field induced phase switching in antiferroelectric lead zirconate and La-modified lead zirconate thin films has been analysed in terms of reversible and irreversible switching process under weak fields as a function of donor concentration. Extension of Rayleigh law of ferromagnetic materials to the present antiferroelectric and modified antiferroelectric compositions have clearly showed that origin of small signal dielectric permittivity is due to reversible domain wall motion. Rayleigh's constant, a measure of irreversible switching process, exhibited a slight increase with lower La3+ concentrations and followed by a gradual fall for higher concentration. This clearly illustrates that donor addition to antiferroelectric thin films controls the domain switching even under weak fields. (C) 2002 Elsevier Science B.V. All rights reserved.

Risk-sensitive optimal control for Markov decision processes with monotone cost

The existence of an optimal feedback law is established for the risk-sensitive optimal control problem with denumerable state space. The main assumptions imposed are irreducibility and a near monotonicity condition on the one-step cost function. A solution can be found constructively using either value iteration or policy iteration under suitable conditions on initial feedback law.

Electrical switching in chalcogenide glasses - Some newer insights

The recent studies on the switching. behavior of several chalcogenide semiconductors indicate that there exists a close relation between the electrical switching and structural effects in these materials; the two network topological Thresholds, namely the Rigidity Percolation and the Chemical Threshold are found to influence considerably the composition dependence of the switching voltages/fields of many memory and threshold switching glasses. Further, changes in the coordination of constituent atoms are found to effect a change in the switching behavior (memory to threshold), Also, an interesting relation has been established between the type of switching exhibited and the thermal diffusivity of the material.

Analysis of link-layer backoff schemes on point-to-point Markov fading links

Backoff algorithms are typically employed in multiple-access networks (e.g., Ethernet) to recover from packet collisions. In this letter, we propose and carry out the analysis for three types of link-layer backoff schemes, namely, linear backoff, exponential backoff, and geometric backoff, on point-to-point wireless fading links where packet errors occur nonindependently. In such a scenario, the backoff schemes are shown to achieve better energy efficiency without compromising much on the link layer throughput performance.