Discrete-Time Controlled Markov Processes with Average Cost Criterion: A Survey

This work is a survey of the average cost control problem for discrete-time Markov processes. The authors have attempted to put together a comprehensive account of the considerable research on this problem over the past three decades. The exposition ranges from finite to Borel state and action spaces and includes a variety of methodologies to find and characterize optimal policies. The authors have included a brief historical perspective of the research efforts in this area and have compiled a substantial yet not exhaustive bibliography. The authors have also identified several important questions that are still open to investigation.

T. E. Harris and branching processes

T. E. Harris was a pioneer par excellence in many fields of probability theory. In this paper, we give a brief survey of the many fundamental contributions of Harris to the theory of branching processes, starting with his doctoral work at Princeton in the late forties and culminating in his fundamental book ``The Theory of Branching Processes,'' published in 1963.

Monsoon circulation interaction with Western Ghats orography under changing climate - Projection by a 20-km mesh AGCM

In this study, the authors have investigated the likely future changes in the summer monsoon over the Western Ghats (WG) orographic region of India in response to global warming, using time-slice simulations of an ultra high-resolution global climate model and climate datasets of recent past. The model with approximately 20-km mesh horizontal resolution resolves orographic features on finer spatial scales leading to a quasi-realistic simulation of the spatial distribution of the present-day summer monsoon rainfall over India and trends in monsoon rainfall over the west coast of India. As a result, a higher degree of confidence appears to emerge in many aspects of the 20-km model simulation, and therefore, we can have better confidence in the validity of the model prediction of future changes in the climate over WG mountains. Our analysis suggests that the summer mean rainfall and the vertical velocities over the orographic regions of Western Ghats have significantly weakened during the recent past and the model simulates these features realistically in the present-day climate simulation. Under future climate scenario, by the end of the twenty-first century, the model projects reduced orographic precipitation over the narrow Western Ghats south of 16A degrees N that is found to be associated with drastic reduction in the southwesterly winds and moisture transport into the region, weakening of the summer mean meridional circulation and diminished vertical velocities. We show that this is due to larger upper tropospheric warming relative to the surface and lower levels, which decreases the lapse rate causing an increase in vertical moist static stability (which in turn inhibits vertical ascent) in response to global warming. Increased stability that weakens vertical velocities leads to reduction in large-scale precipitation which is found to be the major contributor to summer mean rainfall over WG orographic region. This is further corroborated by a significant decrease in the frequency of moderate-to-heavy rainfall days over WG which is a typical manifestation of the decrease in large-scale precipitation over this region. Thus, the drastic reduction of vertical ascent and weakening of circulation due to `upper tropospheric warming effect' predominates over the `moisture build-up effect' in reducing the rainfall over this narrow orographic region. This analysis illustrates that monsoon rainfall over mountainous regions is strongly controlled by processes and parameterized physics which need to be resolved with adequately high resolution for accurate assessment of local and regional-scale climate change.

Critical age-dependent branching Markov processes and their scaling limits

This paper studies:(i)the long-time behaviour of the empirical distribution of age and normalized position of an age-dependent critical branching Markov process conditioned on non-extinction;and (ii) the super-process limit of a sequence of age-dependent critical branching Brownian motions.

Supercritical age-dependent branching Markov processes and their scaling limits

This paper studies the long-time behavior of the empirical distribution of age and normalized position of an age-dependent supercritical branching Markov process. The motion of each individual during its life is a random function of its age. It is shown that the empirical distribution of the age and the normalized position of all individuals alive at time t converges as t -> infinity to a deterministic product measure.

Nonlinear measures of heart rate time series: influence of posture and controlled breathing

In this study, we investigated measures of nonlinear dynamics and chaos theory in regards to heart rate variability in 27 normal control subjects in supine and standing postures, and 14 subjects in spontaneous and controlled breathing conditions. We examined minimum embedding dimension (MED), largest Lyapunov exponent (LLE) and measures of nonlinearity (NL) of heart rate time series. MED quantifies the system's complexity, LLE predictability and NL, a measure of deviation from linear processes. There was a significant decrease in complexity (P<0.00001), a decrease in predictability (P<0.00001) and an increase in nonlinearity (P=0.00001) during the change from supine to standing posture. Decrease in MED, and increases in NL score and LLE in standing posture appear to be partly due to an increase in sympathetic activity of the autonomous nervous system in standing posture. An improvement in predictability during controlled breathing appears to be due to the introduction of a periodic component. (C) 2000 published by Elsevier Science B.V.

Thermodynamics of flow and vaporization processes in long-chain liquids

The flow and vaporization behaviors of long-chain esters of varying molecular weights (300-900) ana branching (linear, Y-shaped, and +-shaped molecules) have been studied. The flow behavior is found to depend on the structure as well as the molecular weight. Below a molecular weight of 600, the molecules flow wholly but above this, segmental motion occurs, and the flow becomes independent of the molecular weight which is explained from the blob model. The blob concept demonstrates that the hole of a size of about 11 angstrom is needed for the flow to occur and it is much less than the size of the molecule. The blob size is observed to slightly decrease along the series linear and Y- and +-branched esters. The heat of vaporization is found to be independent of the molecular structure since the molecules acquire a coiled spherical shape during vaporization and hence depends only on the molecular weight. A significant structural effect is observed for the esters on their glass transition temperature (T(g)). The T(g) vs molecular weight plot displays contrasting trend for linear and +-branched esters, with Y esters showing an intermediate behavior. It is explained from their molecular packing and entanglement as visualized by the blob model.

Fretting studies on self-mated stainless steel and chromium carbide coated surfaces under controlled environment conditions

Adhesive wear has been widely accepted as the type of wear which is most frequently encountered under fretting conditions. Present study has been carried out to study the mode of failure and mechanisms associated under conditions where strong adhesion prevails at the contact interface. Mechanical variables such as normal load, displacement amplitude, and environment conditions were controlled so as to simulate adhesion as the governing mechanism at the contact interface. Self-mated Stainless Steel (SS) and chromium carbide with 25% nickel chrome binder coatings using plasma spray and high-velocity oxy-fuel (HVOF) processes on SS were considered as the material for contacting bodies. Damage in the form of plastic deformation, fracture, and material transfer has been observed. Further, chromium carbide with 25% nickel chrome binder coatings using HVOF process on SS shows less fretting damage, and can be considered as an effective palliative against fretting damage, even under high vacuum conditions. (C) 2013 Elsevier B.V. All rights reserved.

Risk-Sensitive Ergodic Control of Continuous Time Markov Processes With Denumerable State Space

In this article, we study risk-sensitive control problem with controlled continuous time Markov chain state dynamics. Using multiplicative dynamic programming principle along with the atomic structure of the state dynamics, we prove the existence and a characterization of optimal risk-sensitive control under geometric ergodicity of the state dynamics along with a smallness condition on the running cost.

Use of Sr isotopes as a tool to decipher the soil weathering processes in a tropical river catchment, southwestern India

River water composition (major ion and Sr-87/Sr-86 ratio) was monitored on a monthly basis over a period of three years from a mountainous river (Nethravati River) of southwestern India. The total dissolved solid (TDS) concentration is relatively low (46 mg L-1) with silica being the dominant contributor. The basin is characterised by lower dissolved Sr concentration (avg. 150 nmol L-1), with radiogenic Sr-87/Sr-86 isotopic ratios (avg. 0.72041 at outlet). The composition of Sr and Sr-87/Sr-86 and their correlation with silicate derived cations in the river basin reveal that their dominant source is from the radiogenic silicate rock minerals. Their composition in the stream is controlled by a combination of physical and chemical weathering occurring in the basin. The molar ratio of SiO2/Ca and Sr-87/Sr-86 isotopic ratio show strong seasonal variation in the river water, i.e., low SiO2/Ca ratio with radiogenic isotopes during non-monsoon and higher SiO2/Ca with less radiogenic isotopes during monsoon season. Whereas, the seasonal variation of Rb/Sr ratio in the stream water is not significant suggesting that change in the mineral phase being involved in the weathering reaction could be unlikely for the observed molar SiO2/Ca and Sr-87/Sr-86 isotope variation in river water. Therefore, the shift in the stream water chemical composition could be attributed to contribution of ground water which is in contact with the bedrock (weathering front) during non-monsoon and weathering of secondary soil minerals in the regolith layer during monsoon. The secondary soil mineral weathering leads to limited silicate cation and enhanced silica fluxes in the Nethravati river basin. (C) 2015 Elsevier Ltd. All rights reserved.

Self-organized criticality in dynamics without branching

We demonstrate the phenomenon of self-organized criticality (SOC) in a simple random walk model described by a random walk of a myopic ant, i.e., a walker who can see only nearest neighbors. The ant acts on the underlying lattice aiming at uniform digging, i.e., reduction of the height profile of the surface but is unaffected by the underlying lattice. In one, two, and three dimensions we have explored this model and have obtained power laws in the time intervals between consecutive events of "digging." Being a simple random walk, the power laws in space translate to power laws in time. We also study the finite size scaling of asymptotic scale invariant process as well as dynamic scaling in this system. This model differs qualitatively from the cascade models of SOC.

Study of the processes occurring when sputtering YBa2Cu3O7-x in pure oxygen

The sputter deposition of YBa2Cu3O7-x in a de-diode was performed in pure oxygen medium and an optical spectroscopic study of the resultant discharge revealed strong emissions from both metal atoms and oxygen ions. Emission intensities were studied in pressure range from 0.5 to 3 mbar, with substrate temperatures from 150 to 850 degrees C. Raising the substrate temperature to 850 degrees C increased the number of positive ions and excited neutral atoms. Raising the pressure decreased the emission intensities of excited neutral and ionic species. The results have been compared with those obtained from Langmuir probe measurements. The rise in emission intensities of excited neutrals and ions with temperature suggested the possibility of chemically enhanced physical sputtering of YBa2Cu3O7-x. The effect of process conditions on film composition and quality is also discussed.

Influence of friction during forming processes-a study using a numerical simulation technique

Friction has an important influence in metal forming operations, as it contributes to the success or otherwise of the process. In the present investigation, the effect of friction on metal forming was studied by simulating compression tests on cylindrical Al-Mg alloy using the finite element method (FEM) technique. Three kinds of compression tests were considered wherein a constant coefficient of friction was employed at the upper die-work-piece interface. However, the coefficient of friction between the lower die-work-piece interfaces was varied in the tests. The simulation results showed that a difference in metal flow occurs near the interfaces owing to the differences in the coefficient of friction. It was concluded that the variations in the coefficient of friction between the dies and the work-piece directly affect the stress distribution and shape of the work-piece, having implications on the microstructure of the material being processed.

Thermal Degradation Processes in Poly(xylylene sulfides) Investigated by Comparative Direct Pyrolysis MS and Flash Pyrolysis GC/MS Experiments

The thermal degradation processes of two sulfur polymers, poly(xylylene sulfide) (PXM) and poly(xylylene disulfide) (PXD), were investigated in parallel by direct pyrolysis mass spectrometry (DPMS) and flash pyrolysis GC/MS (Py-GC/MS). Thermogravimetric data showed that these polymers decompose with two separate steps in the temperature ranges of 250-280 and 600-650 degrees C, leaving a high amount of residue (about 50% at 800 degrees C). The pyrolysis products detected by DPMS in the first degradation step of PXM and PXD were terminated by three types of end groups, -CH3, -CH2SH, and -CH=S, originating from thermal cleavage reactions involving a series of homolytic chain scissions followed by hydrogen transfer reactions, generating several oligomers containing some intact xylylene sulfide repeating units. The presence of pyrolysis compounds containing some stilbene-like units in the first degradation step has also been observed. Their formation has been accounted for with a parallel cleavage involving the elimination of H2S from the PXM main chains. These unsaturated units can undergo cross-linking at higher temperatures, producing the high amount of char residue observed. The thermal degradation compounds detected by DPMS in the second decomposition step at about 600-650 degrees C were constituted of condensed aromatic molecules containing dihydrofenanthrene and fenanthrene units. These compounds might be generated from the polymer chains containing stilbene units, by isomerization and dehydrogenation reactions. The pyrolysis products obtained in the Py-GC/MS of PXM and PXD at 610 degrees C are almost identical. The relative abundance in the pyrolysate and the spectral properties of the main pyrolysis products were found to be in generally good agreement with those obtained by DPMS. Polycyclic aromatic hydrocarbons (PAHs) were also detected by Py-GC/MS but in minor amounts with respect to DPMS. This apparent discrepancy was due to the simultaneous detection of PAHs together with all pyrolysis products in the Py-GC/MS, whereas in DPMS they were detected in the second thermal degradation step without the greatest part of pyrolysis compounds generated in the first degradation step. The results obtained by DPMS and PSI-GC/MS experiments showed complementary data for the degradation of PXM and PXD and, therefore, allowed the unequivocal formulation of the thermal degradation mechanism for these sulfur-containing polymers.

Structural Transformations in Protein Crystals caused by controlled Dehydration

Recent experiments in this laboratory on structural transformations caused by controlled dehydration of protein crystals have been reviewed. X-ray diffraction patterns of the following crystals have been examined under varying conditions of environmental humidity in the relative humidity range of 100-75%: a new crystal form of bovine pancreatic ribonuclease A grown from acetone solution in tris buffer (I), the well-known monoclinic form of the protein grown from aqueous ethanol (II), the same form grown from a solution of 2-methyl pentan-2,4-diol in phosphate buffer (III), tetragonal (IV), orthorhombic (V), monoclinic (VI) and triclinic (VII) hen egg white lysozyme, porcine 2 Zn insulin (VIII), porcine 4 Zn insulin (IX) and the crystals of concanavalin A(X). I, II, IV, V and VI undergo one or more transformations as evidenced by discontinuous changes in the unit cell dimensions, the diffraction pattern and the solvent content. Such water-mediated transformations do not appear to occur in the remaining crystals in the relative humidity range explored. The relative humidity at which the transformation occurs is reduced when 2-methyl pentan-2,4-diol is present in the mother liquor. The transformations are affected by the crystal structure but not by the amount of solvent in the crystals. The X-ray investigations reviewed here and other related investigations emphasize the probable importance of water-mediated transformations in exploring hydration of proteins and conformational transitions in them.