Discrete-Time Controlled Markov Processes with Average Cost Criterion: A Survey

This work is a survey of the average cost control problem for discrete-time Markov processes. The authors have attempted to put together a comprehensive account of the considerable research on this problem over the past three decades. The exposition ranges from finite to Borel state and action spaces and includes a variety of methodologies to find and characterize optimal policies. The authors have included a brief historical perspective of the research efforts in this area and have compiled a substantial yet not exhaustive bibliography. The authors have also identified several important questions that are still open to investigation.

Orientational glassy phases of C60 and neopentane. A Monte Carlo study

Based on an isothermal, isobaric simulation the structure and properties of the plastic crystalline phases of C60 and neopentane have been examined. Instantaneous cooling of the plastic crystalline phases of both C60 and neopentane leads to orientational glassy phases. These are accompanied by significant slowing down of reorientational motion. Constant pressure quench experiments on C60 yield a glass transition temperature of around 80 K.

Hydrogen Storage Capacity of Carbon-Foams: Grand Canonical Monte Carlo Simulations

Hydrogen storage in the three-dimensional carbon foams is analyzed using classical grand canonical Monte Carlo simulations. The calculated storage capacities of the foams meet the material-based DOE targets and are comparable to the capacities of a bundle of well-separated similar diameter open nanotubes. The pore sizes in the foams are optimized for the best hydrogen uptake. The capacity depends sensitively on the C-H-2 interaction potential, and therefore, the results are presented for its ``weak'' and ``strong'' choices, to offer the lower and upper bounds for the expected capacities. Furthermore, quantum effects on the effective C-H-2 as well as H-2-H-2 interaction potentials are considered. We find that the quantum effects noticeably change the adsorption properties of foams and must be accounted for even at room temperature.

An examination of the BEBO model with the results of ab initio calculations of a reaction series

The BEBO (bond energy-bond order) model of Johnston and Parr is examined with the results of ab initio MO calculations on a series of metathetic reactions which involve hydrogen transfer. Energies are calculated at the 6-31G**/PMP2 = full//6-31G** level while the bond orders are estimated using the 6-31G** basis set with the geometry optimisation at the single configuration unrestricted Hartree-Fock frame. Our analysis reveals that the bond-order exponent in the BEBO theory is greater than unity for the reaction series and the entropy term becomes implicitly present in the BEBO model.

Supersolid Phase in One-Dimensional Bose-Hubbard Model With Extended Range Interactions: DMRG And Field Theoretic Study at Different Densities

We use the Density Matrix Renormalization Group and the Abelian bosonization method to study the effect of density on quantum phases of one-dimensional extended Bose-Hubbard model. We predict the existence of supersolid phase and also other quantum phases for this system. We have analyzed the role of extended range interaction parameters on solitonic phase near half-filling. We discuss the effects of dimerization in nearest neighbor hopping and interaction as well as next nearest neighbor interaction on the plateau phase at half-filling.

Scroll-Wave Dynamics in Human Cardiac Tissue: Lessons from a Mathematical Model with Inhomogeneities and Fiber Architecture

Cardiac arrhythmias, such as ventricular tachycardia (VT) and ventricular fibrillation (VF), are among the leading causes of death in the industrialized world. These are associated with the formation of spiral and scroll waves of electrical activation in cardiac tissue; single spiral and scroll waves are believed to be associated with VT whereas their turbulent analogs are associated with VF. Thus, the study of these waves is an important biophysical problem. We present a systematic study of the combined effects of muscle-fiber rotation and inhomogeneities on scroll-wave dynamics in the TNNP (ten Tusscher Noble Noble Panfilov) model for human cardiac tissue. In particular, we use the three-dimensional TNNP model with fiber rotation and consider both conduction and ionic inhomogeneities. We find that, in addition to displaying a sensitive dependence on the positions, sizes, and types of inhomogeneities, scroll-wave dynamics also depends delicately upon the degree of fiber rotation. We find that the tendency of scroll waves to anchor to cylindrical conduction inhomogeneities increases with the radius of the inhomogeneity. Furthermore, the filament of the scroll wave can exhibit drift or meandering, transmural bending, twisting, and break-up. If the scroll-wave filament exhibits weak meandering, then there is a fine balance between the anchoring of this wave at the inhomogeneity and a disruption of wave-pinning by fiber rotation. If this filament displays strong meandering, then again the anchoring is suppressed by fiber rotation; also, the scroll wave can be eliminated from most of the layers only to be regenerated by a seed wave. Ionic inhomogeneities can also lead to an anchoring of the scroll wave; scroll waves can now enter the region inside an ionic inhomogeneity and can display a coexistence of spatiotemporal chaos and quasi-periodic behavior in different parts of the simulation domain. We discuss the experimental implications of our study.

Monte Carlo simulation of low temperature phase diagrams of YBa2Cu3O6+x

We report the results of Monte Carlo simulation of oxygen ordering in the oxygen deficient portion (x<0.5) of YBa2Cu3O6+x at low temperatures. We find qualitative agreement among cluster - variation, Monte Carlo and transfer matrix methods. However, low temperature and ground state simulations clearly indicate the presence of a tetragonal phase. There is also evidence for two second order phase transition lines separating the tetragonal and the �double cell� ortho II phase. The effect of decreasing the inter-chain repulsion on oxygen ordering has also been investigated.

The mean and turbulence structure simulation of the monsoon trough boundary layer using a one-dimensional model with e-l and e-epsilon closures

An attempt has been made here to study the sensitivity of the mean and the turbulence structure of the monsoon trough boundary layer to the choice of the constants in the dissipation equation for two stations Delhi and Calcutta, using one-dimensional atmospheric boundary layer model with e-epsilon turbulence closure. An analytical discussion of the problems associated with the constants of the dissipation equation is presented. It is shown here that the choice of the constants in the dissipation equation is quite crucial and the turbulence structure is very sensitive to these constants. The modification of the dissipation equation adopted by earlier studies, that is, approximating the Tke generation (due to shear and buoyancy production) in the epsilon-equation by max (shear production, shear + buoyancy production), can be avoided by a suitable choice of the constants suggested here. The observed turbulence structure is better simulated with these constants. The turbulence structure simulation with the constants recommended by Aupoix et al (1989) (which are interactive in time) for the monsoon region is shown to be qualitatively similar to the simulation obtained with the constants suggested here, thus implying that no universal constants exist to regulate dissipation rate. Simulations of the mean structure show little sensitivity to the type of the closure parameterization between e-l and e-epsilon closures. However the turbulence structure simulation with e-epsilon closure is far better compared to the e-l model simulations. The model simulations of temperature profiles compare quite well with the observations whenever the boundary layer is well mixed (neutral) or unstable. However the models are not able to simulate the nocturnal boundary layer (stable) temperature profiles. Moisture profiles are simulated reasonably better. With one-dimensional models, capturing observed wind variations is not up to the mark.

Fixed points in a Hopfield model with random asymmetric interactions

We calculate analytically the average number of fixed points in the Hopfield model of associative memory when a random antisymmetric part is added to the otherwise symmetric synaptic matrix. Addition of the antisymmetric part causes an exponential decrease in the total number of fixed points. If the relative strength of the antisymmetric component is small, then its presence does not cause any substantial degradation of the quality of retrieval when the memory loading level is low. We also present results of numerical simulations which provide qualitative (as well as quantitative for some aspects) confirmation of the predictions of the analytic study. Our numerical results suggest that the analytic calculation of the average number of fixed points yields the correct value for the typical number of fixed points.

Phase separation in a simple model with dynamical asymmetry

We perform computer simulations of a Cahn-Hilliard model of phase separation that has dynamical asymmetry between the two coexisting phases. The dynamical asymmetry is incorporated by considering a mobility function that is order parameter dependent. Simulations of this model reveal morphological features similar to those observed in viscoelastic phase separation. In the early stages, the minority phase domains form a percolating structure that shrinks with time, eventually leading to the formation of disconnected regions that are characterized by the presence of random interfaces as well as isolated droplets. The domains grow as L(t)similar to t(1/3) in the very late stages. Although dynamical scaling is violated in the area shrinking regime, it is restored at late times. However, the form of the scaling function is found to depend on the extent of dynamical asymmetry. [S1063-651X(99)12101-9].

Phase diagram of a two-species lattice model with a linear instability

We discuss the properties of a one-dimensional lattice model of a driven system with two species of particles in which the mobility of one species depends on the density of the other. This model was introduced by Lahiri and Ramaswamy (Phys. Rev. Lett., 79, 1150 (1997)) in the context of sedimenting colloidal crystals, and its continuum version was shown to exhibit an instability arising from linear gradient couplings. In this paper we review recent progress in understanding the full phase diagram of the model. There are three phases. In the first, the steady state can be determined exactly along a representative locus using the condition of detailed balance. The system shows phase separation of an exceptionally robust sort, termed strong phase separation, which survives at all temperatures. The second phase arises in the threshold case where the first species evolves independently of the second, but the fluctuations of the first influence the evolution of the second, as in the passive scalar problem. The second species then shows phase separation of a delicate sort, in which long-range order coexists with fluctuations which do not damp down in the large-size limit. This fluctuation-dominated phase ordering is associated with power law decays in cluster size distributions and a breakdown of the Porod law. The third phase is one with a uniform overall density, and along a representative locus the steady state is shown to have product measure form. Density fluctuations are transported by two kinematic waves, each involving both species and coupled at the nonlinear level. Their dissipation properties are governed by the symmetries of these couplings, which depend on the overall densities. In the most interesting case,, the dissipation of the two modes is characterized by different critical exponents, despite the nonlinear coupling.

Optimal Control of Markov Processes with Age-Dependent Transition Rates

We study optimal control of Markov processes with age-dependent transition rates. The control policy is chosen continuously over time based on the state of the process and its age. We study infinite horizon discounted cost and infinite horizon average cost problems. Our approach is via the construction of an equivalent semi-Markov decision process. We characterise the value function and optimal controls for both discounted and average cost cases.

Low-frequency modes in an equatorial shallow-water model with moisture gradients

Motivated by observations of the mean state of tropical precipitable water (PW), a moist, first baroclinic mode, shallow-water system on an equatorial beta-plane with a background saturation profile that depends on latitude and longitude is studied. In the presence of a latitudinal moisture gradient, linear analysis of the non-rotating problem reveals large-scale, symmetric, eastward and westward propagating unstable modes. The introduction of a zonal moisture gradient breaks the east-west symmetry of the unstable modes. The effects of rotation are then included by numerically solving the resulting eigenvalue problem on an equatorial beta-plane. With a purely meridional moisture gradient, the system supports large-scale, low-frequency, eastward and westward moving neutral modes. Some of the similarities, and some of the discrepancies of these modes with intraseasonal tropical waves are pointed out. Finally, a zonal moisture gradient in the presence of rotation renders some of the aforementioned neutral modes unstable. In particular, according to observations of large-scale, low-frequency tropical variability, it is seen that regions where the background saturation profile increases (decreases) to the east favour eastward (westward) moving moist modes.