Risk-sensitive optimal control for Markov decision processes with monotone cost

The existence of an optimal feedback law is established for the risk-sensitive optimal control problem with denumerable state space. The main assumptions imposed are irreducibility and a near monotonicity condition on the one-step cost function. A solution can be found constructively using either value iteration or policy iteration under suitable conditions on initial feedback law.

Thermal degradation processes in polysulfide copolymers investigated by direct pyrolysis mass spectrometry and flash pyrolysis-gas chromatography/mass spectrometry

This is the first report on the analysis of random block polysulfide copolymers containing different amounts of repeating units in the copolymer backbone, which has been studied by direct pyrolysis mass spectrometry (DPMS) and by pyrolysis-gas chromatography/mass spectrometry (Py-GC/MS). The homopolymers such as poly(ethylene sulfide) (PES), poly(styrene sulfide) (PSS), and two random copolymers, viz., poly(ethylene sulfide(x)-co-styrene sulfide(y)) [copolymer I (x = y = 0.5) and copolymer II (x = 0.74, y = 0.26)] were investigated by both DPMS and Py-GC/MS (except copolymer II) techniques. In the case of copolymer I, the thermal degradation products of SE1, SE2, S-2, and S2E (S = styrene sulfide, E = ethylene sulfide) were detected in DPMS, whereas the formation of SE1 and SE2 were observed by Py-GC/MS technique. However, for copolymer II, SE3 was also found along with SE1, SE2, S-2, and S2E in DPMS. The formation of additional product (SE3) observed in copolymer II could be due to an increase in the block length formed during copolymerization. Further, a comparative study on thermal degradation of PES, poly(ethylene disulfide) (PEDS), and poly(ethylene tetrasulfide) (PETS) were investigated by Py-GC/MS. The pyrolysis products detected by both DPMS and Py-GC/MS indicates that the thermal decomposition of these polymers yield cyclic sulfides through an intramolecular exchange or by backbiting processes. The linear products with thiol and vinyl groups were also observed by Py-GC/MS along with the cyclic products via carbon hydrogen transfer reaction.

Biochemistry of water-logged soils. Part IV. Carbon and nitrogen transformations

1. During the fermentation of water-logged soil containing added substances with different carbon-nitrogen ratios, the reaction first turns slightly acid, but soon returns to the original hydrogen-ion concentration (pH 7·6). 2. The quantities of ammonia present in the medium increase up to a point, after which there is steady decrease. 3. There is nitrification only in the case of substances with narrow C/N ratios. The production of nitrate generally commences only after about a month, when the vigour of the initial fermentation has subsided and fairly large quantities of ammonia have accumulated in the medium. 4. The extent of mineralisation of nitrogen is determined chiefly by the C/N ratio, though in the cases of substances like mahua and lantana the presence of other constituents may also influence the processes. The quantities of mineralised nitrogen present in the soil system generally tend to decrease after about two months.

Embedded Thin Film Resistors on BCB by Low-Cost PWB Compatible Electroless Plating by Direct Foil Lamination Transfer Processes

Benzocyclobutene (BCB) has been proposed as a board level dielectric for advanced system-on-package (SOP) module primarily due to its attractive low-loss (for RF application) and thin film (for high density wiring) properties. Realization of embedded resistors on low loss benzocyclobutene (dielectric loss ~0.0008 at > 40 GHz) has been explored in this study. Two approaches, viz, foil transfer and electroless plating have been attempted for deposition of thin film resistors on benzocyclobutene (BCB). Ni-P alloys were plated using conventional electroless plating, and NiCr and NiCrAlSi foils were used for the foil transfer process. This paper reports NiP and NiWP electroless plated embedded resistors on BCB dielectric for the first time in the literature

An Actor-Critic Algorithm for Finite Horizon Markov Decision Processes

We develop a simulation based algorithm for finite horizon Markov decision processes with finite state and finite action space. Illustrative numerical experiments with the proposed algorithm are shown for problems in flow control of communication networks and capacity switching in semiconductor fabrication.

Scalable processes for fabricating non-volatile memory devices using self-assembled 2D arrays of gold nanoparticles as charge storage nodes

We propose robust and scalable processes for the fabrication of floating gate devices using ordered arrays of 7 nm size gold nanoparticles as charge storage nodes. The proposed strategy can be readily adapted for fabricating next generation (sub-20 nm node) non-volatile memory devices.

Analysis of light‐induced processes in bacteriorhodopsin and its application for spatial light modulation

A simplified energy‐level scheme is proposed for the photochemical cycle of the bacteriorhodopsin molecule. Rate equations are solved for the detailed light‐induced processes based on this model and the intensity‐induced population densities in various states of the molecule at steady state are computed which are used to obtain an analytic expression for the absorption coefficient of the modulation beam. Modulation of the probe laser‐beam transmission by the modulation‐laser‐beam intensity‐induced population changes is analyzed. It is predicted that for a probe beam at 412 nm up to 82% modulation can be achieved using a laser beam intensity of 3.2 W/cm2 at 570 nm. For temperatures ∼77 K, the transmission at 610 nm can be switched from zero to 81% for modulating laser intensity of 11 W/cm2. Construction of a spatial light modulator based on bacteriorhodopsin molecules is proposed and some of its features are discussed.

Transport processes in one component plasmas using Landau equation

A system of transport equations have been obtained for plasma of electrons and having a background of positive ions in the presence of an electric and magnetic field. The starting kinetic equation is the well-known Landau kinetic equation. The distribution function of the kinetic equation has been expanded in powers of generalized Hermite polynomials and following Grad, a consistent set of transport equations have been obtained. The expressions for viscosity and heat conductivity have been deduced from the transport equation.