An Actor-Critic Algorithm for Finite Horizon Markov Decision Processes

We develop a simulation based algorithm for finite horizon Markov decision processes with finite state and finite action space. Illustrative numerical experiments with the proposed algorithm are shown for problems in flow control of communication networks and capacity switching in semiconductor fabrication.

Scalable processes for fabricating non-volatile memory devices using self-assembled 2D arrays of gold nanoparticles as charge storage nodes

We propose robust and scalable processes for the fabrication of floating gate devices using ordered arrays of 7 nm size gold nanoparticles as charge storage nodes. The proposed strategy can be readily adapted for fabricating next generation (sub-20 nm node) non-volatile memory devices.

Role of the cesium antimonide layer in the Na2KSb/Cs3Sb photocathode

When radiation of sufficiently high energy is incident on the surface of a semiconductor photocathode, electrons are excited from the valence band to the conduction band and these may contribute to the photocurrent. The photocurrent in a single-layer cathode is found to be small, because of collisions within the cathode material, the electron affinity condition, etc. It is observed that when a thin layer of n-type cesium antimonide (Cs3Sb) is deposited over a p-type layer of sodium potassium antimonide (Na2KSb), there occurs a sharp rise in the photocurrent. The causes for the dramatic increase in the photocurrent obtainable from a sodium potassium antimonide cathode, by depositing a thin layer of cesium antimonide are analyzed in this article. It has been shown that the interface between sodium potassium antimonide and cesium antimonide can result in lowering of the electron affinity to a level below the bottom of the conduction band of sodium potassium antimonide. The drift field that arises at the heterointerface enables the electrons to reach the surface, leading to the emission of almost all the photogenerated electrons within the cathode. The processes involved in photoemission from such a double-layer cathode are examined from a theoretical point of view. The spectral response of the two-layer cathode is also found to be better than that of a single-layer cathode.

Analysis of light‐induced processes in bacteriorhodopsin and its application for spatial light modulation

A simplified energy‐level scheme is proposed for the photochemical cycle of the bacteriorhodopsin molecule. Rate equations are solved for the detailed light‐induced processes based on this model and the intensity‐induced population densities in various states of the molecule at steady state are computed which are used to obtain an analytic expression for the absorption coefficient of the modulation beam. Modulation of the probe laser‐beam transmission by the modulation‐laser‐beam intensity‐induced population changes is analyzed. It is predicted that for a probe beam at 412 nm up to 82% modulation can be achieved using a laser beam intensity of 3.2 W/cm2 at 570 nm. For temperatures ∼77 K, the transmission at 610 nm can be switched from zero to 81% for modulating laser intensity of 11 W/cm2. Construction of a spatial light modulator based on bacteriorhodopsin molecules is proposed and some of its features are discussed.

Scattering theory and linear optimal control: Regulator and servo problems

In this paper, several known computational solutions are readily obtained in a very natural way for the linear regulator, fixed end-point and servo-mechanism problems using a certain frame-work from scattering theory. The relationships between the solutions to the linear regulator problem with different terminal costs and the interplay between the forward and backward equations have enabled a concise derivation of the partitioned equations, the forward-backward equations, and Chandrasekhar equations for the problem. These methods have been extended to the fixed end-point, servo, and tracking problems.

The pursuit-evasion problem of two aircraft in a horizontal plane

The pursuit-evasion problem of two aircraft in a horizontal plane is modelled as a zerosum differential game with capture time as payoff. The aircraft are modelled as point masses with thrust and bank angle controls. The games of kind and degree for this differential game are solved.

Effect of surface on the conductance characteristics of Au‐Bi2Sr2CaCu2O8+δ (single crystal) point contact junctions

We report the effect of surface treatments on the dynamic conductance curves (G=dI/dV‐V) of Au‐Bi2Sr2CaCu2O8+δ (single crystal) point contact junctions of variable junction conductances (100 mS≳G≳100 μS). We find that if the crystal surface is cleaved freshly just prior to making contacts, all irreproducible sharp multiple features often observed in tunneling data of Bi(2212) oxide superconductors disappear. If the cleaved crystal surfaces are left under ambient conditions for a few days and the tunneling experiments are repeated, these multiple features reappear. We also find that if the current in the junction is made to pass predominantly through the bulk (and not along the surface), gap features are sharper. The observed conductance curves are fitted to a modified model [G. E. Blonder et al., Phys. Rev. B 25, 4515 (1982)] and estimated gap values are Δ≂28 to 30 meV corresponding to the ratio 2Δ/kBTc ≂ 7.5 with lifetime broadening Γ/Δ≂0.2. We conclude that the sharp multiple features observed in Bi(2212) tunneling curves has no intrinsic origin in the bulk and they arise from the surface only.

Transport processes in one component plasmas using Landau equation

A system of transport equations have been obtained for plasma of electrons and having a background of positive ions in the presence of an electric and magnetic field. The starting kinetic equation is the well-known Landau kinetic equation. The distribution function of the kinetic equation has been expanded in powers of generalized Hermite polynomials and following Grad, a consistent set of transport equations have been obtained. The expressions for viscosity and heat conductivity have been deduced from the transport equation.

Reversible Formation of a Planar Chiral Ferrocenylboroxine and Its Supramolecular Structure

The boronic acid (pS)-1,2-NpFcB(OH)(2) (1) was obtained by treatment of the lithiated species (pS)-1,2-NpFcLi with B(O(i)Pr)(3), followed by acidic workup; subsequent dehydration gave the enantiomerically pure boroxine [(pS)-1,2-NpFcBO](3) (2) in 49% isolated yield. Multinuclear and 2D NMR spectroscopies, single-crystal X-ray diffraction, and elemental analysis served to confirm the structure of 2. In the solid-state structure, all three of the naphthyl groups point in one direction and all of the ferrocenyl moieties are placed on the opposite face of the boroxine ring, which is also the preferred conformation in solution according to a (1)H, (1)H-NOESY experiment. Cyclic voltammetry revealed three separate reversible oxidation events, which suggests significant communication between the ferrocenyl moieties. These redox processes experience a cathodic shift upon addition of 4-dimethylaminopyridine (DMAP) as a Lewis base. The six-membered ring is opened upon treatment with hot CHCl(3)/MeOH to form the methoxy species (pS)-1,2-NpFcB(OH)(OMe) (3), which can be converted back to the cycle 2 by dissolution in wet CHCl(3), followed by column chromatography on silica gel.

First passage distributions for long memory processes

We study the distribution of first passage time for Levy type anomalous diffusion. A fractional Fokker-Planck equation framework is introduced.For the zero drift case, using fractional calculus an explicit analytic solution for the first passage time density function in terms of Fox or H-functions is given. The asymptotic behaviour of the density function is discussed. For the nonzero drift case, we obtain an expression for the Laplace transform of the first passage time density function, from which the mean first passage time and variance are derived.

General classical theory of spinning particles in a meson field

An exact classical theory of the motion of a point dipole in a meson field is given which takes into account the effects of the reaction of the emitted meson field. The meson field is characterized by a constant $\chi =\mu /\hslash $ of the dimensions of a reciprocal length, $\mu $ being the meson mass, and as $\chi \rightarrow $ 0 the theory of this paper goes over continuously into the theory of the preceding paper for the motion of a spinning particle in a Maxwell field. The mass of the particle and the spin angular momentum are arbitrary mechanical constants. The field contributes a small finite addition to the mass, and a negative moment of inertia about an axis perpendicular to the spin axis. A cross-section (formula (88 a)) is given for the scattering of transversely polarized neutral mesons by the rotation of the spin of the neutron or proton which should be valid up to energies of 10$^{9}$ eV. For low energies E it agrees completely with the old quantum cross-section, having a dependence on energy proportional to p$^{4}$/E$^{2}$ (p being the meson momentum). At higher energies it deviates completely from the quantum cross-section, which it supersedes by taking into account the effects of radiation reaction on the rotation of the spin. The cross-section is a maximum at E $\sim $ 3$\cdot $5$\mu $, its value at this point being 3 $\times $ 10$^{-26}$ cm.$^{2}$, after which it decreases rapidly, becoming proportional to E$^{-2}$ at high energies. Thus the quantum theory of the interaction of neutrons with mesons goes wrong for E $\gtrsim $ 3$\mu $. The scattering of longitudinally polarized mesons is due to the translational but not the rotational motion of the dipole and is at least twenty thousand times smaller. With the assumption previously made by the present author that the heavy partilesc may exist in states of any integral charge, and in particular that protons of charge 2e and - e may occur in nature, the above results can be applied to charged mesons. Thus transversely polarised mesons should undergo a very big scattering and consequent absorption at energies near 3$\cdot $5$\mu $. Hence the energy spectrum of transversely polarized mesons should fall off rapidly for energies below about 3$\mu $. Scattering plays a relatively unimportant part in the absorption of longitudinally polarized mesons, and they are therefore much more penetrating. The theory does not lead to Heisenberg explosions and multiple processes.

Analysis of residual tropical cemented soil behaviour

In -situ soils in gee-material spectrum might arise due to sedimentation or could be non-sedimentary residual formations. The inherent nature and diversity of geological processes involved in the soil formation stage itself are responsible for a wide variability in the in-situ state of the soil. In this paper the possibility of analyses to arrive at engineering parameters of residual soils with varied degrees of residual or acquired cementation by the use of physical and in-situ parameters normally determined in routine investigations, are examined. An Intrinsic State Line,(ISL), with reference to an intrinsic state parameter (e/e(L)) and its variation with effective stress for reconstituted clays has been developed for residual tropical soils of non-sedimentary origin. In relation to the Intrinsic State Line (ISL), the undisturbed state, e, the potential parameter, e(L), along with the overburden pressure data has been analyzed to identify the dominance of cementation or stress history or both in controlling the compressibility and strength behaviour of natural residual soil. The location of yield stress point in relation to the ISL, pre-, and post- yield stress, compression indices along the e- log sigma(v) path provide a simple means to the analysis of the compressibility characteristics of cemented soils for analysis.