An Actor-Critic Algorithm for Finite Horizon Markov Decision Processes

We develop a simulation based algorithm for finite horizon Markov decision processes with finite state and finite action space. Illustrative numerical experiments with the proposed algorithm are shown for problems in flow control of communication networks and capacity switching in semiconductor fabrication.

Confinement-deconfinement transition and spin correlations in a generalized Kitaev model

We present a spin model, namely, the Kitaev model augmented by a loop term and perturbed by an Ising Hamiltonian, and show that it exhibits both confinement-deconfinement transitions from spin liquid to antiferromagnetic/spin-chain/ferromagnetic phases and topological quantum phase transitions between gapped and gapless spin-liquid phases. We develop a fermionic resonating-valence-bonds (RVB) mean-field theory to chart out the phase diagram of the model and estimate the stability of its spin-liquid phases, which might be relevant for attempts to realize the model in optical lattices and other spin systems. We present an analytical mean-field theory to study the confinement-deconfinement transition for large coefficient of the loop term and show that this transition is first order within such mean-field analysis in this limit. We also conjecture that in some other regimes, the confinement-deconfinement transitions in the model, predicted to be first order within the mean-field theory, may become second order via a defect condensation mechanism. Finally, we present a general classification of the perturbations to the Kitaev model on the basis of their effect on it's spin correlation functions and derive a necessary and sufficient condition, within the regime of validity of perturbation theory, for the spin correlators to exhibit a long-ranged power-law behavior in the presence of such perturbations. Our results reproduce those of Tikhonov et al. [Phys. Rev. Lett. 106, 067203 (2011)] as a special case.

Spin-polarized STM spectra of Dirac electrons on the surface of a topological insulator

We provide a theory for the tunneling conductance G(V) of Dirac electrons on the surface of a topological insulator as measured by a spin-polarized scanning tunneling microscope tip for low-bias voltages V. We show that if the in-plane rotational symmetry on the surface of the topological insulator is broken by an external field that does not couple to spin directly (such as an in-plane electric field), G(V) exhibits an unconventional dependence on the direction of the magnetization of the tip, i.e., it acquires a dependence on the azimuthal angle of the magnetization of the tip. We also show that G(V) can be used to measure the magnitude of the local out-of-plane spin orientation of the Dirac electrons on the surface. We explain the role of the Dirac electrons in this unconventional behavior and suggest experiments to test our theory.

Measurement of Electron Spin Lifetime and Optical Orientation Efficiency in Germanium Using Electrical Detection of Radio Frequency Modulated Spin Polarization

We propose and demonstrate a technique for electrical detection of polarized spins in semiconductors in zero applied magnetic fields. Spin polarization is generated by optical injection using circularly polarized light which is modulated rapidly using an electro-optic cell. The modulated spin polarization generates a weak time-varying magnetic field which is detected by a sensitive radio-frequency coil. Using a calibrated pickup coil and amplification electronics, clear signals were obtained for bulk GaAs and Ge samples from which an optical spin orientation efficiency of 4.8% could be determined for Ge at 1342 nm excitation wavelength. In the presence of a small external magnetic field, the signal decayed according to the Hanle effect, from which a spin lifetime of 4.6 +/- 1.0 ns for electrons in bulk Ge at 127 K was extracted.

Scalable processes for fabricating non-volatile memory devices using self-assembled 2D arrays of gold nanoparticles as charge storage nodes

We propose robust and scalable processes for the fabrication of floating gate devices using ordered arrays of 7 nm size gold nanoparticles as charge storage nodes. The proposed strategy can be readily adapted for fabricating next generation (sub-20 nm node) non-volatile memory devices.

Analysis of light‐induced processes in bacteriorhodopsin and its application for spatial light modulation

A simplified energy‐level scheme is proposed for the photochemical cycle of the bacteriorhodopsin molecule. Rate equations are solved for the detailed light‐induced processes based on this model and the intensity‐induced population densities in various states of the molecule at steady state are computed which are used to obtain an analytic expression for the absorption coefficient of the modulation beam. Modulation of the probe laser‐beam transmission by the modulation‐laser‐beam intensity‐induced population changes is analyzed. It is predicted that for a probe beam at 412 nm up to 82% modulation can be achieved using a laser beam intensity of 3.2 W/cm2 at 570 nm. For temperatures ∼77 K, the transmission at 610 nm can be switched from zero to 81% for modulating laser intensity of 11 W/cm2. Construction of a spatial light modulator based on bacteriorhodopsin molecules is proposed and some of its features are discussed.

Dielectric properties of Li2O–3B2O3 glasses

The frequency and temperature dependences of the dielectric constant and the electrical conductivity of the transparent glasses in the composition Li2O–3B2O3 were investigated in the 100 Hz–10 MHz frequency range. The dielectric constant and the loss in the low frequency regime were electrode material dependent. Dielectric and electrical relaxations were, respectively, analyzed using the Cole–Cole and electric modulus formalisms. The dielectric relaxation mechanism was discussed in the framework of electrode and charge carrier (hopping of the ions) related polarization using generalized Cole–Cole expression. The frequency dependent electrical conductivity was rationalized using Jonscher’s power law. The activation energy associated with the dc conductivity was 0.80±0.02 eV, which was ascribed to the motion of Li+ ions in the glass matrix. The activation energy associated with dielectric relaxation was almost equal to that of the dc conductivity, indicating that the same species took part in both the processes. Temperature dependent behavior of the frequency exponent (n) suggested that the correlated barrier hopping model was the most apposite to rationalize the electrical transport phenomenon in Li2O–3B2O3 glasses. These glasses on heating at 933 K/10 h resulted in the known nonlinear optical phase LiB3O5.

Transport processes in one component plasmas using Landau equation

A system of transport equations have been obtained for plasma of electrons and having a background of positive ions in the presence of an electric and magnetic field. The starting kinetic equation is the well-known Landau kinetic equation. The distribution function of the kinetic equation has been expanded in powers of generalized Hermite polynomials and following Grad, a consistent set of transport equations have been obtained. The expressions for viscosity and heat conductivity have been deduced from the transport equation.

Relaxation: Application to the matrix reconstruction problem

This report describes some preliminary experiments on the use of the relaxation technique for the reconstruction of the elements of a matrix given their various directional sums (or projections).