Parametrized actor-critic algorithms for finite-horizon MDPs

Due to their non-stationarity, finite-horizon Markov decision processes (FH-MDPs) have one probability transition matrix per stage. Thus the curse of dimensionality affects FH-MDPs more severely than infinite-horizon MDPs. We propose two parametrized 'actor-critic' algorithms to compute optimal policies for FH-MDPs. Both algorithms use the two-timescale stochastic approximation technique, thus simultaneously performing gradient search in the parametrized policy space (the 'actor') on a slower timescale and learning the policy gradient (the 'critic') via a faster recursion. This is in contrast to methods where critic recursions learn the cost-to-go proper. We show w.p 1 convergence to a set with the necessary condition for constrained optima. The proposed parameterization is for FHMDPs with compact action sets, although certain exceptions can be handled. Further, a third algorithm for stochastic control of stopping time processes is presented. We explain why current policy evaluation methods do not work as critic to the proposed actor recursion. Simulation results from flow-control in communication networks attest to the performance advantages of all three algorithms.

Excitation energy transfer from a fluorophore to single-walled carbon nanotubes

We study the process of electronic excitation energy transfer from a fluorophore to the electronic energy levels of a single-walled carbon nanotube. The matrix element for the energy transfer involves the Coulombic interaction between the transition densities on the donor and the acceptor. In the Foumlrster approach, this is approximated as the interaction between the corresponding transition dipoles. For energy transfer from a dye to a nanotube, one can use the dipole approximation for the dye, but not for the nanotube. We have therefore calculated the rate using an approach that avoids the dipole approximation for the nanotube. We find that for the metallic nanotubes, the rate has an exponential dependence if the energy that is to be transferred, h is less than a threshold and a d(-5) dependence otherwise. The threshold is the minimum energy required for a transition other than the k(i,perpendicular to)=0 and l=0 transition. Our numerical evaluation of the rate of energy transfer from the dye pyrene to a (5,5) carbon nanotube, which is metallic leads to a distance of similar to 165 A degrees up to which energy transfer is appreciable. For the case of transfer to semiconducting carbon nanotubes, apart from the process of transfer to the electronic energy levels within the one electron picture, we also consider the possibility of energy transfer to the lowest possible excitonic state. Transfer to semiconducting carbon nanotubes is possible only if>=epsilon(g)-epsilon(b). The long range behavior of the rate of transfer has been found to have a d(-5) dependence if h >=epsilon(g). But, when the emission energy of the fluorophore is in the range epsilon(g)>h >=epsilon(g)-epsilon(b), the rate has an exponential dependence on the distance. For the case of transfer from pyrene to the semiconducting (6,4) carbon nanotube, energy transfer is found to be appreciable up to a distance of similar to 175 A degrees.

Spectral Efficiency of Channel-Aware Schedulers in Non-identical Composite Links with Interference

Accurate system planning and performance evaluation requires knowledge of the joint impact of scheduling, interference, and fading. However, current analyses either require costly numerical simulations or make simplifying assumptions that limit the applicability of the results. In this paper, we derive analytical expressions for the spectral efficiency of cellular systems that use either the channel-unaware but fair round robin scheduler or the greedy, channel-aware but unfair maximum signal to interference ratio scheduler. As is the case in real deployments, non-identical co-channel interference at each user, both Rayleigh fading and lognormal shadowing, and limited modulation constellation sizes are accounted for in the analysis. We show that using a simple moment generating function-based lognormal approximation technique and an accurate Gaussian-Q function approximation leads to results that match simulations well. These results are more accurate than erstwhile results that instead used the moment-matching Fenton-Wilkinson approximation method and bounds on the Q function. The spectral efficiency of cellular systems is strongly influenced by the channel scheduler and the small constellation size that is typically used in third generation cellular systems.

Electromagnetic characteristics of carbon nanotubes with strain

Electromagnetic characteristics like absorption and electric field distributions of metallic carbon nanotubes are simulated using the discrete dipole approximation. Absorption of electromagnetic energy over a range of frequencies are studied for both parallel and perpendicular incidence of light to the axis of carbon nanotube. Our simulations show 30% enhancement of electric field in the radial direction for nanotubes with axial strain of 0.2 when compared to unstrained nanotubes in case of parallel incidence of light. Simulations for perpendicular incidence of light show an oscillatory behavior for the electric field in the axial direction. Analysis of simulation results indicate potential applications in designing nanostructured antennae and electromagnetic transmission/shielding using CNT-composite.

Radiative and non-radiative effects of a substrate on localized plasmon resonance of particles

Experiments have shown strong effects of some substrates on the localized plasmons of metallic nano particles but they are inconclusive on the affecting parameters. Here, we have used discrete dipole approximation in conjunction with Sommerfeld integral relations to explain the effect of the substrates as a function of the parameters of incident radiation. The radiative coupling can both quench and enhance the resonance and its dependence on the angle and polarization of incident radiation with respect to the surface is shown. Non-radiative interaction with the substrate enhances the plasmon resonance of the particles and can shift the resonances from their free-space energies significantly. The non-radiative interaction of the substrate is sensitive to the shape of particles and polarization of incident radiation with respect to substrate. Our results show that the plasmon resonances in coupled and single particles can be significantly altered from their free-space resonances and are quenched or enhanced by the choice of substrate and polarization of incident radiation. (C) 2012 American Institute of Physics. http://dx.doi.org/10.1063/1.4736544]

Electromagnetic Characteristics of Polyaniline/SWCNT Composites

Electromagnetic field interactions with the composites made up of polyaniline (PANI) and single wall carbon nanotube (SWCNT) are simulated using the discrete dipole approximation. Recent observations on polymer nano-composites explain the interface interactions between the PANI host and the carbon nanostructures. These types of composite have potential applications in organic solar cell, gas sensor, bio-sensor and electro-chromic devices. Various nanostructures of PANI is possible in the form of nanowires, nanodisks, nanofibers and nanotubes have been reported. In the present study, we considered two types of composite, one is the PANI wrapped CNT and the other is CNT immersed in PANI nanotube. We use Modified Thole's parameters for calculating frequency dependent atomic polarizability of composites. Absorption spectra of the composites are studied by illuminating a wide range of electromagnetic energy spectrum. From the absorption spectra, we observe plasmon excitation in near-infrared region similar to that in SWCNTs reported recently. The interactions between the PANI and CNT in the composite, resulting electromagnetic absorptions are simulated.

Metallic Nanoparticles Arranged in a Helical Geometry: Route Towards Strong and Broadband Chiro-optical Response

Recent advances in nanotechnology have paved ways to various techniques for designing and fabricating novel nanostructures incorporating noble metal nanoparticles, for a wide range of applications. The interaction of light with metal nanoparticles (NPs) can generate strongly localized electromagnetic fields (Localized Surface Plasmon Resonance, LSPR) at certain wavelengths of the incident beam. In assemblies or structures where the nanoparticles are placed in close proximity, the plasmons of individual metallic NPs can be strongly coupled to each other via Coulomb interactions. By arranging the metallic NPs in a chiral (e.g. helical) geometry, it is possible to induce collective excitations, which lead to differential optical response of the structures to right-and left circularly polarized light (e.g. Circular Dichroism - CD). Earlier reports in this field include novel techniques of synthesizing metallic nanoparticles on biological helical templates made from DNA, proteins etc. In the present work, we have developed new ways of fabricating chiral complexes made of metallic NPs, which demonstrate a very strong chiro-optical response in the visible region of the electromagnetic spectrum. Using DDA (Discrete Dipole Approximation) simulations, we theoretically studied the conditions responsible for large and broadband chiro-optical response. This system may be used for various applications, for example those related to polarization control of visible light, sensing of proteins and other chiral bio-molecules, and many more.

Novel Relay Selection Rules for Average Interference-Constrained Cognitive AF Relay Networks

Cooperative relaying combined with selection exploits spatial diversity to significantly improve the performance of interference-constrained secondary users in an underlay cognitive radio (CR) network. However, unlike conventional relaying, the state of the links between the relay and the primary receiver affects the choice of the relay. Further, while the optimal amplify-and-forward (AF) relay selection rule for underlay CR is well understood for the peak interference-constraint, this is not so for the less conservative average interference constraint. For the latter, we present three novel AF relay selection (RS) rules, namely, symbol error probability (SEP)-optimal, inverse-of-affine (IOA), and linear rules. We analyze the SEPs of the IOA and linear rules and also develop a novel, accurate approximation technique for analyzing the performance of AF relays. Extensive numerical results show that all the three rules outperform several RS rules proposed in the literature and generalize the conventional AF RS rule.

A Novel Operator-Splitting Technique for One-Dimensional Laminar Premixed Flames

This paper is concerned the calculation of flame structure of one-dimensional laminar premixed flames using the technique of operator-splitting. The technique utilizes an explicit method of solution with one step Euler for chemistry and a novel probabilistic scheme for diffusion. The relationship between diffusion phenomenon and Gauss-Markoff process is exploited to obtain an unconditionally stable explicit difference scheme for diffusion. The method has been applied to (a) a model problem, (b) hydrazine decomposition, (c) a hydrogen-oxygen system with 28 reactions with constant Dρ 2 approximation, and (d) a hydrogen-oxygen system (28 reactions) with trace diffusion approximation. Certain interesting aspects of behaviour of the solution with non-unity Lewis number are brought out in the case of hydrazine flame. The results of computation in the most complex case are shown to compare very favourably with those of Warnatz, both in terms of accuracy of results as well as computational time, thus showing that explicit methods can be effective in flame computations. Also computations using the Gear-Hindmarsh for chemistry and the present approach for diffusion have been carried out and comparison of the two methods is presented.

Dynamical cluster approximation: Nonlocal dynamics of correlated electron systems

We recently introduced the dynamical cluster approximation (DCA), a technique that includes short-ranged dynamical correlations in addition to the local dynamics of the dynamical mean-field approximation while preserving causality. The technique is based on an iterative self-consistency scheme on a finite-size periodic cluster. The dynamical mean-field approximation (exact result) is obtained by taking the cluster to a single site (the thermodynamic limit). Here, we provide details of our method, explicitly show that it is causal, systematic, Phi derivable, and that it becomes conserving as the cluster size increases. We demonstrate the DCA by applying it to a quantum Monte Carlo and exact enumeration study of the two-dimensional Falicov-Kimball model. The resulting spectral functions preserve causality, and the spectra and the charge-density-wave transition temperature converge quickly and systematically to the thermodynamic limit as the cluster size increases.

Energy efficient asymmetric binary search switching technique for SAR ADC

An asymmetric binary search switching technique for a successive approximation register (SAR) ADC is presented, and trade-off between switching energy and conversion cycles is discussed. Without using any additional switches, the proposed technique consumes 46% less switching energy, for a small input swing (0.5 V-ref (P-P)), as compared to the last reported efficient switching technique in literature for an 8-bit SAR ADC. For a full input swing (2 V-ref (P-P)), the proposed technique consumes 16.5% less switching energy.

Stochastic Approximation Algorithms for Constrained Optimization via Simulation

We develop four algorithms for simulation-based optimization under multiple inequality constraints. Both the cost and the constraint functions are considered to be long-run averages of certain state-dependent single-stage functions. We pose the problem in the simulation optimization framework by using the Lagrange multiplier method. Two of our algorithms estimate only the gradient of the Lagrangian, while the other two estimate both the gradient and the Hessian of it. In the process, we also develop various new estimators for the gradient and Hessian. All our algorithms use two simulations each. Two of these algorithms are based on the smoothed functional (SF) technique, while the other two are based on the simultaneous perturbation stochastic approximation (SPSA) method. We prove the convergence of our algorithms and show numerical experiments on a setting involving an open Jackson network. The Newton-based SF algorithm is seen to show the best overall performance.

Effect of Li+-ion on enhancement of photoluminescence in Gd2O3:Eu3+ nanophosphors prepared by combustion technique

Gd2O3:Eu3+ (4 mol%) nanophosphor co-doped with Li+ ions have been synthesized by low-temperature solution combustion technique in a short time. Powder X-ray diffractometer (PXRD), scanning electron microscopy (SEM), Fourier transform infrared spectroscopy (FT-IR), UV-VIS and photoluminescence (PL) techniques have been employed to characterize the synthesized nanoparticles. It is found that the lattice of Gd2O3:Eu3+ phosphor transforms from monoclinic to cubic as the Li+-ions are doped. Upon 254 nm excitation, the phosphor showed characteristic luminescence D-5(0) -> F-7(J) (J= 0-4) of the Eu3+ ions. The electronic transition located at 626 nm (D-5(0) -> F-7(2)) of Eu3+ ions was stronger than the magnetic dipole transition located at 595 nm (D-5(0) -> F-7(1)). Furthermore, the effects of the Li+ co-doping as well as calcinations temperature on the PL properties have been studied. The results show that incorporation of Li+ ions in Gd2O3:Eu3+ lattice could induce a remarkable improvement of their PL intensity. The emission intensity was observed to be enhanced four times than that of with out Li+-doped Gd2O3:Eu3+. (C) 2010 Elsevier B.V. All rights reserved,

Chopped nonlinear magneto-optic rotation: A technique for precision measurements

We have developed a technique for precise measurement of small magnetic fields using nonlinear magneto-optic rotation (NMOR). The technique relies on the resonant laser beam being chopped. During the on time, the atoms are optically pumped into an aligned ground state (Delta m=2 coherence). During the off time, they freely precess around the magnetic field at the Larmor frequency. If the on-off modulation frequency matches (twice) the Larmor precession frequency, the rotation is resonantly enhanced in every cycle, thereby making the process like a repeated Ramsey measurement of the Larmor frequency. We study chopped-NMOR in a paraffin-coated Cs vapor cell. The out-of-phase demodulated rotation shows a Lorentzian peak of linewidth 85 mu G, corresponding to a sensitivity of 0.15nG/root Hz. We discuss the potential of this technique for the measurement of an atomic electric-dipole moment. Copyright (C) EPLA, 2011

Polynomial Approximation, Local Polynomial convexity, and Degenerate CR Singularities- II

We provide some conditions for the graph of a Holder-continuous function on (D) over bar, where (D) over bar is a closed disk in C, to be polynomially convex. Almost all sufficient conditions known to date - provided the function (say F) is smooth - arise from versions of the Weierstrass Approximation Theorem on (D) over bar. These conditions often fail to yield any conclusion if rank(R)DF is not maximal on a sufficiently large subset of (D) over bar. We bypass this difficulty by introducing a technique that relies on the interplay of certain plurisubharmonic functions. This technique also allows us to make some observations on the polynomial hull of a graph in C(2) at an isolated complex tangency.