Average control of Markov decision processes with Feller transition probabilities and general action spaces

This paper studies the average control problem of discrete-time Markov Decision Processes (MDPs for short) with general state space, Feller transition probabilities, and possibly non-compact control constraint sets A(x). Two hypotheses are considered: either the cost function c is strictly unbounded or the multifunctions A(r)(x) = {a is an element of A(x) : c(x, a) <= r} are upper-semicontinuous and compact-valued for each real r. For these two cases we provide new results for the existence of a solution to the average-cost optimality equality and inequality using the vanishing discount approach. We also study the convergence of the policy iteration approach under these conditions. It should be pointed out that we do not make any assumptions regarding the convergence and the continuity of the limit function generated by the sequence of relative difference of the alpha-discounted value functions and the Poisson equations as often encountered in the literature. (C) 2012 Elsevier Inc. All rights reserved.

Analysis of confinement potential fluctuation and band-gap renormalization effects on excitonic transition in GaAs/AlGaAs multiquantum wells grown on (100) and (311)A GaAs surfaces

The competition between confinement potential fluctuations and band-gap renormalization (BGR) in GaAs/AlxGa1-xAs quantum wells grown on [1 0 0] and [3 1 1]A GaAs substrates is evaluated. The results clearly demonstrate the coexistence of the band-tail states filling related to potential fluctuations and the band-gap renormalization caused by an increase in the density of photogenerated carriers during the photoluminescence (PL) experiments. Both phenomena have strong influence on temperature dependence of the PL-peak energy (E-PL(T)). As the photon density increases, the E-PL can shift to either higher or lower energies, depending on the sample temperature. The temperature at which the displacement changes from a blueshift to a redshift is governed by the magnitude of the potential fluctuations and by the variation of BGR with excitation density. A simple band-tail model with a Gaussian-like distribution of the density of state was used to describe the competition between the band-tail filling and the BGR effects on E-PL(T). (C) 2012 Elsevier B.V. All rights reserved.

Complex mixed state of the Pauli-limited superconductor CeCoIn5

Magnetization measurements were performed on CeCoIn5 at temperatures down to 20 mK and magnetic fields up to 17 T applied along different crystallographic orientations. For field configurations nearly parallel to the ab plane (theta less than or similar to 40 degrees and T <= 50 mK), we have found an intriguing vortex dynamics regime revealed by a hysteretic and metastable anomalous peak effect (APE), which gives evidence of surface barrier effects enhanced by antiferromagnetic fluctuations in the mixed state of CeCoIn5. Furthermore, we have observed crossover features in the torque and magnetization traces at fields below H-c2, which are consistent with vortices lattice phase transitions and with the anomalies speculated to be the Fulde-Ferrel-Larkin-Ovchinnikov (FFLO) superconducting state in CeCoIn5. All of the above features were found to be dramatically perturbed in Ce0.98Gd0.02CoIn5.

SYNCHRONIZATION OF CHAOS AND THE TRANSITION TO WAVE TURBULENCE

We investigated the transition to wave turbulence in a spatially extended three-wave interacting model, where a spatially homogeneous state undergoing chaotic dynamics undergoes spatial mode excitation. The transition to this weakly turbulent state can be regarded as the loss of synchronization of chaos of mode oscillators describing the spatial dynamics.

STRUCTURE AND DYNAMICS: THE TRANSITION FROM NONEQUILIBRIUM TO EQUILIBRIUM IN INTEGRATE-AND-FIRE DYNAMICS

The transient and equilibrium properties of dynamics unfolding in complex systems can depend critically on specific topological features of the underlying interconnections. In this work, we investigate such a relationship with respect to the integrate-and-fire dynamics emanating from a source node and an extended network model that allows control of the small-world feature as well as the length of the long-range connections. A systematic approach to investigate the local and global correlations between structural and dynamical features of the networks was adopted that involved extensive simulations (one and a half million cases) so as to obtain two-dimensional correlation maps. Smooth, but diverse surfaces of correlation values were obtained in all cases. Regarding the global cases, it has been verified that the onset avalanche time (but not its intensity) can be accurately predicted from the structural features within specific regions of the map (i.e. networks with specific structural properties). The analysis at local level revealed that the dynamical features before the avalanches can also be accurately predicted from structural features. This is not possible for the dynamical features after the avalanches take place. This is so because the overall topology of the network predominates over the local topology around the source at the stationary state.

Analysis of phase transition and dehydration processes of nevirapine

Solid-state characterization of crystalline drugs is an important pre-formulation step for the development and design of solid dosage forms, such as pellets and tablets. In this study, phase transition and dehydration processes of nevirapine have been studied by differential scanning calorimetry and thermogravimetry differential thermal analysis to overcome the problems of drug formulation, namely poor solubility and poor content uniformity. Phase solubility studies elucidated the mechanism of enhanced nevirapine solubility.

SINGULARLY PERTURBED DISCOUNTED MARKOV CONTROL PROCESSES IN A GENERAL STATE SPACE

This paper studies the asymptotic optimality of discrete-time Markov decision processes (MDPs) with general state space and action space and having weak and strong interactions. By using a similar approach as developed by Liu, Zhang, and Yin [Appl. Math. Optim., 44 (2001), pp. 105-129], the idea in this paper is to consider an MDP with general state and action spaces and to reduce the dimension of the state space by considering an averaged model. This formulation is often described by introducing a small parameter epsilon > 0 in the definition of the transition kernel, leading to a singularly perturbed Markov model with two time scales. Our objective is twofold. First it is shown that the value function of the control problem for the perturbed system converges to the value function of a limit averaged control problem as epsilon goes to zero. In the second part of the paper, it is proved that a feedback control policy for the original control problem defined by using an optimal feedback policy for the limit problem is asymptotically optimal. Our work extends existing results of the literature in the following two directions: the underlying MDP is defined on general state and action spaces and we do not impose strong conditions on the recurrence structure of the MDP such as Doeblin's condition.

Cassava starch biodegradable films: Influence of glycerol and clay nanoparticles content on tensile and barrier properties and glass transition temperature

In this this study, glycerol content and its incorporation method on tensile and barrier properties of biodegradable films (BF) based on cassava starch were analyzed. ANOVA showed that the glycerol incorporation method did not influence the results (P > 0.05), however the glycerol content influenced significantly the tensile and barrier properties of the films (P < 0.05). Films prepared with lower glycerol content presented better tensile and barrier properties than films with higher content. Films were then prepared with addition of clay nanoparticles and their tensile and barrier properties and glass transition temperature were measured. ANOVA indicated that both glycerol and clay nanoparticles influenced significantly the tensile and barrier properties (P < 0.05), diminishing film permeability when clay nanoparticles were present, while the glass transition temperature was not influenced (P > 0.05). (C) 2011 Elsevier Ltd. All rights reserved.

ScPdZn and ScPtZn with YAlGe type structure: group-subgroup relation and 45Sc solid state NMR spectroscopy

The intermetallic compounds ScPdZn and ScPtZn were prepared from the elements by high-frequency melting in sealed tantalum ampoules. Both structures were refined from single crystal X-ray diffractometer data: YAlGe type, Cmcm, a = 429.53(8), b = 907.7(1), c = 527.86(1) pm, wR2 = 0.0375, 231 F2 values, for ScPdZn and a = 425.3(1), b = 918.4(2), c = 523.3(1) pm, wR2 = 0.0399, 213 F2 values for ScPtZn with 14 variables per refinement. The structures are orthorhombically distorted variants of the AlB2 type. The scandium and palladium (platinum atoms) build up ordered networks Sc3Pd3 and Sc3Pt3 (boron networks) which are slightly shifted with respect to each other. These networks are penetrated by chains of zinc atoms (262 pm in ScPtZn) which correspond to the aluminum positions, i.e. Zn(ScPd) and Zn(ScPt). The corresponding group-subgroup scheme and the differences in chemical bonding with respect to other AlB2-derived REPdZn and REPtZn compounds are discussed. 45Sc solid state NMR spectra confirm the single crystallographic scandium sites. From electronic band structure calculations the two compounds are found metallic with free electron like behavior at the Fermi level. A larger cohesive energy for ScPtZn suggests a more strongly bonded intermetallic than ScPdZn. Electron localization and overlap population analyses identify the largest bonding for scandium with the transition metal (Pd, Pt).

Ground state properties of neutron-rich Mg isotopes

Studies in regions of the nuclear chart in which the model predictions of properties of nuclei fail can bring a better understanding of the strong interaction in the nuclear medium. To such regions belongs the so called "island of inversion" centered around Ne, Na and Mg isotopes with 20 neutrons in which unexpected ground-state spins, large deformations and dense low-energy spectra appear. This is a strong argument that the magic N = 20 is not a closed shell in this area. In this thesis investigations of isotope shifts of stable 24,25,26Mg, as well as spins and magnetic moments of short-lived 29,31Mg are presented. The successful studies were performed at the ISOLDE facility at CERN using collinear laser and beta-NMR spectroscopy techniques. The isotopes were investigated as single-charged ions in the 280-nm transition from the atomic ground state 2S1/2 to one of the two lowest excited states 2P1/2,3/2 using continuous wave laser beams. The isotope-shift measurements with fluorescence detection for the three stable isotopes show that it is feasible to perform the same studies on radioactive Mg isotopes up to the "island of inversion". This will allow to determine differences in the mean charge square radii and interpret them in terms of deformation. The high detection efficiency for beta particles and optical pumping close to saturation allowed to obtain very good beta-asymmetry signals for 29Mg and 31Mg with half-lives around 1 s and production yields about 10^5 ions/s. For this purpose the ions were implanted into a host crystal lattice. Such detection of the atomic resonances revealed their hyperfine structure, which gives the sign and a first estimate of the value of the magnetic moment. The nuclear magnetic resonance gave also their g-factors with the relative uncertainty smaller than 0.2 %. By combining the two techniques also the nuclear spin of both isotopes could be unambiguously determined. The measured spins and g-factors show that 29Mg with 17 neutrons lies outside the "island of inversion". On the other hand, 31Mg with 19 neutrons has an unexpected ground-state spin which can be explained only by promoting at least two neutrons across the N = 20 shell gap. This places the above nucleus inside the "island". However, modern shell-model approaches cannot predict this level as the ground state but only as one of the low-lying states, even though they reproduce very well the experimental g-factor. This indicates that modifications to the available interactions are required. Future measurements include isotope shift measurements on radioactive Mg isotopes and beta-NMR studies on 33Mg.

Helix-coil-transition in solid polypeptides

Abstract Poly(L-glutamic acid) (PLGA) was synthesized by living anionic ring-opening polymerization of the NCA monomer, which was obtained by reacting diphosgene with an amino acid derivative. The chemical structures and thermal properties were characterized by 1H-NMR, 13C-NMR, TGA and DSC. XRD powder patterns found to be amorphous for all polymers obtained. The molecular weights could be determined under severe limitations due to low solubility and high aggregation tendency. The secondary structure of the PLGA films was analyzed in the solid state by IR spectroscopy; the order was determined mainly by XRD. Uniform bulk films (1-5 µm) were produced by drop-casting of PLGA solutions in TFA on silica. The XRD film analysis indicated the absence of a long range order or an orientation even if a helical microstructure was confirmed by IR spectroscopy. The coil solvent TFA delivered constantly a helical or a β-sheet structure in the solid state depending on the water content of the solvent which was observed for the first time to exhibit a high influence on the crystallization process for PLGA. Temperature dependent in-situ IR measurements were examined to analyze if a helix-coil transition occurs, but there could be no solvent system determined, which resulted in a disordered coil structure in the solid state. General parameters like solvent systems, evaporation conditions, concentration, substrates etc. were analyzed. New crystallizations were obtained on silica prepared by drop-casting of solutions of PLGA in DMF, DMA, TMU, NMP, and pyridine/water mixtures, respectively. PSCBC in DMF, CDCl3/TFA-d, and PSBC in CDCl3/TFA-d exhibited the same crystalline diffraction patterns like PLGA. The long range order in the X-ray diffraction pattern is proven by extremely sharp crystalline signals, which are not changing the shape or the position of the peak by increasing the temperature up to 160°C. The substrate seems to play a decisive role because the crystalline structures were not obtainable on glass. The crystal structure consists probably of two different layered structures based on the intensity ratios of the two series of crystalline signals in the X-ray diffraction patterns. The source of the layered structure remains unclear and needs further studies to investigate the spatial arrangement of the chains in more detail. The secondary structure was still not changing upon heating even if a highly crystalline diffraction pattern occurs. Concluding that even the newly investigated crystallization did not show a helix-coil transition in the solid state by annealing, the phenomenon known in solution has to be claimed as unachievable in the solid state based on the results of this work. A remaining open question represents the observation that the same crystalline pattern can be reproducibly prepared with exhibiting two different ordered secondary structures (helix and β-sheet). After the investigation that the evaporation time cannot be decisive for the crystal growth, the choice of a strong hydrogen bonding interrupting solvent is most probably the key to support and induce the crystallization process.

Luminescent Ionic Transition-Metal Complexes for Light-Emitting Electrochemical Cells

The European Union set the ambitious target of reducing energy consumption by 20% within 2020. This goal demands a tremendous change in how we generate and consume energy and urgently calls for an aggressive policy on energy efficiency. Since 19% of the European electrical energy is used for lighting, considerable savings can be achieved with the development of novel and more efficient lighting systems. In this thesis, accomplished in the frame of the EU project CELLO, I report some selected goals we achieved attempting to develop highly efficient, flat, low cost and flexible light sources using Light-Emitting Electrochemical Cells (LECs), based on ionic cyclometalated iridium(III) complexes. After an extensive introduction about LECs and solid-state lighting in general, I focus on the research we carried out on cyclometalated iridium(III) complexes displaying deep-blue emission, which has turned out to be a rather challenging task. In order to demonstrate the wide versatility of this class of compounds, I also report a case in which some tailored iridium(III) complexes act as near-infrared (NIR) sources. In fact, standard NIR emitting devices are typically expensive and, also in this case, LECs could serve as low-cost alternatives in fields were NIR luminescence is crucial, such as telecommunications and bioimaging. Since LECs are based on only one active material, in the last chapter I stress the importance of an integrated approach toward the right selection of suitable emitters not only from the photophysical, but also from the point of view of material science. An iridium(III) complex, once in the device, is interacting with ionic liquids, metal cathodes, electric fields, etc. All these interactions should be taken in to account if Europe really wants to implement more efficient lighting paradigms, generating light beyond research labs.

Effect of mixing, particle interaction, and spatial dimension on the glass transition

In this thesis, the influence of composition changes on the glass transition behavior of binary liquids in two and three spatial dimensions (2D/3D) is studied in the framework of mode-coupling theory (MCT).The well-established MCT equations are generalized to isotropic and homogeneous multicomponent liquids in arbitrary spatial dimensions. Furthermore, a new method is introduced which allows a fast and precise determination of special properties of glass transition lines. The new equations are then applied to the following model systems: binary mixtures of hard disks/spheres in 2D/3D, binary mixtures of dipolar point particles in 2D, and binary mixtures of dipolar hard disks in 2D. Some general features of the glass transition lines are also discussed. The direct comparison of the binary hard disk/sphere models in 2D/3D shows similar qualitative behavior. Particularly, for binary mixtures of hard disks in 2D the same four so-called mixing effects are identified as have been found before by Götze and Voigtmann for binary hard spheres in 3D [Phys. Rev. E 67, 021502 (2003)]. For instance, depending on the size disparity, adding a second component to a one-component liquid may lead to a stabilization of either the liquid or the glassy state. The MCT results for the 2D system are on a qualitative level in agreement with available computer simulation data. Furthermore, the glass transition diagram found for binary hard disks in 2D strongly resembles the corresponding random close packing diagram. Concerning dipolar systems, it is demonstrated that the experimental system of König et al. [Eur. Phys. J. E 18, 287 (2005)] is well described by binary point dipoles in 2D through a comparison between the experimental partial structure factors and those from computer simulations. For such mixtures of point particles it is demonstrated that MCT predicts always a plasticization effect, i.e. a stabilization of the liquid state due to mixing, in contrast to binary hard disks in 2D or binary hard spheres in 3D. It is demonstrated that the predicted plasticization effect is in qualitative agreement with experimental results. Finally, a glass transition diagram for binary mixtures of dipolar hard disks in 2D is calculated. These results demonstrate that at higher packing fractions there is a competition between the mixing effects occurring for binary hard disks in 2D and those for binary point dipoles in 2D.

New developments in state-specific multireference coupled-cluster theory

Coupled-cluster theory in its single-reference formulation represents one of the most successful approaches in quantum chemistry for the description of atoms and molecules. To extend the applicability of single-reference coupled-cluster theory to systems with degenerate or near-degenerate electronic configurations, multireference coupled-cluster methods have been suggested. One of the most promising formulations of multireference coupled cluster theory is the state-specific variant suggested by Mukherjee and co-workers (Mk-MRCC). Unlike other multireference coupled-cluster approaches, Mk-MRCC is a size-extensive theory and results obtained so far indicate that it has the potential to develop to a standard tool for high-accuracy quantum-chemical treatments. This work deals with developments to overcome the limitations in the applicability of the Mk-MRCC method. Therefore, an efficient Mk-MRCC algorithm has been implemented in the CFOUR program package to perform energy calculations within the singles and doubles (Mk-MRCCSD) and singles, doubles, and triples (Mk-MRCCSDT) approximations. This implementation exploits the special structure of the Mk-MRCC working equations that allows to adapt existing efficient single-reference coupled-cluster codes. The algorithm has the correct computational scaling of d*N^6 for Mk-MRCCSD and d*N^8 for Mk-MRCCSDT, where N denotes the system size and d the number of reference determinants. For the determination of molecular properties as the equilibrium geometry, the theory of analytic first derivatives of the energy for the Mk-MRCC method has been developed using a Lagrange formalism. The Mk-MRCC gradients within the CCSD and CCSDT approximation have been implemented and their applicability has been demonstrated for various compounds such as 2,6-pyridyne, the 2,6-pyridyne cation, m-benzyne, ozone and cyclobutadiene. The development of analytic gradients for Mk-MRCC offers the possibility of routinely locating minima and transition states on the potential energy surface. It can be considered as a key step towards routine investigation of multireference systems and calculation of their properties. As the full inclusion of triple excitations in Mk-MRCC energy calculations is computational demanding, a parallel implementation is presented in order to circumvent limitations due to the required execution time. The proposed scheme is based on the adaption of a highly efficient serial Mk-MRCCSDT code by parallelizing the time-determining steps. A first application to 2,6-pyridyne is presented to demonstrate the efficiency of the current implementation.

HCl gas gettering of 3d transition metals for crystalline silicon solar cell concepts

In order to reduce the costs of crystalline silicon solar cells, low-cost silicon materials like upgraded metallurgical grade (UMG) silicon are investigated for the application in the photovoltaic (PV) industry. Conventional high-purity silicon is made by cost-intensive methods, based on the so-called Siemens process, which uses the reaction to form chlorosilanes and subsequent several distillation steps before the deposition of high-purity silicon on slim high-purity silicon rods. UMG silicon in contrast is gained from metallurgical silicon by a rather inexpensive physicochemical purification (e.g., acid leaching and/or segregation). However, this type of silicon usually contains much higher concentrations of impurities, especially 3d transition metals like Ti, Fe, and Cu. These metals are extremely detrimental in the electrically active part of silicon solar cells, as they form recombination centers for charge carriers in the silicon band gap. This is why simple purification techniques like gettering, which can be applied between or during solar cell process steps, will play an important role for such low-cost silicon materials. Gettering in general describes a process, whereby impurities are moved to a place or turned into a state, where they are less detrimental to the solar cell. Hydrogen chloride (HCl) gas gettering in particular is a promising simple and cheap gettering technique, which is based on the reaction of HCl gas with transition metals to form volatile metal chloride species at high temperatures.rnThe aim of this thesis was to find the optimum process parameters for HCl gas gettering of 3d transition metals in low-cost silicon to improve the cell efficiency of solar cells for two different cell concepts, the standard wafer cell concept and the epitaxial wafer equivalent (EpiWE) cell concept. Whereas the former is based on a wafer which is the electrically active part of the solar cell, the latter uses an electrically inactive low-cost silicon substrate with an active layer of epitaxially grown silicon on top. Low-cost silicon materials with different impurity grades were used for HCl gas gettering experiments with the variation of process parameters like the temperature, the gettering time, and the HCl gas concentration. Subsequently, the multicrystalline silicon neighboring wafers with and without gettering were compared by element analysis techniques like neutron activation analysis (NAA). It was demonstrated that HCl gas gettering is an effective purification technique for silicon wafers, which is able to reduce some 3d transition metal concentrations by over 90%. Solar cells were processed for both concepts which could demonstrate a significant increase of the solar cell efficiency by HCl gas gettering. The efficiency of EpiWE cells could be increased by HCl gas gettering by approximately 25% relative to cells without gettering. First process simulations were performed based on a simple model for HCl gas gettering processes, which could be used to make qualitative predictions.