Optimal uncertainty quantification via convex optimization and relaxation

Many engineering applications face the problem of bounding the expected value of a quantity of interest (performance, risk, cost, etc.) that depends on stochastic uncertainties whose probability distribution is not known exactly. Optimal uncertainty quantification (OUQ) is a framework that aims at obtaining the best bound in these situations by explicitly incorporating available information about the distribution. Unfortunately, this often leads to non-convex optimization problems that are numerically expensive to solve.

This thesis emphasizes on efficient numerical algorithms for OUQ problems. It begins by investigating several classes of OUQ problems that can be reformulated as convex optimization problems. Conditions on the objective function and information constraints under which a convex formulation exists are presented. Since the size of the optimization problem can become quite large, solutions for scaling up are also discussed. Finally, the capability of analyzing a practical system through such convex formulations is demonstrated by a numerical example of energy storage placement in power grids.

When an equivalent convex formulation is unavailable, it is possible to find a convex problem that provides a meaningful bound for the original problem, also known as a convex relaxation. As an example, the thesis investigates the setting used in Hoeffding's inequality. The naive formulation requires solving a collection of non-convex polynomial optimization problems whose number grows doubly exponentially. After structures such as symmetry are exploited, it is shown that both the number and the size of the polynomial optimization problems can be reduced significantly. Each polynomial optimization problem is then bounded by its convex relaxation using sums-of-squares. These bounds are found to be tight in all the numerical examples tested in the thesis and are significantly better than Hoeffding's bounds.

I. Spectroscopic evidence for slow vibrational relaxation in excited electronic states of diatomics in rare gas solids. II. Static crystal field effects in the electronic spectra of isotopically mixed benzene crystals

Part I

Studies of vibrational relaxation in excited electronic states of simple diatomic molecules trapped in solid rare-gas matrices at low temperatures are reported. The relaxation is investigated by monitoring the emission intensity from vibrational levels of the excited electronic state to vibrational levels of the ground electronic state. The emission was in all cases excited by bombardment of the doped rare-gas solid with X-rays.

The diatomics studied and the band systems seen are: N₂, Vegard-Kaplan and Second Positive systems; O₂, Herzberg system; OH and OD, A ²Σ⁺ - X²II_i system. The latter has been investigated only in solid Ne, where both emission and absorption spectra were recorded; observed fine structure has been partly interpreted in terms of slightly perturbed rotational motion in the solid. For N₂, OH, and OD emission occurred from v' > 0, establishing a vibrational relaxation time in the excited electronic state of the order, of longer than, the electronic radiative lifetime. The relative emission intensity and decay times for different v' progressions in the Vegard-Kaplan system are found to depend on the rare-gas host and the N₂ concentration, but are independent of temperature in the range 1.7°K to 30°K.

Part II

Static crystal field effects on the absorption, fluorescence, and phosphorescence spectra of isotopically mixed benzene crystals were investigated. Evidence is presented which demonstrate that in the crystal the ground, lowest excited singlet, and lowest triplet states of the guest deviate from hexagonal symmetry. The deviation appears largest in the lowest triplet state and may be due to an intrinsic instability of the ³B_1u state. High resolution absorption and phospho- rescence spectra are reported and analyzed in terms of site-splitting of degenerate vibrations and orientational effects. The guest phosphorescence lifetime for various benzene isotopes in C₆D₆ and sym-C₆H₃D₃ hosts is presented and discussed.

Orientation-controllable self-organized microgratings induced in the bulk SrTiO3 crystal by a single femtosecond laser beam

Self-organized microgratings were induced in the bulk SrTiO3 crystal by readily scanning the laser focus in the direction perpendicular to the laser propagation axis. The groove orientations of those gratings could be controlled by changing the irradiation pulse number per unit scanning length, which could be implemented either through adjusting the scanning velocity at a fixed pulse repetition rate or through varying the pulse repetition rate at a fixed scanning velocity. This high-speed method for fabrication of microgratings will have many potential applications in the integration of micro-optical elements. The possible formation mechanism of the self-organized microgratings is also discussed. (C) 2007 Optical Society of America.

Part I. Influence of membrane morphology on ion-exchange and charge propagation in composite polyelectrolyte electrode coatings. Part II. Dynamic surface tension measurements of polarization relaxation at mercury pool electrodes by the method of Wilhelmy.

Part I. Novel composite polyelectrolyte materials were developed that exhibit desirable charge propagation and ion-retention properties. The morphology of electrode coatings cast from these materials was shown to be more important for its electrochemical behavior than its chemical composition.

Part II. The Wilhelmy plate technique for measuring dynamic surface tension was extended to electrified liquid-liquid interphases. The dynamical response of the aqueous NaF-mercury electrified interphase was examined by concomitant measurement of surface tension, current, and applied electrostatic potential. Observations of the surface tension response to linear sweep voltammetry and to step function perturbations in the applied electrostatic potential (e.g., chronotensiometry) provided strong evidence that relaxation processes proceed for time-periods that are at least an order of magnitude longer than the time periods necessary to establish diffusion equilibrium. The dynamical response of the surface tension is analyzed within the context of non-equilibrium thermodynamics and a kinetic model that requires three simultaneous first order processes.

Existence of the transverse relaxation time in optically excited bulk semiconductors

Two basic types of depolarization mechanisms, carrier-carrier (CC) and carrier-phonon (CP) scattering, are investigated in optically excited bulk semiconductors (3D), in which the existence of the transverse relaxation time is proven based on the vector property of the interband transition matrix elements. The dephasing rates for both CC and CP scattering are determined to be equal to one half of the total scattering-rate-integrals weighted by the factors (1 - cos chi), where chi are the scattering angles. Analytical expressions of the polarization dephasing due to CC scattering are established by using an uncertainty broadening approach, and analytical ones due to both the polar optical-phonon and non-polar deformation potential scattering (including inter-valley scattering) are also presented by using the sharp spectral functions in the dephasing rate calculations. These formulas, which reveal the trivial role of the Coulomb screening effect in the depolarization processes, are used to explain the experimental results at hand and provide a clear physical picture that is difficult to extract from numerical treatments.

Convex Relaxation for Low-Dimensional Representation: Phase Transitions and Limitations

There is a growing interest in taking advantage of possible patterns and structures in data so as to extract the desired information and overcome the curse of dimensionality. In a wide range of applications, including computer vision, machine learning, medical imaging, and social networks, the signal that gives rise to the observations can be modeled to be approximately sparse and exploiting this fact can be very beneficial. This has led to an immense interest in the problem of efficiently reconstructing a sparse signal from limited linear observations. More recently, low-rank approximation techniques have become prominent tools to approach problems arising in machine learning, system identification and quantum tomography.

In sparse and low-rank estimation problems, the challenge is the inherent intractability of the objective function, and one needs efficient methods to capture the low-dimensionality of these models. Convex optimization is often a promising tool to attack such problems. An intractable problem with a combinatorial objective can often be "relaxed" to obtain a tractable but almost as powerful convex optimization problem. This dissertation studies convex optimization techniques that can take advantage of low-dimensional representations of the underlying high-dimensional data. We provide provable guarantees that ensure that the proposed algorithms will succeed under reasonable conditions, and answer questions of the following flavor:

More specifically, i) Focusing on linear inverse problems, we generalize the classical error bounds known for the least-squares technique to the lasso formulation, which incorporates the signal model. ii) We show that intuitive convex approaches do not perform as well as expected when it comes to signals that have multiple low-dimensional structures simultaneously. iii) Finally, we propose convex relaxations for the graph clustering problem and give sharp performance guarantees for a family of graphs arising from the so-called stochastic block model. We pay particular attention to the following aspects. For i) and ii), we aim to provide a general geometric framework, in which the results on sparse and low-rank estimation can be obtained as special cases. For i) and iii), we investigate the precise performance characterization, which yields the right constants in our bounds and the true dependence between the problem parameters.

The origin of the transverse relaxation time in optically excited semiconductor quantum wells

The origin of the transverse relaxation time in optically excited semiconductor quantum wells is investigated based on the vector property of the interband transition matrix elements. The dephasing rate due to carrier-carrier (CC) scattering is found to be equal to half of the common momentum relaxation rate. The analytical expression of the polarization dephasing due to CC scattering in two-dimension is established and the dependence of the dephasing rate Gamma(cc) on the carrier density N is determined to be Gamma(cc) = constant (.) N-1/2, which is used to explain the experimental results and provides a promising physical picture. (C) 2004 Elsevier B.V. All rights reserved.

First principles based multiparadigm modeling of electronic structures and dynamics

Electronic structures and dynamics are the key to linking the material composition and structure to functionality and performance.

An essential issue in developing semiconductor devices for photovoltaics is to design materials with optimal band gaps and relative positioning of band levels. Approximate DFT methods have been justified to predict band gaps from KS/GKS eigenvalues, but the accuracy is decisively dependent on the choice of XC functionals. We show here for CuInSe₂ and CuGaSe₂, the parent compounds of the promising CIGS solar cells, conventional LDA and GGA obtain gaps of 0.0-0.01 and 0.02-0.24 eV (versus experimental values of 1.04 and 1.67 eV), while the historically first global hybrid functional, B3PW91, is surprisingly the best, with band gaps of 1.07 and 1.58 eV. Furthermore, we show that for 27 related binary and ternary semiconductors, B3PW91 predicts gaps with a MAD of only 0.09 eV, which is substantially better than all modern hybrid functionals, including B3LYP (MAD of 0.19 eV) and screened hybrid functional HSE06 (MAD of 0.18 eV).

The laboratory performance of CIGS solar cells (> 20% efficiency) makes them promising candidate photovoltaic devices. However, there remains little understanding of how defects at the CIGS/CdS interface affect the band offsets and interfacial energies, and hence the performance of manufactured devices. To determine these relationships, we use the B3PW91 hybrid functional of DFT with the AEP method that we validate to provide very accurate descriptions of both band gaps and band offsets. This confirms the weak dependence of band offsets on surface orientation observed experimentally. We predict that the CBO of perfect CuInSe₂/CdS interface is large, 0.79 eV, which would dramatically degrade performance. Moreover we show that band gap widening induced by Ga adjusts only the VBO, and we find that Cd impurities do not significantly affect the CBO. Thus we show that Cu vacancies at the interface play the key role in enabling the tunability of CBO. We predict that Na further improves the CBO through electrostatically elevating the valence levels to decrease the CBO, explaining the observed essential role of Na for high performance. Moreover we find that K leads to a dramatic decrease in the CBO to 0.05 eV, much better than Na. We suggest that the efficiency of CIGS devices might be improved substantially by tuning the ratio of Na to K, with the improved phase stability of Na balancing phase instability from K. All these defects reduce interfacial stability slightly, but not significantly.

A number of exotic structures have been formed through high pressure chemistry, but applications have been hindered by difficulties in recovering the high pressure phase to ambient conditions (i.e., one atmosphere and room temperature). Here we use dispersion-corrected DFT (PBE-ulg flavor) to predict that above 60 GPa the most stable form of N₂O (the laughing gas in its molecular form) is a 1D polymer with an all-nitrogen backbone analogous to cis-polyacetylene in which alternate N are bonded (ionic covalent) to O. The analogous trans-polymer is only 0.03-0.10 eV/molecular unit less stable. Upon relaxation to ambient conditions both polymers relax below 14 GPa to the same stable non-planar trans-polymer, accompanied by possible electronic structure transitions. The predicted phonon spectrum and dissociation kinetics validate the stability of this trans-poly-NNO at ambient conditions, which has potential applications as a new type of conducting polymer with all-nitrogen chains and as a high-energy oxidizer for rocket propulsion. This work illustrates in silico materials discovery particularly in the realm of extreme conditions.

Modeling non-adiabatic electron dynamics has been a long-standing challenge for computational chemistry and materials science, and the eFF method presents a cost-efficient alternative. However, due to the deficiency of FSG representation, eFF is limited to low-Z elements with electrons of predominant s-character. To overcome this, we introduce a formal set of ECP extensions that enable accurate description of p-block elements. The extensions consist of a model representing the core electrons with the nucleus as a single pseudo particle represented by FSG, interacting with valence electrons through ECPs. We demonstrate and validate the ECP extensions for complex bonding structures, geometries, and energetics of systems with p-block character (C, O, Al, Si) and apply them to study materials under extreme mechanical loading conditions.

Despite its success, the eFF framework has some limitations, originated from both the design of Pauli potentials and the FSG representation. To overcome these, we develop a new framework of two-level hierarchy that is a more rigorous and accurate successor to the eFF method. The fundamental level, GHA-QM, is based on a new set of Pauli potentials that renders exact QM level of accuracy for any FSG represented electron systems. To achieve this, we start with using exactly derived energy expressions for the same spin electron pair, and fitting a simple functional form, inspired by DFT, against open singlet electron pair curves (H₂ systems). Symmetric and asymmetric scaling factors are then introduced at this level to recover the QM total energies of multiple electron pair systems from the sum of local interactions. To complement the imperfect FSG representation, the AMPERE extension is implemented, and aims at embedding the interactions associated with both the cusp condition and explicit nodal structures. The whole GHA-QM+AMPERE framework is tested on H element, and the preliminary results are promising.

Double refraction and reflection of sequential crystal interfaces with arbitrary orientation of the optic axis and application to optimum design

The general formulation of double refraction or internal double reflection for any directions of incidence and arbitrary orientation of the optic axis in a uniaxial crystal is analysed in terms of Huygens' principle. Then double refraction and double reflection along the sequential interfaces in a crystal are discussed. On this basis, if the parameters of the interface are chosen appropriately, the range of angular separation between the ordinary ray and extraordinary ray can be much greater, It is useful for crystal element design. Finally, as an example, an optimum design of the Output end interface for a 2 x 2 electro-optic switch is given.

Mössbauer effect investigations of the hyperfine interactions and relaxation phenomena in salts of thulium

Two new phenomena have been observed in Mössbauer spectra: a temperature-dependent shift of the center of gravity of the spectrum, and an asymmetric broadening of the spectrum peaks. Both phenomena were observed in thulium salts. In the temperature range 1˚K ≤ T ≤ 5˚K the observed shift has an approximate inverse temperature dependence. We explain this on the basis of a Van Vleck type of interaction between the magnetic moment of two nearly degenerate electronic levels and the magnetic moment of the nucleus. From the size of the shift we are able to deduce an “effective magnetic field” H = (6.0 ± 0.1) x 10⁶ Gauss, which is proportional to ‹r^-3›_M‹G|J|E› where ‹r^-3›_M is an effective magnetic radial integral for the 4f electrons and |G› and |E› are the lowest 4f electronic states in Tm Cl₃·6H₂O. From the temperature dependence of the shift we have derived a preliminary value of 1 cm^-1 for the splitting of these two states. The observed asymmetric line broadening is independent of temperature in the range 1˚K ≤ T ≤ 5˚K, but is dependent on the concentration of thulium ions in the crystal. We explain this broadening on the basis of spin-spin interactions between thulium ions. From size and concentration dependence of the broadening we are able to deduce a spin-spin relaxation time for Tm Cl₃·6H₂O of the order of 10^-11 sec.

Part I. Electric birefringence studies of deoxyribonucleic acids. Part II. Selective dissociation of nucleohistone complexes

Part I

The electric birefringence of dilute DNA solutions has been studied in considerable detail and on a large number of samples, but no new and reliable information was discovered concerning the tertiary structure of DNA. The large number of variables which effect the birefringence results is discussed and suggestions are made for further work on the subject.

The DNA molecules have been aligned in a rapidly alternating (10 to 20 kc/sec) square wave field confirming that the orientation mechanism is that of counterion polarization. A simple empirical relation between the steady state birefringence, Δn_st, and the square of the electric field, E, has been found: Δn_st = E²/(a E² + b), where a = 1/Δn_s and b = (E²/Δn_st)_E→o. Δn_s is the birefringence extrapolated to infinite field strength.

The molecules show a distribution of relaxation times from 10^-4 to 0.2 sec, which is consistent with expectations for flexible coil molecules. The birefringence and the relaxation times decrease with increasing salt concentrations. They also depend on the field strength and pulse duration in a rather non-reproducible manner, which may be due in part to changes in the composition of the solution or in the molecular structure of the DNA (other than denaturation). Further progress depends on the development of some control over these effects.

Part II

The specificity of the dissociation of reconstituted and native deoxyribonucleohistones (DNH) by monovalent salt solutions has been investigated. A novel zone ultracentrifugation method is used in which the DNH is sedimented as a zone through a preformed salt gradient, superimposed on a stabilizing D₂O (sucrose) density gradient. The results, obtained by scanning the quartz sedimentation tubes in a spectrophotometer, were verified by the conventional, preparative sedimentation technique. Procedures are discussed for the detection of microgram quantities of histones, since low concentrations must be used to prevent excessive aggregation of the DNH.

The data show that major histone fractions are selectively dissociated from DNH by increasing salt concentrations: Lysine rich histone (H I) dissociates gradually between 0.1 and 0.3 F, slightly lysine rich histone (H II) dissociates as a narrow band between 0.35 and 0.5 F, and arginine rich histone (H III, H IV) dissociates gradually above 0.5 F NaClO₄.

The activity of the partially dissociated, native DNH in sustaining RNA synthesis, their mobility and their unusual heat denaturation and renaturation behavior are described. The two-step melting behavior of the material indicates that the histones are non-randomly distributed along the DNA, but the implications are that the uncovered regions are not of gene-size length.

I. Proton magnetic resonance of polynucleotides and transfer RNA. II. Electron spin relaxation studies of manganese (II) complexes in acetonitrile

Part I. Proton Magnetic Resonance of Polynucleotides and Transfer RNA.

Proton magnetic resonance was used to follow the temperature dependent intramolecular stacking of the bases in the polynucleotides of adenine and cytosine. Analysis of the results on the basis of a two state stacked-unstacked model yielded values of -4.5 kcal/mole and -9.5 kcal/mole for the enthalpies of stacking in polyadenylic and polycytidylic acid, respectively.

The interaction of purine with these molecules was also studied by pmr. Analysis of these results and the comparison of the thermal unstacking of polynucleotides and short chain nucleotides indicates that the bases contained in stacks within the long chain poly nucleotides are, on the average, closer together than the bases contained in stacks in the short chain nucleotides.

Temperature and purine studies were also carried out with an aqueous solution of formylmethionine transfer ribonucleic acid. Comparison of these results with the results of similar experiments with the homopolynucleotides of adenine, cytosine and uracil indicate that the purine is probably intercalating into loop regions of the molecule.

The solvent denaturation of phenylalanine transfer ribonucleic acid was followed by pmr. In a solvent mixture containing 83 volume per cent dimethylsulf oxide and 17 per cent deuterium oxide, the tRNA molecule is rendered quite flexible. It is possible to resolve resonances of protons on the common bases and on certain modified bases.

Part II. Electron Spin Relaxation Studies of Manganese (II) Complexes in Acetonitrile.

The electron paramagnetic resonance spectra of three Mn⁺² complexes, [Mn(CH₃CN)₆]⁺², [MnCl₄]^-2, and [MnBr₄]^-2, in acetonitrile were studied in detail. The objective of this study was to relate changes in the effective spin Hamiltonian parameters and the resonance line widths to the structure of these molecular complexes as well as to dynamical processes in solution.

Of the three systems studied, the results obtained from the [Mn(CH₃CN)₆]⁺² system were the most straight-forward to interpret. Resonance broadening attributable to manganese spin-spin dipolar interactions was observed as the manganese concentration was increased.

In the [MnCl₄]^-2 system, solvent fluctuations and dynamical ion-pairing appear to be significant in determining electron spin relaxation.

In the [MnBr₄]^-2 system, solvent fluctuations, ion-pairing, and Br- ligand exchange provide the principal means of electron spin relaxation. It was also found that the spin relaxation in this system is dependent upon the field strength and is directly related to the manganese concentration. A relaxation theory based on a two state collisional model was developed to account for the observed behavior.