Optimal uncertainty quantification via convex optimization and relaxation

Many engineering applications face the problem of bounding the expected value of a quantity of interest (performance, risk, cost, etc.) that depends on stochastic uncertainties whose probability distribution is not known exactly. Optimal uncertainty quantification (OUQ) is a framework that aims at obtaining the best bound in these situations by explicitly incorporating available information about the distribution. Unfortunately, this often leads to non-convex optimization problems that are numerically expensive to solve.

This thesis emphasizes on efficient numerical algorithms for OUQ problems. It begins by investigating several classes of OUQ problems that can be reformulated as convex optimization problems. Conditions on the objective function and information constraints under which a convex formulation exists are presented. Since the size of the optimization problem can become quite large, solutions for scaling up are also discussed. Finally, the capability of analyzing a practical system through such convex formulations is demonstrated by a numerical example of energy storage placement in power grids.

When an equivalent convex formulation is unavailable, it is possible to find a convex problem that provides a meaningful bound for the original problem, also known as a convex relaxation. As an example, the thesis investigates the setting used in Hoeffding's inequality. The naive formulation requires solving a collection of non-convex polynomial optimization problems whose number grows doubly exponentially. After structures such as symmetry are exploited, it is shown that both the number and the size of the polynomial optimization problems can be reduced significantly. Each polynomial optimization problem is then bounded by its convex relaxation using sums-of-squares. These bounds are found to be tight in all the numerical examples tested in the thesis and are significantly better than Hoeffding's bounds.

Techniques for strength measurement at high pressures and strain-rates using transverse waves

The study of the strength of a material is relevant to a variety of applications including automobile collisions, armor penetration and inertial confinement fusion. Although dynamic behavior of materials at high pressures and strain-rates has been studied extensively using plate impact experiments, the results provide measurements in one direction only. Material behavior that is dependent on strength is unaccounted for. The research in this study proposes two novel configurations to mitigate this problem.

The first configuration introduced is the oblique wedge experiment, which is comprised of a driver material, an angled target of interest and a backing material used to measure in-situ velocities. Upon impact, a shock wave is generated in the driver material. As the shock encounters the angled target, it is reflected back into the driver and transmitted into the target. Due to the angle of obliquity of the incident wave, a transverse wave is generated that allows the target to be subjected to shear while being compressed by the initial longitudinal shock such that the material does not slip. Using numerical simulations, this study shows that a variety of oblique wedge configurations can be used to study the shear response of materials and this can be extended to strength measurement as well. Experiments were performed on an oblique wedge setup with a copper impactor, polymethylmethacrylate driver, aluminum 6061-t6 target, and a lithium fluoride window. Particle velocities were measured using laser interferometry and results agree well with the simulations.

The second novel configuration is the y-cut quartz sandwich design, which uses the anisotropic properties of y-cut quartz to generate a shear wave that is transmitted into a thin sample. By using an anvil material to back the thin sample, particle velocities measured at the rear surface of the backing plate can be implemented to calculate the shear stress in the material and subsequently the strength. Numerical simulations were conducted to show that this configuration has the ability to measure the strength for a variety of materials.

I. Spectroscopic evidence for slow vibrational relaxation in excited electronic states of diatomics in rare gas solids. II. Static crystal field effects in the electronic spectra of isotopically mixed benzene crystals

Part I

Studies of vibrational relaxation in excited electronic states of simple diatomic molecules trapped in solid rare-gas matrices at low temperatures are reported. The relaxation is investigated by monitoring the emission intensity from vibrational levels of the excited electronic state to vibrational levels of the ground electronic state. The emission was in all cases excited by bombardment of the doped rare-gas solid with X-rays.

The diatomics studied and the band systems seen are: N₂, Vegard-Kaplan and Second Positive systems; O₂, Herzberg system; OH and OD, A ²Σ⁺ - X²II_i system. The latter has been investigated only in solid Ne, where both emission and absorption spectra were recorded; observed fine structure has been partly interpreted in terms of slightly perturbed rotational motion in the solid. For N₂, OH, and OD emission occurred from v' > 0, establishing a vibrational relaxation time in the excited electronic state of the order, of longer than, the electronic radiative lifetime. The relative emission intensity and decay times for different v' progressions in the Vegard-Kaplan system are found to depend on the rare-gas host and the N₂ concentration, but are independent of temperature in the range 1.7°K to 30°K.

Part II

Static crystal field effects on the absorption, fluorescence, and phosphorescence spectra of isotopically mixed benzene crystals were investigated. Evidence is presented which demonstrate that in the crystal the ground, lowest excited singlet, and lowest triplet states of the guest deviate from hexagonal symmetry. The deviation appears largest in the lowest triplet state and may be due to an intrinsic instability of the ³B_1u state. High resolution absorption and phospho- rescence spectra are reported and analyzed in terms of site-splitting of degenerate vibrations and orientational effects. The guest phosphorescence lifetime for various benzene isotopes in C₆D₆ and sym-C₆H₃D₃ hosts is presented and discussed.

High-strain composites and dual-matrix composite structures

Most space applications require deployable structures due to the limiting size of current launch vehicles. Specifically, payloads in nanosatellites such as CubeSats require very high compaction ratios due to the very limited space available in this typo of platform. Strain-energy-storing deployable structures can be suitable for these applications, but the curvature to which these structures can be folded is limited to the elastic range. Thanks to fiber microbuckling, high-strain composite materials can be folded into much higher curvatures without showing significant damage, which makes them suitable for very high compaction deployable structure applications. However, in applications that require carrying loads in compression, fiber microbuckling also dominates the strength of the material. A good understanding of the strength in compression of high-strain composites is then needed to determine how suitable they are for this type of application.

The goal of this thesis is to investigate, experimentally and numerically, the microbuckling in compression of high-strain composites. Particularly, the behavior in compression of unidirectional carbon fiber reinforced silicone rods (CFRS) is studied. Experimental testing of the compression failure of CFRS rods showed a higher strength in compression than the strength estimated by analytical models, which is unusual in standard polymer composites. This effect, first discovered in the present research, was attributed to the variation in random carbon fiber angles respect to the nominal direction. This is an important effect, as it implies that microbuckling strength might be increased by controlling the fiber angles. With a higher microbuckling strength, high-strain materials could carry loads in compression without reaching microbuckling and therefore be suitable for several space applications.

A finite element model was developed to predict the homogenized stiffness of the CFRS, and the homogenization results were used in another finite element model that simulated a homogenized rod under axial compression. A statistical representation of the fiber angles was implemented in the model. The presence of fiber angles increased the longitudinal shear stiffness of the material, resulting in a higher strength in compression. The simulations showed a large increase of the strength in compression for lower values of the standard deviation of the fiber angle, and a slight decrease of strength in compression for lower values of the mean fiber angle. The strength observed in the experiments was achieved with the minimum local angle standard deviation observed in the CFRS rods, whereas the shear stiffness measured in torsion tests was achieved with the overall fiber angle distribution observed in the CFRS rods.

High strain composites exhibit good bending capabilities, but they tend to be soft out-of-plane. To achieve a higher out-of-plane stiffness, the concept of dual-matrix composites is introduced. Dual-matrix composites are foldable composites which are soft in the crease regions and stiff elsewhere. Previous attempts to fabricate continuous dual-matrix fiber composite shells had limited performance due to excessive resin flow and matrix mixing. An alternative method, presented in this thesis uses UV-cure silicone and fiberglass to avoid these problems. Preliminary experiments on the effect of folding on the out-of-plane stiffness are presented. An application to a conical log-periodic antenna for CubeSats is proposed, using origami-inspired stowing schemes, that allow a conical dual-matrix composite shell to reach very high compaction ratios.

Part I. Influence of membrane morphology on ion-exchange and charge propagation in composite polyelectrolyte electrode coatings. Part II. Dynamic surface tension measurements of polarization relaxation at mercury pool electrodes by the method of Wilhelmy.

Part I. Novel composite polyelectrolyte materials were developed that exhibit desirable charge propagation and ion-retention properties. The morphology of electrode coatings cast from these materials was shown to be more important for its electrochemical behavior than its chemical composition.

Part II. The Wilhelmy plate technique for measuring dynamic surface tension was extended to electrified liquid-liquid interphases. The dynamical response of the aqueous NaF-mercury electrified interphase was examined by concomitant measurement of surface tension, current, and applied electrostatic potential. Observations of the surface tension response to linear sweep voltammetry and to step function perturbations in the applied electrostatic potential (e.g., chronotensiometry) provided strong evidence that relaxation processes proceed for time-periods that are at least an order of magnitude longer than the time periods necessary to establish diffusion equilibrium. The dynamical response of the surface tension is analyzed within the context of non-equilibrium thermodynamics and a kinetic model that requires three simultaneous first order processes.

Convex Relaxation for Low-Dimensional Representation: Phase Transitions and Limitations

There is a growing interest in taking advantage of possible patterns and structures in data so as to extract the desired information and overcome the curse of dimensionality. In a wide range of applications, including computer vision, machine learning, medical imaging, and social networks, the signal that gives rise to the observations can be modeled to be approximately sparse and exploiting this fact can be very beneficial. This has led to an immense interest in the problem of efficiently reconstructing a sparse signal from limited linear observations. More recently, low-rank approximation techniques have become prominent tools to approach problems arising in machine learning, system identification and quantum tomography.

In sparse and low-rank estimation problems, the challenge is the inherent intractability of the objective function, and one needs efficient methods to capture the low-dimensionality of these models. Convex optimization is often a promising tool to attack such problems. An intractable problem with a combinatorial objective can often be "relaxed" to obtain a tractable but almost as powerful convex optimization problem. This dissertation studies convex optimization techniques that can take advantage of low-dimensional representations of the underlying high-dimensional data. We provide provable guarantees that ensure that the proposed algorithms will succeed under reasonable conditions, and answer questions of the following flavor:

More specifically, i) Focusing on linear inverse problems, we generalize the classical error bounds known for the least-squares technique to the lasso formulation, which incorporates the signal model. ii) We show that intuitive convex approaches do not perform as well as expected when it comes to signals that have multiple low-dimensional structures simultaneously. iii) Finally, we propose convex relaxations for the graph clustering problem and give sharp performance guarantees for a family of graphs arising from the so-called stochastic block model. We pay particular attention to the following aspects. For i) and ii), we aim to provide a general geometric framework, in which the results on sparse and low-rank estimation can be obtained as special cases. For i) and iii), we investigate the precise performance characterization, which yields the right constants in our bounds and the true dependence between the problem parameters.

Part I. Synthesis of L-amino acid oxidase by a serine- or glycine-requiring strain of neurospora. Part II. Studies concerning multiple electrophoretic forms of tyrosinase in neurospora

Part I: Synthesis of L-Amino Acid Oxidase by a Serine- or Glycine-Requiring Strain of Neurospora

Wild-type cultures of Neurospora crassa growing on minimal medium contain low levels of L-amino acid oxidase, tyrosinase, and nicotinarnide adenine dinucleotide glycohydrase (NADase). The enzymes are derepressed by starvation and by a number of other conditions which are inhibitory to growth. L-amino acid oxidase is, in addition, induced by growth on amino acids. A mutant which produces large quantities of both L-amino acid oxidase and NADase when growing on minimal medium was investigated. Constitutive synthesis of L-amino acid oxidase was shown to be inherited as a single gene, called P110, which is separable from constitutive synthesis of NADase. P110 maps near the centromere on linkage group IV.

L-amino acid oxidase produced constitutively by P110 was partially purified and compared to partially purified L-amino acid oxidase produced by derepressed wild-type cultures. The enzymes are identical with respect to thermostability and molecular weight as judged by gel filtration.

The mutant P110 was shown to be an incompletely blocked auxotroph which requires serine or glycine. None of the enzymes involved in the synthesis of serine from 3-phosphoglyceric acid or glyceric acid was found to be deficient in the mutant, however. An investigation of the free intracellular amino acid pools of P110 indicated that the mutant is deficient in serine, glycine, and alanine, and accumulates threonine and homoserine.

The relationship between the amino acid requirement of P110 and its synthesis of L-amino acid oxidase is discussed.

Part II: Studies Concerning Multiple Electrophoretic Forms of Tyrosinase in Neurospora

Supernumerary bands shown by some crude tyrosinase preparations in paper electrophoresis were investigated. Genetic analysis indicated that the location of the extra bands is determined by the particular T allele present. The presence of supernumerary bands varies with the method used to derepress tyrosinase production, and with the duration of derepression. The extra bands are unstable and may convert to the major electrophoretic band, suggesting that they result from modification of a single protein. Attempts to isolate the supernumerary bands by continuous flow paper electrophoresis or density gradient zonal electrophoresis were unsuccessful.

I. Electron spin relaxation studies of manganese(II) complexes in acetonitrile. II. Nuclear spin relaxation studies of bromine in tetrabromomanganese(II) in acetonitrile

Magnetic resonance techniques have given us a powerful means for investigating dynamical processes in gases, liquids and solids. Dynamical effects manifest themselves in both resonance line shifts and linewidths, and, accordingly, require detailed analyses to extract desired information. The success of a magnetic resonance experiment depends critically on relaxation mechanisms to maintain thermal equilibrium between spin states. Consequently, there must be an interaction between the excited spin states and their immediate molecular environment which promote changes in spin orientation while excess magnetic energy is coupled into other degrees of freedom by non-radiative processes. This is well known as spin-lattice relaxation. Certain dynamical processes cause fluctuations in the spin state energy levels leading to spin-spin relaxation and, here again, the environment at the molecular level plays a significant role in the magnitude of interaction. Relatively few electron spin relaxation studies of solutions have been conducted and the present work is addressed toward the extension of our knowledge in this area and the retrieval of dynamical information from line shape analyses on a time scale comparable to diffusion controlled phenomena.

Specifically, the electron spin relaxation of three Mn⁺²3d⁵ complexes, Mn(CH₃CN)₆⁺², MnCl₄^-2 in acetonitrile has been studied in considerable detail. The effective spin Hamiltonian constants were carefully evaluated under a wide range of experimental conditions. Resonance widths of these Mn⁺² complexes were studied in the presence of various excess ligand ions and as a function of concentration, viscosity, temperature and frequency (X-band, ~9.5 Ԍ Hz and K-band, ~35 Ԍ Hz).

A number of interesting conclusions were drawn from these studies. For the Et₄NCl-₄^-2 system several relaxation mechanisms leading to resonance broadening were observed. One source appears to arise through spin-orbit interactions caused by modulation of the ligand field resulting from transient distortions of the complex imparted by solvent fluctuations in the immediate surroundings of the paramagnetic ion. An additional spin relaxation was assigned to the formation of ion pairs [Et₄N⁺…MnCl₄^-2] and it was possible to estimate the dissociation constant for this specie in acetonitrile.

The Bu₄NBr-MnBr₄^-2 study was considerably more interesting. As in the former case, solvent fluctuations and ion-pairing of the paramagnetic complex [Bu₄N⁺…MnBr₄^-2] provide significant relaxation for the electronic spin system. Most interesting, without doubt, is the onset of a new relaxation mechanism leading to resonance broadening which is best interpreted as chemical exchange. Thus, assuming that resonance widths were simply governed by electron spin state lifetimes, we were able to extract dynamical information from an interaction in which the initial and final states are the same

MnBr₄^-2 + Br^- = MnBr₄^-2 + Br^-.

The bimolecular rate constants were obtained at six different temperatures and their magnitudes suggested that the exchange is probably diffusion controlled with essentially a zero energy of activation. The most important source of spin relaxation in this system stems directly from dipolar interactions between the manganese 3d⁵ electrons. Moreover, the dipolar broadening is strongly frequency dependent indicating a deviation between the transverse and longitudinal relaxation times. We are led to the conclusion that the 3d⁵ spin states of ion-paired MnBr₄^-2 are significantly correlated so that dynamical processes are also entering the picture. It was possible to estimate the correlation time, ^Td, characterizing this dynamical process.

In Part II we study nuclear magnetic relaxation of bromine ions in the MnBr4-2-Bu4NBr-acetonitrile system. Essentially we monitor the 79Br and 81Br linewidths in response to the [MnBr4-2]/[Br-] ratio with the express purpose of supporting our contention that exchange is occurring between "free" bromine ions in the solvent and bromine in the first coordination sphere of the paramagnetic anion. The complexity of the system elicited a two-part study: (1) the linewidth behavior of Bu4NBr in anhydrous CH3CN in the absence of MnBr4-2 and (2) in the presence of MnBr4-2. It was concluded in study (1) that dynamical association, Bu4NBr k1= Bu4N+ + Br-, was modulating field-gradient interactions at frequencies high enough to provide an estimation of the unimolecular rate constant, k1. A comparison of the two isotopic bromine linewidth-mole fraction results led to the conclusion that quadrupole interactions provided the dominant relaxation mechanism. In study (2) the "residual" bromine linewidths for both 79Br and 81Br are clearly controlled by quadrupole interactions which appear to be modulated by very rapid dynamical processes other than molecular reorientation. We conclude that the "residual" linewidth has its origin in chemical exchange and that bromine nuclei exchange rapidly between a "free" solvated ion and the paramagnetic complex, MnBr4-2.

Mössbauer effect investigations of the hyperfine interactions and relaxation phenomena in salts of thulium

Two new phenomena have been observed in Mössbauer spectra: a temperature-dependent shift of the center of gravity of the spectrum, and an asymmetric broadening of the spectrum peaks. Both phenomena were observed in thulium salts. In the temperature range 1˚K ≤ T ≤ 5˚K the observed shift has an approximate inverse temperature dependence. We explain this on the basis of a Van Vleck type of interaction between the magnetic moment of two nearly degenerate electronic levels and the magnetic moment of the nucleus. From the size of the shift we are able to deduce an “effective magnetic field” H = (6.0 ± 0.1) x 10⁶ Gauss, which is proportional to ‹r^-3›_M‹G|J|E› where ‹r^-3›_M is an effective magnetic radial integral for the 4f electrons and |G› and |E› are the lowest 4f electronic states in Tm Cl₃·6H₂O. From the temperature dependence of the shift we have derived a preliminary value of 1 cm^-1 for the splitting of these two states. The observed asymmetric line broadening is independent of temperature in the range 1˚K ≤ T ≤ 5˚K, but is dependent on the concentration of thulium ions in the crystal. We explain this broadening on the basis of spin-spin interactions between thulium ions. From size and concentration dependence of the broadening we are able to deduce a spin-spin relaxation time for Tm Cl₃·6H₂O of the order of 10^-11 sec.

Observation and interpretation of tectonic strain release mechanisms

In four chapters various aspects of earthquake source are studied.

Chapter I

Surface displacements that followed the Parkfield, 1966, earthquakes were measured for two years with six small-scale geodetic networks straddling the fault trace. The logarithmic rate and the periodic nature of the creep displacement recorded on a strain meter made it possible to predict creep episodes on the San Andreas fault. Some individual earthquakes were related directly to surface displacement, while in general, slow creep and aftershock activity were found to occur independently. The Parkfield earthquake is interpreted as a buried dislocation.

Chapter II

The source parameters of earthquakes between magnitude 1 and 6 were studied using field observations, fault plane solutions, and surface wave and S-wave spectral analysis. The seismic moment, M_O, was found to be related to local magnitude, M_L, by log M_O = 1.7 M_L + 15.1. The source length vs magnitude relation for the San Andreas system found to be: M_L = 1.9 log L - 6.7. The surface wave envelope parameter AR gives the moment according to log M_O = log AR₃₀₀ + 30.1, and the stress drop, τ, was found to be related to the magnitude by τ = 0.54 M - 2.58. The relation between surface wave magnitude M_S and M_L is proposed to be M_S = 1.7 M_L - 4.1. It is proposed to estimate the relative stress level (and possibly the strength) of a source-region by the amplitude ratio of high-frequency to low-frequency waves. An apparent stress map for Southern California is presented.

Chapter III

Seismic triggering and seismic shaking are proposed as two closely related mechanisms of strain release which explain observations of the character of the P wave generated by the Alaskan earthquake of 1964, and distant fault slippage observed after the Borrego Mountain, California earthquake of 1968. The Alaska, 1964, earthquake is shown to be adequately described as a series of individual rupture events. The first of these events had a body wave magnitude of 6.6 and is considered to have initiated or triggered the whole sequence. The propagation velocity of the disturbance is estimated to be 3.5 km/sec. On the basis of circumstantial evidence it is proposed that the Borrego Mountain, 1968, earthquake caused release of tectonic strain along three active faults at distances of 45 to 75 km from the epicenter. It is suggested that this mechanism of strain release is best described as "seismic shaking."

Chapter IV

The changes of apparent stress with depth are studied in the South American deep seismic zone. For shallow earthquakes the apparent stress is 20 bars on the average, the same as for earthquakes in the Aleutians and on Oceanic Ridges. At depths between 50 and 150 km the apparent stresses are relatively high, approximately 380 bars, and around 600 km depth they are again near 20 bars. The seismic efficiency is estimated to be 0.1. This suggests that the true stress is obtained by multiplying the apparent stress by ten. The variation of apparent stress with depth is explained in terms of the hypothesis of ocean floor consumption.

I. Proton magnetic resonance of polynucleotides and transfer RNA. II. Electron spin relaxation studies of manganese (II) complexes in acetonitrile

Part I. Proton Magnetic Resonance of Polynucleotides and Transfer RNA.

Proton magnetic resonance was used to follow the temperature dependent intramolecular stacking of the bases in the polynucleotides of adenine and cytosine. Analysis of the results on the basis of a two state stacked-unstacked model yielded values of -4.5 kcal/mole and -9.5 kcal/mole for the enthalpies of stacking in polyadenylic and polycytidylic acid, respectively.

The interaction of purine with these molecules was also studied by pmr. Analysis of these results and the comparison of the thermal unstacking of polynucleotides and short chain nucleotides indicates that the bases contained in stacks within the long chain poly nucleotides are, on the average, closer together than the bases contained in stacks in the short chain nucleotides.

Temperature and purine studies were also carried out with an aqueous solution of formylmethionine transfer ribonucleic acid. Comparison of these results with the results of similar experiments with the homopolynucleotides of adenine, cytosine and uracil indicate that the purine is probably intercalating into loop regions of the molecule.

The solvent denaturation of phenylalanine transfer ribonucleic acid was followed by pmr. In a solvent mixture containing 83 volume per cent dimethylsulf oxide and 17 per cent deuterium oxide, the tRNA molecule is rendered quite flexible. It is possible to resolve resonances of protons on the common bases and on certain modified bases.

Part II. Electron Spin Relaxation Studies of Manganese (II) Complexes in Acetonitrile.

The electron paramagnetic resonance spectra of three Mn⁺² complexes, [Mn(CH₃CN)₆]⁺², [MnCl₄]^-2, and [MnBr₄]^-2, in acetonitrile were studied in detail. The objective of this study was to relate changes in the effective spin Hamiltonian parameters and the resonance line widths to the structure of these molecular complexes as well as to dynamical processes in solution.

Of the three systems studied, the results obtained from the [Mn(CH₃CN)₆]⁺² system were the most straight-forward to interpret. Resonance broadening attributable to manganese spin-spin dipolar interactions was observed as the manganese concentration was increased.

In the [MnCl₄]^-2 system, solvent fluctuations and dynamical ion-pairing appear to be significant in determining electron spin relaxation.

In the [MnBr₄]^-2 system, solvent fluctuations, ion-pairing, and Br- ligand exchange provide the principal means of electron spin relaxation. It was also found that the spin relaxation in this system is dependent upon the field strength and is directly related to the manganese concentration. A relaxation theory based on a two state collisional model was developed to account for the observed behavior.