Optimal uncertainty quantification via convex optimization and relaxation

Many engineering applications face the problem of bounding the expected value of a quantity of interest (performance, risk, cost, etc.) that depends on stochastic uncertainties whose probability distribution is not known exactly. Optimal uncertainty quantification (OUQ) is a framework that aims at obtaining the best bound in these situations by explicitly incorporating available information about the distribution. Unfortunately, this often leads to non-convex optimization problems that are numerically expensive to solve.

This thesis emphasizes on efficient numerical algorithms for OUQ problems. It begins by investigating several classes of OUQ problems that can be reformulated as convex optimization problems. Conditions on the objective function and information constraints under which a convex formulation exists are presented. Since the size of the optimization problem can become quite large, solutions for scaling up are also discussed. Finally, the capability of analyzing a practical system through such convex formulations is demonstrated by a numerical example of energy storage placement in power grids.

When an equivalent convex formulation is unavailable, it is possible to find a convex problem that provides a meaningful bound for the original problem, also known as a convex relaxation. As an example, the thesis investigates the setting used in Hoeffding's inequality. The naive formulation requires solving a collection of non-convex polynomial optimization problems whose number grows doubly exponentially. After structures such as symmetry are exploited, it is shown that both the number and the size of the polynomial optimization problems can be reduced significantly. Each polynomial optimization problem is then bounded by its convex relaxation using sums-of-squares. These bounds are found to be tight in all the numerical examples tested in the thesis and are significantly better than Hoeffding's bounds.

Social saliency : visual psychophysics and single-neuron recordings in humans

My thesis studies how people pay attention to other people and the environment. How does the brain figure out what is important and what are the neural mechanisms underlying attention? What is special about salient social cues compared to salient non-social cues? In Chapter I, I review social cues that attract attention, with an emphasis on the neurobiology of these social cues. I also review neurological and psychiatric links: the relationship between saliency, the amygdala and autism. The first empirical chapter then begins by noting that people constantly move in the environment. In Chapter II, I study the spatial cues that attract attention during locomotion using a cued speeded discrimination task. I found that when the motion was expansive, attention was attracted towards the singular point of the optic flow (the focus of expansion, FOE) in a sustained fashion. The more ecologically valid the motion features became (e.g., temporal expansion of each object, spatial depth structure implied by distribution of the size of the objects), the stronger the attentional effects. However, compared to inanimate objects and cues, people preferentially attend to animals and faces, a process in which the amygdala is thought to play an important role. To directly compare social cues and non-social cues in the same experiment and investigate the neural structures processing social cues, in Chapter III, I employ a change detection task and test four rare patients with bilateral amygdala lesions. All four amygdala patients showed a normal pattern of reliably faster and more accurate detection of animate stimuli, suggesting that advantageous processing of social cues can be preserved even without the amygdala, a key structure of the “social brain”. People not only attend to faces, but also pay attention to others’ facial emotions and analyze faces in great detail. Humans have a dedicated system for processing faces and the amygdala has long been associated with a key role in recognizing facial emotions. In Chapter IV, I study the neural mechanisms of emotion perception and find that single neurons in the human amygdala are selective for subjective judgment of others’ emotions. Lastly, people typically pay special attention to faces and people, but people with autism spectrum disorders (ASD) might not. To further study social attention and explore possible deficits of social attention in autism, in Chapter V, I employ a visual search task and show that people with ASD have reduced attention, especially social attention, to target-congruent objects in the search array. This deficit cannot be explained by low-level visual properties of the stimuli and is independent of the amygdala, but it is dependent on task demands. Overall, through visual psychophysics with concurrent eye-tracking, my thesis found and analyzed socially salient cues and compared social vs. non-social cues and healthy vs. clinical populations. Neural mechanisms underlying social saliency were elucidated through electrophysiology and lesion studies. I finally propose further research questions based on the findings in my thesis and introduce my follow-up studies and preliminary results beyond the scope of this thesis in the very last section, Future Directions.

Spectroscopic investigations of inter- and intramolecular processes in crystalline benzene

I. Introductory Remarks

A brief discussion of the overall organization of the thesis is presented along with a discussion of the relationship between this thesis and previous work on the spectroscopic properties of benzene.

II. Radiationless Transitions and Line broadening

Radiationless rates have been calculated for the ³B_1u→¹A_1g transitions of benzene and perdeuterobenzene as well as for the ¹B_2u→¹A_1g transition of benzene. The rates were calculated using a model that considers the radiationless transition as a tunneling process between two multi-demensional potential surfaces and assuming both harmonic and anharmonic vibrational potentials. Whenever possible experimental parameters were used in the calculation. To this end we have obtained experimental values for the anharmonicities of the carbon-carbon and carbon-hydrogen vibrations and the size of the lowest triplet state of benzene. The use of the breakdown of the Born-Oppenheimer approximation in describing radiationless transitions is critically examined and it is concluded that Herzberg-Teller vibronic coupling is 100 times more efficient at inducing radiationless transitions.

The results of the radiationless transition rate calculation are used to calculate line broadening in several of the excited electronic states of benzene. The calculated line broadening in all cases is in qualitative agreement with experimental line widths.

III. ³B_1u←¹A_1g Absorption Spectra

The ³B_1u←¹A_1g absorption spectra of C₆H₆ and C₆D₆ at 4.2˚K have been obtained at high resolution using the phosphorescence photoexcitation method. The spectrum exhibits very clear evidence of a pseudo-Jahn-Teller distortion of the normally hexagonal benzene molecule upon excitation to the triplet state. Factor group splitting of the 0 – 0 and 0 – 0 + v exciton bands have also been observed. The position of the mean of the 0 – 0 exciton band of C₆H₆ when compared to the phosphorescence origin of a C₆H₆ guest in a C₆D₆ host crystal indicates that the “static” intermolecular interactions between guest and hose are different for C₆H₆ and C₆D₆. Further investigation of this difference using the currently accepted theory of isotopic mixed crystals indicates that there is a 2cm^-1 shift of the ideal mixed crystal level per hot deuterium atom. This shift is observed for both the singlet and triplet states of benzene.

IV. ³E_1u←¹A_1g, Absorption Spectra

The ³E_1u←¹A_1g absorption spectra of C₆H₆ and C₆D₆ at 4.2˚K have been obtained using the phosphorescence photoexcitation technique. In both cases the spectrum is broad and structureless as would be expected from the line broadening calculations.

Distributed Optimal Control of Cyber-Physical Systems: Controller Synthesis, Architecture Design and System Identification

The centralized paradigm of a single controller and a single plant upon which modern control theory is built is no longer applicable to modern cyber-physical systems of interest, such as the power-grid, software defined networks or automated highways systems, as these are all large-scale and spatially distributed. Both the scale and the distributed nature of these systems has motivated the decentralization of control schemes into local sub-controllers that measure, exchange and act on locally available subsets of the globally available system information. This decentralization of control logic leads to different decision makers acting on asymmetric information sets, introduces the need for coordination between them, and perhaps not surprisingly makes the resulting optimal control problem much harder to solve. In fact, shortly after such questions were posed, it was realized that seemingly simple decentralized optimal control problems are computationally intractable to solve, with the Wistenhausen counterexample being a famous instance of this phenomenon. Spurred on by this perhaps discouraging result, a concerted 40 year effort to identify tractable classes of distributed optimal control problems culminated in the notion of quadratic invariance, which loosely states that if sub-controllers can exchange information with each other at least as quickly as the effect of their control actions propagates through the plant, then the resulting distributed optimal control problem admits a convex formulation.

The identification of quadratic invariance as an appropriate means of "convexifying" distributed optimal control problems led to a renewed enthusiasm in the controller synthesis community, resulting in a rich set of results over the past decade. The contributions of this thesis can be seen as being a part of this broader family of results, with a particular focus on closing the gap between theory and practice by relaxing or removing assumptions made in the traditional distributed optimal control framework. Our contributions are to the foundational theory of distributed optimal control, and fall under three broad categories, namely controller synthesis, architecture design and system identification.

We begin by providing two novel controller synthesis algorithms. The first is a solution to the distributed H-infinity optimal control problem subject to delay constraints, and provides the only known exact characterization of delay-constrained distributed controllers satisfying an H-infinity norm bound. The second is an explicit dynamic programming solution to a two player LQR state-feedback problem with varying delays. Accommodating varying delays represents an important first step in combining distributed optimal control theory with the area of Networked Control Systems that considers lossy channels in the feedback loop. Our next set of results are concerned with controller architecture design. When designing controllers for large-scale systems, the architectural aspects of the controller such as the placement of actuators, sensors, and the communication links between them can no longer be taken as given -- indeed the task of designing this architecture is now as important as the design of the control laws themselves. To address this task, we formulate the Regularization for Design (RFD) framework, which is a unifying computationally tractable approach, based on the model matching framework and atomic norm regularization, for the simultaneous co-design of a structured optimal controller and the architecture needed to implement it. Our final result is a contribution to distributed system identification. Traditional system identification techniques such as subspace identification are not computationally scalable, and destroy rather than leverage any a priori information about the system's interconnection structure. We argue that in the context of system identification, an essential building block of any scalable algorithm is the ability to estimate local dynamics within a large interconnected system. To that end we propose a promising heuristic for identifying the dynamics of a subsystem that is still connected to a large system. We exploit the fact that the transfer function of the local dynamics is low-order, but full-rank, while the transfer function of the global dynamics is high-order, but low-rank, to formulate this separation task as a nuclear norm minimization problem. Finally, we conclude with a brief discussion of future research directions, with a particular emphasis on how to incorporate the results of this thesis, and those of optimal control theory in general, into a broader theory of dynamics, control and optimization in layered architectures.

Transition metal clusters supported by multinucleating ligand frameworks as models of biological active sites

This dissertation describes efforts to model biological active sites with small molecule clusters. The approach used took advantage of a multinucleating ligand to control the structure and nuclearity of the product complexes, allowing the study of many different homo- and heterometallic clusters. Chapter 2 describes the synthesis of the multinucleating hexapyridyl trialkoxy ligand used throughout this thesis and the synthesis of trinuclear first row transition metal complexes supported by this framework, with an emphasis on tricopper systems as models of biological multicopper oxidases. The magnetic susceptibility of these complexes were studied, and a linear relation was found between the Cu-O(alkoxide)-Cu angles and the antiferromagnetic coupling between copper centers. The triiron(II) and trizinc(II) complexes of the ligand were also isolated and structurally characterized.

Chapter 3 describes the synthesis of a series of heterometallic tetranuclear manganese dioxido complexes with various incorporated apical redox-inactive metal cations (M = Na⁺, Ca²⁺, Sr²⁺, Zn²⁺, Y³⁺). Chapter 4 presents the synthesis of heterometallic trimanganese(IV) tetraoxido complexes structurally related to the CaMn₃ subsite of the oxygen-evolving complex (OEC) of Photosystem II. The reduction potentials of these complexes were studied, and it was found that each isostructural series displays a linear correlation between the reduction potentials and the Lewis acidities of the incorporated redox-inactive metals. The slopes of the plotted lines for both the dioxido and tetraoxido clusters are the same, suggesting a more general relationship between the electrochemical potentials of heterometallic manganese oxido clusters and their “spectator” cations. Additionally, these studies suggest that Ca²⁺ plays a role in modulating the redox potential of the OEC for water oxidation.

Chapter 5 presents studies of the effects of the redox-inactive metals on the reactivities of the heterometallic manganese complexes discussed in Chapters 3 and 4. Oxygen atom transfer from the clusters to phosphines is studied; although the reactivity is kinetically controlled in the tetraoxido clusters, the dioxido clusters with more Lewis acidic metal ions (Y³⁺ vs. Ca²⁺) appear to be more reactive. Investigations of hydrogen atom transfer and electron transfer rates are also discussed.

Appendix A describes the synthesis, and metallation reactions of a new dinucleating bis(N-heterocyclic carbene)ligand framework. Dicopper(I) and dicobalt(II) complexes of this ligand were prepared and structurally characterized. A dinickel(I) dichloride complex was synthesized, reduced, and found to activate carbon dioxide. Appendix B describes preliminary efforts to desymmetrize the manganese oxido clusters via functionalization of the basal multinucleating ligand used in the preceding sections of this dissertation. Finally, Appendix C presents some partially characterized side products and unexpected structures that were isolated throughout the course of these studies.