Distributed optimization in power networks and general multi-agent systems

The dissertation studies the general area of complex networked systems that consist of interconnected and active heterogeneous components and usually operate in uncertain environments and with incomplete information. Problems associated with those systems are typically large-scale and computationally intractable, yet they are also very well-structured and have features that can be exploited by appropriate modeling and computational methods. The goal of this thesis is to develop foundational theories and tools to exploit those structures that can lead to computationally-efficient and distributed solutions, and apply them to improve systems operations and architecture.

Specifically, the thesis focuses on two concrete areas. The first one is to design distributed rules to manage distributed energy resources in the power network. The power network is undergoing a fundamental transformation. The future smart grid, especially on the distribution system, will be a large-scale network of distributed energy resources (DERs), each introducing random and rapid fluctuations in power supply, demand, voltage and frequency. These DERs provide a tremendous opportunity for sustainability, efficiency, and power reliability. However, there are daunting technical challenges in managing these DERs and optimizing their operation. The focus of this dissertation is to develop scalable, distributed, and real-time control and optimization to achieve system-wide efficiency, reliability, and robustness for the future power grid. In particular, we will present how to explore the power network structure to design efficient and distributed market and algorithms for the energy management. We will also show how to connect the algorithms with physical dynamics and existing control mechanisms for real-time control in power networks.

The second focus is to develop distributed optimization rules for general multi-agent engineering systems. A central goal in multiagent systems is to design local control laws for the individual agents to ensure that the emergent global behavior is desirable with respect to the given system level objective. Ideally, a system designer seeks to satisfy this goal while conditioning each agent’s control on the least amount of information possible. Our work focused on achieving this goal using the framework of game theory. In particular, we derived a systematic methodology for designing local agent objective functions that guarantees (i) an equivalence between the resulting game-theoretic equilibria and the system level design objective and (ii) that the resulting game possesses an inherent structure that can be exploited for distributed learning, e.g., potential games. The control design can then be completed by applying any distributed learning algorithm that guarantees convergence to the game-theoretic equilibrium. One main advantage of this game theoretic approach is that it provides a hierarchical decomposition between the decomposition of the systemic objective (game design) and the specific local decision rules (distributed learning algorithms). This decomposition provides the system designer with tremendous flexibility to meet the design objectives and constraints inherent in a broad class of multiagent systems. Furthermore, in many settings the resulting controllers will be inherently robust to a host of uncertainties including asynchronous clock rates, delays in information, and component failures.

Tissue engineering active biological machines : bio-inspired design, directed self-assembly, and characterization of muscular pumps simulating the embryonic heart

Biological machines are active devices that are comprised of cells and other biological components. These functional devices are best suited for physiological environments that support cellular function and survival. Biological machines have the potential to revolutionize the engineering of biomedical devices intended for implantation, where the human body can provide the required physiological environment. For engineering such cell-based machines, bio-inspired design can serve as a guiding platform as it provides functionally proven designs that are attainable by living cells. In the present work, a systematic approach was used to tissue engineer one such machine by exclusively using biological building blocks and by employing a bio-inspired design. Valveless impedance pumps were constructed based on the working principles of the embryonic vertebrate heart and by using cells and tissue derived from rats. The function of these tissue-engineered muscular pumps was characterized by exploring their spatiotemporal and flow behavior in order to better understand the capabilities and limitations of cells when used as the engines of biological machines.

The oculomotor system: (1) Vertical-horizontal interaction and signal recognition, (2) Time delays and power spectra

In the first section of this thesis, two-dimensional properties of the human eye movement control system were studied. The vertical - horizontal interaction was investigated by using a two-dimensional target motion consisting of a sinusoid in one of the directions vertical or horizontal, and low-pass filtered Gaussian random motion of variable bandwidth (and hence information content) in the orthogonal direction. It was found that the random motion reduced the efficiency of the sinusoidal tracking. However, the sinusoidal tracking was only slightly dependent on the bandwidth of the random motion. Thus the system should be thought of as consisting of two independent channels with a small amount of mutual cross-talk.

These target motions were then rotated to discover whether or not the system is capable of recognizing the two-component nature of the target motion. That is, the sinusoid was presented along an oblique line (neither vertical nor horizontal) with the random motion orthogonal to it. The system did not simply track the vertical and horizontal components of motion, but rotated its frame of reference so that its two tracking channels coincided with the directions of the two target motion components. This recognition occurred even when the two orthogonal motions were both random, but with different bandwidths.

In the second section, time delays, prediction and power spectra were examined. Time delays were calculated in response to various periodic signals, various bandwidths of narrow-band Gaussian random motions and sinusoids. It was demonstrated that prediction occurred only when the target motion was periodic, and only if the harmonic content was such that the signal was sufficiently narrow-band. It appears as if general periodic motions are split into predictive and non-predictive components.

For unpredictable motions, the relationship between the time delay and the average speed of the retinal image was linear. Based on this I proposed a model explaining the time delays for both random and periodic motions. My experiments did not prove that the system is sampled data, or that it is continuous. However, the model can be interpreted as representative of a sample data system whose sample interval is a function of the target motion.

It was shown that increasing the bandwidth of the low-pass filtered Gaussian random motion resulted in an increase of the eye movement bandwidth. Some properties of the eyeball-muscle dynamics and the extraocular muscle "active state tension" were derived.

Kinematics and Local Motion Planning for Quasi-static Whole-body Mobile Manipulation

This thesis studies mobile robotic manipulators, where one or more robot manipulator arms are integrated with a mobile robotic base. The base could be a wheeled or tracked vehicle, or it might be a multi-limbed locomotor. As robots are increasingly deployed in complex and unstructured environments, the need for mobile manipulation increases. Mobile robotic assistants have the potential to revolutionize human lives in a large variety of settings including home, industrial and outdoor environments.

Mobile Manipulation is the use or study of such mobile robots as they interact with physical objects in their environment. As compared to fixed base manipulators, mobile manipulators can take advantage of the base mechanism’s added degrees of freedom in the task planning and execution process. But their use also poses new problems in the analysis and control of base system stability, and the planning of coordinated base and arm motions. For mobile manipulators to be successfully and efficiently used, a thorough understanding of their kinematics, stability, and capabilities is required. Moreover, because mobile manipulators typically possess a large number of actuators, new and efficient methods to coordinate their large numbers of degrees of freedom are needed to make them practically deployable. This thesis develops new kinematic and stability analyses of mobile manipulation, and new algorithms to efficiently plan their motions.

I first develop detailed and novel descriptions of the kinematics governing the operation of multi- limbed legged robots working in the presence of gravity, and whose limbs may also be simultaneously used for manipulation. The fundamental stance constraint that arises from simple assumptions about friction and the ground contact and feasible motions is derived. Thereafter, a local relationship between joint motions and motions of the robot abdomen and reaching limbs is developed. Baseeon these relationships, one can define and analyze local kinematic qualities including limberness, wrench resistance and local dexterity. While previous researchers have noted the similarity between multi- fingered grasping and quasi-static manipulation, this thesis makes explicit connections between these two problems.

The kinematic expressions form the basis for a local motion planning problem that that determines the joint motions to achieve several simultaneous objectives while maintaining stance stability in the presence of gravity. This problem is translated into a convex quadratic program entitled the balanced priority solution, whose existence and uniqueness properties are developed. This problem is related in spirit to the classical redundancy resoxlution and task-priority approaches. With some simple modifications, this local planning and optimization problem can be extended to handle a large variety of goals and constraints that arise in mobile-manipulation. This local planning problem applies readily to other mobile bases including wheeled and articulated bases. This thesis describes the use of the local planning techniques to generate global plans, as well as for use within a feedback loop. The work in this thesis is motivated in part by many practical tasks involving the Surrogate and RoboSimian robots at NASA/JPL, and a large number of examples involving the two robots, both real and simulated, are provided.

Finally, this thesis provides an analysis of simultaneous force and motion control for multi- limbed legged robots. Starting with a classical linear stiffness relationship, an analysis of this problem for multiple point contacts is described. The local velocity planning problem is extended to include generation of forces, as well as to maintain stability using force-feedback. This thesis also provides a concise, novel definition of static stability, and proves some conditions under which it is satisfied.

Contribution of the temporoammonic pathway to hippocampal processing

The temporoammonic (TA) pathway is the direct, monosynaptic projection from layer III of entorhinal cortex to the distal dendritic region of area CA1 of the hippo­ campus. Although this pathway has been implicated in various functions, such as memory encoding and retrieval, spatial navigation, generation of oscillatory activity, and control of hippocampal excitability, the details of its physiology are not well understood. In this thesis, I examine the contribution of the TA pathway to hippocampal processing. I find that, as has been previously reported, the TA pathway includes both excitatory, glutamatergic components and inhibitory, GABAergic components. Several new discoveries are reported in this thesis. I show that the TA pathway is subject to forms of short-term activity-dependent regulation, including paired-pulse and frequency­ dependent plasticity, similar to other hippocampal pathways such as the Schaffer collateral (SC) input from CA3 to CA1. The TA pathway provides a strongly excitatory input to stratum radiatum giant cells of CA1. The excitatory component of the TA pathway undergoes a long-lasting decrease in synaptic strength following low-frequency stimulation in a manner partially dependent on the activation of NMDA receptors. High­ frequency activation of the TA pathway recruits a feedforward inhibition that can prevent CA1 pyramidal cells from spiking in response to SC input; this spike-blocking effect shows that the TA pathway can act to regulate information flow through the hippocampal trisynaptic pathway.

Part I. Synchronization of the cell division cycle of HeLa cells in suspension cultures. Part II. Studies on chromosomal proteins of HeLa cells during the cell division cycle

Part I

These studies investigate the potential of single and double treatments with either 5-fluorodeoxyuridine of excess thymidine to induce cell division synchrony in suspension cultures of HeLa cells. The patterns of nucleic acid synthesis and cell proliferation have been analyzed in cultures thus synchronized. Several changes in cell population during long incubation with 5-fluorodeoxyuridine or excess thymidine are also described. These results are subjected to detailed evaluation in terms of the degree and quality of synchrony finally achieved.

Part II

Histones and non-histone proteins associated with interphase and metaphase chromosomes of HeLa cells have been qualitatively and quantitatively analyzed. Histones were fractionated by chromatography on Amberlite CG-50 and further characterized by analytical disc electrophoresis and amino acid analysis of each chromatographic fraction. It is concluded that histones of HeLa cells are comprised of only a small number of major components and that these components are homologous to those of other higher organisms. Of all the histones, arginine-rich histone III alone contains cysteine and can polymerize through formation of intermolecular disulfide bridges between histone III monomers.

A detailed comparison by chromatography and disc electrophoresis established that interphase and metaphase histones are made up of similar components. However, certain quantitative differences in proportions of different histones of interphase and metaphase cells are reported. Indirect evidence indicates that a certain proportion of metaphase histone III is polymerized through intermolecular disulfide links, whereas interphase histone III occurs mainly in the monomeric form.

Metaphase chromosomes are associated with an additional acid-soluble protein fraction which is absent from interphase chromosomes. All of these additional acid-soluble proteins of metaphase chromosomes are shown to be non-histones and it is concluded that the histone/DNA ratio is identical in interphase and metaphase chromosomes. The bulk of acid-soluble non-histone proteins of metaphase chromosomes were found to be polymerized through disulfide bridges; corresponding interphase non-histone proteins displayed no evidence of similar polymerization.

The factors responsible for the condensed configuration and metabolic inactivity of metaphase chromosomes are discussed in light of these findings.

The relationship between histone and DNA synthesis in nondividing differentiated chicken erythrocyte cells and in rapidly dividing undifferentiated HeLa cells is also investigated. Of all the histones, only arginine-rich histones are synthesized in mature erythrocytes. Histone synthesis in HeLa cells was studied in both unsynchronized and synchronized cultures. In HeLa cells, only part of the synthesis of all histone fractions is dependent on concurrent DNA synthesis, whereas all histones are synthesized in varying degrees even in the absence of DNA synthesis.