Various algorithms for optimization and learning in adaptive systems

This thesis discusses various methods for learning and optimization in adaptive systems. Overall, it emphasizes the relationship between optimization, learning, and adaptive systems; and it illustrates the influence of underlying hardware upon the construction of efficient algorithms for learning and optimization. Chapter 1 provides a summary and an overview.

Chapter 2 discusses a method for using feed-forward neural networks to filter the noise out of noise-corrupted signals. The networks use back-propagation learning, but they use it in a way that qualifies as unsupervised learning. The networks adapt based only on the raw input data-there are no external teachers providing information on correct operation during training. The chapter contains an analysis of the learning and develops a simple expression that, based only on the geometry of the network, predicts performance.

Chapter 3 explains a simple model of the piriform cortex, an area in the brain involved in the processing of olfactory information. The model was used to explore the possible effect of acetylcholine on learning and on odor classification. According to the model, the piriform cortex can classify odors better when acetylcholine is present during learning but not present during recall. This is interesting since it suggests that learning and recall might be separate neurochemical modes (corresponding to whether or not acetylcholine is present). When acetylcholine is turned off at all times, even during learning, the model exhibits behavior somewhat similar to Alzheimer's disease, a disease associated with the degeneration of cells that distribute acetylcholine.

Chapters 4, 5, and 6 discuss algorithms appropriate for adaptive systems implemented entirely in analog hardware. The algorithms inject noise into the systems and correlate the noise with the outputs of the systems. This allows them to estimate gradients and to implement noisy versions of gradient descent, without having to calculate gradients explicitly. The methods require only noise generators, adders, multipliers, integrators, and differentiators; and the number of devices needed scales linearly with the number of adjustable parameters in the adaptive systems. With the exception of one global signal, the algorithms require only local information exchange.

Synthesis of (±)-7,8-epoxy-4-basmen-6-one by a transannular cyclization strategy

The first synthesis of the cembranoid natural product (±)-7,8-epoxy-4-basmen-6- one (1) is described. Key steps of the synthetic route include the cationic cyclization of the acid chloride from 15 to provide the macrocycle 16, and the photochemical transannular radical cyclization of the ester 41 to form the tricyclic product 50. Product 50 was transformed into 1 in ten steps. Transition-state molecular modeling studies were found to provide accurate predictions of the structural and stereochemical outcomes of cyclization reactions explored experimentally in the development of the synthetic route to 1. These investigations should prove valuable in the development of transannular cyclization as a strategy for synthetic simplification.

Geometric integration applied to moving mesh methods and degenerate Lagrangians

Moving mesh methods (also called r-adaptive methods) are space-adaptive strategies used for the numerical simulation of time-dependent partial differential equations. These methods keep the total number of mesh points fixed during the simulation, but redistribute them over time to follow the areas where a higher mesh point density is required. There are a very limited number of moving mesh methods designed for solving field-theoretic partial differential equations, and the numerical analysis of the resulting schemes is challenging. In this thesis we present two ways to construct r-adaptive variational and multisymplectic integrators for (1+1)-dimensional Lagrangian field theories. The first method uses a variational discretization of the physical equations and the mesh equations are then coupled in a way typical of the existing r-adaptive schemes. The second method treats the mesh points as pseudo-particles and incorporates their dynamics directly into the variational principle. A user-specified adaptation strategy is then enforced through Lagrange multipliers as a constraint on the dynamics of both the physical field and the mesh points. We discuss the advantages and limitations of our methods. The proposed methods are readily applicable to (weakly) non-degenerate field theories---numerical results for the Sine-Gordon equation are presented.

In an attempt to extend our approach to degenerate field theories, in the last part of this thesis we construct higher-order variational integrators for a class of degenerate systems described by Lagrangians that are linear in velocities. We analyze the geometry underlying such systems and develop the appropriate theory for variational integration. Our main observation is that the evolution takes place on the primary constraint and the 'Hamiltonian' equations of motion can be formulated as an index 1 differential-algebraic system. We then proceed to construct variational Runge-Kutta methods and analyze their properties. The general properties of Runge-Kutta methods depend on the 'velocity' part of the Lagrangian. If the 'velocity' part is also linear in the position coordinate, then we show that non-partitioned variational Runge-Kutta methods are equivalent to integration of the corresponding first-order Euler-Lagrange equations, which have the form of a Poisson system with a constant structure matrix, and the classical properties of the Runge-Kutta method are retained. If the 'velocity' part is nonlinear in the position coordinate, we observe a reduction of the order of convergence, which is typical of numerical integration of DAEs. We also apply our methods to several models and present the results of our numerical experiments.

A unified strategy to ent-kauranoid natural products : total syntheses of (–)-maoecrystal Z, (–)-trichorabdal A, and (–)-longikaurin E

The diterpenoid constituents of the Isodon plants have attracted reasearchers interested in both their chemical structures and biological properties for more than a half-century. In recent years, the isolations of new members displaying previously unprecedented ring systems and highly selective biological properties have piqued interest from the synthetic community in this class of natural products.

Reported herein is the first total synthesis of such a recently isolated diterpenoid, (–)-maoecrystal Z. The principal transformations implemented in this synthesis include two highly diastereoselective radical cyclization reactions: a Sm^(II)-mediated reductive cascade cyclization, which forms two rings and establishes four new stereocenters in a single step, and a Ti^(III)-mediated reductive epoxide-acrylate coupling that yields a functionalized spirolactone product, which forms a core bicycle of maoecrystal Z.

The preparation of two additional ent-kauranoid natural products, (–)-trichorabdal A and (–)-longikaurin E, is also described from a derivative of this key spirolactone. These syntheses are additionally enabled by the palladium-mediated oxidative cyclization reaction of a silyl ketene acetal precursor that is used to install the bridgehead all-carbon quaternary stereocenter and bicyclo[3.2.1]octane present in each natural product. These studies have established a synthetic relationship among three architecturally distinct ent-kaurane diterpenoids and have forged a path for the preparation of interesting unnatural ent-kauranoid structural analogs for more thorough biological study.

How resources control aggression in Drosophila

How animals use sensory information to weigh the risks vs. benefits of behavioral decisions remains poorly understood. Inter-male aggression is triggered when animals perceive both the presence of an appetitive resource, such as food or females, and of competing conspecific males. How such signals are detected and integrated to control the decision to fight is not clear. Here we use the vinegar fly, Drosophila melanogaster, to investigate the manner in which food and females promotes aggression.

In the first chapter, we explore how food controls aggression. As in many other species, food promotes aggression in flies, but it is not clear whether food increases aggression per se, or whether aggression is a secondary consequence of increased social interactions caused by aggregation of flies on food. Furthermore, nothing is known about how animals evaluate the quality and quantity of food in the context of competition. We show that food promotes aggression independently of any effect to increase the frequency of contact between males. Food increases aggression but not courtship between males, suggesting that the effect of food on aggression is specific. Next, we show that flies tune the level of aggression according to absolute amount of food rather than other parameters, such as area or concentration of food. Sucrose, a sugar molecule present in many fruits, is sufficient to promote aggression, and detection of sugar via gustatory receptor neurons is necessary for food-promoted aggression. Furthermore, we show that while food is necessary for aggression, too much food decreases aggression. Finally, we show that flies exhibit strategies consistent with a territorial strategy. These data suggest that flies use sweet-sensing gustatory information to guide their decision to fight over a limited quantity of a food resource.

Following up on the findings of the first chapter, we asked how the presence of a conspecific female resource promotes male-male aggression. In the absence of food, group-housed male flies, who normally do not fight even in the presence of food, fight in the presence of females. Unlike food, the presence of females strongly influences proximity between flies. Nevertheless, as group-housed flies do not fight even when they are in small chambers, it is unlikely that the presence of female indirectly increases aggression by first increasing proximity. Unlike food, the presence of females also leads to large increases in locomotion and in male-female courtship behaviors, suggesting that females may influence aggression as well as general arousal. Female cuticular hydrocarbons are required for this effect, as females that do not produce CH pheromones are unable to promote male-male aggression. In particular, 7,11-HD––a female-specific cuticular hydrocarbon pheromone critical for male-female courtship––is sufficient to mediate this effect when it is perfumed onto pheromone-deficient females or males. Recent studies showed that ppk23⁺ GRNs label two population of GRNs, one of which detects male cuticular hydrocarbons and another labeled by ppk23 and ppk25, which detects female cuticular hydrocarbons. I show that in particular, both of these GRNs control aggression, presumably via detection of female or male pheromones. To further investigate the ways in which these two classes of GRNs control aggression, I developed new genetic tools to independently test the male- and female-sensing GRNs. I show that ppk25-LexA and ppk25-GAL80 faithfully recapitulate the expression pattern of ppk25-GAL4 and label a subset of ppk23⁺ GRNs. These tools can be used in future studies to dissect the respective functions of male-sensing and female-sensing GRNs in male social behaviors.

Finally, in the last chapter, I discuss quantitative approaches to describe how varying quantities of food and females could control the level of aggression. Flies show an inverse-U shaped aggressive response to varying quantities of food and a flat aggressive response to varying quantities of females. I show how two simple game theoretic models, “prisoner’s dilemma” and “coordination game” could be used to describe the level of aggression we observe. These results suggest that flies may use strategic decision-making, using simple comparisons of costs and benefits.

In conclusion, male-male aggression in Drosophila is controlled by simple gustatory cues from food and females, which are detected by gustatory receptor neurons. Different quantities of resource cues lead to different levels of aggression, and flies show putative territorial behavior, suggesting that fly aggression is a highly strategic adaptive behavior. How these resource cues are integrated with male pheromone cues and give rise to this complex behavior is an interesting subject, which should keep researchers busy in the coming years.

Applications of a Concise and General Strategy for the Syntheses of Transtaganolide and Basiliolide Natural Products

Herein are described the total syntheses of all members of the transtaganolide and basiliolide natural product family. Utilitzation of an Ireland–Claisen rearrangement/Diels–Alder cycloaddition cascade (ICR/DA) allowed for rapid assembly of the transtaganolide and basiliolide oxabicyclo[2.2.2]octane core. This methodology is general and was applicable to all members of the natural product family.

A brief introduction outlines all the synthetic progress previously disclosed by Lee, Dudley, and Johansson. This also includes the initial syntheses of transtaganolides C and D, as well as basiliolide B and epi-basiliolide B accomplished by Stoltz in 2011. Lastly, we discuss our racemic synthesis of basililide C and epi-basiliolide C, which utilized an ICR/DA cascade to constuct the oxabicyclo[2.2.2]octane core and formal [5+2] annulation to form the ketene-acetal containing 7-membered C-ring.

Next, we describe a strategy for an asymmetric ICR/DA cascade, by incorporation of a chiral silane directing group. This allowed for enantioselective construction of the C8 all-carbon quaternary center formed in the Ireland–Claisen rearrangement. Furthermore, a single hydride reduction and subsequent translactonization of a C4 methylester bearing oxabicyclo[2.2.2]octane core demonstrated a viable strategy for the desired skeletal rearrangement to obtain pentacyclic transtaganolides A and B. Application of the asymmetric strategy culminated in the total syntheses of (–)-transtaganolide A, (+)-transtaganolide B, (+)-transtaganolide C, and (–)-transtaganolide D. Comparison of the optical rotation data of the synthetically derived transtaganolides to that from the isolated counterparts has overarching biosynthetic implications which are discussed.

Lastly, improvement to the formal [5+2] annulation strategy is described. Negishi cross-coupling of methoxyethynyl zinc chloride using a palladium Xantphos catalyst is optimized for iodo-cyclohexene. Application of this technology to an iodo-pyrone geranyl ester allowed for formation and isolation of the eneyne product. Hydration of the enenye product forms natural metabolite basiliopyrone. Furthermore, the eneyne product can undergo an ICR/DA cascade and form transtaganolides C and D in a single step from an achiral monocyclic precursor.