Distributed Large-scale Mixed-Integer Optimization with Application to Energy and Multi-robot Networks

Several decision and control tasks in cyber-physical networks can be formulated as large- scale optimization problems with coupling constraints. In these "constraint-coupled" problems, each agent is associated to a local decision variable, subject to individual constraints. This thesis explores the use of primal decomposition techniques to develop tailored distributed algorithms for this challenging set-up over graphs. We first develop a distributed scheme for convex problems over random time-varying graphs with non-uniform edge probabilities. The approach is then extended to unknown cost functions estimated online. Subsequently, we consider Mixed-Integer Linear Programs (MILPs), which are of great interest in smart grid control and cooperative robotics. We propose a distributed methodological framework to compute a feasible solution to the original MILP, with guaranteed suboptimality bounds, and extend it to general nonconvex problems. Monte Carlo simulations highlight that the approach represents a substantial breakthrough with respect to the state of the art, thus representing a valuable solution for new toolboxes addressing large-scale MILPs. We then propose a distributed Benders decomposition algorithm for asynchronous unreliable networks. The framework has been then used as starting point to develop distributed methodologies for a microgrid optimal control scenario. We develop an ad-hoc distributed strategy for a stochastic set-up with renewable energy sources, and show a case study with samples generated using Generative Adversarial Networks (GANs). We then introduce a software toolbox named ChoiRbot, based on the novel Robot Operating System 2, and show how it facilitates simulations and experiments in distributed multi-robot scenarios. Finally, we consider a Pickup-and-Delivery Vehicle Routing Problem for which we design a distributed method inspired to the approach of general MILPs, and show the efficacy through simulations and experiments in ChoiRbot with ground and aerial robots.

Design, synthesis and biological evaluation of dual inhibitors of GSK-3B and Fyn kinases for the study of inflammatory pathways in neurodegenerative diseases

Neuroinflammation represents a key hallmark of neurodegenerative diseases and is the result of a complex network of signaling cascades within microglial cells. A positive feedback loop exists between inflammation, microglia activation and protein misfolding processes, that, together with oxidative stress and excitotoxicity, lead to neuronal degeneration. Therefore, targeting this vicious cycle can be beneficial for mitigating neurodegeneration and cognitive decline in central nervous system disorders. At molecular level, GSK-3B and Fyn kinases play a crucial role in microglia activation and their deregulation has been associated to many neurodegenerative diseases. Thus, we envisioned their combined targeting as an effective approach to disrupt this toxic loop. Specifically in this project, a hit compound, based on a 7-azaindole-3-aminothiazole structure, was first identified in a virtual screening campaign, and displayed a weak dual inhibitory activity on GSK-3B and Fyn, unbalanced towards the former. Then, in a commitment to uncover the structural features required for modulating the activity on the two targets, we systematically manipulated this compound by inserting various substitution patterns in different positions. The most potent compounds obtained were advanced to deeper investigations to test their ability of tackling the inflammatory burden also in cellular systems and to unveil their binding modes within the catalytic pocket. The new class of molecules synthesized emerged as a valuable tool to deepen our understanding of the complex network governing the inflammatory events in neurodegenerative disorders.

Physical land degradation and loss of soil fertility: soil structural stability and bio-physical indicators

This study investigates the changes in soil fertility due to the different aggregate breakdown mechanisms and it analyses their relationships in different soil-plant systems, using physical aggregates behavior and organic matter (OM) changes as indicators. Three case studies were investigated: i) an organic agricultural soil, where a combined method, aimed to couple aggregate stability to nutrients loss, were tested; ii) a soil biosequence, where OM chemical characterisation and fractionation of aggregates on the basis of their physical behaviour were coupled and iii) a soils sequence in different phytoclimatic conditions, where isotopic C signature of separated aggregates was analysed. In agricultural soils the proposed combined method allows to identify that the severity of aggregate breakdown affected the quantity of nutrients lost more than nutrients availability, and that P, K and Mg were the most susceptible elements to water abrasion, while C and N were mainly susceptible to wetting. In the studied Chestnut-Douglas fir biosequence, OM chemical properties affected the relative importance of OM direct and indirect mechanisms (i.e., organic and organic-metallic cements, respectively) involved in aggregate stability and nutrient losses: under Douglas fir, high presence of carboxylate groups enhanced OM-metal interactions and stabilised aggregates; whereas under Chestnut, OM directly acted and fresh, more C-rich OM was preserved. OM direct mechanism seemed to be more efficient in C preservation in aggregates. The 13C natural abundance approach showed that, according to phytoclimatic conditions, stable macroaggregates can form both around partially decomposed OM and by organic-mineral interactions. In topsoils, aggregate resistance enhanced 13C-rich OM preservation, but in subsoils C preservation was due to other mechanisms, likely OM-mineral interactions. The proposed combined approach seems to be useful in the understanding of C and nutrients fate relates to water stresses, and in future research it could provide new insights into the complexity of soil biophysical processes.

Induction of Hebbian associative plasticity through paired non-invasive brain stimulation of premotor-motor areas to elucidate the network's functional role

The ventral premotor cortex (PMv) is believed to play a pivotal role in a multitude of visuomotor behaviors, such as sensory-guided goal-directed visuomotor transformations, arbitrary visuomotor mapping, and hyper-learnt visuomotor associations underlying automatic imitative tendencies. All these functions are likely carried out through the copious projections connecting PMv to the primary motor cortex (M1). Yet, causal evidence investigating the functional relevance of the PMv-M1 network remains elusive and scarce. In the studies reported in this thesis we addressed this issue using a transcranial magnetic stimulation (TMS) protocol called cortico-cortical paired associative stimulation (ccPAS), which relies on multisite stimulation to induce Hebbian spike-timing dependent plasticity (STDP) by repeatedly stimulating the pathway connecting two target areas to manipulate their connectivity. Firstly, we show that ccPAS protocols informed by both short- and long-latency PMv-M1 interactions effectively modulate connectivity between the two nodes. Then, by pre-activating the network to apply ccPAS in a state-dependent manner, we were able to selectively target specific functional visuo-motor pathways, demonstrating the relevance of PMv-M1 connectivity to arbitrary visuomotor mapping. Subsequently, we addressed the PMv-to-M1 role in automatic imitation, and demonstrated that its connectivity manipulation has a corresponding impact on automatic imitative tendencies. Finally, by combining dual-coil TMS connectivity assessments and ccPAS in young and elderly individuals, we traced effective connectivity of premotor-motor networks and tested their plasticity and relevance to manual dexterity and force in healthy ageing. Our findings provide unprecedent causal evidence of the functional role of the PMv-to-M1 network in young and elderly individuals. The studies presented in this thesis suggest that ccPAS can effectively modulate the strength of connectivity between targeted areas, and coherently manipulate a networks’ behavioral output. Results open new research prospects into the causal role of cortico-cortical connectivity, and provide necessary information to the development of clinical interventions based on connectivity manipulation.

A core calculus for the analysis and implementation of biologically inspired languages

The application of Concurrency Theory to Systems Biology is in its earliest stage of progress. The metaphor of cells as computing systems by Regev and Shapiro opened the employment of concurrent languages for the modelling of biological systems. Their peculiar characteristics led to the design of many bio-inspired formalisms which achieve higher faithfulness and specificity. In this thesis we present pi@, an extremely simple and conservative extension of the pi-calculus representing a keystone in this respect, thanks to its expressiveness capabilities. The pi@ calculus is obtained by the addition of polyadic synchronisation and priority to the pi-calculus, in order to achieve compartment semantics and atomicity of complex operations respectively. In its direct application to biological modelling, the stochastic variant of the calculus, Spi@, is shown able to model consistently several phenomena such as formation of molecular complexes, hierarchical subdivision of the system into compartments, inter-compartment reactions, dynamic reorganisation of compartment structure consistent with volume variation. The pivotal role of pi@ is evidenced by its capability of encoding in a compositional way several bio-inspired formalisms, so that it represents the optimal core of a framework for the analysis and implementation of bio-inspired languages. In this respect, the encodings of BioAmbients, Brane Calculi and a variant of P Systems in pi@ are formalised. The conciseness of their translation in pi@ allows their indirect comparison by means of their encodings. Furthermore it provides a ready-to-run implementation of minimal effort whose correctness is granted by the correctness of the respective encoding functions. Further important results of general validity are stated on the expressive power of priority. Several impossibility results are described, which clearly state the superior expressiveness of prioritised languages and the problems arising in the attempt of providing their parallel implementation. To this aim, a new setting in distributed computing (the last man standing problem) is singled out and exploited to prove the impossibility of providing a purely parallel implementation of priority by means of point-to-point or broadcast communication.

Structural changes and dynamic behaviour of vanadium oxide-based catalysts for gas-phase selective oxidations

Selective oxidation is one of the simplest functionalization methods and essentially all monomers used in manufacturing artificial fibers and plastics are obtained by catalytic oxidation processes. Formally, oxidation is considered as an increase in the oxidation number of the carbon atoms, then reactions such as dehydrogenation, ammoxidation, cyclization or chlorination are all oxidation reactions. In this field, most of processes for the synthesis of important chemicals used vanadium oxide-based catalysts. These catalytic systems are used either in the form of multicomponent mixed oxides and oxysalts, e.g., in the oxidation of n-butane (V/P/O) and of benzene (supported V/Mo/O) to maleic anhydride, or in the form of supported metal oxide, e.g., in the manufacture of phthalic anhydride by o-xylene oxidation, of sulphuric acid by oxidation of SO2, in the reduction of NOx with ammonia and in the ammoxidation of alkyl aromatics. In addition, supported vanadia catalysts have also been investigated for the oxidative dehydrogenation of alkanes to olefins , oxidation of pentane to maleic anhydride and the selective oxidation of methanol to formaldehyde or methyl formate [1]. During my PhD I focused my work on two gas phase selective oxidation reactions. The work was done at the Department of Industrial Chemistry and Materials (University of Bologna) in collaboration with Polynt SpA. Polynt is a leader company in the development, production and marketing of catalysts for gas-phase oxidation. In particular, I studied the catalytic system for n-butane oxidation to maleic anhydride (fluid bed technology) and for o-xylene oxidation to phthalic anhydride. Both reactions are catalyzed by systems based on vanadium, but catalysts are completely different. Part A is dedicated to the study of V/P/O catalyst for n-butane selective oxidation, while in the Part B the results of an investigation on TiO2-supported V2O5, catalyst for o-xylene oxidation are showed. In Part A, a general introduction about the importance of maleic anhydride, its uses, the industrial processes and the catalytic system are reported. The reaction is the only industrial direct oxidation of paraffins to a chemical intermediate. It is produced by n-butane oxidation either using fixed bed and fluid bed technology; in both cases the catalyst is the vanadyl pyrophosphate (VPP). Notwithstanding the good performances, the yield value didn’t exceed 60% and the system is continuously studied to improve activity and selectivity. The main open problem is the understanding of the real active phase working under reaction conditions. Several articles deal with the role of different crystalline and/or amorphous vanadium/phosphorous (VPO) compounds. In all cases, bulk VPP is assumed to constitute the core of the active phase, while two different hypotheses have been formulated concerning the catalytic surface. In one case the development of surface amorphous layers that play a direct role in the reaction is described, in the second case specific planes of crystalline VPP are assumed to contribute to the reaction pattern, and the redox process occurs reversibly between VPP and VOPO4. Both hypotheses are supported also by in-situ characterization techniques, but the experiments were performed with different catalysts and probably under slightly different working conditions. Due to complexity of the system, these differences could be the cause of the contradictions present in literature. Supposing that a key role could be played by P/V ratio, I prepared, characterized and tested two samples with different P/V ratio. Transformation occurring on catalytic surfaces under different conditions of temperature and gas-phase composition were studied by means of in-situ Raman spectroscopy, trying to investigate the changes that VPP undergoes during reaction. The goal is to understand which kind of compound constituting the catalyst surface is the most active and selective for butane oxidation reaction, and also which features the catalyst should possess to ensure the development of this surface (e.g. catalyst composition). On the basis of results from this study, it could be possible to project a new catalyst more active and selective with respect to the present ones. In fact, the second topic investigated is the possibility to reproduce the surface active layer of VPP onto a support. In general, supportation is a way to improve mechanical features of the catalysts and to overcome problems such as possible development of local hot spot temperatures, which could cause a decrease of selectivity at high conversion, and high costs of catalyst. In literature it is possible to find different works dealing with the development of supported catalysts, but in general intrinsic characteristics of VPP are worsened due to the chemical interaction between active phase and support. Moreover all these works deal with the supportation of VPP; on the contrary, my work is an attempt to build-up a V/P/O active layer on the surface of a zirconia support by thermal treatment of a precursor obtained by impregnation of a V5+ salt and of H3PO4. In-situ Raman analysis during the thermal treatment, as well as reactivity tests are used to investigate the parameters that may influence the generation of the active phase. Part B is devoted to the study of o-xylene oxidation of phthalic anhydride; industrially, the reaction is carried out in gas-phase using as catalysts a supported system formed by V2O5 on TiO2. The V/Ti/O system is quite complex; different vanadium species could be present on the titania surface, as a function of the vanadium content and of the titania surface area: (i) V species which is chemically bound to the support via oxo bridges (isolated V in octahedral or tetrahedral coordination, depending on the hydration degree), (ii) a polymeric species spread over titania, and (iii) bulk vanadium oxide, either amorphous or crystalline. The different species could have different catalytic properties therefore changing the relative amount of V species can be a way to optimize the catalytic performances of the system. For this reason, samples containing increasing amount of vanadium were prepared and tested in the oxidation of o-xylene, with the aim of find a correlations between V/Ti/O catalytic activity and the amount of the different vanadium species. The second part deals with the role of a gas-phase promoter. Catalytic surface can change under working conditions; the high temperatures and a different gas-phase composition could have an effect also on the formation of different V species. Furthermore, in the industrial practice, the vanadium oxide-based catalysts need the addition of gas-phase promoters in the feed stream, that although do not have a direct role in the reaction stoichiometry, when present leads to considerable improvement of catalytic performance. Starting point of my investigation is the possibility that steam, a component always present in oxidation reactions environment, could cause changes in the nature of catalytic surface under reaction conditions. For this reason, the dynamic phenomena occurring at the surface of a 7wt% V2O5 on TiO2 catalyst in the presence of steam is investigated by means of Raman spectroscopy. Moreover a correlation between the amount of the different vanadium species and catalytic performances have been searched. Finally, the role of dopants has been studied. The industrial V/Ti/O system contains several dopants; the nature and the relative amount of promoters may vary depending on catalyst supplier and on the technology employed for the process, either a single-bed or a multi-layer catalytic fixed-bed. Promoters have a quite remarkable effect on both activity and selectivity to phthalic anhydride. Their role is crucial, and the proper control of the relative amount of each component is fundamental for the process performance. Furthermore, it can not be excluded that the same promoter may play different role depending on reaction conditions (T, composition of gas phase..). The reaction network of phthalic anhydride formation is very complex and includes several parallel and consecutive reactions; for this reason a proper understanding of the role of each dopant cannot be separated from the analysis of the reaction scheme. One of the most important promoters at industrial level, which is always present in the catalytic formulations is Cs. It is known that Cs plays an important role on selectivity to phthalic anhydride, but the reasons of this phenomenon are not really clear. Therefore the effect of Cs on the reaction scheme has been investigated at two different temperature with the aim of evidencing in which step of the reaction network this promoter plays its role.

Self-organising coordination systems

Many research fields are pushing the engineering of large-scale, mobile, and open systems towards the adoption of techniques inspired by self-organisation: pervasive computing, but also distributed artificial intelligence, multi-agent systems, social networks, peer-topeer and grid architectures exploit adaptive techniques to make global system properties emerge in spite of the unpredictability of interactions and behaviour. Such a trend is visible also in coordination models and languages, whenever a coordination infrastructure needs to cope with managing interactions in highly dynamic and unpredictable environments. As a consequence, self-organisation can be regarded as a feasible metaphor to define a radically new conceptual coordination framework. The resulting framework defines a novel coordination paradigm, called self-organising coordination, based on the idea of spreading coordination media over the network, and charge them with services to manage interactions based on local criteria, resulting in the emergence of desired and fruitful global coordination properties of the system. Features like topology, locality, time-reactiveness, and stochastic behaviour play a key role in both the definition of such a conceptual framework and the consequent development of self-organising coordination services. According to this framework, the thesis presents several self-organising coordination techniques developed during the PhD course, mainly concerning data distribution in tuplespace-based coordination systems. Some of these techniques have been also implemented in ReSpecT, a coordination language for tuple spaces, based on logic tuples and reactions to events occurring in a tuple space. In addition, the key role played by simulation and formal verification has been investigated, leading to analysing how automatic verification techniques like probabilistic model checking can be exploited in order to formally prove the emergence of desired behaviours when dealing with coordination approaches based on self-organisation. To this end, a concrete case study is presented and discussed.

Mass Loss in Population II Red Giants: an IRAC@Spitzer Survey of Galactic Globular Clusters

With the goal of studying ML along the RGB, mid-IR observations of a carefully selected sample of 17 Galactic globular clusters (GGCs) with different metallicity and horizontal branch (HB) morphology have been secured with IRAC on board Spitzer: a global sample counting about 8000 giant has been obtained. Suitable complementary photometry in the optical and near-IR has been also secured in order to properly characterize the stellar counterparts to the Spitzer sources and their photospheric parameters. Stars with color (i.e. dust) excess have been identified, their likely circumstellar emission quantified and modelled, and empirical estimates of mass loss rates and timescales obtained. We find that mass loss rates increases with increasing stellar luminosity and decreasing metallicity. For a given luminosity, we find that ML rates are systematically higher than the prediction by extrapolating the Reimers law. CMDs constructed from ground based near-IR and IRAC bands show that at a given luminosity some stars have dusty envelopes and others do not. From this, we deduce that the mass loss is episodic and is ``on'' for some fraction of the time. The total mass lost on the RGB can be easily computed by multiplying ML rates by the ML timescales and integrating over the evolutionary timescale. The average total mass lost moderately increases with increasing metallicity, and for a given metallicity is systematically higher in clusters with extended blue HB.

Collaborative Change: Environmental Jolt, Network (Re)Design and Firm Performance

Motivated by the need to understand which are the underlying forces that trigger network evolution, we develop a multilevel theoretical and empirically testable model to examine the relationship between changes in the external environment and network change. We refer to network change as the dissolution or replacement of an interorganizational tie, adding also the case of the formation of new ties with new or preexisting partners. Previous research has paid scant attention to the organizational consequences of quantum change enveloping entire industries in favor of an emphasis on continuous change. To highlight radical change we introduce the concept of environmental jolt. The September 11 terrorist attacks provide us with a natural experiment to test our hypotheses on the antecedents and the consequences of network change. Since network change can be explained at multiple levels, we incorporate firm-level variables as moderators. The empirical setting is the global airline industry, which can be regarded as a constantly changing network of alliances. The study reveals that firms react to environmental jolts by forming homophilous ties and transitive triads as opposed to the non jolt periods. Moreover, we find that, all else being equal, firms that adopt a brokerage posture will have positive returns. However, we find that in the face of an environmental jolt brokerage relates negatively to firm performance. Furthermore, we find that the negative relationship between brokerage and performance during an environmental jolt is more significant for larger firms. Our findings suggest that jolts are an important predictor of network change, that they significantly affect operational returns and should be thus incorporated in studies of network dynamics.

Type Systems for Distributed Programs: Components and Sessions

Modern software systems, in particular distributed ones, are everywhere around us and are at the basis of our everyday activities. Hence, guaranteeing their cor- rectness, consistency and safety is of paramount importance. Their complexity makes the verification of such properties a very challenging task. It is natural to expect that these systems are reliable and above all usable. i) In order to be reliable, compositional models of software systems need to account for consistent dynamic reconfiguration, i.e., changing at runtime the communication patterns of a program. ii) In order to be useful, compositional models of software systems need to account for interaction, which can be seen as communication patterns among components which collaborate together to achieve a common task. The aim of the Ph.D. was to develop powerful techniques based on formal methods for the verification of correctness, consistency and safety properties related to dynamic reconfiguration and communication in complex distributed systems. In particular, static analysis techniques based on types and type systems appeared to be an adequate methodology, considering their success in guaranteeing not only basic safety properties, but also more sophisticated ones like, deadlock or livelock freedom in a concurrent setting. The main contributions of this dissertation are twofold. i) On the components side: we design types and a type system for a concurrent object-oriented calculus to statically ensure consistency of dynamic reconfigurations related to modifications of communication patterns in a program during execution time. ii) On the communication side: we study advanced safety properties related to communication in complex distributed systems like deadlock-freedom, livelock- freedom and progress. Most importantly, we exploit an encoding of types and terms of a typical distributed language, session π-calculus, into the standard typed π- calculus, in order to understand their expressive power.