Methods for integrating machine learning and constrained optimization

In the framework of industrial problems, the application of Constrained Optimization is known to have overall very good modeling capability and performance and stands as one of the most powerful, explored, and exploited tool to address prescriptive tasks. The number of applications is huge, ranging from logistics to transportation, packing, production, telecommunication, scheduling, and much more. The main reason behind this success is to be found in the remarkable effort put in the last decades by the OR community to develop realistic models and devise exact or approximate methods to solve the largest variety of constrained or combinatorial optimization problems, together with the spread of computational power and easily accessible OR software and resources. On the other hand, the technological advancements lead to a data wealth never seen before and increasingly push towards methods able to extract useful knowledge from them; among the data-driven methods, Machine Learning techniques appear to be one of the most promising, thanks to its successes in domains like Image Recognition, Natural Language Processes and playing games, but also the amount of research involved. The purpose of the present research is to study how Machine Learning and Constrained Optimization can be used together to achieve systems able to leverage the strengths of both methods: this would open the way to exploiting decades of research on resolution techniques for COPs and constructing models able to adapt and learn from available data. In the first part of this work, we survey the existing techniques and classify them according to the type, method, or scope of the integration; subsequently, we introduce a novel and general algorithm devised to inject knowledge into learning models through constraints, Moving Target. In the last part of the thesis, two applications stemming from real-world projects and done in collaboration with Optit will be presented.

Valorization of bio-alcohols into added value chemicals

The present research work focused on the valorisation and upgrading of bio-ethanol over heterogeneous catalysts in a lab-scale continuous gas-flow system. In the Unibo laboratories, catalytic tests have been carried out in the temperature range 300-600°C by feeding an ethanol/He mixture in the reactor. After choosing the reaction conditions, ion-exchanged hydroxyapatite with transition metals (i.e., Fe, Cu) and alkaline earth metal (i.e., Sr) have been synthesized and tested. The Sr-HAP catalyst led to the formation of a complex reaction mixture the composition of which need further optimization in order to fill the requisite to be used as fuel-blend. Then, some zirconium-oxide based catalysts have been prepared through two different methods, precipitation and hydrothermal, by varying some synthetic parameters (i.e., pH, the nature of the base) and by adding a transition metal as dopant agent (i.e., Ti and Y). The presence of a dopant into the zirconia structure favoured the stabilization of the tetragonal or cubic phase against the monoclinic one. Interestingly, 5%mol Ti-doped zirconia exhibited a different catalytic behaviour yielding diethyl ether as major product at 300°C, while all the others samples produced mainly ethylene. Then, the effect of acid-base properties of sepiolite, using alkali metals (i.e., Na, K, Cs) with different metal loading (i.e., 2, 4, 5, 7, 14 wt%) as promoters, and of the redox properties of sepiolite-supported CuO or NiO, on the catalytic conversion of ethanol into n-butanol has been investigated. Thermal treated sepiolite samples mainly acted as acid catalyst, yielding preferentially the dehydration products of ethanol (ethylene and diethyl ether). Best results in terms of activity (ethanol conversion, 59%) and n-butanol selectivity (30%) where obtained at 400ºC and a contact time, W/F, of 2 g/mL·s over the catalyst consisting of sepiolite calcined at 500ºC modified with 7 wt% of cesium.

Distributed optimization and games over networks: a system theoretical perspective

Several decision and control tasks involve networks of cyber-physical systems that need to be coordinated and controlled according to a fully-distributed paradigm involving only local communications without any central unit. This thesis focuses on distributed optimization and games over networks from a system theoretical perspective. In the addressed frameworks, we consider agents communicating only with neighbors and running distributed algorithms with optimization-oriented goals. The distinctive feature of this thesis is to interpret these algorithms as dynamical systems and, thus, to resort to powerful system theoretical tools for both their analysis and design. We first address the so-called consensus optimization setup. In this context, we provide an original system theoretical analysis of the well-known Gradient Tracking algorithm in the general case of nonconvex objective functions. Then, inspired by this method, we provide and study a series of extensions to improve the performance and to deal with more challenging settings like, e.g., the derivative-free framework or the online one. Subsequently, we tackle the recently emerged framework named distributed aggregative optimization. For this setup, we develop and analyze novel schemes to handle (i) online instances of the problem, (ii) ``personalized'' optimization frameworks, and (iii) feedback optimization settings. Finally, we adopt a system theoretical approach to address aggregative games over networks both in the presence or absence of linear coupling constraints among the decision variables of the players. In this context, we design and inspect novel fully-distributed algorithms, based on tracking mechanisms, that outperform state-of-the-art methods in finding the Nash equilibrium of the game.

Optimization of an innovative T6 heat treatment for the AlSi10Mg alloy processed by Laser-based Powder Bed Fusion: effect on microstructure, mechanical properties, and tribological behavior

Laser-based Powder Bed Fusion (L-PBF) technology is one of the most commonly used metal Additive Manufacturing (AM) techniques to produce highly customized and value-added parts. The AlSi10Mg alloy has received more attention in the L-PBF process due to its good printability, high strength/weight ratio, corrosion resistance, and relatively low cost. However, a deep understanding of the effect of heat treatments on this alloy's metastable microstructure is still required for developing tailored heat treatments for the L-PBF AlSi10Mg alloy to overcome the limits of the as-built condition. Several authors have already investigated the effects of conventional heat treatment on the microstructure and mechanical behavior of the L-PBF AlSi10Mg alloy but often overlooked the peculiarities of the starting supersatured and ultrafine microstructure induced by rapid solidification. For this reason, the effects of innovative T6 heat treatment (T6R) on the microstructure and mechanical behavior of the L-PBF AlSi10Mg alloy were assessed. The short solution soaking time (10 min) and the relatively low temperature (510 °C) reduced the typical porosity growth at high temperatures and led to a homogeneous distribution of fine globular Si particles in the Al matrix. In addition, it increased the amount of Mg and Si in the solid solution available for precipitation hardening during the aging step. The mechanical (at room temperature and 200 °C) and tribological properties of the T6R alloy were evaluated and compared with other solutions, especially with an optimized direct-aged alloy (T5 alloy). Results showed that the innovative T6R alloy exhibits the best mechanical trade-off between strength and ductility, the highest fatigue strength among the analyzed conditions, and interesting tribological behavior. Furthermore, the high-temperature mechanical performances of the heat-treated L-PBF AlSi10Mg alloy make it suitable for structural components operating in mild service conditions at 200 °C.

Drive up electrochemical and electrochemiluminescence signal through biosensing mechanism optimization

Biomarkers are biological indicators of human health conditions. Their ultra-sensitive quantification is of cardinal importance in clinical monitoring and early disease diagnosis. Biosensors are some worldwide simple and easy-to-use analytical devices as a matter of fact, biosensors using electrochemiluminescence (ECL) are one of the most promising biosensors that needs an ever-increasing sensitivity for improving its clinical effectiveness. The principal aspiration of this project is the investigation of the ECL generation mechanisms for enhancing the ECL intensity and the development of an ultrasensitive sensor, the use of metal-oxide materials (Mox) and the substitution of metal-free dyes. Novel dyes such as BODIPY, TADF are used to improve the sensitivity of ECL techniques thanks to their advantageous and tunable properties, enhancing the signal and also the ECL efficiency. Additionally, the use of Mox could be beneficial for the investigation of two different ECL mechanisms, which occur simultaneously. In this thesis, the investigation of size and distance effects on electrochemical (EC) mechanisms was carried out through the innovative combination of a standard detection system using different size of micromagnetic beads (MBs). That allowed the discovery of an unexpected and highly efficient mechanistic path for electrochemical generation at small distances from the electrode’s surface. The smallest MBs (0.1μm) demostrate an enhancement of electrochemical signal than the bigger one (2.8μm) until 4 times of magnitude. Finally, a novel ultrasensitive sensor, based on the coreactant-luminophores mechanism, was developed for the determination of whole viral genome specific for cardiac HBV and COVID-19 virus. In conclusion, the ECL and the use of EC techniques (such as amperometry), improved the understanding of mechanisms responsible for the ECL/EC signal led to a great enhancement in the signal.

Chemiluminescence – based bioanalytical devices for astrobiological, food safety and clinical applications

At the intersection of biology, chemistry, and engineering, biosensors are a multidisciplinary innovation that provide a cost-effective alternative to traditional laboratory techniques. Due to their advantages, biosensors are used in medical diagnostics, environmental monitoring, food safety and many other fields. The first part of the thesis is concerned with learning the state of the art of paper-based immunosensors with bioluminescent (BL) and chemiluminescent (CL) detection. The use of biospecific assays combined with CL detection and paper-based technology offers an optimal approach to creating analytical tools for on-site applications and we have focused on the specific areas that need to be considered more in order to ensure a future practical implementation of these methods in routine analyses. The subsequent part of the thesis addresses the development of an autonomous lab-on-chip platform for performing chemiluminescent-based bioassays in space environment, exploiting a CubeSat platform for astrobiological investigations. An origami-inspired microfluidic paper-based analytical device has been developed with the purpose of assesses its performance in space and to evaluate its functionality and the resilience of the (bio)molecules when exposed to a radiation-rich environment. Subsequently, we designed a paper-based assay to detect traces of ovalbumin in food samples, creating a user-friendly immunosensing platform. To this purpose, we developed an origami device that exploits a competitive immunoassay coupled with chemiluminescence detection and magnetic microbeads used to immobilize ovalbumin on paper. Finally, with the aim of exploring the use of biomimetic materials, an hydrogel-based chemiluminescence biosensor for the detection of H2O2 and glucose was developed. A guanosine hydrogel was prepared and loaded with luminol and hemin, miming a DNAzyme activity. Subsequently, the hydrogel was modified by incorporating glucose oxidase enzyme to enable glucose biosensing. The emitted photons were detected using a portable device equipped with a smartphone's CMOS (complementary metal oxide semiconductor) camera for CL emission detection.

Development of textile wearable chemical sensors

In this elaborate, a textile-based Organic Electrochemical Transistor (OECT) was first developed for the determination of uric acid in wound exudate based on the conductive polymer poly(3,4-ethylenedioxythiophene):polystyrene sulfonate (PEDOT:PSS), which was then coupled to an electrochemically gated textile transistor consisting of a composite of iridium oxide particles and PEDOT:PSS for pH monitoring in wound exudate. In that way a sensor for multiparameter monitoring of wound health status was assembled, including the ability to differentiate between a wet-dry status of the smart bandage by implementing impedance measurements exploiting the OECT architecture. Afterwards, for both wound management as well as generic health status tracking applications, a glass-based calcium sensor was developed employing polymeric ion-selective membranes on a novel architecture inspired by the Wrighton OECT configuration, which was later converted to a Proof-of-Concept textile prototype for wearable applications. Lastly, in collaboration with the King Abdullah University of Science and Technology (KAUST, Thuwal, Saudi Arabia) under the supervision of Prof. Sahika Inal, different types of ion-selective thiophene-based monomers were used to develop ion-selective conductive polymers to detect sodium ion by different methods, involving standard potentiometry and OECT-based approaches. The textile OECTs for uric acid detection performances were optimized by investigating the geometry effect on the instrumental response and the properties of the different textile materials involved in their production, with a special focus on the final application that implies the operativity in flow conditions to simulate the wound environment. The same testing route was followed for the multiparameter sensor and the calcium sensor prototype, with a particular care towards the ion-selective membrane composition and electrode conditioning protocol optimization. The sodium-selective polymer electrosynthesis was optimized in non-aqueous environments and was characterized by means of potentiostatic and potentiodynamic techniques coupled with Quartz Crystal Microbalance and spectrophotometric measurements.

Mind the gaps: cognitive-inspired AI for high-level visual sensemaking. Towards abstract concept image classification

The abundance of visual data and the push for robust AI are driving the need for automated visual sensemaking. Computer Vision (CV) faces growing demand for models that can discern not only what images "represent," but also what they "evoke." This is a demand for tools mimicking human perception at a high semantic level, categorizing images based on concepts like freedom, danger, or safety. However, automating this process is challenging due to entropy, scarcity, subjectivity, and ethical considerations. These challenges not only impact performance but also underscore the critical need for interoperability. This dissertation focuses on abstract concept-based (AC) image classification, guided by three technical principles: situated grounding, performance enhancement, and interpretability. We introduce ART-stract, a novel dataset of cultural images annotated with ACs, serving as the foundation for a series of experiments across four key domains: assessing the effectiveness of the end-to-end DL paradigm, exploring cognitive-inspired semantic intermediaries, incorporating cultural and commonsense aspects, and neuro-symbolic integration of sensory-perceptual data with cognitive-based knowledge. Our results demonstrate that integrating CV approaches with semantic technologies yields methods that surpass the current state of the art in AC image classification, outperforming the end-to-end deep vision paradigm. The results emphasize the role semantic technologies can play in developing both effective and interpretable systems, through the capturing, situating, and reasoning over knowledge related to visual data. Furthermore, this dissertation explores the complex interplay between technical and socio-technical factors. By merging technical expertise with an understanding of human and societal aspects, we advocate for responsible labeling and training practices in visual media. These insights and techniques not only advance efforts in CV and explainable artificial intelligence but also propel us toward an era of AI development that harmonizes technical prowess with deep awareness of its human and societal implications.