Exploiting the environment for structural health monitoring: Strategies, algorithms, and technologies

A densely built environment is a complex system of infrastructure, nature, and people closely interconnected and interacting. Vehicles, public transport, weather action, and sports activities constitute a manifold set of excitation and degradation sources for civil structures. In this context, operators should consider different factors in a holistic approach for assessing the structural health state. Vibration-based structural health monitoring (SHM) has demonstrated great potential as a decision-supporting tool to schedule maintenance interventions. However, most excitation sources are considered an issue for practical SHM applications since traditional methods are typically based on strict assumptions on input stationarity. Last-generation low-cost sensors present limitations related to a modest sensitivity and high noise floor compared to traditional instrumentation. If these devices are used for SHM in urban scenarios, short vibration recordings collected during high-intensity events and vehicle passage may be the only available datasets with a sufficient signal-to-noise ratio. While researchers have spent efforts to mitigate the effects of short-term phenomena in vibration-based SHM, the ultimate goal of this thesis is to exploit them and obtain valuable information on the structural health state. First, this thesis proposes strategies and algorithms for smart sensors operating individually or in a distributed computing framework to identify damage-sensitive features based on instantaneous modal parameters and influence lines. Ordinary traffic and people activities become essential sources of excitation, while human-powered vehicles, instrumented with smartphones, take the role of roving sensors in crowdsourced monitoring strategies. The technical and computational apparatus is optimized using in-memory computing technologies. Moreover, identifying additional local features can be particularly useful to support the damage assessment of complex structures. Thereby, smart coatings are studied to enable the self-sensing properties of ordinary structural elements. In this context, a machine-learning-aided tomography method is proposed to interpret the data provided by a nanocomposite paint interrogated electrically.

Sparse Signal Representation of Ultrasonic Signals for Structural Health Monitoring Applications

Assessment of the integrity of structural components is of great importance for aerospace systems, land and marine transportation, civil infrastructures and other biological and mechanical applications. Guided waves (GWs) based inspections are an attractive mean for structural health monitoring. In this thesis, the study and development of techniques for GW ultrasound signal analysis and compression in the context of non-destructive testing of structures will be presented. In guided wave inspections, it is necessary to address the problem of the dispersion compensation. A signal processing approach based on frequency warping was adopted. Such operator maps the frequencies axis through a function derived by the group velocity of the test material and it is used to remove the dependence on the travelled distance from the acquired signals. Such processing strategy was fruitfully applied for impact location and damage localization tasks in composite and aluminum panels. It has been shown that, basing on this processing tool, low power embedded system for GW structural monitoring can be implemented. Finally, a new procedure based on Compressive Sensing has been developed and applied for data reduction. Such procedure has also a beneficial effect in enhancing the accuracy of structural defects localization. This algorithm uses the convolutive model of the propagation of ultrasonic guided waves which takes advantage of a sparse signal representation in the warped frequency domain. The recovery from the compressed samples is based on an alternating minimization procedure which achieves both an accurate reconstruction of the ultrasonic signal and a precise estimation of waves time of flight. Such information is used to feed hyperbolic or elliptic localization procedures, for accurate impact or damage localization.

Intelligent Sensor Systems for Structural Health Monitoring Applications

The convergence between the recent developments in sensing technologies, data science, signal processing and advanced modelling has fostered a new paradigm to the Structural Health Monitoring (SHM) of engineered structures, which is the one based on intelligent sensors, i.e., embedded devices capable of stream processing data and/or performing structural inference in a self-contained and near-sensor manner. To efficiently exploit these intelligent sensor units for full-scale structural assessment, a joint effort is required to deal with instrumental aspects related to signal acquisition, conditioning and digitalization, and those pertaining to data management, data analytics and information sharing. In this framework, the main goal of this Thesis is to tackle the multi-faceted nature of the monitoring process, via a full-scale optimization of the hardware and software resources involved by the {SHM} system. The pursuit of this objective has required the investigation of both: i) transversal aspects common to multiple application domains at different abstraction levels (such as knowledge distillation, networking solutions, microsystem {HW} architectures), and ii) the specificities of the monitoring methodologies (vibrations, guided waves, acoustic emission monitoring). The key tools adopted in the proposed monitoring frameworks belong to the embedded signal processing field: namely, graph signal processing, compressed sensing, ARMA System Identification, digital data communication and TinyML.

Structural health monitoring of storage tanks

In this thesis, Ph.D candidate presents a compact sensor node (SN) designed for long-term and real-time acoustic emission (AE) monitoring of above ground storage tanks (ASTs). Each SN exploits up to three inexpensive low-frequency sensors based on piezoelectric diaphragms for effective leakage detection, and it is capable by means of built-in Digital Signal Processing functionalities to process the acquired time waveforms extracting the AE features usually required by testing protocols. Alternatively, capability to plug three high frequency AE sensors to a SN for corrosion simulated phenomena detection is envisaged and demonstrated. Another innovative aspect that the Ph.D candidate presents in this work is an alternative mathematical model of corrosion location on the bottom of the AST. This approach implies considering the three-dimensional localization model versus the two-dimensional commonly used according to the literature. This approach is aimed at significant optimization in the number of sensors in relation to the standard approach for solving localization problems as well as to allow filtering the false AE events related to the condensate droplets from AST ceiling. The technological implementation of this concept required the solution of a number of technical problems, such as the precise time of arrival (ToA) signal estimation, vertical localization of the AE source and multilaration solution that were discussed in detail in this work. To validate the developed prototype, several experimental campaigns were organized that included the simulation of target phenomena both in laboratory conditions and on a real water storage tank. The presented test results demonstrate the successful application of the developed AE system both for simulated leaks and for corrosion processes on the tank bottom. Mathematical and technological algorithms for localization and characterization of AE signals implemented during the development of the prototype are also confirmed by the test results.

Qualification of optical fiber sensors for the structural health monitoring of aerospace structures

In recent years, composite materials have revolutionized the design of many structures. Their superior mechanical properties and light weight make composites convenient over traditional metal structures for many applications. However, composite materials are susceptible to complex and challenging to predict damage behaviors due to their anisotropy nature. Therefore, structural Health Monitoring (SHM) can be a valuable tool to assess the damage and understand the physics underneath. Distributed Optical Fiber Sensors (DOFS) can be used to monitor several types of damage in composites. However, their implementation outside academia is still unsatisfactory. One of the hindrances is the lack of a rigorous methodology for uncertainty quantification, which is essential for the performance assessment of the monitoring system. The concept of Probability of Detection (POD) must function as the guiding light in this process. However, precautions must be taken since this tool was established for Non-Destructive Evaluation (NDE) rather than Structural Health Monitoring (SHM). In addition, although DOFS have been the object of numerous studies, a well-established POD methodology for their performance assessment is still missing. This thesis aims to develop a methodology to produce POD curves for DOFS in composite materials. The problem is analyzed considering several critical points, such as the strain transfer characterizing the DOFS and the development of an experimental and model-assisted methodology to understand the parameters that affect the DOFS performance.

Sensor networks optimization and software development for Structural Health Monitoring based on ultrasonic guided waves

The Structural Health Monitoring (SHM) research area is increasingly investigated due to its high potential in reducing the maintenance costs and in ensuring the systems safety in several industrial application fields. A growing demand of new SHM systems, permanently embedded into the structures, for savings in weight and cabling, comes from the aeronautical and aerospace application fields. As consequence, the embedded electronic devices are to be wirelessly connected and battery powered. As result, a low power consumption is requested. At the same time, high performance in defects or impacts detection and localization are to be ensured to assess the structural integrity. To achieve these goals, the design paradigms can be changed together with the associate signal processing. The present thesis proposes design strategies and unconventional solutions, suitable both for real-time monitoring and periodic inspections, relying on piezo-transducers and Ultrasonic Guided Waves. In the first context, arrays of closely located sensors were designed, according to appropriate optimality criteria, by exploiting sensors re-shaping and optimal positioning, to achieve improved damages/impacts localisation performance in noisy environments. An additional sensor re-shaping procedure was developed to tackle another well-known issue which arises in realistic scenario, namely the reverberation. A novel sensor, able to filter undesired mechanical boundaries reflections, was validated via simulations based on the Green's functions formalism and FEM. In the active SHM context, a novel design methodology was used to develop a single transducer, called Spectrum-Scanning Acoustic Transducer, to actively inspect a structure. It can estimate the number of defects and their distances with an accuracy of 2[cm]. It can also estimate the damage angular coordinate with an equivalent mainlobe aperture of 8[deg], when a 24[cm] radial gap between two defects is ensured. A suitable signal processing was developed in order to limit the computational cost, allowing its use with embedded electronic devices.

Numerical methods for the dispersion analysis of Guided Waves

The use of guided ultrasonic waves (GUW) has increased considerably in the fields of non-destructive (NDE) testing and structural health monitoring (SHM) due to their ability to perform long range inspections, to probe hidden areas as well as to provide a complete monitoring of the entire waveguide. Guided waves can be fully exploited only once their dispersive properties are known for the given waveguide. In this context, well stated analytical and numerical methods are represented by the Matrix family methods and the Semi Analytical Finite Element (SAFE) methods. However, while the former are limited to simple geometries of finite or infinite extent, the latter can model arbitrary cross-section waveguides of finite domain only. This thesis is aimed at developing three different numerical methods for modelling wave propagation in complex translational invariant systems. First, a classical SAFE formulation for viscoelastic waveguides is extended to account for a three dimensional translational invariant static prestress state. The effect of prestress, residual stress and applied loads on the dispersion properties of the guided waves is shown. Next, a two-and-a-half Boundary Element Method (2.5D BEM) for the dispersion analysis of damped guided waves in waveguides and cavities of arbitrary cross-section is proposed. The attenuation dispersive spectrum due to material damping and geometrical spreading of cavities with arbitrary shape is shown for the first time. Finally, a coupled SAFE-2.5D BEM framework is developed to study the dispersion characteristics of waves in viscoelastic waveguides of arbitrary geometry embedded in infinite solid or liquid media. Dispersion of leaky and non-leaky guided waves in terms of speed and attenuation, as well as the radiated wavefields, can be computed. The results obtained in this thesis can be helpful for the design of both actuation and sensing systems in practical application, as well as to tune experimental setup.

Embedded systems and advanced signal processing for Acousto- Ultrasonic Inspections

Non Destructive Testing (NDT) and Structural Health Monitoring (SHM) are becoming essential in many application contexts, e.g. civil, industrial, aerospace etc., to reduce structures maintenance costs and improve safety. Conventional inspection methods typically exploit bulky and expensive instruments and rely on highly demanding signal processing techniques. The pressing need to overcome these limitations is the common thread that guided the work presented in this Thesis. In the first part, a scalable, low-cost and multi-sensors smart sensor network is introduced. The capability of this technology to carry out accurate modal analysis on structures undergoing flexural vibrations has been validated by means of two experimental campaigns. Then, the suitability of low-cost piezoelectric disks in modal analysis has been demonstrated. To enable the use of this kind of sensing technology in such non conventional applications, ad hoc data merging algorithms have been developed. In the second part, instead, imaging algorithms for Lamb waves inspection (namely DMAS and DS-DMAS) have been implemented and validated. Results show that DMAS outperforms the canonical Delay and Sum (DAS) approach in terms of image resolution and contrast. Similarly, DS-DMAS can achieve better results than both DMAS and DAS by suppressing artefacts and noise. To exploit the full potential of these procedures, accurate group velocity estimations are required. Thus, novel wavefield analysis tools that can address the estimation of the dispersion curves from SLDV acquisitions have been investigated. An image segmentation technique (called DRLSE) was exploited in the k-space to draw out the wavenumber profile. The DRLSE method was compared with compressive sensing methods to extract the group and phase velocity information. The validation, performed on three different carbon fibre plates, showed that the proposed solutions can accurately determine the wavenumber and velocities in polar coordinates at multiple excitation frequencies.

Behaviour and applications of elastic waves in structures and metamaterials

The present thesis focuses on elastic waves behaviour in ordinary structures as well as in acousto-elastic metamaterials via numerical and experimental applications. After a brief introduction on the behaviour of elastic guided waves in the framework of non-destructive evaluation (NDE) and structural health monitoring (SHM) and on the study of elastic waves propagation in acousto-elastic metamaterials, dispersion curves for thin-walled beams and arbitrary cross-section waveguides are extracted via Semi-Analytical Finite Element (SAFE) methods. Thus, a novel strategy tackling signal dispersion to locate defects in irregular waveguides is proposed and numerically validated. Finally, a time-reversal and laser-vibrometry based procedure for impact location is numerically and experimentally tested. In the second part, an introduction and a brief review of the basic definitions necessary to describe acousto-elastic metamaterials is provided. A numerical approach to extract dispersion properties in such structures is highlighted. Afterwards, solid-solid and solid-fluid phononic systems are discussed via numerical applications. In particular, band structures and transmission power spectra are predicted for 1P-2D, 2P-2D and 2P-3D phononic systems. In addition, attenuation bands in the ultrasonic as well as in the sonic frequency regimes are experimentally investigated. In the experimental validation, PZTs in a pitch-catch configuration and laser vibrometric measurements are performed on a PVC phononic plate in the ultrasonic frequency range and sound insulation index is computed for a 2P-3D phononic barrier in the sonic frequency range. In both cases the numerical-experimental results comparison confirms the existence of the numerical predicted band-gaps. Finally, the feasibility of an innovative passive isolation strategy based on giant elastic metamaterials is numerically proved to be practical for civil structures. In particular, attenuation of seismic waves is demonstrated via finite elements analyses. Further, a parametric study shows that depending on the soil properties, such an earthquake-proof barrier could lead to significant reduction of the superstructure displacement.

PCM-based in-memory computing: architectures, circuits and applications

Analog In-memory Computing (AIMC) has been proposed in the context of Beyond Von Neumann architectures as a valid strategy to reduce internal data transfers energy consumption and latency, and to improve compute efficiency. The aim of AIMC is to perform computations within the memory unit, typically leveraging the physical features of memory devices. Among resistive Non-volatile Memories (NVMs), Phase-change Memory (PCM) has become a promising technology due to its intrinsic capability to store multilevel data. Hence, PCM technology is currently investigated to enhance the possibilities and the applications of AIMC. This thesis aims at exploring the potential of new PCM-based architectures as in-memory computational accelerators. In a first step, a preliminar experimental characterization of PCM devices has been carried out in an AIMC perspective. PCM cells non-idealities, such as time-drift, noise, and non-linearity have been studied to develop a dedicated multilevel programming algorithm. Measurement-based simulations have been then employed to evaluate the feasibility of PCM-based operations in the fields of Deep Neural Networks (DNNs) and Structural Health Monitoring (SHM). Moreover, a first testchip has been designed and tested to evaluate the hardware implementation of Multiply-and-Accumulate (MAC) operations employing PCM cells. This prototype experimentally demonstrates the possibility to reach a 95% MAC accuracy with a circuit-level compensation of cells time drift and non-linearity. Finally, empirical circuit behavior models have been included in simulations to assess the use of this technology in specific DNN applications, and to enhance the potentiality of this innovative computation approach.

Hardware-software design of embedded systems for intelligent sensing applications

This Thesis wants to highlight the importance of ad-hoc designed and developed embedded systems in the implementation of intelligent sensor networks. As evidence four areas of application are presented: Precision Agriculture, Bioengineering, Automotive and Structural Health Monitoring. For each field is reported one, or more, smart device design and developing, in addition to on-board elaborations, experimental validation and in field tests. In particular, it is presented the design and development of a fruit meter. In the bioengineering field, three different projects are reported, detailing the architectures implemented and the validation tests conducted. Two prototype realizations of an inner temperature measurement system in electric motors for an automotive application are then discussed. Lastly, the HW/SW design of a Smart Sensor Network is analyzed: the network features on-board data management and processing, integration in an IoT toolchain, Wireless Sensor Network developments and an AI framework for vibration-based structural assessment.

Directly training spiking neural networks for cyber-physical systems: from supervised to reinforcement learning

Spiking Neural Networks (SNNs) are bio-inspired Artificial Neural Networks (ANNs) utilizing discrete spiking signals, akin to neuron communication in the brain, making them ideal for real-time and energy-efficient Cyber-Physical Systems (CPSs). This thesis explores their potential in Structural Health Monitoring (SHM), leveraging low-cost MEMS accelerometers for early damage detection in motorway bridges. The study focuses on Long Short-Term SNNs (LSNNs), although their complex learning processes pose challenges. Comparing LSNNs with other ANN models and training algorithms for SHM, findings indicate LSNNs' effectiveness in damage identification, comparable to ANNs trained using traditional methods. Additionally, an optimized embedded LSNN implementation demonstrates a 54% reduction in execution time, but with longer pre-processing due to spike-based encoding. Furthermore, SNNs are applied in UAV obstacle avoidance, trained directly using a Reinforcement Learning (RL) algorithm with event-based input from a Dynamic Vision Sensor (DVS). Performance evaluation against Convolutional Neural Networks (CNNs) highlights SNNs' superior energy efficiency, showing a 6x decrease in energy consumption. The study also investigates embedded SNN implementations' latency and throughput in real-world deployments, emphasizing their potential for energy-efficient monitoring systems. This research contributes to advancing SHM and UAV obstacle avoidance through SNNs' efficient information processing and decision-making capabilities within CPS domains.

Marine biodiversity survey in the Northern Red Sea: a large-scale monitoring carried out in collaboration with volunteer divers

Concerns over global change and its effect on coral reef survivorship have highlighted the need for long-term datasets and proxy records, to interpret environmental trends and inform policymakers. Citizen science programs have showed to be a valid method for collecting data, reducing financial and time costs for institutions. This study is based on the elaboration of data collected by recreational divers and its main purpose is to evaluate changes in the state of coral reef biodiversity in the Red Sea over a long term period and validate the volunteer-based monitoring method. Volunteers recreational divers completed a questionnaire after each dive, recording the presence of 72 animal taxa and negative reef conditions. Comparisons were made between records from volunteers and independent records from a marine biologist who performed the same dive at the same time. A total of 500 volunteers were tested in 78 validation trials. Relative values of accuracy, reliability and similarity seem to be comparable to those performed by volunteer divers on precise transects in other projects, or in community-based terrestrial monitoring. 9301 recreational divers participated in the monitoring program, completing 23,059 survey questionnaires in a 5-year period. The volunteer-sightings-based index showed significant differences between the geographical areas. The area of Hurghada is distinguished by a medium-low biodiversity index, heavily damaged by a not controlled anthropic exploitation. Coral reefs along the Ras Mohammed National Park at Sharm el Sheikh, conversely showed high biodiversity index. The detected pattern seems to be correlated with the conservation measures adopted. In our experience and that of other research institutes, citizen science can integrate conventional methods and significantly reduce costs and time. Involving recreational divers we were able to build a large data set, covering a wide geographic area. The main limitation remains the difficulty of obtaining an homogeneous spatial sampling distribution.

Smart Textile Sensors for Healthcare Monitoring

Wearable electronic textiles are an emerging research field playing a pivotal role among several different technological areas such as sensing, communication, clothing, health monitoring, information technology, and microsystems. The possibility to realise a fully-textile platform, endowed with various sensors directly realised with textile fibres and fabric, represents a new challenge for the entire research community. Among several high-performing materials, the intrinsically conductive poly(3,4-ethylenedioxythiophene) (PEDOT), doped with poly(styrenesulfonic acid) (PSS), or PEDOT:PSS, is one of the most representative and utilised, having an excellent chemical and thermal stability, as well as reversible doping state and high conductivity. This work relies on PEDOT:PSS combined with sensible materials to design, realise, and develop textile chemical and physical sensors. In particular, chloride concentration and pH level sensors in human sweat for continuous monitoring of the wearer's hydration status and stress level are reported. Additionally, a prototype smart bandage detecting the moisture level and pH value of a bed wound to allow the remote monitoring of the healing process of severe and chronic wounds is described. Physical sensors used to monitor the pressure distribution for rehabilitation, workplace safety, or sport tracking are also presented together with a novel fully-textile device able to measure the incident X-ray dose for medical or security applications where thin, comfortable, and flexible features are essential. Finally, a proof-of-concept for an organic-inorganic textile thermoelectric generator that harvests energy directly from body heat has been proposed. Though further efforts must be dedicated to overcome issues such as durability, washability, power consumption, and large-scale production, the novel, versatile, and widely encompassing area of electronic textiles is a promising protagonist in the upcoming technological revolution.