Performance Evaluation of a Statistical and a Neural Network Model for Nonrigid Shape-Based Registration

Shape-based registration methods frequently encounters in the domains of computer vision, image processing and medical imaging. The registration problem is to find an optimal transformation/mapping between sets of rigid or nonrigid objects and to automatically solve for correspondences. In this paper we present a comparison of two different probabilistic methods, the entropy and the growing neural gas network (GNG), as general feature-based registration algorithms. Using entropy shape modelling is performed by connecting the point sets with the highest probability of curvature information, while with GNG the points sets are connected using nearest-neighbour relationships derived from competitive hebbian learning. In order to compare performances we use different levels of shape deformation starting with a simple shape 2D MRI brain ventricles and moving to more complicated shapes like hands. Results both quantitatively and qualitatively are given for both sets.

Guiding Monte Carlo tree searches with neural networks in the game of go

A dissertation submitted in fulfillment of the requirements to the degree of Master in Computer Science and Computer Engineering

A Learning Function for Parameter Reduction in Spiking Neural Networks with Radial Basis Function

Spiking neural networks - networks that encode information in the timing of spikes - are arising as a new approach in the artificial neural networks paradigm, emergent from cognitive science. One of these new models is the pulsed neural network with radial basis function, a network able to store information in the axonal propagation delay of neurons. Learning algorithms have been proposed to this model looking for mapping input pulses into output pulses. Recently, a new method was proposed to encode constant data into a temporal sequence of spikes, stimulating deeper studies in order to establish abilities and frontiers of this new approach. However, a well known problem of this kind of network is the high number of free parameters - more that 15 - to be properly configured or tuned in order to allow network convergence. This work presents for the first time a new learning function for this network training that allow the automatic configuration of one of the key network parameters: the synaptic weight decreasing factor.

Optimal control of non-linear systems through hybrid cell-mapping/artificial-neural-networks techniques

In this paper, a real-time optimal control technique for non-linear plants is proposed. The control system makes use of the cell-mapping (CM) techniques, widely used for the global analysis of highly non-linear systems. The CM framework is employed for designing approximate optimal controllers via a control variable discretization. Furthermore, CM-based designs can be improved by the use of supervised feedforward artificial neural networks (ANNs), which have proved to be universal and efficient tools for function approximation, providing also very fast responses. The quantitative nature of the approximate CM solutions fits very well with ANNs characteristics. Here, we propose several control architectures which combine, in a different manner, supervised neural networks and CM control algorithms. On the one hand, different CM control laws computed for various target objectives can be employed for training a neural network, explicitly including the target information in the input vectors. This way, tracking problems, in addition to regulation ones, can be addressed in a fast and unified manner, obtaining smooth, averaged and global feedback control laws. On the other hand, adjoining CM and ANNs are also combined into a hybrid architecture to address problems where accuracy and real-time response are critical. Finally, some optimal control problems are solved with the proposed CM, neural and hybrid techniques, illustrating their good performance.

Interpretable Convolutional Neural Networks for Decoding and Analyzing Neural Time Series Data

Machine learning is widely adopted to decode multi-variate neural time series, including electroencephalographic (EEG) and single-cell recordings. Recent solutions based on deep learning (DL) outperformed traditional decoders by automatically extracting relevant discriminative features from raw or minimally pre-processed signals. Convolutional Neural Networks (CNNs) have been successfully applied to EEG and are the most common DL-based EEG decoders in the state-of-the-art (SOA). However, the current research is affected by some limitations. SOA CNNs for EEG decoding usually exploit deep and heavy structures with the risk of overfitting small datasets, and architectures are often defined empirically. Furthermore, CNNs are mainly validated by designing within-subject decoders. Crucially, the automatically learned features mainly remain unexplored; conversely, interpreting these features may be of great value to use decoders also as analysis tools, highlighting neural signatures underlying the different decoded brain or behavioral states in a data-driven way. Lastly, SOA DL-based algorithms used to decode single-cell recordings rely on more complex, slower to train and less interpretable networks than CNNs, and the use of CNNs with these signals has not been investigated. This PhD research addresses the previous limitations, with reference to P300 and motor decoding from EEG, and motor decoding from single-neuron activity. CNNs were designed light, compact, and interpretable. Moreover, multiple training strategies were adopted, including transfer learning, which could reduce training times promoting the application of CNNs in practice. Furthermore, CNN-based EEG analyses were proposed to study neural features in the spatial, temporal and frequency domains, and proved to better highlight and enhance relevant neural features related to P300 and motor states than canonical EEG analyses. Remarkably, these analyses could be used, in perspective, to design novel EEG biomarkers for neurological or neurodevelopmental disorders. Lastly, CNNs were developed to decode single-neuron activity, providing a better compromise between performance and model complexity.

Directly training spiking neural networks for cyber-physical systems: from supervised to reinforcement learning

Spiking Neural Networks (SNNs) are bio-inspired Artificial Neural Networks (ANNs) utilizing discrete spiking signals, akin to neuron communication in the brain, making them ideal for real-time and energy-efficient Cyber-Physical Systems (CPSs). This thesis explores their potential in Structural Health Monitoring (SHM), leveraging low-cost MEMS accelerometers for early damage detection in motorway bridges. The study focuses on Long Short-Term SNNs (LSNNs), although their complex learning processes pose challenges. Comparing LSNNs with other ANN models and training algorithms for SHM, findings indicate LSNNs' effectiveness in damage identification, comparable to ANNs trained using traditional methods. Additionally, an optimized embedded LSNN implementation demonstrates a 54% reduction in execution time, but with longer pre-processing due to spike-based encoding. Furthermore, SNNs are applied in UAV obstacle avoidance, trained directly using a Reinforcement Learning (RL) algorithm with event-based input from a Dynamic Vision Sensor (DVS). Performance evaluation against Convolutional Neural Networks (CNNs) highlights SNNs' superior energy efficiency, showing a 6x decrease in energy consumption. The study also investigates embedded SNN implementations' latency and throughput in real-world deployments, emphasizing their potential for energy-efficient monitoring systems. This research contributes to advancing SHM and UAV obstacle avoidance through SNNs' efficient information processing and decision-making capabilities within CPS domains.

Convolutional Neural Network Architectures for Template Matching

The Neural Networks customized and tested in this thesis (WaldoNet, FlowNet and PatchNet) are a first exploration and approach to the Template Matching task. The possibilities of extension are therefore many and some are proposed below. During my thesis, I have analyzed the functioning of the classical algorithms and adapted with deep learning algorithms. The features extracted from both the template and the query images resemble the keypoints of the SIFT algorithm. Then, instead of similarity function or keypoints matching, WaldoNet and PatchNet use the convolutional layer to compare the features, while FlowNet uses the correlational layer. In addition, I have identified the major challenges of the Template Matching task (affine/non-affine transformations, intensity changes...) and solved them with a careful design of the dataset.

Neural Machine Translation in the Field of Law. Analysis and Evaluation against Human Reference of NMT Raw Outputs of an Atto Costitutivo of S.r.l. from Italian into German.

Artificial Intelligence (AI) is gaining ever more ground in every sphere of human life, to the point that it is now even used to pass sentences in courts. The use of AI in the field of Law is however deemed quite controversial, as it could provide more objectivity yet entail an abuse of power as well, given that bias in algorithms behind AI may cause lack of accuracy. As a product of AI, machine translation is being increasingly used in the field of Law too in order to translate laws, judgements, contracts, etc. between different languages and different legal systems. In the legal setting of Company Law, accuracy of the content and suitability of terminology play a crucial role within a translation task, as any addition or omission of content or mistranslation of terms could entail legal consequences for companies. The purpose of the present study is to first assess which neural machine translation system between DeepL and ModernMT produces a more suitable translation from Italian into German of the atto costitutivo of an Italian s.r.l. in terms of accuracy of the content and correctness of terminology, and then to assess which translation proves to be closer to a human reference translation. In order to achieve the above-mentioned aims, two human and automatic evaluations are carried out based on the MQM taxonomy and the BLEU metric. Results of both evaluations show an overall better performance delivered by ModernMT in terms of content accuracy, suitability of terminology, and closeness to a human translation. As emerged from the MQM-based evaluation, its accuracy and terminology errors account for just 8.43% (as opposed to DeepL’s 9.22%), while it obtains an overall BLEU score of 29.14 (against DeepL’s 27.02). The overall performances however show that machines still face barriers in overcoming semantic complexity, tackling polysemy, and choosing domain-specific terminology, which suggests that the discrepancy with human translation may still be remarkable.

Biased Random-key Genetic Algorithms For The Winner Determination Problem In Combinatorial Auctions.

Abstract In this paper, we address the problem of picking a subset of bids in a general combinatorial auction so as to maximize the overall profit using the first-price model. This winner determination problem assumes that a single bidding round is held to determine both the winners and prices to be paid. We introduce six variants of biased random-key genetic algorithms for this problem. Three of them use a novel initialization technique that makes use of solutions of intermediate linear programming relaxations of an exact mixed integer-linear programming model as initial chromosomes of the population. An experimental evaluation compares the effectiveness of the proposed algorithms with the standard mixed linear integer programming formulation, a specialized exact algorithm, and the best-performing heuristics proposed for this problem. The proposed algorithms are competitive and offer strong results, mainly for large-scale auctions.

Neural Mechanisms And Delayed Gastric Emptying Of Liquid Induced Through Acute Myocardial Infarction In Rats.

Background: In pathological situations, such as acute myocardial infarction, disorders of motility of the proximal gut can trigger symptoms like nausea and vomiting. Acute myocardial infarction delays gastric emptying (GE) of liquid in rats. Objective: Investigate the involvement of the vagus nerve, α 1-adrenoceptors, central nervous system GABAB receptors and also participation of paraventricular nucleus (PVN) of the hypothalamus in GE and gastric compliance (GC) in infarcted rats. Methods: Wistar rats, N = 8-15 in each group, were divided as INF group and sham (SH) group and subdivided. The infarction was performed through ligation of the left anterior descending coronary artery. GC was estimated with pressure-volume curves. Vagotomy was performed by sectioning the dorsal and ventral branches. To verify the action of GABAB receptors, baclofen was injected via icv (intracerebroventricular). Intravenous prazosin was used to produce chemical sympathectomy. The lesion in the PVN of the hypothalamus was performed using a 1mA/10s electrical current and GE was determined by measuring the percentage of gastric retention (% GR) of a saline meal. Results: No significant differences were observed regarding GC between groups; vagotomy significantly reduced % GR in INF group; icv treatment with baclofen significantly reduced %GR. GABAB receptors were not conclusively involved in delaying GE; intravenous treatment with prazosin significantly reduced GR% in INF group. PVN lesion abolished the effect of myocardial infarction on GE. Conclusion: Gastric emptying of liquids induced through acute myocardial infarction in rats showed the involvement of the vagus nerve, alpha1- adrenergic receptors and PVN.Fundamento: Distúrbios da motilidade do intestino proximal no infarto agudo do miocárdio podem desencadear sintomas digestivos como náuseas e vômitos. O infarto do miocárdio ocasiona retardo do esvaziamento gástrico (EG) de líquido em ratos. Objetivo: Investigar se existe a influência do nervo vago (VGX), adrenoreceptores α-1, receptores GABAB do sistema nervoso central e participação do núcleo paraventricular (NPV) do hipotálamo no esvaziamento gástrico (EG) e complacência gástrica (CG) em ratos infartados. Métodos: Ratos Wistar (n = 8-15) foram divididos em: grupo infarto (INF), sham (SH) e subdivididos. O infarto foi realizado por ligadura da artéria coronária descendente anterior. A complacência gástrica foi estimada com curvas pressão-volume. Realizada vagotomia por secção dos ramos dorsal e ventral. Para verificar a ação dos receptores GABAB foi injetado baclofeno por via intra ventrículo-cerebral. Simpatectomia química foi realizada com prazosina intravenosa (iv), e na lesão do núcleo paraventricular do hipotálamo foi utilizada corrente elétrica de 1mA/10s, com esvaziamento gástrico determinado por medição da retenção gástrica (% RG) de uma refeição salina. Resultados: Não houve diferença significativa na CG. A vagotomia (VGX) reduziu significativamente a %RG; no grupo INF, o tratamento intra ventrículo-cerebral (ivc) com baclofeno reduziu significativamente a % RG; não houve conclusivamente envolvimento dos receptores GABAB em retardar o EG; o tratamento intravenoso com prazosina reduziu significativamente a %RG no grupo INF. A lesão do NPV aboliu o efeito do infarto do miocárdio no EG. Conclusão: O nervo vago, receptores α-adrenérgicos e núcleo paraventricular estão envolvidos no retardo do esvaziamento gástrico no infarto agudo do miocárdio em ratos.

Plasticidade neural: relações com o comportamento e abordagens experimentais

Behavioral adaptiveness to different situations as well as behavioral individuality result from the interrelations between environmental sitmuli and the responses of an organism.These kind of interrelationships also shape the neural circuits as well as characterize the plasticity and the neural individuality of the organism. Studies on neural plasticity may analyze changes in neural circuitry after environmental manipulations or changes in behavior after lesions in the nervous system. Issues on neural plasticity and recovery of function refer both to physiology and behavior as well as to the subjacent mechanisms related to morphology, biochemistry and genetics. They may be approached at the systemic, behavioral, cellular and molecular levels. This work intends to characterize these kinds of studies pointing to their relations with the analyis of behavior and learning.The analysis of how the environmental-organismic interrelationships affect the neural substrates of behavior is pointed as a very stimulating area for investigation.

Central chemoreceptors and neural mechanisms of cardiorespiratory control

The arterial partial pressure (P CO2) of carbon dioxide is virtually constant because of the close match between the metabolic production of this gas and its excretion via breathing. Blood gas homeostasis does not rely solely on changes in lung ventilation, but also to a considerable extent on circulatory adjustments that regulate the transport of CO2 from its sites of production to the lungs. The neural mechanisms that coordinate circulatory and ventilatory changes to achieve blood gas homeostasis are the subject of this review. Emphasis will be placed on the control of sympathetic outflow by central chemoreceptors. High levels of CO2 exert an excitatory effect on sympathetic outflow that is mediated by specialized chemoreceptors such as the neurons located in the retrotrapezoid region. In addition, high CO2 causes an aversive awareness in conscious animals, activating wake-promoting pathways such as the noradrenergic neurons. These neuronal groups, which may also be directly activated by brain acidification, have projections that contribute to the CO2-induced rise in breathing and sympathetic outflow. However, since the level of activity of the retrotrapezoid nucleus is regulated by converging inputs from wake-promoting systems, behavior-specific inputs from higher centers and by chemical drive, the main focus of the present manuscript is to review the contribution of central chemoreceptors to the control of autonomic and respiratory mechanisms.

Engagement of multifocal neural circuits during recall of autobiographical happy events

Happy emotional states have not been extensively explored in functional magnetic resonance imaging studies using autobiographic recall paradigms. We investigated the brain circuitry engaged during induction of happiness by standardized script-driven autobiographical recall in 11 healthy subjects (6 males), aged 32.4 ± 7.2 years, without physical or psychiatric disorders, selected according to their ability to vividly recall personal experiences. Blood oxygen level-dependent (BOLD) changes were recorded during auditory presentation of personal scripts of happiness, neutral content and negative emotional content (irritability). The same uniform structure was used for the cueing narratives of both emotionally salient and neutral conditions, in order to decrease the variability of findings. In the happiness relative to the neutral condition, there was an increased BOLD signal in the left dorsal prefrontal cortex and anterior insula, thalamus bilaterally, left hypothalamus, left anterior cingulate gyrus, and midportions of the left middle temporal gyrus (P < 0.05, corrected for multiple comparisons). Relative to the irritability condition, the happiness condition showed increased activity in the left insula, thalamus and hypothalamus, and in anterior and midportions of the inferior and middle temporal gyri bilaterally (P < 0.05, corrected), varying in size between 13 and 64 voxels. Findings of happiness-related increased activity in prefrontal and subcortical regions extend the results of previous functional imaging studies of autobiographical recall. The BOLD signal changes identified reflect general aspects of emotional processing, emotional control, and the processing of sensory and bodily signals associated with internally generated feelings of happiness. These results reinforce the notion that happiness induction engages a wide network of brain regions.

Neural networks and statistical analysis for classification of corneal videokeratography maps based on Zernike coefficients: a quantitative comparison

PURPOSE: The main goal of this study was to develop and compare two different techniques for classification of specific types of corneal shapes when Zernike coefficients are used as inputs. A feed-forward artificial Neural Network (NN) and discriminant analysis (DA) techniques were used. METHODS: The inputs both for the NN and DA were the first 15 standard Zernike coefficients for 80 previously classified corneal elevation data files from an Eyesys System 2000 Videokeratograph (VK), installed at the Departamento de Oftalmologia of the Escola Paulista de Medicina, São Paulo. The NN had 5 output neurons which were associated with 5 typical corneal shapes: keratoconus, with-the-rule astigmatism, against-the-rule astigmatism, "regular" or "normal" shape and post-PRK. RESULTS: The NN and DA responses were statistically analyzed in terms of precision ([true positive+true negative]/total number of cases). Mean overall results for all cases for the NN and DA techniques were, respectively, 94% and 84.8%. CONCLUSION: Although we used a relatively small database, results obtained in the present study indicate that Zernike polynomials as descriptors of corneal shape may be a reliable parameter as input data for diagnostic automation of VK maps, using either NN or DA.

Learning processes and the neural analysis of conditioning

Classical and operant conditioning principles, such as the behavioral discrepancy-derived assumption that reinforcement always selects antecedent stimulus and response relations, have been studied at the neural level, mainly by observing the strengthening of neuronal responses or synaptic connections. A review of the literature on the neural basis of behavior provided extensive scientific data that indicate a synthesis between the two conditioning processes based mainly on stimulus control in learning tasks. The resulting analysis revealed the following aspects. Dopamine acts as a behavioral discrepancy signal in the midbrain pathway of positive reinforcement, leading toward the nucleus accumbens. Dopamine modulates both types of conditioning in the Aplysia mollusk and in mammals. In vivo and in vitro mollusk preparations show convergence of both types of conditioning in the same motor neuron. Frontal cortical neurons are involved in behavioral discrimination in reversal and extinction procedures, and these neurons preferentially deliver glutamate through conditioned stimulus or discriminative stimulus pathways. Discriminative neural responses can reliably precede operant movements and can also be common to stimuli that share complex symbolic relations. The present article discusses convergent and divergent points between conditioning paradigms at the neural level of analysis to advance our knowledge on reinforcement.