Training a Linear Neural Network with a Stable LSP Solution for Jamming Cancellation

Two jamming cancellation algorithms are developed based on a stable solution of least squares problem (LSP) provided by regularization. They are based on filtered singular value decomposition (SVD) and modifications of the Greville formula. Both algorithms allow an efficient hardware implementation. Testing results on artificial data modeling difficult real-world situations are also provided.

Natthärbärget som vandrande lösning

The shelter as a recurrent solution to homelessness During most of the 20th century shelters for the homeless has been criticized as being of too low standard and an unworthy way of living in a welfare society. During the 1960s and 1970s most shelters in Sweden were shut down and replaced with other forms of housing for the homeless. Since the late 1980s and early 1990s the issue of homelessness has returned to the political agenda as an existing social problem in Sweden. In this period we have also experienced a return of the shelters. These newly opened shelters are in many ways based on the same ideas like the old shelters described in stories of poverty and deprivation from the 19th century. In our article we raise the question how a system that has been rejected and condemned from both ethical and ideological standpoints as an unworthy way of living can be “remodernized” and considered again as a (temporary) solution to homelessness. We examine how shelters are justified in the 21st century and what functions they fill. We also discuss the fact that the shelters are almost exclusively run by (religious) voluntary organizations.

Ingegneria di sistemi auto‐organizzanti con il paradigma multiagente

Self-organisation is increasingly being regarded as an effective approach to tackle modern systems complexity. The self-organisation approach allows the development of systems exhibiting complex dynamics and adapting to environmental perturbations without requiring a complete knowledge of the future surrounding conditions. However, the development of self-organising systems (SOS) is driven by different principles with respect to traditional software engineering. For instance, engineers typically design systems combining smaller elements where the composition rules depend on the reference paradigm, but typically produce predictable results. Conversely, SOS display non-linear dynamics, which can hardly be captured by deterministic models, and, although robust with respect to external perturbations, are quite sensitive to changes on inner working parameters. In this thesis, we describe methodological aspects concerning the early-design stage of SOS built relying on the Multiagent paradigm: in particular, we refer to the A&A metamodel, where MAS are composed by agents and artefacts, i.e. environmental resources. Then, we describe an architectural pattern that has been extracted from a recurrent solution in designing self-organising systems: this pattern is based on a MAS environment formed by artefacts, modelling non-proactive resources, and environmental agents acting on artefacts so as to enable self-organising mechanisms. In this context, we propose a scientific approach for the early design stage of the engineering of self-organising systems: the process is an iterative one and each cycle is articulated in four stages, modelling, simulation, formal verification, and tuning. During the modelling phase we mainly rely on the existence of a self-organising strategy observed in Nature and, hopefully encoded as a design pattern. Simulations of an abstract system model are used to drive design choices until the required quality properties are obtained, thus providing guarantees that the subsequent design steps would lead to a correct implementation. However, system analysis exclusively based on simulation results does not provide sound guarantees for the engineering of complex systems: to this purpose, we envision the application of formal verification techniques, specifically model checking, in order to exactly characterise the system behaviours. During the tuning stage parameters are tweaked in order to meet the target global dynamics and feasibility constraints. In order to evaluate the methodology, we analysed several systems: in this thesis, we only describe three of them, i.e. the most representative ones for each of the three years of PhD course. We analyse each case study using the presented method, and describe the exploited formal tools and techniques.

Exact Solution of the Nonlinear Dynamics of Recurrent Neural Mechanisms for Direction Selectivity

Different theoretical models have tried to investigate the feasibility of recurrent neural mechanisms for achieving direction selectivity in the visual cortex. The mathematical analysis of such models has been restricted so far to the case of purely linear networks. We present an exact analytical solution of the nonlinear dynamics of a class of direction selective recurrent neural models with threshold nonlinearity. Our mathematical analysis shows that such networks have form-stable stimulus-locked traveling pulse solutions that are appropriate for modeling the responses of direction selective cortical neurons. Our analysis shows also that the stability of such solutions can break down giving raise to a different class of solutions ("lurching activity waves") that are characterized by a specific spatio-temporal periodicity. These solutions cannot arise in models for direction selectivity with purely linear spatio-temporal filtering.

A propensity score-matched comparison between Cardia and Amplatzer PFO closure devices - insights from the SOLUTION registry (Swiss percutaneOus patent foramen ovale cLosUre in recurrent clinical events prevenTION)

Aims: To compare clinical outcome of Amplatzer PFO (APFO) to Cardia PFO (CPFO) occluder. Percutaneous patent foramen ovale (PFO) closure prevents stroke recurrence in stroke due to paradoxical embolism. Methods and results: The primary endpoint was a composite of stroke, TIA, or peripheral embolism at follow-up. The secondary endpoint was residual shunt. Outcome was compared among 934 (APFO: 712; CPFO: 222) patients, and in 297 propensity score-matched patients. The primary endpoint occurred in 29 patients (0.71/100 patient-years): four (2%) with the CPFO (0.31/100 patient-years), and 25 (4%) with the APFO (0.89/100 patient-years) (p=0.20). Residual shunt at six months was more frequent with the CPFO (31% versus 9%, p<0.001). No differences in residual shunts were seen at the last available echocardiographic follow-up (9±18 months): APFO 11%, CPFO 14%, p=0.22. Conclusions: This study suggests that PFO closure with APFO or CPFO is equally effective for the prevention of recurrent events. Residual shunt was more frequent at six months with CPFO, but was similar to APFO at later follow-up.

Context-free and context-sensitive dynamics in recurrent neural networks

Continuous-valued recurrent neural networks can learn mechanisms for processing context-free languages. The dynamics of such networks is usually based on damped oscillation around fixed points in state space and requires that the dynamical components are arranged in certain ways. It is shown that qualitatively similar dynamics with similar constraints hold for a(n)b(n)c(n), a context-sensitive language. The additional difficulty with a(n)b(n)c(n), compared with the context-free language a(n)b(n), consists of 'counting up' and 'counting down' letters simultaneously. The network solution is to oscillate in two principal dimensions, one for counting up and one for counting down. This study focuses on the dynamics employed by the sequential cascaded network, in contrast to the simple recurrent network, and the use of backpropagation through time. Found solutions generalize well beyond training data, however, learning is not reliable. The contribution of this study lies in demonstrating how the dynamics in recurrent neural networks that process context-free languages can also be employed in processing some context-sensitive languages (traditionally thought of as requiring additional computation resources). This continuity of mechanism between language classes contributes to our understanding of neural networks in modelling language learning and processing.

Essai clinique randomisé visant à évaluer l’efficacité du lavage des cavités nasales à l’aide d’une solution saline dans la prévention des otites moyennes aiguës à répétition

Introduction: Les instillations nasales de solution saline isotonique (INSS) chez les enfants sont recommandées par les pédiatres et des oto-rhino-laryngologistes de notre institution dans le but de prévenir les otites moyennes aigues à répétition (OMAr). Cependant, aucune étude dans la littérature ne vient corroborer ou infirmer cette pratique. Objectifs: Déterminer l’efficacité des INSS dans la prévention des OMAr. Méthode: Projet pilote d’un essai clinique randomisé. Les enfants diagnostiqués avec des OMAr étaient éligibles. Les patients recrutés ont été randomisés en 2 groupes. Seul le groupe traitement procède aux INSS. L’issue primaire est l’incidence d’OMAr pendant une période de 3 mois. Résultats: Vingt-neuf patients satisfaisant les critères d’inclusion et d’exclusion ont consenti à participer. Le taux d’OMAr était inférieur dans le groupe traitement (p=0.03, chi-carré) Conclusion: Les INSS semblent efficaces dans la prévention des OMAr. Une étude multicentrique est indiquée pour vérifier la validité externe et confirmer la sécurité.

On Recurrent and Deep Neural Networks

L'apprentissage profond est un domaine de recherche en forte croissance en apprentissage automatique qui est parvenu à des résultats impressionnants dans différentes tâches allant de la classification d'images à la parole, en passant par la modélisation du langage. Les réseaux de neurones récurrents, une sous-classe d'architecture profonde, s'avèrent particulièrement prometteurs. Les réseaux récurrents peuvent capter la structure temporelle dans les données. Ils ont potentiellement la capacité d'apprendre des corrélations entre des événements éloignés dans le temps et d'emmagasiner indéfiniment des informations dans leur mémoire interne. Dans ce travail, nous tentons d'abord de comprendre pourquoi la profondeur est utile. Similairement à d'autres travaux de la littérature, nos résultats démontrent que les modèles profonds peuvent être plus efficaces pour représenter certaines familles de fonctions comparativement aux modèles peu profonds. Contrairement à ces travaux, nous effectuons notre analyse théorique sur des réseaux profonds acycliques munis de fonctions d'activation linéaires par parties, puisque ce type de modèle est actuellement l'état de l'art dans différentes tâches de classification. La deuxième partie de cette thèse porte sur le processus d'apprentissage. Nous analysons quelques techniques d'optimisation proposées récemment, telles l'optimisation Hessian free, la descente de gradient naturel et la descente des sous-espaces de Krylov. Nous proposons le cadre théorique des méthodes à région de confiance généralisées et nous montrons que plusieurs de ces algorithmes développés récemment peuvent être vus dans cette perspective. Nous argumentons que certains membres de cette famille d'approches peuvent être mieux adaptés que d'autres à l'optimisation non convexe. La dernière partie de ce document se concentre sur les réseaux de neurones récurrents. Nous étudions d'abord le concept de mémoire et tentons de répondre aux questions suivantes: Les réseaux récurrents peuvent-ils démontrer une mémoire sans limite? Ce comportement peut-il être appris? Nous montrons que cela est possible si des indices sont fournis durant l'apprentissage. Ensuite, nous explorons deux problèmes spécifiques à l'entraînement des réseaux récurrents, à savoir la dissipation et l'explosion du gradient. Notre analyse se termine par une solution au problème d'explosion du gradient qui implique de borner la norme du gradient. Nous proposons également un terme de régularisation conçu spécifiquement pour réduire le problème de dissipation du gradient. Sur un ensemble de données synthétique, nous montrons empiriquement que ces mécanismes peuvent permettre aux réseaux récurrents d'apprendre de façon autonome à mémoriser des informations pour une période de temps indéfinie. Finalement, nous explorons la notion de profondeur dans les réseaux de neurones récurrents. Comparativement aux réseaux acycliques, la définition de profondeur dans les réseaux récurrents est souvent ambiguë. Nous proposons différentes façons d'ajouter de la profondeur dans les réseaux récurrents et nous évaluons empiriquement ces propositions.

A novel approach based on recurrent neural networks applied to nonlinear systems optimization

This paper presents an efficient approach based on recurrent neural network for solving nonlinear optimization. More specifically, a modified Hopfield network is developed and its internal parameters are computed using the valid subspace technique. These parameters guarantee the convergence of the network to the equilibrium points that represent an optimal feasible solution. The main advantage of the developed network is that it treats optimization and constraint terms in different stages with no interference with each other. Moreover, the proposed approach does not require specification of penalty and weighting parameters for its initialization. A study of the modified Hopfield model is also developed to analyze its stability and convergence. Simulation results are provided to demonstrate the performance of the proposed neural network. (c) 2005 Elsevier B.V. All rights reserved.

A safe and simple solution for intravesical tension-free vaginal tape erosion: removal by standard transurethral resection

OBJECTIVE: To report our experience with the successful removal of visible tension-free vaginal tape (TVT) by standard transurethral electroresection, as intravesical tape erosion after TVT is a rare complication, and removal can be challenging, with few cases reported. PATIENTS AND METHODS: Five patients presenting with TVT erosion into the bladder were treated at our institutions from December 2004 to July 2007; all had standard transurethral electroresection. Their records were reviewed retrospectively to retrieve data on presenting symptoms, diagnostic tests, surgical procedures and outcomes. RESULTS: The median (range) interval between the TVT procedure and the onset of symptoms was 17 (1-32) months. The predominant symptoms were painful micturition, recurrent urinary tract infection (UTI), urgency and urge incontinence. There were no complications during surgery. The storage symptoms and UTI resolved completely after removing the eroded mesh in all but one patient. Cystoscopy at 1 month after surgery showed complete healing of the bladder mucosa. CONCLUSION: Although TVT erosion into the bladder is rare, persistent symptoms, particularly recurrent UTIs, must raise some suspicion for this condition. Standard transurethral electroresection seems to be a safe, simple, minimally invasive and successful treatment option for TVT removal.

Exact Solution of Bayes and Minimax Change-Detection Problems

The challenge of detecting a change in the distribution of data is a sequential decision problem that is relevant to many engineering solutions, including quality control and machine and process monitoring. This dissertation develops techniques for exact solution of change-detection problems with discrete time and discrete observations. Change-detection problems are classified as Bayes or minimax based on the availability of information on the change-time distribution. A Bayes optimal solution uses prior information about the distribution of the change time to minimize the expected cost, whereas a minimax optimal solution minimizes the cost under the worst-case change-time distribution. Both types of problems are addressed. The most important result of the dissertation is the development of a polynomial-time algorithm for the solution of important classes of Markov Bayes change-detection problems. Existing techniques for epsilon-exact solution of partially observable Markov decision processes have complexity exponential in the number of observation symbols. A new algorithm, called constellation induction, exploits the concavity and Lipschitz continuity of the value function, and has complexity polynomial in the number of observation symbols. It is shown that change-detection problems with a geometric change-time distribution and identically- and independently-distributed observations before and after the change are solvable in polynomial time. Also, change-detection problems on hidden Markov models with a fixed number of recurrent states are solvable in polynomial time. A detailed implementation and analysis of the constellation-induction algorithm are provided. Exact solution methods are also established for several types of minimax change-detection problems. Finite-horizon problems with arbitrary observation distributions are modeled as extensive-form games and solved using linear programs. Infinite-horizon problems with linear penalty for detection delay and identically- and independently-distributed observations can be solved in polynomial time via epsilon-optimal parameterization of a cumulative-sum procedure. Finally, the properties of policies for change-detection problems are described and analyzed. Simple classes of formal languages are shown to be sufficient for epsilon-exact solution of change-detection problems, and methods for finding minimally sized policy representations are described.

Comparison Of The Solution Of Histidine-tryptophan-alfacetoglutarate With Histidine-tryptophan-glutamate As Cardioplegic Agents In Isolated Rat Hearts: An Immunohistochemical Study.

Cardiac arrest during heart surgery is a common procedure and allows the surgeon to perform surgical procedures in an environment free of blood and movement. Using a model of isolated rat heart, the authors compare a new cardioplegic solution containing histidine-tryptophan-glutamate (group 2) with the histidine-tryptophan-alphacetoglutarate (group 1) routinely used by some cardiac surgeons. To assess caspase, IL-8 and KI-67 in isolated rat hearts using immunohistochemistry. 20 Wistar male rats were anesthetized and heparinized. The chest was opened, cardioctomy was performed and 40 ml/kg of the appropriate cardioplegic solution was infused. The hearts were kept for 2 hours at 4ºC in the same solution, and thereafter, placed in the Langendorff apparatus for 30 minutes with Ringer-Locke solution. Immunohistochemistry analysis of caspase, IL-8, and KI-67 were performed. The concentration of caspase was lower in group 2 and Ki-67 was higher in group 2, both P<0.05. There was no statistical difference between the values of IL-8 between the groups. Histidine-tryptophan-glutamate solution was better than histidine-tryptophan-alphacetoglutarate solution because it reduced caspase (apoptosis), increased KI-67 (cell proliferation), and showed no difference in IL-8 levels compared to group 1. This suggests that the histidine-tryptophan-glutamate solution was more efficient than the histidine-tryptophan-alphacetoglutarate for the preservation of hearts of rat cardiomyocytes.

Remediation Of 17-α-ethinylestradiol Aqueous Solution By Photocatalysis And Electrochemically-assisted Photocatalysis Using Tio2 And Tio2/wo3 Electrodes Irradiated By A Solar Simulator.

TiO2 and TiO2/WO3 electrodes, irradiated by a solar simulator in configurations for heterogeneous photocatalysis (HP) and electrochemically-assisted HP (EHP), were used to remediate aqueous solutions containing 10 mg L(-1) (34 μmol L(-1)) of 17-α-ethinylestradiol (EE2), active component of most oral contraceptives. The photocatalysts consisted of 4.5 μm thick porous films of TiO2 and TiO2/WO3 (molar ratio W/Ti of 12%) deposited on transparent electrodes from aqueous suspensions of TiO2 particles and WO3 precursors, followed by thermal treatment at 450 (°)C. First, an energy diagram was organized with photoelectrochemical and UV-Vis absorption spectroscopy data and revealed that EE2 could be directly oxidized by the photogenerated holes at the semiconductor surfaces, considering the relative HOMO level for EE2 and the semiconductor valence band edges. Also, for the irradiated hybrid photocatalyst, electrons in TiO2 should be transferred to WO3 conduction band, while holes move toward TiO2 valence band, improving charge separation. The remediated EE2 solutions were analyzed by fluorescence, HPLC and total organic carbon measurements. As expected from the energy diagram, both photocatalysts promoted the EE2 oxidation in HP configuration; after 4 h, the EE2 concentration decayed to 6.2 mg L(-1) (35% of EE2 removal) with irradiated TiO2 while TiO2/WO3 electrode resulted in 45% EE2 removal. A higher performance was achieved in EHP systems, when a Pt wire was introduced as a counter-electrode and the photoelectrodes were biased at +0.7 V; then, the EE2 removal corresponded to 48 and 54% for the TiO2 and TiO2/WO3, respectively. The hybrid TiO2/WO3, when compared to TiO2 electrode, exhibited enhanced sunlight harvesting and improved separation of photogenerated charge carriers, resulting in higher performance for removing this contaminant of emerging concern from aqueous solution.

Myocardial Extracellular Volume Expansion And The Risk Of Recurrent Atrial Fibrillation After Pulmonary Vein Isolation.

This study tested whether myocardial extracellular volume (ECV) is increased in patients with hypertension and atrial fibrillation (AF) undergoing pulmonary vein isolation and whether there is an association between ECV and post-procedural recurrence of AF. Hypertension is associated with myocardial fibrosis, an increase in ECV, and AF. Data linking these findings are limited. T1 measurements pre-contrast and post-contrast in a cardiac magnetic resonance (CMR) study provide a method for quantification of ECV. Consecutive patients with hypertension and recurrent AF referred for pulmonary vein isolation underwent a contrast CMR study with measurement of ECV and were followed up prospectively for a median of 18 months. The endpoint of interest was late recurrence of AF. Patients had elevated left ventricular (LV) volumes, LV mass, left atrial volumes, and increased ECV (patients with AF, 0.34 ± 0.03; healthy control patients, 0.29 ± 0.03; p < 0.001). There were positive associations between ECV and left atrial volume (r = 0.46, p < 0.01) and LV mass and a negative association between ECV and diastolic function (early mitral annular relaxation [E'], r = -0.55, p < 0.001). In the best overall multivariable model, ECV was the strongest predictor of the primary outcome of recurrent AF (hazard ratio: 1.29; 95% confidence interval: 1.15 to 1.44; p < 0.0001) and the secondary composite outcome of recurrent AF, heart failure admission, and death (hazard ratio: 1.35; 95% confidence interval: 1.21 to 1.51; p < 0.0001). Each 10% increase in ECV was associated with a 29% increased risk of recurrent AF. In patients with AF and hypertension, expansion of ECV is associated with diastolic function and left atrial remodeling and is a strong independent predictor of recurrent AF post-pulmonary vein isolation.

Human Mitochondrial Hsp70 (mortalin): Shedding Light On Atpase Activity, Interaction With Adenosine Nucleotides, Solution Structure And Domain Organization.

The human mitochondrial Hsp70, also called mortalin, is of considerable importance for mitochondria biogenesis and the correct functioning of the cell machinery. In the mitochondrial matrix, mortalin acts in the importing and folding process of nucleus-encoded proteins. The in vivo deregulation of mortalin expression and/or function has been correlated with age-related diseases and certain cancers due to its interaction with the p53 protein. In spite of its critical biological roles, structural and functional studies on mortalin are limited by its insoluble recombinant production. This study provides the first report of the production of folded and soluble recombinant mortalin when co-expressed with the human Hsp70-escort protein 1, but it is still likely prone to self-association. The monomeric fraction of mortalin presented a slightly elongated shape and basal ATPase activity that is higher than that of its cytoplasmic counterpart Hsp70-1A, suggesting that it was obtained in the functional state. Through small angle X-ray scattering, we assessed the low-resolution structural model of monomeric mortalin that is characterized by an elongated shape. This model adequately accommodated high resolution structures of Hsp70 domains indicating its quality. We also observed that mortalin interacts with adenosine nucleotides with high affinity. Thermally induced unfolding experiments indicated that mortalin is formed by at least two domains and that the transition is sensitive to the presence of adenosine nucleotides and that this process is dependent on the presence of Mg2+ ions. Interestingly, the thermal-induced unfolding assays of mortalin suggested the presence of an aggregation/association event, which was not observed for human Hsp70-1A, and this finding may explain its natural tendency for in vivo aggregation. Our study may contribute to the structural understanding of mortalin as well as to contribute for its recombinant production for antitumor compound screenings.