Transcriptional regulation of human mu-opioid receptor gene: functional characterization of activating and inhibitory transcription factors

The organization of the nervous and immune systems is characterized by obvious differences and striking parallels. Both systems need to relay information across very short and very long distances. The nervous system communicates over both long and short ranges primarily by means of more or less hardwired intercellular connections, consisting of axons, dendrites, and synapses. Longrange communication in the immune system occurs mainly via the ordered and guided migration of immune cells and systemically acting soluble factors such as antibodies, cytokines, and chemokines. Its short-range communication either is mediated by locally acting soluble factors or transpires during direct cell–cell contact across specialized areas called “immunological synapses” (Kirschensteiner et al., 2003). These parallels in intercellular communication are complemented by a complex array of factors that induce cell growth and differentiation: these factors in the immune system are called cytokines; in the nervous system, they are called neurotrophic factors. Neither the cytokines nor the neurotrophic factors appear to be completely exclusive to either system (Neumann et al., 2002). In particular, mounting evidence indicates that some of the most potent members of the neurotrophin family, for example, nerve growth factor (NGF) and brainderived neurotrophic factor (BDNF), act on or are produced by immune cells (Kerschensteiner et al., 1999) There are, however, other neurotrophic factors, for example the insulin-like growth factor-1 (IGF-1), that can behave similarly (Kermer et al., 2000). These factors may allow the two systems to “cross-talk” and eventually may provide a molecular explanation for the reports that inflammation after central nervous system (CNS) injury has beneficial effects (Moalem et al., 1999). In order to shed some more light on such a cross-talk, therefore, transcription factors modulating mu-opioid receptor (MOPr) expression in neurons and immune cells are here investigated. More precisely, I focused my attention on IGF-I modulation of MOPr in neurons and T-cell receptor induction of MOPr expression in T-lymphocytes. Three different opioid receptors [mu (MOPr), delta (DOPr), and kappa (KOPr)] belonging to the G-protein coupled receptor super-family have been cloned. They are activated by structurallyrelated exogenous opioids or endogenous opioid peptides, and contribute to the regulation of several functions including pain transmission, respiration, cardiac and gastrointestinal functions, and immune response (Zollner and Stein 2007). MOPr is expressed mainly in the central nervous system where it regulates morphine-induced analgesia, tolerance and dependence (Mayer and Hollt 2006). Recently, induction of MOPr expression in different immune cells induced by cytokines has been reported (Kraus et al., 2001; Kraus et al., 2003). The human mu-opioid receptor gene (OPRM1) promoter is of the TATA-less type and has clusters of potential binding sites for different transcription factors (Law et al. 2004). Several studies, primarily focused on the upstream region of the OPRM1 promoter, have investigated transcriptional regulation of MOPr expression. Presently, however, it is still not completely clear how positive and negative transcription regulators cooperatively coordinate cellor tissue-specific transcription of the OPRM1 gene, and how specific growth factors influence its expression. IGF-I and its receptors are widely distributed throughout the nervous system during development, and their involvement in neurogenesis has been extensively investigated (Arsenijevic et al. 1998; van Golen and Feldman 2000). As previously mentioned, such neurotrophic factors can be also produced and/or act on immune cells (Kerschenseteiner et al., 2003). Most of the physiologic effects of IGF-I are mediated by the type I IGF surface receptor which, after ligand binding-induced autophosphorylation, associates with specific adaptor proteins and activates different second messengers (Bondy and Cheng 2004). These include: phosphatidylinositol 3-kinase, mitogen-activated protein kinase (Vincent and Feldman 2002; Di Toro et al. 2005) and members of the Janus kinase (JAK)/STAT3 signalling pathway (Zong et al. 2000; Yadav et al. 2005). REST plays a complex role in neuronal cells by differentially repressing target gene expression (Lunyak et al. 2004; Coulson 2005; Ballas and Mandel 2005). REST expression decreases during neurogenesis, but has been detected in the adult rat brain (Palm et al. 1998) and is up-regulated in response to global ischemia (Calderone et al. 2003) and induction of epilepsy (Spencer et al. 2006). Thus, the REST concentration seems to influence its function and the expression of neuronal genes, and may have different effects in embryonic and differentiated neurons (Su et al. 2004; Sun et al. 2005). In a previous study, REST was elevated during the early stages of neural induction by IGF-I in neuroblastoma cells. REST may contribute to the down-regulation of genes not yet required by the differentiation program, but its expression decreases after five days of treatment to allow for the acquisition of neural phenotypes. Di Toro et al. proposed a model in which the extent of neurite outgrowth in differentiating neuroblastoma cells was affected by the disappearance of REST (Di Toro et al. 2005). The human mu-opioid receptor gene (OPRM1) promoter contains a DNA sequence binding the repressor element 1 silencing transcription factor (REST) that is implicated in transcriptional repression. Therefore, in the fist part of this thesis, I investigated whether insulin-like growth factor I (IGF-I), which affects various aspects of neuronal induction and maturation, regulates OPRM1 transcription in neuronal cells in the context of the potential influence of REST. A series of OPRM1-luciferase promoter/reporter constructs were transfected into two neuronal cell models, neuroblastoma-derived SH-SY5Y cells and PC12 cells. In the former, endogenous levels of human mu-opioid receptor (hMOPr) mRNA were evaluated by real-time PCR. IGF-I upregulated OPRM1 transcription in: PC12 cells lacking REST, in SH-SY5Y cells transfected with constructs deficient in the REST DNA binding element, or when REST was down-regulated in retinoic acid-differentiated cells. IGF-I activates the signal transducer and activator of transcription-3 (STAT3) signaling pathway and this transcription factor, binding to the STAT1/3 DNA element located in the promoter, increases OPRM1 transcription. T-cell receptor (TCR) recognizes peptide antigens displayed in the context of the major histocompatibility complex (MHC) and gives rise to a potent as well as branched intracellular signalling that convert naïve T-cells in mature effectors, thus significantly contributing to the genesis of a specific immune response. In the second part of my work I exposed wild type Jurkat CD4+ T-cells to a mixture of CD3 and CD28 antigens in order to fully activate TCR and study whether its signalling influence OPRM1 expression. Results were that TCR engagement determined a significant induction of OPRM1 expression through the activation of transcription factors AP-1, NF-kB and NFAT. Eventually, I investigated MOPr turnover once it has been expressed on T-cells outer membrane. It turned out that DAMGO induced MOPr internalisation and recycling, whereas morphine did not. Overall, from the data collected in this thesis we can conclude that that a reduction in REST is a critical switch enabling IGF-I to up-regulate human MOPr, helping these findings clarify how human MOPr expression is regulated in neuronal cells, and that TCR engagement up-regulates OPRM1 transcription in T-cells. My results that neurotrophic factors a and TCR engagement, as well as it is reported for cytokines, seem to up-regulate OPRM1 in both neurons and immune cells suggest an important role for MOPr as a molecular bridge between neurons and immune cells; therefore, MOPr could play a key role in the cross-talk between immune system and nervous system and in particular in the balance between pro-inflammatory and pro-nociceptive stimuli and analgesic and neuroprotective effects.

Meta-models, environment and layers: agent-oriented engineering of complex systems

Traditional software engineering approaches and metaphors fall short when applied to areas of growing relevance such as electronic commerce, enterprise resource planning, and mobile computing: such areas, in fact, generally call for open architectures that may evolve dynamically over time so as to accommodate new components and meet new requirements. This is probably one of the main reasons that the agent metaphor and the agent-oriented paradigm are gaining momentum in these areas. This thesis deals with the engineering of complex software systems in terms of the agent paradigm. This paradigm is based on the notions of agent and systems of interacting agents as fundamental abstractions for designing, developing and managing at runtime typically distributed software systems. However, today the engineer often works with technologies that do not support the abstractions used in the design of the systems. For this reason the research on methodologies becomes the basic point in the scientific activity. Currently most agent-oriented methodologies are supported by small teams of academic researchers, and as a result, most of them are in an early stage and still in the first context of mostly \academic" approaches for agent-oriented systems development. Moreover, such methodologies are not well documented and very often defined and presented only by focusing on specific aspects of the methodology. The role played by meta- models becomes fundamental for comparing and evaluating the methodologies. In fact a meta-model specifies the concepts, rules and relationships used to define methodologies. Although it is possible to describe a methodology without an explicit meta-model, formalising the underpinning ideas of the methodology in question is valuable when checking its consistency or planning extensions or modifications. A good meta-model must address all the different aspects of a methodology, i.e. the process to be followed, the work products to be generated and those responsible for making all this happen. In turn, specifying the work products that must be developed implies dening the basic modelling building blocks from which they are built. As a building block, the agent abstraction alone is not enough to fully model all the aspects related to multi-agent systems in a natural way. In particular, different perspectives exist on the role that environment plays within agent systems: however, it is clear at least that all non-agent elements of a multi-agent system are typically considered to be part of the multi-agent system environment. The key role of environment as a first-class abstraction in the engineering of multi-agent system is today generally acknowledged in the multi-agent system community, so environment should be explicitly accounted for in the engineering of multi-agent system, working as a new design dimension for agent-oriented methodologies. At least two main ingredients shape the environment: environment abstractions - entities of the environment encapsulating some functions -, and topology abstractions - entities of environment that represent the (either logical or physical) spatial structure. In addition, the engineering of non-trivial multi-agent systems requires principles and mechanisms for supporting the management of the system representation complexity. These principles lead to the adoption of a multi-layered description, which could be used by designers to provide different levels of abstraction over multi-agent systems. The research in these fields has lead to the formulation of a new version of the SODA methodology where environment abstractions and layering principles are exploited for en- gineering multi-agent systems.

Computational methods for the analysis of protein structure and function

The vast majority of known proteins have not yet been experimentally characterized and little is known about their function. The design and implementation of computational tools can provide insight into the function of proteins based on their sequence, their structure, their evolutionary history and their association with other proteins. Knowledge of the three-dimensional (3D) structure of a protein can lead to a deep understanding of its mode of action and interaction, but currently the structures of <1% of sequences have been experimentally solved. For this reason, it became urgent to develop new methods that are able to computationally extract relevant information from protein sequence and structure. The starting point of my work has been the study of the properties of contacts between protein residues, since they constrain protein folding and characterize different protein structures. Prediction of residue contacts in proteins is an interesting problem whose solution may be useful in protein folding recognition and de novo design. The prediction of these contacts requires the study of the protein inter-residue distances related to the specific type of amino acid pair that are encoded in the so-called contact map. An interesting new way of analyzing those structures came out when network studies were introduced, with pivotal papers demonstrating that protein contact networks also exhibit small-world behavior. In order to highlight constraints for the prediction of protein contact maps and for applications in the field of protein structure prediction and/or reconstruction from experimentally determined contact maps, I studied to which extent the characteristic path length and clustering coefficient of the protein contacts network are values that reveal characteristic features of protein contact maps. Provided that residue contacts are known for a protein sequence, the major features of its 3D structure could be deduced by combining this knowledge with correctly predicted motifs of secondary structure. In the second part of my work I focused on a particular protein structural motif, the coiled-coil, known to mediate a variety of fundamental biological interactions. Coiled-coils are found in a variety of structural forms and in a wide range of proteins including, for example, small units such as leucine zippers that drive the dimerization of many transcription factors or more complex structures such as the family of viral proteins responsible for virus-host membrane fusion. The coiled-coil structural motif is estimated to account for 5-10% of the protein sequences in the various genomes. Given their biological importance, in my work I introduced a Hidden Markov Model (HMM) that exploits the evolutionary information derived from multiple sequence alignments, to predict coiled-coil regions and to discriminate coiled-coil sequences. The results indicate that the new HMM outperforms all the existing programs and can be adopted for the coiled-coil prediction and for large-scale genome annotation. Genome annotation is a key issue in modern computational biology, being the starting point towards the understanding of the complex processes involved in biological networks. The rapid growth in the number of protein sequences and structures available poses new fundamental problems that still deserve an interpretation. Nevertheless, these data are at the basis of the design of new strategies for tackling problems such as the prediction of protein structure and function. Experimental determination of the functions of all these proteins would be a hugely time-consuming and costly task and, in most instances, has not been carried out. As an example, currently, approximately only 20% of annotated proteins in the Homo sapiens genome have been experimentally characterized. A commonly adopted procedure for annotating protein sequences relies on the "inheritance through homology" based on the notion that similar sequences share similar functions and structures. This procedure consists in the assignment of sequences to a specific group of functionally related sequences which had been grouped through clustering techniques. The clustering procedure is based on suitable similarity rules, since predicting protein structure and function from sequence largely depends on the value of sequence identity. However, additional levels of complexity are due to multi-domain proteins, to proteins that share common domains but that do not necessarily share the same function, to the finding that different combinations of shared domains can lead to different biological roles. In the last part of this study I developed and validate a system that contributes to sequence annotation by taking advantage of a validated transfer through inheritance procedure of the molecular functions and of the structural templates. After a cross-genome comparison with the BLAST program, clusters were built on the basis of two stringent constraints on sequence identity and coverage of the alignment. The adopted measure explicity answers to the problem of multi-domain proteins annotation and allows a fine grain division of the whole set of proteomes used, that ensures cluster homogeneity in terms of sequence length. A high level of coverage of structure templates on the length of protein sequences within clusters ensures that multi-domain proteins when present can be templates for sequences of similar length. This annotation procedure includes the possibility of reliably transferring statistically validated functions and structures to sequences considering information available in the present data bases of molecular functions and structures.

Role of BDNF secretion and signaling in the activity-dependent refinement of synaptic connections

Neuronal networks exhibit diverse types of plasticity, including the activity-dependent regulation of synaptic functions and refinement of synaptic connections. In addition, continuous generation of new neurons in the “adult” brain (adult neurogenesis) represents a powerful form of structural plasticity establishing new connections and possibly implementing pre-existing neuronal circuits (Kempermann et al, 2000; Ming and Song, 2005). Neurotrophins, a family of neuronal growth factors, are crucially involved in the modulation of activity-dependent neuronal plasticity. The first evidence for the physiological importance of this role evolved from the observations that the local administration of neurotrophins has dramatic effects on the activity-dependent refinement of synaptic connections in the visual cortex (McAllister et al, 1999; Berardi et al, 2000; Thoenen, 1995). Moreover, the local availability of critical amounts of neurotrophins appears to be relevant for the ability of hippocampal neurons to undergo long-term potentiation (LTP) of the synaptic transmission (Lu, 2004; Aicardi et al, 2004). To achieve a comprehensive understanding of the modulatory role of neurotrophins in integrated neuronal systems, informations on the mechanisms about local neurotrophins synthesis and secretion as well as ditribution of their cognate receptors are of crucial importance. In the first part of this doctoral thesis I have used electrophysiological approaches and real-time imaging tecniques to investigate additional features about the regulation of neurotrophins secretion, namely the capability of the neurotrophin brain-derived neurotrophic factor (BDNF) to undergo synaptic recycling. In cortical and hippocampal slices as well as in dissociated cell cultures, neuronal activity rapidly enhances the neuronal expression and secretion of BDNF which is subsequently taken up by neurons themselves but also by perineuronal astrocytes, through the selective activation of BDNF receptors. Moreover, internalized BDNF becomes part of the releasable source of the neurotrophin, which is promptly recruited for activity-dependent recycling. Thus, we described for the first time that neurons and astrocytes contain an endocytic compartment competent for BDNF recycling, suggesting a specialized form of bidirectional communication between neurons and glia. The mechanism of BDNF recycling is reminiscent of that for neurotransmitters and identifies BDNF as a new modulator implicated in neuro- and glio-transmission. In the second part of this doctoral thesis I addressed the role of BDNF signaling in adult hippocampal neurogenesis. I have generated a transgenic mouse model to specifically investigate the influence of BDNF signaling on the generation, differentiation, survival and connectivity of newborn neurons into the adult hippocampal network. I demonstrated that the survival of newborn neurons critically depends on the activation of the BDNF receptor TrkB. The TrkB-dependent decision regarding life or death in these newborn neurons takes place right at the transition point of their morphological and functional maturation Before newborn neurons start to die, they exhibit a drastic reduction in dendritic complexity and spine density compared to wild-type newborn neurons, indicating that this receptor is required for the connectivity of newborn neurons. Both the failure to become integrated and subsequent dying lead to impaired LTP. Finally, mice lacking a functional TrkB in the restricted population of newborn neurons show behavioral deficits, namely increased anxiety-like behavior. These data suggest that the integration and establishment of proper connections by newly generated neurons into the pre-existing network are relevant features for regulating the emotional state of the animal.

Architectures and design patterns for functional design of logic control and diagnostics in industrial automation

Recently in most of the industrial automation process an ever increasing degree of automation has been observed. This increasing is motivated by the higher requirement of systems with great performance in terms of quality of products/services generated, productivity, efficiency and low costs in the design, realization and maintenance. This trend in the growth of complex automation systems is rapidly spreading over automated manufacturing systems (AMS), where the integration of the mechanical and electronic technology, typical of the Mechatronics, is merging with other technologies such as Informatics and the communication networks. An AMS is a very complex system that can be thought constituted by a set of flexible working stations, one or more transportation systems. To understand how this machine are important in our society let considerate that every day most of us use bottles of water or soda, buy product in box like food or cigarets and so on. Another important consideration from its complexity derive from the fact that the the consortium of machine producers has estimated around 350 types of manufacturing machine. A large number of manufacturing machine industry are presented in Italy and notably packaging machine industry,in particular a great concentration of this kind of industry is located in Bologna area; for this reason the Bologna area is called “packaging valley”. Usually, the various parts of the AMS interact among them in a concurrent and asynchronous way, and coordinate the parts of the machine to obtain a desiderated overall behaviour is an hard task. Often, this is the case in large scale systems, organized in a modular and distributed manner. Even if the success of a modern AMS from a functional and behavioural point of view is still to attribute to the design choices operated in the definition of the mechanical structure and electrical electronic architecture, the system that governs the control of the plant is becoming crucial, because of the large number of duties associated to it. Apart from the activity inherent to the automation of themachine cycles, the supervisory system is called to perform other main functions such as: emulating the behaviour of traditional mechanical members thus allowing a drastic constructive simplification of the machine and a crucial functional flexibility; dynamically adapting the control strategies according to the different productive needs and to the different operational scenarios; obtaining a high quality of the final product through the verification of the correctness of the processing; addressing the operator devoted to themachine to promptly and carefully take the actions devoted to establish or restore the optimal operating conditions; managing in real time information on diagnostics, as a support of the maintenance operations of the machine. The kind of facilities that designers can directly find on themarket, in terms of software component libraries provides in fact an adequate support as regard the implementation of either top-level or bottom-level functionalities, typically pertaining to the domains of user-friendly HMIs, closed-loop regulation and motion control, fieldbus-based interconnection of remote smart devices. What is still lacking is a reference framework comprising a comprehensive set of highly reusable logic control components that, focussing on the cross-cutting functionalities characterizing the automation domain, may help the designers in the process of modelling and structuring their applications according to the specific needs. Historically, the design and verification process for complex automated industrial systems is performed in empirical way, without a clear distinction between functional and technological-implementation concepts and without a systematic method to organically deal with the complete system. Traditionally, in the field of analog and digital control design and verification through formal and simulation tools have been adopted since a long time ago, at least for multivariable and/or nonlinear controllers for complex time-driven dynamics as in the fields of vehicles, aircrafts, robots, electric drives and complex power electronics equipments. Moving to the field of logic control, typical for industrial manufacturing automation, the design and verification process is approached in a completely different way, usually very “unstructured”. No clear distinction between functions and implementations, between functional architectures and technological architectures and platforms is considered. Probably this difference is due to the different “dynamical framework”of logic control with respect to analog/digital control. As a matter of facts, in logic control discrete-events dynamics replace time-driven dynamics; hence most of the formal and mathematical tools of analog/digital control cannot be directly migrated to logic control to enlighten the distinction between functions and implementations. In addition, in the common view of application technicians, logic control design is strictly connected to the adopted implementation technology (relays in the past, software nowadays), leading again to a deep confusion among functional view and technological view. In Industrial automation software engineering, concepts as modularity, encapsulation, composability and reusability are strongly emphasized and profitably realized in the so-calledobject-oriented methodologies. Industrial automation is receiving lately this approach, as testified by some IEC standards IEC 611313, IEC 61499 which have been considered in commercial products only recently. On the other hand, in the scientific and technical literature many contributions have been already proposed to establish a suitable modelling framework for industrial automation. During last years it was possible to note a considerable growth in the exploitation of innovative concepts and technologies from ICT world in industrial automation systems. For what concerns the logic control design, Model Based Design (MBD) is being imported in industrial automation from software engineering field. Another key-point in industrial automated systems is the growth of requirements in terms of availability, reliability and safety for technological systems. In other words, the control system should not only deal with the nominal behaviour, but should also deal with other important duties, such as diagnosis and faults isolations, recovery and safety management. Indeed, together with high performance, in complex systems fault occurrences increase. This is a consequence of the fact that, as it typically occurs in reliable mechatronic systems, in complex systems such as AMS, together with reliable mechanical elements, an increasing number of electronic devices are also present, that are more vulnerable by their own nature. The diagnosis problem and the faults isolation in a generic dynamical system consists in the design of an elaboration unit that, appropriately processing the inputs and outputs of the dynamical system, is also capable of detecting incipient faults on the plant devices, reconfiguring the control system so as to guarantee satisfactory performance. The designer should be able to formally verify the product, certifying that, in its final implementation, it will perform itsrequired function guarantying the desired level of reliability and safety; the next step is that of preventing faults and eventually reconfiguring the control system so that faults are tolerated. On this topic an important improvement to formal verification of logic control, fault diagnosis and fault tolerant control results derive from Discrete Event Systems theory. The aimof this work is to define a design pattern and a control architecture to help the designer of control logic in industrial automated systems. The work starts with a brief discussion on main characteristics and description of industrial automated systems on Chapter 1. In Chapter 2 a survey on the state of the software engineering paradigm applied to industrial automation is discussed. Chapter 3 presentes a architecture for industrial automated systems based on the new concept of Generalized Actuator showing its benefits, while in Chapter 4 this architecture is refined using a novel entity, the Generalized Device in order to have a better reusability and modularity of the control logic. In Chapter 5 a new approach will be present based on Discrete Event Systems for the problemof software formal verification and an active fault tolerant control architecture using online diagnostic. Finally conclusive remarks and some ideas on new directions to explore are given. In Appendix A are briefly reported some concepts and results about Discrete Event Systems which should help the reader in understanding some crucial points in chapter 5; while in Appendix B an overview on the experimental testbed of the Laboratory of Automation of University of Bologna, is reported to validated the approach presented in chapter 3, chapter 4 and chapter 5. In Appendix C some components model used in chapter 5 for formal verification are reported.

Analysis of human body kinematics using a hybrid markerless video acquisition and processing

A main objective of the human movement analysis is the quantitative description of joint kinematics and kinetics. This information may have great possibility to address clinical problems both in orthopaedics and motor rehabilitation. Previous studies have shown that the assessment of kinematics and kinetics from stereophotogrammetric data necessitates a setup phase, special equipment and expertise to operate. Besides, this procedure may cause feeling of uneasiness on the subjects and may hinder with their walking. The general aim of this thesis is the implementation and evaluation of new 2D markerless techniques, in order to contribute to the development of an alternative technique to the traditional stereophotogrammetric techniques. At first, the focus of the study has been the estimation of the ankle-foot complex kinematics during stance phase of the gait. Two particular cases were considered: subjects barefoot and subjects wearing ankle socks. The use of socks was investigated in view of the development of the hybrid method proposed in this work. Different algorithms were analyzed, evaluated and implemented in order to have a 2D markerless solution to estimate the kinematics for both cases. The validation of the proposed technique was done with a traditional stereophotogrammetric system. The implementation of the technique leads towards an easy to configure (and more comfortable for the subject) alternative to the traditional stereophotogrammetric system. Then, the abovementioned technique has been improved so that the measurement of knee flexion/extension could be done with a 2D markerless technique. The main changes on the implementation were on occlusion handling and background segmentation. With the additional constraints, the proposed technique was applied to the estimation of knee flexion/extension and compared with a traditional stereophotogrammetric system. Results showed that the knee flexion/extension estimation from traditional stereophotogrammetric system and the proposed markerless system were highly comparable, making the latter a potential alternative for clinical use. A contribution has also been given in the estimation of lower limb kinematics of the children with cerebral palsy (CP). For this purpose, a hybrid technique, which uses high-cut underwear and ankle socks as “segmental markers” in combination with a markerless methodology, was proposed. The proposed hybrid technique is different than the abovementioned markerless technique in terms of the algorithm chosen. Results showed that the proposed hybrid technique can become a simple and low-cost alternative to the traditional stereophotogrammetric systems.

Aktionenlernen mit Selbstorganisierenden Karten und Reinforcement Learning

Die vorliegende Arbeit beschäftigt sich mit der Entwicklung eines Funktionsapproximators und dessen Verwendung in Verfahren zum Lernen von diskreten und kontinuierlichen Aktionen: 1. Ein allgemeiner Funktionsapproximator – Locally Weighted Interpolating Growing Neural Gas (LWIGNG) – wird auf Basis eines Wachsenden Neuralen Gases (GNG) entwickelt. Die topologische Nachbarschaft in der Neuronenstruktur wird verwendet, um zwischen benachbarten Neuronen zu interpolieren und durch lokale Gewichtung die Approximation zu berechnen. Die Leistungsfähigkeit des Ansatzes, insbesondere in Hinsicht auf sich verändernde Zielfunktionen und sich verändernde Eingabeverteilungen, wird in verschiedenen Experimenten unter Beweis gestellt. 2. Zum Lernen diskreter Aktionen wird das LWIGNG-Verfahren mit Q-Learning zur Q-LWIGNG-Methode verbunden. Dafür muss der zugrunde liegende GNG-Algorithmus abgeändert werden, da die Eingabedaten beim Aktionenlernen eine bestimmte Reihenfolge haben. Q-LWIGNG erzielt sehr gute Ergebnisse beim Stabbalance- und beim Mountain-Car-Problem und gute Ergebnisse beim Acrobot-Problem. 3. Zum Lernen kontinuierlicher Aktionen wird ein REINFORCE-Algorithmus mit LWIGNG zur ReinforceGNG-Methode verbunden. Dabei wird eine Actor-Critic-Architektur eingesetzt, um aus zeitverzögerten Belohnungen zu lernen. LWIGNG approximiert sowohl die Zustands-Wertefunktion als auch die Politik, die in Form von situationsabhängigen Parametern einer Normalverteilung repräsentiert wird. ReinforceGNG wird erfolgreich zum Lernen von Bewegungen für einen simulierten 2-rädrigen Roboter eingesetzt, der einen rollenden Ball unter bestimmten Bedingungen abfangen soll.

Parameterschätzung in zeitdiskreten ergodischen Markov-Prozessen am Beispiel des Cox-Ingersoll-Ross-Modells

In dieser Arbeit geht es um die Schätzung von Parametern in zeitdiskreten ergodischen Markov-Prozessen im allgemeinen und im CIR-Modell im besonderen. Beim CIR-Modell handelt es sich um eine stochastische Differentialgleichung, die von Cox, Ingersoll und Ross (1985) zur Beschreibung der Dynamik von Zinsraten vorgeschlagen wurde. Problemstellung ist die Schätzung der Parameter des Drift- und des Diffusionskoeffizienten aufgrund von äquidistanten diskreten Beobachtungen des CIR-Prozesses. Nach einer kurzen Einführung in das CIR-Modell verwenden wir die insbesondere von Bibby und Sørensen untersuchte Methode der Martingal-Schätzfunktionen und -Schätzgleichungen, um das Problem der Parameterschätzung in ergodischen Markov-Prozessen zunächst ganz allgemein zu untersuchen. Im Anschluss an Untersuchungen von Sørensen (1999) werden hinreichende Bedingungen (im Sinne von Regularitätsvoraussetzungen an die Schätzfunktion) für die Existenz, starke Konsistenz und asymptotische Normalität von Lösungen einer Martingal-Schätzgleichung angegeben. Angewandt auf den Spezialfall der Likelihood-Schätzung stellen diese Bedingungen zugleich lokal-asymptotische Normalität des Modells sicher. Ferner wird ein einfaches Kriterium für Godambe-Heyde-Optimalität von Schätzfunktionen angegeben und skizziert, wie dies in wichtigen Spezialfällen zur expliziten Konstruktion optimaler Schätzfunktionen verwendet werden kann. Die allgemeinen Resultate werden anschließend auf das diskretisierte CIR-Modell angewendet. Wir analysieren einige von Overbeck und Rydén (1997) vorgeschlagene Schätzer für den Drift- und den Diffusionskoeffizienten, welche als Lösungen quadratischer Martingal-Schätzfunktionen definiert sind, und berechnen das optimale Element in dieser Klasse. Abschließend verallgemeinern wir Ergebnisse von Overbeck und Rydén (1997), indem wir die Existenz einer stark konsistenten und asymptotisch normalen Lösung der Likelihood-Gleichung zeigen und lokal-asymptotische Normalität für das CIR-Modell ohne Einschränkungen an den Parameterraum beweisen.

Effect of hypoxia and hyperglycemia on cell bioenergetics

Mitochondria have a central role in energy supply in cells, ROS production and apoptosis and have been implicated in several human disease and mitochondrial dysfunctions in hypoxia have been related with disorders like Type II Diabetes, Alzheimer Disease, inflammation, cancer and ischemia/reperfusion in heart. When oxygen availability becomes limiting in cells, mitochondrial functions are modulated to allow biologic adaptation. Cells exposed to a reduced oxygen concentration readily respond by adaptive mechanisms to maintain the physiological ATP/ADP ratio, essential for their functions and survival. In the beginning, the AMP-activated protein kinase (AMPK) pathway is activated, but the responsiveness to prolonged hypoxia requires the stimulation of hypoxia-inducible factors (HIFs). In this work we report a study of the mitochondrial bioenergetics of primary cells exposed to a prolonged hypoxic period . To shine light on this issue we examined the bioenergetics of fibroblast mitochondria cultured in hypoxic atmospheres (1% O2) for 72 hours. Here we report on the mitochondrial organization in cells and on their contribution to the cellular energy state. Our results indicate that prolonged hypoxia cause a significant reduction of mitochondrial mass and of the quantity of the oxidative phosphorylation complexes. Hypoxia is also responsible to damage mitochondrial complexes as shown after normalization versus citrate synthase activity. HIF-1α plays a pivotal role in wound healing, and its expression in the multistage process of normal wound healing has been well characterized, it is necessary for cell motility, expression of angiogenic growth factor and recruitment of endothelial progenitor cells. We studied hypoxia in the pathological status of diabetes and complications of diabetes and we evaluated the combined effect of hyperglycemia and hypoxia on human dermal fibroblasts (HDFs) and human dermal micro-vascular endothelial cells (HDMECs) that were grown in high glucose, low glucose concentrations and mannitol as control for the osmotic challenge.

The future in action: neurophysiological and behavioral evidence of anticipatory motor simulation.

The motor system can no longer be considered as a mere passive executive system of motor commands generated elsewhere in the brain. On the contrary, it is deeply involved in perceptual and cognitive functions and acts as an “anticipation device”. The present thesis investigates the anticipatory motor mechanisms occurring in two particular instances: i) when processing sensory events occurring within the peripersonal space (PPS); and ii) when perceiving and predicting others’actions. The first study provides evidence that PPS representation in humans modulates neural activity within the motor system, while the second demonstrates that the motor mapping of sensory events occurring within the PPS critically relies on the activity of the premotor cortex. The third study provides direct evidence that the anticipatory motor simulation of others’ actions critically relies on the activity of the anterior node of the action observation network (AON), namely the inferior frontal cortex (IFC). The fourth study, sheds light on the pivotal role of the left IFC in predicting the future end state of observed right-hand actions. Finally, the fifth study examines how the ability to predict others’ actions could be influenced by a reduction of sensorimotor experience due to the traumatic or congenital loss of a limb. Overall, the present work provides new insights on: i) the anticipatory mechanisms of the basic reactivity of the motor system when processing sensory events occurring within the PPS, and the same anticipatory motor mechanisms when perceiving others’ implied actions; ii) the functional connectivity and plasticity of premotor-motor circuits both during the motor mapping of sensory events occurring within the PPS and when perceiving others’ actions; and iii) the anticipatory mechanisms related to others’ actions prediction.

Water-soluble organic compounds in air particulate matter analyzed by HPLC-DAD-MS and HPLC-MS/MS: abundance, sources and transformation of carboxylic acids, nitrophenols and nitrated proteins

Wasserlösliche organische Verbindungen (WSOCs) sind Hauptbestandteile atmosphärischer Aerosole, die bis zu ~ 50% und mehr der organischen Aerosolfraktion ausmachen. Sie können die optischen Eigenschaften sowie die Hygroskopizität von Aerosolpartikeln und damit deren Auswirkungen auf das Klima beeinflussen. Darüber hinaus können sie zur Toxizität und Allergenität atmosphärischer Aerosole beitragen.In dieser Studie wurde Hochleistungsflüssigchromatographie gekoppelt mit optischen Diodenarraydetektion und Massenspektrometrie (HPLC-DAD-MS und HPLC-MS/MS) angewandt, um WSOCs zu analysieren, die für verschiedene Aerosolquellen und -prozesse charakteristisch sind. Niedermolekulare Carbonsäuren und Nitrophenole wurden als Indikatoren für die Verbrennung fossiler Brennstoffe und die Entstehung sowie Alterung sekundärer organischer Aerosole (SOA) aus biogenen Vorläufern untersucht. Protein-Makromoleküle wurden mit Blick auf den Einfluss von Luftverschmutzung und Nitrierungsreaktionen auf die Allergenität primärer biologischer Aerosolpartikel – wie Pollen und Pilzsporen – untersucht.rnFilterproben von Grob- und Feinstaubwurden über ein Jahr hinweg gesammelt und auf folgende WSOCs untersucht: die Pinen-Oxidationsprodukte Pinsäure, Pinonsäure und 3-Methyl-1,2,3-Butantricarbonsäure (3-MBTCA) sowie eine Vielzahl anderer Dicarbonsäuren und Nitrophenole. Saisonale Schwankungen und andere charakteristische Merkmale werden mit Blick auf Aerosolquellen und -senken im Vergleich zu Daten anderen Studien und Regionen diskutiert. Die Verhätlnisse von Adipinsäure und Phthalsäure zu Azelainsäure deuten darauf hin, dass die untersuchten Aerosolproben hauptsächlich durch biogene Quellen beeinflusst werden. Eine ausgeprägte Arrhenius-artige Korrelation wurde zwischen der 3-MBTCA-¬Konzentration und der inversen Temperatur beobachtet (R2 = 0.79, Ea = 126±10 kJ mol-1, Temperaturbereich 275–300 K). Modellrechnungen zeigen, dass die Temperaturabhängigkeit auf eine Steigerung der photochemischen Produktionsraten von 3-MBTCA durch erhöhte OH-Radikal-Konzentrationen bei erhöhten Temperaturen zurückgeführt werden kann. Im Vergleich zur chemischen Reaktionskinetik scheint der Einfluss von Gas-Partikel-Partitionierungseffekten nur eine untergeordnete Rolle zu spielen. Die Ergebnisse zeigen, dass die OH-initiierte Oxidation von Pinosäure der geschwindigkeitsbestimmende Schritt der Bildung von 3-MBTCA ist. 3-MBTCA erscheint somit als Indikator für die chemische Alterung von biogener sekundärer organischer Aerosole (SOA) durch OH-Radikale geeignet. Eine Arrhenius-artige Temperaturabhängigkeit wurde auch für Pinäure beobachtet und kann durch die Temperaturabhängigkeit der biogenen Pinen-Emissionen als geschwindigkeitsbestimmender Schritt der Pinsäure-Bildung erklärt werden (R2 = 0.60, Ea = 84±9 kJ mol-1).rn rnFür die Untersuchung von Proteinnitrierungreaktionen wurde nitrierte Protein¬standards durch Flüssigphasenreaktion von Rinderserumalbumin (BSA) und Ovalbumin (OVA) mit Tetranitromethan (TNM) synthetisiert.Proteinnitrierung erfolgt vorrangig an den Resten der aromatischen Aminosäure Tyrosin auf, und mittels UV-Vis-Photometrie wurde der Proteinnnitrierungsgrad (ND) bestimmt. Dieser ist definiert als Verhältnis der mittleren Anzahl von Nitrotyrosinresten zur Tyrosinrest-Gesamtzahl in den Proteinmolekülen. BSA und OVA zeigten verschiedene Relationen zwischen ND und TNM/Tyrosin-Verhältnis im Reaktionsgemisch, was vermutlich auf Unterschiede in den Löslichkeiten und den molekularen Strukturen der beiden Proteine zurück zu führen ist.rnDie Nitrierung von BSA und OVA durch Exposition mit einem Gasgemisch aus Stickstoffdioxid (NO2) und Ozon (O3) wurde mit einer neu entwickelten HPLC-DAD-¬Analysemethode untersucht. Diese einfache und robuste Methode erlaubt die Bestimmung des ND ohne Hydrolyse oder Verdau der untersuchten Proteine und ernöglicht somit eine effiziente Untersuchung der Kinetik von Protein¬nitrierungs-Reaktionen. Für eine detaillierte Produktstudien wurden die nitrierten Proteine enzymatisch verdaut, und die erhaltenen Oligopeptide wurden mittels HPLC-MS/MS und Datenbankabgleich mit hoher Sequenzübereinstimmung analysiert. Die Nitrierungsgrade individueller Nitrotyrosin-Reste (NDY) korrelierten gut mit dem Gesamt-Proteinnitrierungsgrad (ND), und unterschiedliche Verhältnisse von NDY zu ND geben Aufschluss über die Regioselektivität der Reaktion. Die Nitrierungmuster von BSA und OVA nach Beahndlung mit TNM deuten darauf hin, dass die Nachbarschaft eines negativ geladenen Aminosäurerestes die Tyrosinnitrierung fördert. Die Behandlung von BSA durch NO2 und O3 führte zu anderend Nitrierungemustern als die Behandlung mit TNM, was darauf hindeutet, dass die Regioselektivität der Nitrierung vom Nitrierungsmittel abhängt. Es zeigt sich jedoch, dass Tyrosinreste in Loop-Strukturen bevorzugt und unabhängig vom Reagens nitriert werden.Die Methoden und Ergebnisse dieser Studie bilden eine Grundlage für weitere, detaillierte Untersuchungen der Reaktionskinetik sowie der Produkte und Mechanismen von Proteinnitrierungreaktionen. Sie sollen helfen, die Zusammenhänge zwischen verkehrsbedingten Luftschadstoffen wie Stickoxiden und Ozon und der Allergenität von Luftstaub aufzuklären.rn

Early steps in ventral nerve cord development in chelicerates and myriapods and formation of brain compartments in spiders

The central point of this work is the investigation of neurogenesis in chelicerates and myriapods. By comparing decisive mechanisms in neurogenesis in the four arthropod groups (Chelicerata, Crustacea, Insecta, Myriapoda) I was able to show which of these mechanisms are conserved and which developmental modules have diverged. Thereby two processes of embryonic development of the central nervous system were brought into focus. On the one hand I studied early neurogenesis in the ventral nerve cord of the spiders Cupiennius salei and Achaearanea tepidariorum and the millipede Glomeris marginata and on the other hand the development of the brain in Cupiennius salei.rnWhile the nervous system of insects and crustaceans is formed by the progeny of single neural stem cells (neuroblasts), in chelicerates and myriapods whole groups of cells adopt the neural cell fate and give rise to the ventral nerve cord after their invagination. The detailed comparison of the positions and the number of the neural precursor groups within the neuromeres in chelicerates and myriapods showed that the pattern is almost identical which suggests that the neural precursors groups in these arthropod groups are homologous. This pattern is also very similar to the neuroblast pattern in insects. This raises the question if the mechanisms that confer regional identity to the neural precursors is conserved in arthropods although the mode of neural precursor formation is different. The analysis of the functions and expression patterns of genes which are known to be involved in this mechanism in Drosophila melanogaster showed that neural patterning is highly conserved in arthropods. But I also discovered differences in early neurogenesis which reflect modifications and adaptations in the development of the nervous systems in the different arthropod groups.rnThe embryonic development of the brain in chelicerates which was investigated for the first time in this work shows similarities but also some modifications to insects. In vertebrates and arthropods the adult brain is composed of distinct centres with different functions. Investigating how these centres, which are organised in smaller compartments, develop during embryogenesis was part of this work. By tracing the morphogenetic movements and analysing marker gene expressions I could show the formation of the visual brain centres from the single-layered precheliceral neuroectoderm. The optic ganglia, the mushroom bodies and the arcuate body (central body) are formed by large invaginations in the peripheral precheliceral neuroectoderm. This epithelium itself contains neural precursor groups which are assigned to the respective centres and thereby build the three-dimensional optical centres. The single neural precursor groups are distinguishable during this process leading to the assumption that they carry positional information which might subdivide the individual brain centres into smaller functional compartments.rn

Quantifying and modeling financial market fluctuations

Die Entstehung eines Marktpreises für einen Vermögenswert kann als Superposition der einzelnen Aktionen der Marktteilnehmer aufgefasst werden, die damit kumulativ Angebot und Nachfrage erzeugen. Dies ist in der statistischen Physik mit der Entstehung makroskopischer Eigenschaften vergleichbar, die von mikroskopischen Wechselwirkungen zwischen den beteiligten Systemkomponenten hervorgerufen werden. Die Verteilung der Preisänderungen an Finanzmärkten unterscheidet sich deutlich von einer Gaußverteilung. Dies führt zu empirischen Besonderheiten des Preisprozesses, zu denen neben dem Skalierungsverhalten nicht-triviale Korrelationsfunktionen und zeitlich gehäufte Volatilität zählen. In der vorliegenden Arbeit liegt der Fokus auf der Analyse von Finanzmarktzeitreihen und den darin enthaltenen Korrelationen. Es wird ein neues Verfahren zur Quantifizierung von Muster-basierten komplexen Korrelationen einer Zeitreihe entwickelt. Mit dieser Methodik werden signifikante Anzeichen dafür gefunden, dass sich typische Verhaltensmuster von Finanzmarktteilnehmern auf kurzen Zeitskalen manifestieren, dass also die Reaktion auf einen gegebenen Preisverlauf nicht rein zufällig ist, sondern vielmehr ähnliche Preisverläufe auch ähnliche Reaktionen hervorrufen. Ausgehend von der Untersuchung der komplexen Korrelationen in Finanzmarktzeitreihen wird die Frage behandelt, welche Eigenschaften sich beim Wechsel von einem positiven Trend zu einem negativen Trend verändern. Eine empirische Quantifizierung mittels Reskalierung liefert das Resultat, dass unabhängig von der betrachteten Zeitskala neue Preisextrema mit einem Anstieg des Transaktionsvolumens und einer Reduktion der Zeitintervalle zwischen Transaktionen einhergehen. Diese Abhängigkeiten weisen Charakteristika auf, die man auch in anderen komplexen Systemen in der Natur und speziell in physikalischen Systemen vorfindet. Über 9 Größenordnungen in der Zeit sind diese Eigenschaften auch unabhängig vom analysierten Markt - Trends, die nur für Sekunden bestehen, zeigen die gleiche Charakteristik wie Trends auf Zeitskalen von Monaten. Dies eröffnet die Möglichkeit, mehr über Finanzmarktblasen und deren Zusammenbrüche zu lernen, da Trends auf kleinen Zeitskalen viel häufiger auftreten. Zusätzlich wird eine Monte Carlo-basierte Simulation des Finanzmarktes analysiert und erweitert, um die empirischen Eigenschaften zu reproduzieren und Einblicke in deren Ursachen zu erhalten, die zum einen in der Finanzmarktmikrostruktur und andererseits in der Risikoaversion der Handelsteilnehmer zu suchen sind. Für die rechenzeitintensiven Verfahren kann mittels Parallelisierung auf einer Graphikkartenarchitektur eine deutliche Rechenzeitreduktion erreicht werden. Um das weite Spektrum an Einsatzbereichen von Graphikkarten zu aufzuzeigen, wird auch ein Standardmodell der statistischen Physik - das Ising-Modell - auf die Graphikkarte mit signifikanten Laufzeitvorteilen portiert. Teilresultate der Arbeit sind publiziert in [PGPS07, PPS08, Pre11, PVPS09b, PVPS09a, PS09, PS10a, SBF+10, BVP10, Pre10, PS10b, PSS10, SBF+11, PB10].

Genetic and environmental factors associated with cardiovascular diseases and acute myocardial infarction

Acute myocardial infarction (AMI) is a multifactorial disease with a complex pathogenesis where lifestyle, individual genetic background and environmental risk factors are involved. Altered inflammatory responses seems to be implicated in the pathogenesis of atherosclerosis. To understand which genes may predispose to increased risk of cardiovascular disease gene polymorphism of immune regulatory genes, and clinical events from the Offs of parents with an early AMI were investigated. Genetics data from Offs were compared with those obtained from healthy subjects and an independent cohort of patients with clinical sporadic AMI. Rates of clinical events during a 24 years follow up from Offs and from an independent Italian population survey were also evaluated. This study showed that a genetic signature consisting of the concomitant presence of the CC genotype of VEGF, the A allele of IL-10 and the A allele of IFN-γ was indeed present in the Offs population. During the 24-year follow-up, Offs with a positive familiarity in spite of a relatively young age showed an increased prevalence of diabetes, ischemic heart disease and stroke. In these patients with the genetic signature the EBV and HHV-6 herpes virus were also investigated and founded. These findings reinforce the notion that subjects with a familial history of AMI are at risk of an accelerated aging of cardiovascular system resulting in cardiovascular events. These data suggest that selected genes with immune regulatory functions and envoronmental factors are part of the complex genetic background contributing to familiarity for cardiovascular diseases.N

Max Abraham's and Tullio Levi-Civita's approach to Einstein Theory of Relativity

This work deals with the theory of Relativity and its diffusion in Italy in the first decades of the XX century. Not many scientists belonging to Italian universities were active in understanding Relativity, but two of them, Max Abraham and Tullio Levi-Civita left a deep mark. Max Abraham engaged a substantial debate against Einstein between 1912 and 1914 about electromagnetic and gravitation aspects of the theories. Levi-Civita played a fundamental role in giving Einstein the correct mathematical instruments for the General Relativity formulation since 1915. This work, which doesn't have the aim of a mere historical chronicle of the events, wants to highlight two particular perspectives: on one hand, the importance of Abraham-Einstein debate in order to clarify the basis of Special Relativity, to observe the rigorous logical structure resulting from a fragmentary reasoning sequence and to understand Einstein's thinking; on the other hand, the originality of Levi-Civita's approach, quite different from the Einstein's one, characterized by the introduction of a method typical of General Relativity even to Special Relativity and the attempt to hide the two Einstein Special Relativity postulates.