Self-Organizing Map Neural Architectures Based on Limit Cycle Attractors

Recent efforts to develop large-scale neural architectures have paid relatively little attention to the use of self-organizing maps (SOMs). Part of the reason is that most conventional SOMs use a static encoding representation: Each input is typically represented by the fixed activation of a single node in the map layer. This not only carries information in an inefficient and unreliable way that impedes building robust multi-SOM neural architectures, but it is also inconsistent with rhythmic oscillations in biological neural networks. Here I develop and study an alternative encoding scheme that instead uses limit cycle attractors of multi-focal activity patterns to represent input patterns/sequences. Such a fundamental change in representation raises several questions: Can this be done effectively and reliably? If so, will map formation still occur? What properties would limit cycle SOMs exhibit? Could multiple such SOMs interact effectively? Could robust architectures based on such SOMs be built for practical applications? The principal results of examining these questions are as follows. First, conditions are established for limit cycle attractors to emerge in a SOM through self-organization when encoding both static and temporal sequence inputs. It is found that under appropriate conditions a set of learned limit cycles are stable, unique, and preserve input relationships. In spite of the continually changing activity in a limit cycle SOM, map formation continues to occur reliably. Next, associations between limit cycles in different SOMs are learned. It is shown that limit cycles in one SOM can be successfully retrieved by another SOM’s limit cycle activity. Control timings can be set quite arbitrarily during both training and activation. Importantly, the learned associations generalize to new inputs that have never been seen during training. Finally, a complete neural architecture based on multiple limit cycle SOMs is presented for robotic arm control. This architecture combines open-loop and closed-loop methods to achieve high accuracy and fast movements through smooth trajectories. The architecture is robust in that disrupting or damaging the system in a variety of ways does not completely destroy the system. I conclude that limit cycle SOMs have great potentials for use in constructing robust neural architectures.

Nano-Engineering of Densely Packed Electrochemical Energy Storage Architectures by Atomic Layer Deposition

Nanostructures are highly attractive for future electrical energy storage devices because they enable large surface area and short ion transport time through thin electrode layers for high power devices. Significant enhancement in power density of batteries has been achieved by nano-engineered structures, particularly anode and cathode nanostructures spatially separated far apart by a porous membrane and/or a defined electrolyte region. A self-aligned nanostructured battery fully confined within a single nanopore presents a powerful platform to determine the rate performance and cyclability limits of nanostructured storage devices. Atomic layer deposition (ALD) has enabled us to create and evaluate such structures, comprised of nanotubular electrodes and electrolyte confined within anodic aluminum oxide (AAO) nanopores. The V2O5- V2O5 symmetric nanopore battery displays exceptional power-energy performance and cyclability when tested as a massively parallel device (~2billion/cm2), each with ~1m3 volume (~1fL). Cycled between 0.2V and 1.8V, this full cell has capacity retention of 95% at 5C rate and 46% at 150C, with more than 1000 charge/discharge cycles. These results demonstrate the promise of ultrasmall, self-aligned/regular, densely packed nanobattery structures as a testbed to study ionics and electrodics at the nanoscale with various geometrical modifications and as a building block for high performance energy storage systems[1, 2]. Further increase of full cell output potential is also demonstrated in asymmetric full cell configurations with various low voltage anode materials. The asymmetric full cell nanopore batteries, comprised of V2O5 as cathode and prelithiated SnO2 or anatase phase TiO2 as anode, with integrated nanotubular metal current collectors underneath each nanotubular storage electrode, also enabled by ALD. By controlling the amount of lithium ion prelithiated into SnO2 anode, we can tune full cell output voltage in the range of 0.3V and 3V. This asymmetric nanopore battery array displays exceptional rate performance and cyclability. When cycled between 1V and 3V, it has capacity retention of approximately 73% at 200C rate compared to 1C, with only 2% capacity loss after more than 500 charge/discharge cycles. With increased full cell output potential, the asymmetric V2O5-SnO2 nanopore battery shows significantly improved energy and power density. This configuration presents a more realistic test - through its asymmetric (vs symmetric) configuration – of performance and cyclability in nanoconfined environment. This dissertation covers (1) Ultra small electrochemical storage platform design and fabrication, (2) Electron and ion transport in nanostructured electrodes inside a half cell configuration, (3) Ion transport between anode and cathode in confined nanochannels in symmetric full cells, (4) Scale up energy and power density with geometry optimization and low voltage anode materials in asymmetric full cell configurations. As a supplement, selective growth of ALD to improve graphene conductance will also be discussed[3]. References: 1. Liu, C., et al., (Invited) A Rational Design for Batteries at Nanoscale by Atomic Layer Deposition. ECS Transactions, 2015. 69(7): p. 23-30. 2. Liu, C.Y., et al., An all-in-one nanopore battery array. Nature Nanotechnology, 2014. 9(12): p. 1031-1039. 3. Liu, C., et al., Improving Graphene Conductivity through Selective Atomic Layer Deposition. ECS Transactions, 2015. 69(7): p. 133-138.

Improvements in Hardware Transactional Memory for GPU Architectures

In the multi-core CPU world, transactional memory (TM)has emerged as an alternative to lock-based programming for thread synchronization. Recent research proposes the use of TM in GPU architectures, where a high number of computing threads, organized in SIMT fashion, requires an effective synchronization method. In contrast to CPUs, GPUs offer two memory spaces: global memory and local memory. The local memory space serves as a shared scratch-pad for a subset of the computing threads, and it is used by programmers to speed-up their applications thanks to its low latency. Prior work from the authors proposed a lightweight hardware TM (HTM) support based in the local memory, modifying the SIMT execution model and adding a conflict detection mechanism. An efficient implementation of these features is key in order to provide an effective synchronization mechanism at the local memory level. After a quick description of the main features of our HTM design for GPU local memory, in this work we gather together a number of proposals designed with the aim of improving those mechanisms with high impact on performance. Firstly, the SIMT execution model is modified to increase the parallelism of the application when transactions must be serialized in order to make forward progress. Secondly, the conflict detection mechanism is optimized depending on application characteristics, such us the read/write sets, the probability of conflict between transactions and the existence of read-only transactions. As these features can be present in hardware simultaneously, it is a task of the compiler and runtime to determine which ones are more important for a given application. This work includes a discussion on the analysis to be done in order to choose the best configuration solution.

A Qualitative Study of the Status of Children’s Play From the Viewpoints of Experts and Suggestions for Promotion Interventions

Background: The latest national census reports the population of Iranian children (1 - 8 years old) about 11 millions. On the other hand, the latest population policies approved by supreme cultural revolution council (SCRC) will make this population increase faster. Childhood development is one of the social determinants of health, of which “child’s play” is a part. Objectives: This study is an effort to identify difficulties and challenges of the plays influential on Iranian children’s health nationwide, in order to present enhancive strategies by utilizing the views of stakeholders and national studies. Patients and Methods: Analyzing children’s play stakeholders, main organizations were identified and views of 13 informed people involved in the field were investigated through deep semi-structured interview. A denaturalized approach was employed in analyzing the data. In addition to descriptions of the state, interventions development, and designing the conceptual model, national reports and studies, and other countries’ experiences were also reviewed. Results: Society’s little knowledge of “children’s plays”, absence of administrators for children’s play, shortage of public facilities for children’s play and improper geographical and demographic availability, absence of policies for Iranian “toy”, and little attention of media to the issue are the five major problems as stated by interviewees. Conclusions: The proposed interventions are presented as “promoting the educational levels of parents and selected administrators for children’s play”, “approving the play and toy policy for Iran 2025”, and “increasing public facilities for children’s play with defined distribution and availability”.

Security Evaluation of Substation Network Architectures

In recent years, security of industrial control systems has been the main research focus due to the potential cyber-attacks that can impact the physical operations. As a result of these risks, there has been an urgent need to establish a stronger security protection against these threats. Conventional firewalls with stateful rules can be implemented in the critical cyberinfrastructure environment which might require constant updates. Despite the ongoing effort to maintain the rules, the protection mechanism does not restrict malicious data flows and it poses the greater risk of potential intrusion occurrence. The contributions of this thesis are motivated by the aforementioned issues which include a systematic investigation of attack-related scenarios within a substation network in a reliable sense. The proposed work is two-fold: (i) system architecture evaluation and (ii) construction of attack tree for a substation network. Cyber-system reliability remains one of the important factors in determining the system bottleneck for investment planning and maintenance. It determines the longevity of the system operational period with or without any disruption. First, a complete enumeration of existing implementation is exhaustively identified with existing communication architectures (bidirectional) and new ones with strictly unidirectional. A detailed modeling of the extended 10 system architectures has been evaluated. Next, attack tree modeling for potential substation threats is formulated. This quantifies the potential risks for possible attack scenarios within a network or from the external networks. The analytical models proposed in this thesis can serve as a fundamental development that can be further researched.

COMPARATIVE ANALYSIS OF EFFICIENCY AND OPERATING CHARACTERISTICS OF AUTOMOTIVE POWERTRAIN ARCHITECTURES THROUGH CHASSIS DYNAMOMETER TESTING

The thesis "COMPARATIVE ANALYSIS OF EFFICIENCY AND OPERATING CHARACTERISTICS OF AUTOMOTIVE POWERTRAIN ARCHITECTURES THROUGH CHASSIS DYNAMOMETER TESTING" was completed through a collaborative partnership between Michigan Technological University and Argonne National Laboratory under a contractual agreement titled "Advanced Vehicle Characterization at Argonne National Laboratory". The goal of this project was to investigate, understand and document the performance and operational strategy of several modern passenger vehicles of various architectures. The vehicles were chosen to represent several popular engine and transmission architectures and were instrumented to allow for data collection to facilitate comparative analysis. In order to ensure repeatability and reliability during testing, each vehicle was tested over a series of identical drive cycles in a controlled environment utilizing a vehicle chassis dynamometer. Where possible, instrumentation was preserved between vehicles to ensure robust data collection. The efficiency and fuel economy performance of the vehicles was studied. In addition, the powertrain utilization strategies, significant energy loss sources, tailpipe emissions, combustion characteristics, and cold start behavior were also explored in detail. It was concluded that each vehicle realizes different strengths and suffers from different limitations in the course of their attempts to maximize efficiency and fuel economy. In addition, it was observed that each vehicle regardless of architecture exhibits significant energy losses and difficulties in cold start operation that can be further improved with advancing technology. It is clear that advanced engine technologies and driveline technologies are complimentary aspects of vehicle design that must be utilized together for best efficiency improvements. Finally, it was concluded that advanced technology vehicles do not come without associated cost; the complexity of the powertrains and lifecycle costs must be considered to understand the full impact of advanced vehicle technology.

Hybrid Power System Intelligent Operation and Protection Involving Distributed Architectures and Pulsed Loads

Efficient and reliable techniques for power delivery and utilization are needed to account for the increased penetration of renewable energy sources in electric power systems. Such methods are also required for current and future demands of plug-in electric vehicles and high-power electronic loads. Distributed control and optimal power network architectures will lead to viable solutions to the energy management issue with high level of reliability and security. This dissertation is aimed at developing and verifying new techniques for distributed control by deploying DC microgrids, involving distributed renewable generation and energy storage, through the operating AC power system. To achieve the findings of this dissertation, an energy system architecture was developed involving AC and DC networks, both with distributed generations and demands. The various components of the DC microgrid were designed and built including DC-DC converters, voltage source inverters (VSI) and AC-DC rectifiers featuring novel designs developed by the candidate. New control techniques were developed and implemented to maximize the operating range of the power conditioning units used for integrating renewable energy into the DC bus. The control and operation of the DC microgrids in the hybrid AC/DC system involve intelligent energy management. Real-time energy management algorithms were developed and experimentally verified. These algorithms are based on intelligent decision-making elements along with an optimization process. This was aimed at enhancing the overall performance of the power system and mitigating the effect of heavy non-linear loads with variable intensity and duration. The developed algorithms were also used for managing the charging/discharging process of plug-in electric vehicle emulators. The protection of the proposed hybrid AC/DC power system was studied. Fault analysis and protection scheme and coordination, in addition to ideas on how to retrofit currently available protection concepts and devices for AC systems in a DC network, were presented. A study was also conducted on the effect of changing the distribution architecture and distributing the storage assets on the various zones of the network on the system’s dynamic security and stability. A practical shipboard power system was studied as an example of a hybrid AC/DC power system involving pulsed loads. Generally, the proposed hybrid AC/DC power system, besides most of the ideas, controls and algorithms presented in this dissertation, were experimentally verified at the Smart Grid Testbed, Energy Systems Research Laboratory. All the developments in this dissertation were experimentally verified at the Smart Grid Testbed.

Améliorer la compréhension et la gestion des conflits d’intérêts des experts conseillant la prise de décisions en santé publique

Étude de cas / Case study

L'enseignement des jeux sportifs collectifs d'invasion à l'école: enseignants experts vs enseignants débutants

Les modèles d'enseignement sur les aspects pédagogiques portant sur la pratique sportive servent de base à l'élaboration de cette étude. Ces modèles renvoient au type d'approche et d'intervention des enseignants en ce qui concerne l’enseignement des jeux sportifs collectifs d’invasion (ci-après JSC), selon l'expertise. 8 professeurs d'éducation physique ont fait partie de cette étude, dont 4 experts et 4 débutants, sur un total de 16 cours observés. Les données statistiques ont été analysées en utilisant le logiciel IBM SPSS. L'analyse des résultats a démontré que les professeurs experts tendent à utiliser de plus amples espaces, et tendent, par défaut, à recourir au jeu formel, au détriment des jeux réduits ou conditionnés, plus couramment utilisés par le groupe d'enseignants débutants. Quant au niveau de feedback proposé, nous avons pu détecter quelques différences. Les enseignants débutants procèdent davantage à des feedbacks descriptifs, alors que le groupe d'experts opte plutôt pour des feedbacks prescriptifs.

Améliorer la compréhension et la gestion des conflits d’intérêts des experts conseillant la prise de décisions en santé publique

Étude de cas / Case study

Enseignantes et enseignants experts en histoire : Comment se développe leur expertise?

L’objet de cette recherche concerne le développement de l’expertise enseignante chez les enseignantes et les enseignants d’histoire au secondaire. Une recension des écrits nous a permis d’identifier des aspects qui contribuent au développement professionnel comme les réseaux professionnels, la formation continue ou congrès, le mentorat, des lectures d’ouvrages spécialisés, des collègues de travail et l’expérience. L’objectif de recherche était d’identifier, auprès d’enseignantes et d’enseignants d’histoire au secondaire, quels sont les aspects et les expériences professionnelles qui ont contribué au développement de leur expertise professionnelle. Cette recherche, dite qualitative/interprétative de type exploratoire, repose sur la stratégie du récit de vie. Les participants sont quatre enseignants d’histoire au secondaire considérés comme experts. L’entrevue semi-dirigée a permis de colliger des données qualitatives quant aux aspects et aux expériences professionnelles ayant contribué au développement de leur expertise enseignante. Les résultats de recherche indiquent que les aspects ciblés au départ ont influencé à divers degrés le cheminement des experts participants. D’autres aspects ont émergé comme étant marquants dans le développement professionnel comme la passion ou l’intérêt pour l’enseignement de l’histoire, la qualité des relations tant avec les élèves qu’avec les collègues et la capacité de réfléchir sur sa pratique. Toutefois, trois aspects favorisent plus particulièrement le développement de l’expertise soit l’expérience, les compétences professionnelles en enseignement qui regroupent la préparation de cours, la réflexion sur sa pratique et la relation maitre/élève puis les collègues de travail. Cette recherche est utile parce qu’elle apporte un éclairage sur les aspects contribuant au développement de l’expertise enseignante et peut ouvrir la voie vers une autre étude qui mettrait en évidence les différences entre les voies empruntées pour développer cette dernière.

Synthesis of the contribution of the GiESCO (group of International Experts of vitivinicultural Systems for CoOperation) to the study of terroirs.

2010

Powertrain Architectures and Technologies for New Emission and Fuel Consumption Standards

New powertrain design is highly influenced by CO2 and pollutant limits defined by legislations, the demand of fuel economy in for real conditions, high performances and acceptable cost. To reach the requirements coming from both end-users and legislations, several powertrain architectures and engine technologies are possible (e.g. SI or CI engines), with many new technologies, new fuels, and different degree of electrification. The benefits and costs given by the possible architectures and technology mix must be accurately evaluated by means of objective procedures and tools in order to choose among the best alternatives. This work presents a basic design methodology and a comparison at concept level of the main powertrain architectures and technologies that are currently being developed, considering technical benefits and their cost effectiveness. The analysis is carried out on the basis of studies from the technical literature, integrating missing data with evaluations performed by means of powertrain-vehicle simplified models, considering the most important powertrain architectures. Technology pathways for passenger cars up to 2025 and beyond have been defined. After that, with support of more detailed models and experimentations, the investigation has been focused on the more promising technologies to improve internal combustion engine, such as: water injection, low temperature combustions and heat recovery systems.