Self-Organizing Map Neural Architectures Based on Limit Cycle Attractors

Recent efforts to develop large-scale neural architectures have paid relatively little attention to the use of self-organizing maps (SOMs). Part of the reason is that most conventional SOMs use a static encoding representation: Each input is typically represented by the fixed activation of a single node in the map layer. This not only carries information in an inefficient and unreliable way that impedes building robust multi-SOM neural architectures, but it is also inconsistent with rhythmic oscillations in biological neural networks. Here I develop and study an alternative encoding scheme that instead uses limit cycle attractors of multi-focal activity patterns to represent input patterns/sequences. Such a fundamental change in representation raises several questions: Can this be done effectively and reliably? If so, will map formation still occur? What properties would limit cycle SOMs exhibit? Could multiple such SOMs interact effectively? Could robust architectures based on such SOMs be built for practical applications? The principal results of examining these questions are as follows. First, conditions are established for limit cycle attractors to emerge in a SOM through self-organization when encoding both static and temporal sequence inputs. It is found that under appropriate conditions a set of learned limit cycles are stable, unique, and preserve input relationships. In spite of the continually changing activity in a limit cycle SOM, map formation continues to occur reliably. Next, associations between limit cycles in different SOMs are learned. It is shown that limit cycles in one SOM can be successfully retrieved by another SOM’s limit cycle activity. Control timings can be set quite arbitrarily during both training and activation. Importantly, the learned associations generalize to new inputs that have never been seen during training. Finally, a complete neural architecture based on multiple limit cycle SOMs is presented for robotic arm control. This architecture combines open-loop and closed-loop methods to achieve high accuracy and fast movements through smooth trajectories. The architecture is robust in that disrupting or damaging the system in a variety of ways does not completely destroy the system. I conclude that limit cycle SOMs have great potentials for use in constructing robust neural architectures.

MANIPULATION OF IONS, ELECTRONS, AND PHOTONS IN 2D MATERIALS BY ION INTERCALATION

2D materials have attracted tremendous attention due to their unique physical and chemical properties since the discovery of graphene. Despite these intrinsic properties, various modification methods have been applied to 2D materials that yield even more exciting results. Among all modification methods, the intercalation of 2D materials provides the highest possible doping and/or phase change to the pristine 2D materials. This doping effect highly modifies 2D materials, with extraordinary electrical transport as well as optical, thermal, magnetic, and catalytic properties, which are advantageous for optoelectronics, superconductors, thermoelectronics, catalysis and energy storage applications. To study the property changes of 2D materials, we designed and built a planar nanobattery that allows electrochemical ion intercalation in 2D materials. More importantly, this planar nanobattery enables characterization of electrical, optical and structural properties of 2D materials in situ and real time upon ion intercalation. With this device, we successfully intercalated Li-ions into few layer graphene (FLG) and ultrathin graphite, heavily dopes the graphene to 0.6 x 10^15 /cm2, which simultaneously increased its conductivity and transmittance in the visible range. The intercalated LiC6 single crystallite achieved extraordinary optoelectronic properties, in which an eight-layered Li intercalated FLG achieved transmittance of 91.7% (at 550 nm) and sheet resistance of 3 ohm/sq. We extend the research to obtain scalable, printable graphene based transparent conductors with ion intercalation. Surfactant free, printed reduced graphene oxide transparent conductor thin film with Na-ion intercalation is obtained with transmittance of 79% and sheet resistance of 300 ohm/sq (at 550 nm). The figure of merit is calculated as the best pure rGO based transparent conductors. We further improved the tunability of the reduced graphene oxide film by using two layers of CNT films to sandwich it. The tunable range of rGO film is demonstrated from 0.9 um to 10 um in wavelength. Other ions such as K-ion is also studied of its intercalation chemistry and optical properties in graphitic materials. We also used the in situ characterization tools to understand the fundamental properties and improve the performance of battery electrode materials. We investigated the Na-ion interaction with rGO by in situ Transmission electron microscopy (TEM). For the first time, we observed reversible Na metal cluster (with diameter larger than 10 nm) deposition on rGO surface, which we evidenced with atom-resolved HRTEM image of Na metal and electron diffraction pattern. This discovery leads to a porous reduced graphene oxide sodium ion battery anode with record high reversible specific capacity around 450 mAh/g at 25mA/g, a high rate performance of 200 mAh/g at 250 mA/g, and stable cycling performance up to 750 cycles. In addition, direct observation of irreversible formation of Na2O on rGO unveils the origin of commonly observed low 1st Columbic Efficiency of rGO containing electrodes. Another example for in situ characterization for battery electrode is using the planar nanobattery for 2D MoS2 crystallite. Planar nanobattery allows the intrinsic electrical conductivity measurement with single crystalline 2D battery electrode upon ion intercalation and deintercalation process, which is lacking in conventional battery characterization techniques. We discovered that with a “rapid-charging” process at the first cycle, the lithiated MoS2 undergoes a drastic resistance decrease, which in a regular lithiation process, the resistance always increases after lithiation at its final stage. This discovery leads to a 2- fold increase in specific capacity with with rapid first lithiated MoS2 composite electrode material, compare with the regular first lithiated MoS2 composite electrode material, at current density of 250 mA/g.

Remoção de ruídos sísmicos utilizando transformada de wavelet 1D e 2D com software em desenvolvimento

In the Hydrocarbon exploration activities, the great enigma is the location of the deposits. Great efforts are undertaken in an attempt to better identify them, locate them and at the same time, enhance cost-effectiveness relationship of extraction of oil. Seismic methods are the most widely used because they are indirect, i.e., probing the subsurface layers without invading them. Seismogram is the representation of the Earth s interior and its structures through a conveniently disposed arrangement of the data obtained by seismic reflection. A major problem in this representation is the intensity and variety of present noise in the seismogram, as the surface bearing noise that contaminates the relevant signals, and may mask the desired information, brought by waves scattered in deeper regions of the geological layers. It was developed a tool to suppress these noises based on wavelet transform 1D and 2D. The Java language program makes the separation of seismic images considering the directions (horizontal, vertical, mixed or local) and bands of wavelengths that form these images, using the Daubechies Wavelets, Auto-resolution and Tensor Product of wavelet bases. Besides, it was developed the option in a single image, using the tensor product of two-dimensional wavelets or one-wavelet tensor product by identities. In the latter case, we have the wavelet decomposition in a two dimensional signal in a single direction. This decomposition has allowed to lengthen a certain direction the two-dimensional Wavelets, correcting the effects of scales by applying Auto-resolutions. In other words, it has been improved the treatment of a seismic image using 1D wavelet and 2D wavelet at different stages of Auto-resolution. It was also implemented improvements in the display of images associated with breakdowns in each Auto-resolution, facilitating the choices of images with the signals of interest for image reconstruction without noise. The program was tested with real data and the results were good

Enhanced 3-Dimensional Carbon Nanotube Based Anodes for Li-ion Battery Applications

A prototype 3-dimensional (3D) anode, based on multiwall carbon nanotubes (MWCNTs), for Li-ion batteries (LIBs), with potential use in Electric Vehicles (EVs) was investigated. The unique 3D design of the anode allowed much higher areal mass density of MWCNTs as active materials, resulting in more amount of Li+ ion intake, compared to that of a conventional 2D counterpart. Furthermore, 3D amorphous Si/MWCNTs hybrid structure offered enhancement in electrochemical response (specific capacity 549 mAhg-1). Also, an anode stack was fabricated to further increase the areal or volumetric mass density of MWCNTs. An areal mass density of the anode stack 34.9 mg/cm2 was attained, which is 1,342% higher than the value for a single layer 2.6 mg/cm2. Furthermore, the binder-assisted and hot-pressed anode stack yielded the average reversible, stable gravimetric and volumetric specific capacities of 213 mAhg-1 and 265 mAh/cm3, respectively (at 0.5C). Moreover, a large-scale patterned novel flexible 3D MWCNTs-graphene-polyethylene terephthalate (PET) anode structure was prepared. It generated a reversible specific capacity of 153 mAhg-1 at 0.17C and cycling stability of 130 mAhg-1 up to 50 cycles at 1.7C.

Collaborative filtering and deep learning based recommendation system for cold start items

Recommender system is a specific type of intelligent systems, which exploits historical user ratings on items and/or auxiliary information to make recommendations on items to the users. It plays a critical role in a wide range of online shopping, e-commercial services and social networking applications. Collaborative filtering (CF) is the most popular approaches used for recommender systems, but it suffers from complete cold start (CCS) problem where no rating record are available and incomplete cold start (ICS) problem where only a small number of rating records are available for some new items or users in the system. In this paper, we propose two recommendation models to solve the CCS and ICS problems for new items, which are based on a framework of tightly coupled CF approach and deep learning neural network. A specific deep neural network SADE is used to extract the content features of the items. The state of the art CF model, timeSVD++, which models and utilizes temporal dynamics of user preferences and item features, is modified to take the content features into prediction of ratings for cold start items. Extensive experiments on a large Netflix rating dataset of movies are performed, which show that our proposed recommendation models largely outperform the baseline models for rating prediction of cold start items. The two proposed recommendation models are also evaluated and compared on ICS items, and a flexible scheme of model retraining and switching is proposed to deal with the transition of items from cold start to non-cold start status. The experiment results on Netflix movie recommendation show the tight coupling of CF approach and deep learning neural network is feasible and very effective for cold start item recommendation. The design is general and can be applied to many other recommender systems for online shopping and social networking applications. The solution of cold start item problem can largely improve user experience and trust of recommender systems, and effectively promote cold start items.

Matching theory based travel plan aware charging algorithms in V2G smart grid networks

The frequency, time and places of charging have large impact on the Quality of Experience (QoE) of EV drivers. It is critical to design effective EV charging scheduling system to improve the QoE of EV drivers. In order to improve EV charging QoE and utilization of CSs, we develop an innovative travel plan aware charging scheduling scheme for moving EVs to be charged at Charging Stations (CS). In the design of the proposed charging scheduling scheme for moving EVs, the travel routes of EVs and the utility of CSs are taken into consideration. The assignment of EVs to CSs is modeled as a two-sided many-to-one matching game with the objective of maximizing the system utility which reflects the satisfactory degrees of EVs and the profits of CSs. A Stable Matching Algorithm (SMA) is proposed to seek stable matching between charging EVs and CSs. Furthermore, an improved Learning based On-LiNe scheduling Algorithm (LONA) is proposed to be executed by each CS in a distributed manner. The performance gain of the average system utility by the SMA is up to 38.2% comparing to the Random Charging Scheduling (RCS) algorithm, and 4.67% comparing to Only utility of Electric Vehicle Concerned (OEVC) scheme. The effectiveness of the proposed SMA and LONA is also demonstrated by simulations in terms of the satisfactory ratio of charging EVs and the the convergence speed of iteration.

An Islanding Detection Method based on Impedance Estimation and Grid Identification for Grid-Tie Distributed Power Generation Systems

Power system policies are broadly on track to escalate the use of renewable energy resources in electric power generation. Integration of dispersed generation to the utility network not only intensifies the benefits of renewable generation but also introduces further advantages such as power quality enhancement and freedom of power generation for the consumers. However, issues arise from the integration of distributed generators to the existing utility grid are as significant as its benefits. The issues are aggravated as the number of grid-connected distributed generators increases. Therefore, power quality demands become stricter to ensure a safe and proper advancement towards the emerging smart grid. In this regard, system protection is the area that is highly affected as the grid-connected distributed generation share in electricity generation increases. Islanding detection, amongst all protection issues, is the most important concern for a power system with high penetration of distributed sources. Islanding occurs when a portion of the distribution network which includes one or more distributed generation units and local loads is disconnected from the remaining portion of the grid. Upon formation of a power island, it remains energized due to the presence of one or more distributed sources. This thesis introduces a new islanding detection technique based on an enhanced multi-layer scheme that shows superior performance over the existing techniques. It provides improved solutions for safety and protection of power systems and distributed sources that are capable of operating in grid-connected mode. The proposed active method offers negligible non-detection zone. It is applicable to micro-grids with a number of distributed generation sources without sacrificing the dynamic response of the system. In addition, the information obtained from the proposed scheme allows for smooth transition to stand-alone operation if required. The proposed technique paves the path towards a comprehensive protection solution for future power networks. The proposed method is converter-resident and all power conversion systems that are operating based on power electronics converters can benefit from this method. The theoretical analysis is presented, and extensive simulation results confirm the validity of the analytical work.

Estimation of Convective Extreme Events over Germany based on Large Scale Parameters

Strong convective events can produce extreme precipitation, hail, lightning or gusts, potentially inducing severe socio-economic impacts. These events have a relatively small spatial extension and, in most cases, a short lifetime. In this study, a model is developed for estimating convective extreme events based on large scale conditions. It is shown that strong convective events can be characterized by a Weibull distribution of radar-based rainfall with a low shape and high scale parameter value. A radius of 90km around a station reporting a convective situation turned out to be suitable. A methodology is developed to estimate the Weibull parameters and thus the occurrence probability of convective events from large scale atmospheric instability and enhanced near-surface humidity, which are usually found on a larger scale than the convective event itself. Here, the probability for the occurrence of extreme convective events is estimated from the KO-index indicating the stability, and relative humidity at 1000hPa. Both variables are computed from ERA-Interim reanalysis. In a first version of the methodology, these two variables are applied to estimate the spatial rainfall distribution and to estimate the occurrence of a convective event. The developed method shows significant skill in estimating the occurrence of convective events as observed at synoptic stations, lightning measurements, and severe weather reports. In order to take frontal influences into account, a scheme for the detection of atmospheric fronts is implemented. While generally higher instability is found in the vicinity of fronts, the skill of this approach is largely unchanged. Additional improvements were achieved by a bias-correction and the use of ERA-Interim precipitation. The resulting estimation method is applied to the ERA-Interim period (1979-2014) to establish a ranking of estimated convective extreme events. Two strong estimated events that reveal a frontal influence are analysed in detail. As a second application, the method is applied to GCM-based decadal predictions in the period 1979-2014, which were initialized every year. It is shown that decadal predictive skill for convective event frequencies over Germany is found for the first 3-4 years after the initialization.

Integration of process planning and scheduling using mobile-agent based approach in a networked manufacturing environment

Effective and efficient implementation of intelligent and/or recently emerged networked manufacturing systems require an enterprise level integration. The networked manufacturing offers several advantages in the current competitive atmosphere by way to reduce, by shortening manufacturing cycle time and maintaining the production flexibility thereby achieving several feasible process plans. The first step in this direction is to integrate manufacturing functions such as process planning and scheduling for multi-jobs in a network based manufacturing system. It is difficult to determine a proper plan that meets conflicting objectives simultaneously. This paper describes a mobile-agent based negotiation approach to integrate manufacturing functions in a distributed manner; and its fundamental framework and functions are presented. Moreover, ontology has been constructed by using the Protégé software which possesses the flexibility to convert knowledge into Extensible Markup Language (XML) schema of Web Ontology Language (OWL) documents. The generated XML schemas have been used to transfer information throughout the manufacturing network for the intelligent interoperable integration of product data models and manufacturing resources. To validate the feasibility of the proposed approach, an illustrative example along with varied production environments that includes production demand fluctuations is presented and compared the proposed approach performance and its effectiveness with evolutionary algorithm based Hybrid Dynamic-DNA (HD-DNA) algorithm. The results show that the proposed scheme is very effective and reasonably acceptable for integration of manufacturing functions.

Congenital thoracic vertebral malformations in brachycephalic “screw-tailed” dog breeds: Validation of a human classification scheme and a method of Cobb angle measurement in the assessment of vertebral column deformity

Congenital vertebral malformations are common in brachycephalic “screw-tailed” dog breeds such as French bulldogs, English bulldogs, Boston terriers, and Pugs. Those vertebral malformations disrupt the normal vertebral column anatomy and biomechanics, potentially leading to deformity of the vertebral column and subsequent neurological dysfunction. The initial aim of this work was to study and determine whether the congenital vertebral malformations identified in those breeds could be translated in a radiographic classification scheme used in humans to give an improved classification, with clear and well-defined terminology, with the expectation that this would facilitate future study and clinical management in the veterinary field. Therefore, two observers who were blinded to the neurologic status of the dogs classified each vertebral malformation based on the human classification scheme of McMaster and were able to translate them successfully into a new classification scheme for veterinary use. The following aim was to assess the nature and the impact of vertebral column deformity engendered by those congenital vertebral malformations in the target breeds. As no gold standard exists in veterinary medicine for the calculation of the degree of deformity, it was elected to adapt the human equivalent, termed the Cobb angle, as a potential standard reference tool for use in veterinary practice. For the validation of the Cobb angle measurement method, a computerised semi-automatic technique was used and assessed by multiple independent observers. They observed not only that Kyphosis was the most common vertebral column deformity but also that patients with such deformity were found to be more likely to suffer from neurological deficits, more especially if their Cobb angle was above 35 degrees.

Reductive dechlorination of TCE and cis-DCE by zero-valent iron and iron-based bimetallic reductants

CEs are the most frequently detected pollutants in groundwater. Several studies have been shown iron-based bimetallic reductants as a good method toward to chlorinated ethylenes degradation. However, many fundamental issues surrounding the chemistry of this phenomena remains elusive. In this study, kinetics and compound specific isotope analysis for reductive dechlorination of TCE and cis-DCE by unamended iron and iron-based bimetal reductants was evaluated. Generally, all the bimetals reductants tested revealed to increase the reactivity of the degradation, in which palladium and nickel were the additional metals more reactive. Ethene and ethane were the major products of TCE degradation. It is supported the simultaneous hydrogenolysis and β-elimination reaction hypothesis, however, the first step of TCE degradation by Au/Fe undergoes preferably by β-elimination, while by unamended iron, Pt/Fe and Co/Fe goes preferably by hydrogenolysis. No apparent elucidation was obtained to explain the high reactivity on bimetals systems; Degradação do TCE e cis-DCE por ferro de valência zero e redutores bimetálicos à base de ferro Resumo: Etilenos clorados são os poluentes mais frequentemente detetados na água subterrânea. Vários estudos têm mostrado que redutores bimetálicos à base de ferro são um bom método para a degradação dos etilenos clorados. Porém, muitas questões fundamentais acerca da química deste fenómeno permanecem elusivas. Neste estudo foi avaliada a cinética e a análise isotópica de compostos específicos para a degradação do TCE e cis-DCE por ferro e redutores bimetálicos à base de ferro. Genericamente, os redutores bimetálicos mostraram aumentar a reatividade da degradação, sendo paládio e níquel os metais adicionais mais reativos. Os produtos principais da degradação do TCE foram eteno e etano. É apoiada a hipótese da simultaneidade de hidrogenólise e β-eliminação, porém, o primeiro passo da degradação do TCE por Au/Fe é realizada preferencialmente por β-eliminação, enquanto por ferro, Pt/Fe e Co/Fe é realizada preferencialmente por hidrogenólise. Não houve uma elucidação aparente para explicar a reatividade nos sistemas bimetálicos.

Reconstituição histórica virtual do retábulo-mor da Igreja do Espírito Santo de Évora: aplicação ao Património da infografia web-based

As a part of a multidisciplinary and integrated research, including conservation sciences and history, a proposal is presented for the historical reconstitution and the virtual restoration of the mannerist altarpiece of the main altar at the Espírito Santo Church, in Évora. The collected data is abundant and the scientific information, because of its technicality, is less prone to be easily understood by the general public, thus becoming less accessible. Web-based infographics are explored as privileged forms of disseminating results and raising awareness to Cultural Heritage. The project materializes as an Internet platform where data and a reconstitution proposal are shared in a visual and interactive way. In addition to the digital virtual reconstitution (2D), some tridimensional models (3D) are presented of various elements of the altarpiece, obtained using methods of computer graphics and digital photogrammetry

A novel two-stage discrete crack method based on the screened Poisson equation and local mesh refinement

We propose an alternative crack propagation algo- rithm which effectively circumvents the variable transfer procedure adopted with classical mesh adaptation algo- rithms. The present alternative consists of two stages: a mesh-creation stage where a local damage model is employed with the objective of defining a crack-conforming mesh and a subsequent analysis stage with a localization limiter in the form of a modified screened Poisson equation which is exempt of crack path calculations. In the second stage, the crack naturally occurs within the refined region. A staggered scheme for standard equilibrium and screened Poisson equa- tions is used in this second stage. Element subdivision is based on edge split operations using a constitutive quantity (damage). To assess the robustness and accuracy of this algo- rithm, we use five quasi-brittle benchmarks, all successfully solved.

Computer-based monitoring platform for renewable energy systems: Four experimental application cases using NI LabVIEW

Sustainability and responsible environmental behaviour constitute a vital premise in the development of the humankind. In fact, during last decades, the global energetic scenario is evolving towards a scheme with increasing relevance of Renewable Energy Sources (RES) like photovoltaic, wind, biomass and hydrogen. Furthermore, hydrogen is an energy carrier which constitutes a mean for long-term energy storage. The integration of hydrogen with local RES contributes to distributed power generation and early introduction of hydrogen economy. Intermittent nature of many of RES, for instance solar and wind sources, impose the development of a management and control strategy to overcome this drawback. This strategy is responsible of providing a reliable, stable and efficient operation of the system. To implement such strategy, a monitoring system is required.The present paper aims to contribute to experimentally validate LabVIEW as valuable tool to develop monitoring platforms in the field of RES-based facilities. To this aim, a set of real systems successfully monitored is exposed.

Assessment of a best practise approach for the attribution and authentication of paintings

The ever-growing interest in scientific techniques, able to characterise the materials and rediscover the steps behind the execution of a painting, makes them widely accepted in its investigation. This research discusses issues emerging from attribution and authentication studies and proposes best practise for the characterisation of materials and techniques, favouring the contextualisation of the results in an integrated approach; the work aims to systematically classify paintings in categories that aid the examination of objects. A first grouping of paintings is based on the information initially available on them, identifying four categories. A focus of this study is the examination of case studies, spanning from the 16th to the 20th century, to evaluate and validate different protocols associated to each category, to show problems arising from paintings and explain advantages and limits of the approach. The research methodology incorporates a combined set of scientific techniques (non-invasive, such as technical imaging and XRF, micro-invasive, such as optical microscopy, SEM-EDS, FTIR, Raman microscopy and in one case radiocarbon dating) to answer the questions and, if necessary for the classification, exhaustively characterise the materials of the paintings, as the creation and contribution of shared technical databases related to various artists and their evolution over time is an objective tool that benefits this kind of study. The reliability of a close collaboration among different professionals is an essential aspect of this research to comprehensively study a painting, as the integration of stylistic, documentary and provenance studies corroborates the scientific findings and helps in the successful contextualisation of the results and the reconstruction of the history of the object.