Self-Organizing Map Neural Architectures Based on Limit Cycle Attractors

Recent efforts to develop large-scale neural architectures have paid relatively little attention to the use of self-organizing maps (SOMs). Part of the reason is that most conventional SOMs use a static encoding representation: Each input is typically represented by the fixed activation of a single node in the map layer. This not only carries information in an inefficient and unreliable way that impedes building robust multi-SOM neural architectures, but it is also inconsistent with rhythmic oscillations in biological neural networks. Here I develop and study an alternative encoding scheme that instead uses limit cycle attractors of multi-focal activity patterns to represent input patterns/sequences. Such a fundamental change in representation raises several questions: Can this be done effectively and reliably? If so, will map formation still occur? What properties would limit cycle SOMs exhibit? Could multiple such SOMs interact effectively? Could robust architectures based on such SOMs be built for practical applications? The principal results of examining these questions are as follows. First, conditions are established for limit cycle attractors to emerge in a SOM through self-organization when encoding both static and temporal sequence inputs. It is found that under appropriate conditions a set of learned limit cycles are stable, unique, and preserve input relationships. In spite of the continually changing activity in a limit cycle SOM, map formation continues to occur reliably. Next, associations between limit cycles in different SOMs are learned. It is shown that limit cycles in one SOM can be successfully retrieved by another SOM’s limit cycle activity. Control timings can be set quite arbitrarily during both training and activation. Importantly, the learned associations generalize to new inputs that have never been seen during training. Finally, a complete neural architecture based on multiple limit cycle SOMs is presented for robotic arm control. This architecture combines open-loop and closed-loop methods to achieve high accuracy and fast movements through smooth trajectories. The architecture is robust in that disrupting or damaging the system in a variety of ways does not completely destroy the system. I conclude that limit cycle SOMs have great potentials for use in constructing robust neural architectures.

Continuation of limit cycles near saddle homoclinic points using splines in phase space

We present a new algorithm for continuation of limit cycles of autonomous systems as a system parameter is varied. The algorithm works in phase space with an ordered set of points on the limit cycle, along with spline interpolation. Currently popular algorithms in bifurcation analysis packages compute time-domain approximations of limit cycles using either shooting or collocation. The present approach seems useful for continuation near saddle homoclinic points, where it encounters a corner while time-domain methods essentially encounter a discontinuity (a relatively short period of rapid variation). Other phase space-based algorithms use rescaled arclength in place of time, but subsequently resemble the time-domain methods. Compared to these, we introduce additional freedom through a variable stretching of arclength based on local curvature, through the use of an auxiliary index-based variable. Several numerical examples are presented. Comparisons with results from the popular package, MATCONT, are favorable close to saddle homoclinic points.

LIMIT CYCLES of DISCONTINUOUS PIECEWISE LINEAR DIFFERENTIAL SYSTEMS

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Discussion on the limit cycles of the Lev Ginzburg equation by M. Bellamy and R.E. Mickens, Journal of Sound and Vibration 308 (2007) 337-342

The authors M. Bellamy and R.E. Mickens in the article "Hopf bifurcation analysis of the Lev Ginzburg equation" published in Journal of Sound and Vibration 308 (2007) 337-342, claimed that this differential equation in the plane can exhibit a limit cycle. Here we prove that the Lev Ginzburg differential equation has no limit cycles. (C) 2012 Elsevier Ltd. All rights reserved.

Universality and Scaling Limit of Weakly-Bound Tetramers

The occurrence of a new limit cycle in few-body physics, expressing a universal scaling function relating the binding energies of two successive tetramer states, is revealed by considering a renormalized zero-range two-body interaction in bound state of four identical bosons. The tetramer energy spectrum is obtained by adding a boson to an Efimov bound state with energy B-3 in the unitary limit (for zero two-body binding energy or infinite two-body scattering length). Each excited N-th tetramer energy B-4((N)) is shown to slide along a scaling function as a short-range four-body scale is changed, emerging from the 3+1 threshold for a universal ratio B-4((N))/B-3 = 4.6, which does not depend on N. The new scale can also be revealed by a resonance in the atom-trimer recombination process.

Limit Cycles for a Class of Continuous and Discontinuous Cubic Polynomial Differential Systems

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

On the number of limit cycles in discontinuous piecewise linear differential systems with two pieces separated by a straight line

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

On the Limit Cycles for a Class of Continuous Piecewise Linear Differential Systems with Three Zones

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Periodic oscillations in feedback systems with combined pulse modulation

This paper presents a systematic method of investigating the existence of limit cycle oscillations in feedback systems with combined integral pulse frequency-pulse width (IPF-P/V) modulation. The method is based on the non-linear discrete equivalence of the continuous feedback system containing the IPF-PW modulator.

Spectral states and accretion geometries in Galactic black hole binaries

Black hole X-ray binaries, binary systems where matter from a companion star is accreted by a stellar mass black hole, thereby releasing enormous amounts of gravitational energy converted into radiation, are seen as strong X-ray sources in the sky. As a black hole can only be detected via its interaction with its surroundings, these binary systems provide important evidence for the existence of black holes. There are now at least twenty cases where the measured mass of the X-ray emitting compact object in a binary exceeds the upper limit for a neutron star, thus inferring the presence of a black hole. These binary systems serve as excellent laboratories not only to study the physics of accretion but also to test predictions of general relativity in strongly curved space time. An understanding of the accretion flow onto these, the most compact objects in our Universe, is therefore of great importance to physics. We are only now slowly beginning to understand the spectra and variability observed in these X-ray sources. During the last decade, a framework has developed that provides an interpretation of the spectral evolution as a function of changes in the physics and geometry of the accretion flow driven by a variable accretion rate. This doctoral thesis presents studies of two black hole binary systems, Cygnus~X-1 and GRS~1915+105, plus the possible black hole candidate Cygnus~X-3, and the results from an attempt to interpret their observed properties within this emerging framework. The main result presented in this thesis is an interpretation of the spectral variability in the enigmatic source Cygnus~X-3, including the nature and accretion geometry of its so-called hard spectral state. The results suggest that the compact object in this source, which has not been uniquely identified as a black hole on the basis of standard mass measurements, is most probably a massive, ~30 Msun, black hole, and thus the most massive black hole observed in a binary in our Galaxy so far. In addition, results concerning a possible observation of limit-cycle variability in the microquasar GRS~1915+105 are presented as well as evidence of `mini-hysteresis' in the extreme hard state of Cygnus X-1.

Neural network modeling of associative memory: Beyond the Hopfield model

A number of neural network models, in which fixed-point and limit-cycle attractors of the underlying dynamics are used to store and associatively recall information, are described. In the first class of models, a hierarchical structure is used to store an exponentially large number of strongly correlated memories. The second class of models uses limit cycles to store and retrieve individual memories. A neurobiologically plausible network that generates low-amplitude periodic variations of activity, similar to the oscillations observed in electroencephalographic recordings, is also described. Results obtained from analytic and numerical studies of the properties of these networks are discussed.

Synchronization of globally coupled two-state stochastic oscillators with a state-dependent refractory period

We present a model of identical coupled two-state stochastic units, each of which in isolation is governed by a fixed refractory period. The nonlinear coupling between units directly affects the refractory period, which now depends on the global state of the system and can therefore itself become time dependent. At weak coupling the array settles into a quiescent stationary state. Increasing coupling strength leads to a saddle node bifurcation, beyond which the quiescent state coexists with a stable limit cycle of nonlinear coherent oscillations. We explicitly determine the critical coupling constant for this transition.

Asymptotic solutions to a class of nonlinear oscillation systems

In this paper, we present an asymptotic method for the analysis of a class of strongly nonlinear oscillators, derive second-order approximate solutions to them expressed in terms of their amplitudes and phases, and obtain the equations governing the amplitudes and phases, by which the amplitudes of the corresponding limit cycles and their behaviour can be determined. As an example, we investigate the modified van der Pol oscillator and give the second-order approximate analytical solution of its limit cycle. The comparison with the numerical solutions shows that the two results agree well with each other.

Formation Mechanism Of Lamellar Chips During Machining Of Bulk Metallic Glass

The uniqThe unique lamellar chips formed in turning–machining of a Vit 1 bulk metallic glass (BMG) are found to be due to repeated shearband formation in the primary shear zone (PSZ). A coupled thermomechanical orthogonal cutting model, taking into account force, free volume and energy balance in the PSZ, is developed to quantitatively characterize lamellar chip formation. Its onset criterion is revealed through a linear perturbation analysis. Lamellar chip formation is understood as a self-sustained limit-cycle phenomenon: there is autonomous feedback in stress, free volume and temperature in the PSZ. The underlying mechanism is the symmetry breaking of free volume flow and source, rather than thermal instability. These results are fundamentally useful for machining BMGs and even for understanding the physical nature of inhomogeneous flow in BMGs.ue lamellar chips formed in turning–machining of a Vit 1 bulk metallic glass (BMG) are found to be due to repeated shearband.

Model-based control of a Rijke tube combustion instability

A Rijke tube is used to demonstrate model-based control of a combustion instability, where controller design is based on measurement of the unstable system. The Rijke tube used was of length 0.75m and had a grid-stabilised laminar flame in its lower half. A microphone was used as a sensor and a loudspeaker as an actuator for active control. The open loop transfer function (OLTF) required for controller design was that from the actuator to the sensor. This was measured experimentally by sending a signal with two components to the actuator. The first was a control component from an empirically designed controller, which was used to stabilise the system, thus eliminating the non-linear limit cycle. The second was a high bandwidth signal for identification of the OLTF. This approach to measuring the OLTF is generic and can be applied to large-scale combustors. The measured OLTF showed that only the fundamental mode of the tube was unstable; this was consistent with the OLTF predicted by a mathematical model of the tube, involving 1-D linear acoustic waves and a time delay heat release model. Based on the measured OLTF, a controller to stabilise the instability was designed using Nyquist techniques. This was implemented and was seen to result in an 80dB reduction in the microphone pressure spectrum. A robustness study was performed by adding an additional length to the top of the Rijke tobe. The controller was found to achieve control up to an increase in tube length of 19%. This compared favourably with the empirical controller, which lost control for an increase in tube length of less than 3%.