Measuring complexity through average symmetry

This work introduces a complexity measure which addresses some conflicting issues between existing ones by using a new principle - measuring the average amount of symmetry broken by an object. It attributes low (although different) complexity to either deterministic or random homogeneous densities and higher complexity to the intermediate cases. This new measure is easily computable, breaks the coarse graining paradigm and can be straightforwardly generalized, including to continuous cases and general networks. By applying this measure to a series of objects, it is shown that it can be consistently used for both small scale structures with exact symmetry breaking and large scale patterns, for which, differently from similar measures, it consistently discriminates between repetitive patterns, random configurations and self-similar structures

Capacity of the upstart algorithm

The storage capacity of multilayer networks with overlapping receptive fields is investigated for a constructive algorithm within a one-step replica symmetry breaking (RSB) treatment. We find that the storage capacity increases logarithmically with the number of hidden units K without saturating the Mitchison-Durbin bound. The slope of the logarithmic increase decays exponentionally with the stability with which the patterns have been stored.

Threshold-induced phase transitions in perceptrons

Error rates of a Boolean perceptron with threshold and either spherical or Ising constraint on the weight vector are calculated for storing patterns from biased input and output distributions derived within a one-step replica symmetry breaking (RSB) treatment. For unbiased output distribution and non-zero stability of the patterns, we find a critical load, α p, above which two solutions to the saddlepoint equations appear; one with higher free energy and zero threshold and a dominant solution with non-zero threshold. We examine this second-order phase transition and the dependence of α p on the required pattern stability, κ, for both one-step RSB and replica symmetry (RS) in the spherical case and for one-step RSB in the Ising case.

Dynamics of on-line learning in radial basis function networks

On-line learning is examined for the radial basis function network, an important and practical type of neural network. The evolution of generalization error is calculated within a framework which allows the phenomena of the learning process, such as the specialization of the hidden units, to be analyzed. The distinct stages of training are elucidated, and the role of the learning rate described. The three most important stages of training, the symmetric phase, the symmetry-breaking phase, and the convergence phase, are analyzed in detail; the convergence phase analysis allows derivation of maximal and optimal learning rates. As well as finding the evolution of the mean system parameters, the variances of these parameters are derived and shown to be typically small. Finally, the analytic results are strongly confirmed by simulations.

Finite-connectivity spin-glass phase diagrams and low-density parity check codes

We obtain phase diagrams of regular and irregular finite-connectivity spin glasses. Contact is first established between properties of the phase diagram and the performance of low-density parity check (LDPC) codes within the replica symmetric (RS) ansatz. We then study the location of the dynamical and critical transition points of these systems within the one step replica symmetry breaking theory (RSB), extending similar calculations that have been performed in the past for the Bethe spin-glass problem. We observe that the location of the dynamical transition line does change within the RSB theory, in comparison with the results obtained in the RS case. For LDPC decoding of messages transmitted over the binary erasure channel we find, at zero temperature and rate R=14, an RS critical transition point at pc 0.67 while the critical RSB transition point is located at pc 0.7450±0.0050, to be compared with the corresponding Shannon bound 1-R. For the binary symmetric channel we show that the low temperature reentrant behavior of the dynamical transition line, observed within the RS ansatz, changes its location when the RSB ansatz is employed; the dynamical transition point occurs at higher values of the channel noise. Possible practical implications to improve the performance of the state-of-the-art error correcting codes are discussed. © 2006 The American Physical Society.

Inference by replication in densely connected systems

An efficient Bayesian inference method for problems that can be mapped onto dense graphs is presented. The approach is based on message passing where messages are averaged over a large number of replicated variable systems exposed to the same evidential nodes. An assumption about the symmetry of the solutions is required for carrying out the averages; here we extend the previous derivation based on a replica-symmetric- (RS)-like structure to include a more complex one-step replica-symmetry-breaking-like (1RSB-like) ansatz. To demonstrate the potential of the approach it is employed for studying critical properties of the Ising linear perceptron and for multiuser detection in code division multiple access (CDMA) under different noise models. Results obtained under the RS assumption in the noncritical regime give rise to a highly efficient signal detection algorithm in the context of CDMA; while in the critical regime one observes a first-order transition line that ends in a continuous phase transition point. Finite size effects are also observed. While the 1RSB ansatz is not required for the original problems, it was applied to the CDMA signal detection problem with a more complex noise model that exhibits RSB behavior, resulting in an improvement in performance. © 2007 The American Physical Society.

Nonlinear dynamics of a periodically driven Duffing resonator coupled to a Van der Pol oscillator

We explore the dynamics of a periodically driven Duffing resonator coupled elastically to a van der Pol oscillator in the case of 1?:?1 internal resonance in the cases of weak and strong coupling. Whilst strong coupling leads to dominating synchronization, the weak coupling case leads to a multitude of complex behaviours. A two-time scales method is used to obtain the frequency-amplitude modulation. The internal resonance leads to an antiresonance response of the Duffing resonator and a stagnant response (a small shoulder in the curve) of the van der Pol oscillator. The stability of the dynamic motions is also analyzed. The coupled system shows a hysteretic response pattern and symmetry-breaking facets. Chaotic behaviour of the coupled system is also observed and the dependence of the system dynamics on the parameters are also studied using bifurcation analysis.

Characterization of the hairpin vortex solution in plane Couette flow

Quantitative evidence that establishes the existence of the hairpin vortex state (HVS) in plane Couette flow (PCF) is provided in this work. The evidence presented in this paper shows that the HVS can be obtained via homotopy from a flow with a simple geometrical configuration, namely, the laterally heated flow (LHF). Although the early stages of bifurcations of LHF have been previously investigated, our linear stability analysis reveals that the root in the LHF yields multiple branches via symmetry breaking. These branches connect to the PCF manifold as steady nonlinear amplitude solutions. Moreover, we show that the HVS has a direct bifurcation route to the Rayleigh-Bénard convection. © 2010 The American Physical Society.

Characterizing femtosecond laser inscribed Bragg grating spectra

We present numerical modeling based on a combination of the Bidirectional Beam Propagation Method and Finite Element Method that completely describes the wavelength spectra of point by point femtosecond laser inscribed fiber Bragg gratings, showing excellent agreement with experiment. We have investigated the dependence of different spectral parameters such as insertion loss, all dominant cladding and ghost modes and their shape relative to the position of the fiber Bragg grating in the core of the fiber. Our model is validated by comparing model predictions with experimental data and allows for predictive modeling of the gratings. We expand our analysis to more complicated structures, where we introduce symmetry breaking; this highlights the importance of centered gratings and how maintaining symmetry contributes to the overall spectral quality of the inscribed Bragg gratings. Finally, the numerical modeling is applied to superstructure gratings and a comparison with experimental results reveals a capability for dealing with complex grating structures that can be designed with particular wavelength characteristics. (C) 2010 Optical Society of America

Numerical modelling of complex femtosecond laser inscribed fiber gratings - comparison wih experiment

We present experimental studies and numerical modeling based on a combination of the Bidirectional Beam Propagation Method and Finite Element Modeling that completely describes the wavelength spectra of point by point femtosecond laser inscribed fiber Bragg gratings, showing excellent agreement with experiment. We have investigated the dependence of different spectral parameters such as insertion loss, all dominant cladding and ghost modes and their shape relative to the position of the fiber Bragg grating in the core of the fiber. Our model is validated by comparing model predictions with experimental data and allows for predictive modeling of the gratings. We expand our analysis to more complicated structures, where we introduce symmetry breaking; this highlights the importance of centered gratings and how maintaining symmetry contributes to the overall spectral quality of the inscribed Bragg gratings. Finally, the numerical modeling is applied to superstructure gratings and a comparison with experimental results reveals a capability for dealing with complex grating structures that can be designed with particular wavelength characteristics.

Femtosecond laser inscribed Bragg sensor in Terfenol-D coated optical fibre with ablated microslot for the detection of static magnetic fields

A novel device for the detection and characterisation of static magnetic fields is presented. It consists of a femtosecond laser inscribed fibre Bragg grating (FBG) that is incorporated into an optical fibre with a femtosecond laser micromachined slot. The symmetry of the fibre is broken by the micro-slot, producing non-uniform strain across the fibre cross section. The sensing region is coated with Terfenol-D making the device sensitive to static magnetic fields, whereas the symmetry breaking results in a vectorial sensor for the detection of magnetic fields as low as 0.046 mT with a resolution of ±0.3mT in transmission and ±0.7mT in reflection. The sensor output is directly wavelength encoded from the FBG filtering, leading to simple demodulation through the monitoring of wavelength shifts that result as the fibre structure changes shape in response to the external magnetic field. The use of a femtosecond laser to both inscribe the FBG and micro-machine the slot in a single stage, prior to coating the device, significantly simplifies the sensor fabrication.

Femtosecond laser inscribed Bragg sensor in Terfenol-D coated optical fibre with ablated microslot for the detection of static magnetic fields

A novel device for the detection and characterisation of static magnetic fields is presented. It consists of a femtosecond laser inscribed fibre Bragg grating (FBG) that is incorporated into an optical fibre with a femtosecond laser micromachined slot. The symmetry of the fibre is broken by the micro-slot, producing non-uniform strain across the fibre cross section. The sensing region is coated with Terfenol-D making the device sensitive to static magnetic fields, whereas the symmetry breaking results in a vectorial sensor for the detection of magnetic fields as low as 0.046 mT with a resolution of ±0.3mT in transmission and ±0.7mT in reflection. The sensor output is directly wavelength encoded from the FBG filtering, leading to simple demodulation through the monitoring of wavelength shifts that result as the fibre structure changes shape in response to the external magnetic field. The use of a femtosecond laser to both inscribe the FBG and micro-machine the slot in a single stage, prior to coating the device, significantly simplifies the sensor fabrication.

Nonlinear multicore waveguiding structures with balanced gain and loss

We study existence, stability, and dynamics of linear and nonlinear stationary modes propagating in radially symmetric multicore waveguides with balanced gain and loss. We demonstrate that, in general, the system can be reduced to an effective PT-symmetric dimer with asymmetric coupling. In the linear case, we find that there exist two modes with real propagation constants before an onset of the PT-symmetry breaking while other modes have always the propagation constants with nonzero imaginary parts. This leads to a stable (unstable) propagation of the modes when gain is localized in the core (ring) of the waveguiding structure. In the case of nonlinear response, we show that an interplay between nonlinearity, gain, and loss induces a high degree of instability, with only small windows in the parameter space where quasistable propagation is observed. We propose a novel stabilization mechanism based on a periodic modulation of both gain and loss along the propagation direction that allows bounded light propagation in the multicore waveguiding structures.

Online learning in discrete hidden Markov models

We present and analyze three different online algorithms for learning in discrete Hidden Markov Models (HMMs) and compare their performance with the Baldi-Chauvin Algorithm. Using the Kullback-Leibler divergence as a measure of the generalization error we draw learning curves in simplified situations and compare the results. The performance for learning drifting concepts of one of the presented algorithms is analyzed and compared with the Baldi-Chauvin algorithm in the same situations. A brief discussion about learning and symmetry breaking based on our results is also presented. © 2006 American Institute of Physics.

Numerical modelling of complex femtosecond laser inscribed fiber gratings - comparison wih experiment

We present experimental studies and numerical modeling based on a combination of the Bidirectional Beam Propagation Method and Finite Element Modeling that completely describes the wavelength spectra of point by point femtosecond laser inscribed fiber Bragg gratings, showing excellent agreement with experiment. We have investigated the dependence of different spectral parameters such as insertion loss, all dominant cladding and ghost modes and their shape relative to the position of the fiber Bragg grating in the core of the fiber. Our model is validated by comparing model predictions with experimental data and allows for predictive modeling of the gratings. We expand our analysis to more complicated structures, where we introduce symmetry breaking; this highlights the importance of centered gratings and how maintaining symmetry contributes to the overall spectral quality of the inscribed Bragg gratings. Finally, the numerical modeling is applied to superstructure gratings and a comparison with experimental results reveals a capability for dealing with complex grating structures that can be designed with particular wavelength characteristics.