Threshold-induced phase transitions in perceptrons

Error rates of a Boolean perceptron with threshold and either spherical or Ising constraint on the weight vector are calculated for storing patterns from biased input and output distributions derived within a one-step replica symmetry breaking (RSB) treatment. For unbiased output distribution and non-zero stability of the patterns, we find a critical load, α p, above which two solutions to the saddlepoint equations appear; one with higher free energy and zero threshold and a dominant solution with non-zero threshold. We examine this second-order phase transition and the dependence of α p on the required pattern stability, κ, for both one-step RSB and replica symmetry (RS) in the spherical case and for one-step RSB in the Ising case.

Phase transitions and memory effects in the dynamics of Boolean networks

The generating functional method is employed to investigate the synchronous dynamics of Boolean networks, providing an exact result for the system dynamics via a set of macroscopic order parameters. The topology of the networks studied and its constituent Boolean functions represent the system's quenched disorder and are sampled from a given distribution. The framework accommodates a variety of topologies and Boolean function distributions and can be used to study both the noisy and noiseless regimes; it enables one to calculate correlation functions at different times that are inaccessible via commonly used approximations. It is also used to determine conditions for the annealed approximation to be valid, explore phases of the system under different levels of noise and obtain results for models with strong memory effects, where existing approximations break down. Links between Boolean networks and general Boolean formulas are identified and results common to both system types are highlighted. © 2012 Copyright Taylor and Francis Group, LLC.

Computing with noise: phase transitions in Boolean formulas

Computing circuits composed of noisy logical gates and their ability to represent arbitrary Boolean functions with a given level of error are investigated within a statistical mechanics setting. Existing bounds on their performance are straightforwardly retrieved, generalized, and identified as the corresponding typical-case phase transitions. Results on error rates, function depth, and sensitivity, and their dependence on the gate-type and noise model used are also obtained.

Phase transitions in wave turbulence

We consider turbulence within the Gross-Pitaevsky model and look into the creation of a coherent condensate via an inverse cascade originating at small scales. The growth of the condensate leads to a spontaneous breakdown of statistical symmetries of overcondensate fluctuations: First, isotropy is broken, then a series of phase transitions marks the changing symmetry from twofold to threefold to fourfold. We describe respective anisotropic flux flows in the k space. At the highest level reached, we observe a short-range positional and long-range orientational order (as in a hexatic phase). In other words, the more one pumps the system, the more ordered the system becomes. The phase transitions happen when the system is pumped by an instability term and does not occur when pumped by a random force. We thus demonstrate nonuniversality of an inverse-cascade turbulence with respect to the nature of small-scale forcing.

A hierarchy of phase transitions in optimal neuronal coding:from binary to M-ary discrete optimal codes

We have investigated how optimal coding for neural systems changes with the time available for decoding. Optimization was in terms of maximizing information transmission. We have estimated the parameters for Poisson neurons that optimize Shannon transinformation with the assumption of rate coding. We observed a hierarchy of phase transitions from binary coding, for small decoding times, toward discrete (M-ary) coding with two, three and more quantization levels for larger decoding times. We postulate that the presence of subpopulations with specific neural characteristics could be a signiture of an optimal population coding scheme and we use the mammalian auditory system as an example.

Mössbauer spectroscopic study of the thermal spin crossover in [Fe(II)(isoxazole)6](ClO4)2

The Fe Mössbauer spectroscopy of mononuclear [Fe(II)(isoxazole)](ClO) has been studied to reveal the thermal spin crossover of Fe(II) between low-spin (S = 0) and high-spin (S = 2) states. Temperaturedependent spin transition curves have been constructed with the least-square fitted data obtained from the Mössbauer spectra measured at various temperatures between 84 and 270 K during a cooling and heating cycle. This compound exhibits an unusual temperature-dependent spin transition behaviour with T(?) = 223 and T(?) = 213 K occurring in the reverse order in comparison to those observed in SQUID observation and many other spin transition compounds. The compound has three high-spin Fe(II) sites at the highest temperature of study of which two undergo spin transitions. The compound seems to undergo a structural phase transition around the spin transition temperature, which plays a significant role in the spin crossover behaviour as well as the magnetic properties of the compound at temperatures below T. The present study reveals an increase in high-spin fraction upon heating in the temperature range below T, and an explanation is provided.

Dielectric and electro-optical properties of some cyanobiphenyl liquid-crystals

A variety of methods have been reviewed for obtaining parallel or perpendicular alignment in liquid-crystal cells. Some of these methods have been selected and developed and were used in polarised spectroscopy, dielectric and electro-optic studies. Also, novel dielectric and electro-optic cells were constructed for use over a range of temperature. Dielectric response of thin layers of E7 and E8 (eutectic mixture liquid-crystals) have been measured in the frequency range (12 Hz-100 kHz) and over a range of temperature (183-337K). Dielectric spectra were also obtained for supercooled E7 and E8 in the Hz and kHz range. When the measuring electric field was parallel to the nematic director, one loss peak (low-frequency relaxation process) was observed for E7 and for E8, that exhibits a Debye-type behaviour in the supercooled systems. When the measuring electric field was perpendicular to the nematic director, two resolved dielectric processes have been observed. The phase transitions, effective molecular polarisabilities, anisotropy of polarisabilities and order parameters of three liquid crystal homologs (5CB, 6CB, and 7CB), 60CB and three eutectic nematic mixtures E7, E8, and E607 were calculated using optical and density data measured at several temperatures. The order parameters calculated using the different methods of Vuks, Neugebauer, Saupe-Maier, and Palffy-Muhoray are nearly the same for the liquid crystals considered in the present study. Also, the interrelationship between density and refractive index and the molecular structure of these liquid crystals were established. Accurate dielectric and dipole results of a range of liquid-crystal forming molecules at several temperatures have reported. The role of the cyano-end group, biphenyl core, and flexible tail in molecular association, were investigated using the dielectric method for some molecules which have a structural relationship to the nematogens. Analysis of the dielectric data for solution of the liquid-crystals indicated a high molecular association, comparable to that observed in the nematic or isotropic phases. Electro-optic Kerr effect were investigated for some alkyl cyanobiphenyls, their nematic mixtures and the eutectic mixture liquid-crystals E7 and E8 in the isotropic phase and solution. The Kerr constant of these liquid crystals found to be very high at the nematic-isotropic transition temperatures as the molecules are expected to be highly ordered close to phase transition temperatures. Dynamic Kerr effect behaviour and transient molecular reorientation were also observed in thin layers of some alkyl cyanobiphenyls. Dichroic ratio R and order parameters of solutions containing some azo and anthraquinone dyes in the nematic solvent (E7 and E8), were investigated by the measurement of the intensity of the absorption bands in the visible region of parallel aligned samples. The effective factors on the dichroic ratio of the dyes dissolved in the nematic solvents were determined and discussed.

Noisy random Boolean formulae:a statistical physics perspective

Properties of computing Boolean circuits composed of noisy logical gates are studied using the statistical physics methodology. A formula-growth model that gives rise to random Boolean functions is mapped onto a spin system, which facilitates the study of their typical behavior in the presence of noise. Bounds on their performance, derived in the information theory literature for specific gates, are straightforwardly retrieved, generalized and identified as the corresponding macroscopic phase transitions. The framework is employed for deriving results on error-rates at various function-depths and function sensitivity, and their dependence on the gate-type and noise model used. These are difficult to obtain via the traditional methods used in this field.

On the robustness of random Boolean formulae

Random Boolean formulae, generated by a growth process of noisy logical gates are analyzed using the generating functional methodology of statistical physics. We study the type of functions generated for different input distributions, their robustness for a given level of gate error and its dependence on the formulae depth and complexity and the gates used. Bounds on their performance, derived in the information theory literature for specific gates, are straightforwardly retrieved, generalized and identified as the corresponding typical-case phase transitions. Results for error-rates, function-depth and sensitivity of the generated functions are obtained for various gate-type and noise models. © 2010 IOP Publishing Ltd.

Neural population coding is optimized by discrete tuning curves

The sigmoidal tuning curve that maximizes the mutual information for a Poisson neuron, or population of Poisson neurons, is obtained. The optimal tuning curve is found to have a discrete structure that results in a quantization of the input signal. The number of quantization levels undergoes a hierarchy of phase transitions as the length of the coding window is varied. We postulate, using the mammalian auditory system as an example, that the presence of a subpopulation structure within a neural population is consistent with an optimal neural code.

Statistical physics of error-correcting codes

In this thesis we use statistical physics techniques to study the typical performance of four families of error-correcting codes based on very sparse linear transformations: Sourlas codes, Gallager codes, MacKay-Neal codes and Kanter-Saad codes. We map the decoding problem onto an Ising spin system with many-spins interactions. We then employ the replica method to calculate averages over the quenched disorder represented by the code constructions, the arbitrary messages and the random noise vectors. We find, as the noise level increases, a phase transition between successful decoding and failure phases. This phase transition coincides with upper bounds derived in the information theory literature in most of the cases. We connect the practical decoding algorithm known as probability propagation with the task of finding local minima of the related Bethe free-energy. We show that the practical decoding thresholds correspond to noise levels where suboptimal minima of the free-energy emerge. Simulations of practical decoding scenarios using probability propagation agree with theoretical predictions of the replica symmetric theory. The typical performance predicted by the thermodynamic phase transitions is shown to be attainable in computation times that grow exponentially with the system size. We use the insights obtained to design a method to calculate the performance and optimise parameters of the high performance codes proposed by Kanter and Saad.

From the physics of interacting polymers to optimizing routes on the London Underground

Optimizing paths on networks is crucial for many applications, ranging from subway traffic to Internet communication. Because global path optimization that takes account of all path choices simultaneously is computationally hard, most existing routing algorithms optimize paths individually, thus providing suboptimal solutions. We use the physics of interacting polymers and disordered systems to analyze macroscopic properties of generic path optimization problems and derive a simple, principled, generic, and distributed routing algorithm capable of considering all individual path choices simultaneously. We demonstrate the efficacy of the algorithm by applying it to: (i) random graphs resembling Internet overlay networks, (ii) travel on the London Underground network based on Oyster card data, and (iii ) the global airport network. Analytically derived macroscopic properties give rise to insightful new routing phenomena, including phase transitions and scaling laws, that facilitate better understanding of the appropriate operational regimes and their limitations, which are difficult to obtain otherwise.

21-residue peptide's dynamics at and between elementary structural transitions

Elementary conformational changes of the backbone of a 21-residue peptide A5(A3RA)3A are studied using molecular dynamics simulations in explicit water. The processes of the conformational transitions and the regimes of stationary fluctuations between them are investigated using minimal perturbations of the system. The perturbations consist of a few degrees rotation of the velocity of one of the systems' atoms and keep the system on the same energy surface. It is found that (i) the system dynamics is insignificantly changed by the perturbations in the regimes between the transitions; (ii) it is very sensitive to the perturbations just before the transitions that prevents the peptide from making the transitions; and (iii) the perturbation of any atom of the system, including distant water molecules is equally effective in preventing the transition. The latter implies strongly collective dynamics of the peptide and water during the transitions.

The chemistry of British bituminous coals : an assessment of phase transfer catalysed reactions in the determination of coal structure

Three British bituminous coals, (Gedling, Cresswell, and Cortonwood Silkstone) were selected for study. Procedures were developed, using phase transfer catalysts (PTC's), to degrade the solvent insoluble fractions of the coals. PTC's are of interest because they have the potential to bring about selective high conversion reactions, under mild conditions, (often in the past, severe reaction conditions have had to be used to degrade the coals, this in turn resulted in the loss of much of the structural information). We have applied a variety of physical and chemical techniques to maximise the amount of structural information, these include, elemental analysis, 1H-NMR, 13C-CPMAS-NMR, GPC, GC-MS, FTIR spectroscopy, DRIFT spectroscopy, and gas adsorption measurements. The main conclusions from the work are listed below:- ( 1 ) PTC O-methylation; This reaction removes hydrogen bonds within the coal matrix by 'capping' the phenolic groups. It was found that the polymer-like matrix could be made more flexible, but not significantly more soluble, by O-methylation. I.E. the trapped or 'mobile' phase of the coals could be removed at a faster rate after this reaction had been carried out. ( 2 ) PTC Reductive and Acidic Ether Cleavage; The three coals were found to contain insignificant amounts of dialkyl and alkyl aryl ethers. The number of diaryl ethers could not be estimated, by reductive ether cleavage, (even though a high proportion of all three coals was solublised). The majority of the ethers present in the coals were inert to both cleavage methods, and are therefore assumed to be heterocyclic ethers. ( 3 ) Trif!uoroperacetic Acid Oxidation; This oxidant was used to study the aliphatic portions of the polymer-like macromolecular matrix of the coals. Normally this reagent will only solublise low rank coals, we however have developed a method whereby trifluoroperacetic acid can be used to degrade high rank bituminous coals. ( 4 ) PTC/Permanganate Oxidation; This reagent has been found to be much more selective than the traditional alkaline permanganate oxidation, with a lot more structural information being retained within the various fractions. This degradative method therefore has the potential of yielding new information about the molecular structure of coals.

Atomic structure of the two intermediate phase glasses SiSe4 and GeSe4

The microscopic origin of the intermediate phase in two prototypical covalently bonded AxB1-x network glass forming systems, where A=Ge or Si, B=Se, and 0=x=1, was investigated by combining neutron diffraction with first-principles molecular-dynamics methods. Specifically, the structure of glassy GeSe4 and SiSe4 was examined, and the calculated total structure factor and total pair-correlation function for both materials are in good agreement with experiment. The structure of both glasses differs markedly from a simple model comprising undefective AB4 corner-sharing tetrahedra in which all A atoms are linked by B2 dimers. Instead, edge-sharing tetrahedra occur and the twofold coordinated Se atoms form three distinct structural motifs, namely, Se-Se2, Se-SeGe (or Se-SeSi), and Se-Ge2 (or Se-Si2). This identifies several of the conformations that are responsible for the structural variability in GexSe1-x and SixSe1-x glasses, a quantity that is linked to the finite width of the intermediate phase window.