A mean field theory of coded CDMA systems

We present a mean field theory of code-division multiple access (CDMA) systems with error-control coding. On the basis of the relation between the free energy and mutual information, we obtain an analytical expression of the maximum spectral efficiency of the coded CDMA system, from which a mean field description of the coded CDMA system is provided in terms of a bank of scalar Gaussian channels whose variances in general vary at different code symbol positions. Regular low-density parity-check (LDPC)-coded CDMA systems are also discussed as an example of the coded CDMA systems.

Advanced mean field methods:theory and practice

A major problem in modern probabilistic modeling is the huge computational complexity involved in typical calculations with multivariate probability distributions when the number of random variables is large. Because exact computations are infeasible in such cases and Monte Carlo sampling techniques may reach their limits, there is a need for methods that allow for efficient approximate computations. One of the simplest approximations is based on the mean field method, which has a long history in statistical physics. The method is widely used, particularly in the growing field of graphical models. Researchers from disciplines such as statistical physics, computer science, and mathematical statistics are studying ways to improve this and related methods and are exploring novel application areas. Leading approaches include the variational approach, which goes beyond factorizable distributions to achieve systematic improvements; the TAP (Thouless-Anderson-Palmer) approach, which incorporates correlations by including effective reaction terms in the mean field theory; and the more general methods of graphical models. Bringing together ideas and techniques from these diverse disciplines, this book covers the theoretical foundations of advanced mean field methods, explores the relation between the different approaches, examines the quality of the approximation obtained, and demonstrates their application to various areas of probabilistic modeling.

Gaussian processes for classification: mean field algorithms:mean-field algorithms

We derive a mean field algorithm for binary classification with Gaussian processes which is based on the TAP approach originally proposed in Statistical Physics of disordered systems. The theory also yields an approximate leave-one-out estimator for the generalization error which is computed with no extra computational cost. We show that from the TAP approach, it is possible to derive both a simpler 'naive' mean field theory and support vector machines (SVM) as limiting cases. For both mean field algorithms and support vectors machines, simulation results for three small benchmark data sets are presented. They show 1. that one may get state of the art performance by using the leave-one-out estimator for model selection and 2. the built-in leave-one-out estimators are extremely precise when compared to the exact leave-one-out estimate. The latter result is a taken as a strong support for the internal consistency of the mean field approach.

One-dimensional optical wave turbulence:experiment and theory

We present a review of the latest developments in one-dimensional (1D) optical wave turbulence (OWT). Based on an original experimental setup that allows for the implementation of 1D OWT, we are able to show that an inverse cascade occurs through the spontaneous evolution of the nonlinear field up to the point when modulational instability leads to soliton formation. After solitons are formed, further interaction of the solitons among themselves and with incoherent waves leads to a final condensate state dominated by a single strong soliton. Motivated by the observations, we develop a theoretical description, showing that the inverse cascade develops through six-wave interaction, and that this is the basic mechanism of nonlinear wave coupling for 1D OWT. We describe theory, numerics and experimental observations while trying to incorporate all the different aspects into a consistent context. The experimental system is described by two coupled nonlinear equations, which we explore within two wave limits allowing for the expression of the evolution of the complex amplitude in a single dynamical equation. The long-wave limit corresponds to waves with wave numbers smaller than the electrical coherence length of the liquid crystal, and the opposite limit, when wave numbers are larger. We show that both of these systems are of a dual cascade type, analogous to two-dimensional (2D) turbulence, which can be described by wave turbulence (WT) theory, and conclude that the cascades are induced by a six-wave resonant interaction process. WT theory predicts several stationary solutions (non-equilibrium and thermodynamic) to both the long- and short-wave systems, and we investigate the necessary conditions required for their realization. Interestingly, the long-wave system is close to the integrable 1D nonlinear Schrödinger equation (NLSE) (which contains exact nonlinear soliton solutions), and as a result during the inverse cascade, nonlinearity of the system at low wave numbers becomes strong. Subsequently, due to the focusing nature of the nonlinearity, this leads to modulational instability (MI) of the condensate and the formation of solitons. Finally, with the aid of the probability density function (PDF) description of WT theory, we explain the coexistence and mutual interactions between solitons and the weakly nonlinear random wave background in the form of a wave turbulence life cycle (WTLC).

The single-phase induction motor:a critical appraisal of the rotating-field and cross-field theories with particular reference to skin effect

The purpose of this thesis is twofold: to examine the validity of the rotating-field and cross-field theories of the single-phase induction motor when applied to a cage rotor machine; and to examine the extent to which skin effect is likely to modify the characteristics of a cage rotor machine. A mathematical analysis is presented for a single-phase induction motor in which the rotor parameters are modified by skin effect. Although this is based on the usual type of ideal machine, a new form of model rotor allows approximations for skin effect phenomena to be included as an integral part of the analysis. Performance equations appropriate to the rotating-field and cross-field theories are deduced, and the corresponding explanations for the steady-state mode of operation are critically examined. The evaluation of the winding currents and developed torque is simplified by the introduction of new dimensionless factors which are functions of the resistance/reactance ratios of the rotor and the speed. Tables of the factors are included for selected numerical values of the parameter ratios, and these are used to deduce typical operating characteristics for both cage and wound rotor machines. It is shown that a qualitative explanation of the mode of operation of a cage rotor machine is obtained from either theory; but the operating characteristics must be deduced from the performance equations of the rotating-field theory, because of the restrictions on the values of the rotor parameters imposed by skin effect.

The chemistry of ceramic glazes

The development of ideas and theories concerning the structure of glazes, as one of the glassy materials, are reviewed in the general introduction. The raw materials and the manufacturing process for glazes are described (Chapter One). A number of new vanadyl(IV) dipyridylamine and tripyrldylamine complexes have been prepared, various spectroscopic techniques are used in the investigation of the vanadyl ion in a weak ligand field, the situation of those found in a glaze environment (Chapter Three). In glaze recipes containing silica, potash feldspar, china clay, MO(M= Ca, Sr, Sa, Ti and Zn) and NiO, the ligand field theory is used in the elucidation of the effect of M (in MO) on the absorption spectra and coordination behaviour of Ni(II) in glazes. The magnetic and visible spectral results are reviewed in terms of Dietzel's idea of field strength of M and also in terms of Shteinberg's theory of glaze structure. X-ray diffraction is used for the identification of various species that formed after the firing process of glazes (Chapter Four). In Chapter Five, [] Mossbauer spectroscopy, supplemented by E.S.R., X-ray and visible spectral measurements are used in the investigation of iron in a glaze composition similar to that used in Chapter Four. The Mossbauer results are used in following the influence of; M in MO (M= Sr, Ca and Ba), oxides of titanium(IV) and vanadium(V ), and firing conditions on the chemistry of iron. Generally the iron(II) and iron(III) in the fired glazes are in octahedral sites although there are a range of similar, though not identical environments. A quite noticable influence of M (in MO) on the resonance line width is seen. In one case evidence is found for iron(IV) in an iron/vanadium glaze. E.S.R. of vanadium containing glazes indicate that vanadium is present as V02+ in a highly distorted tetragonal environment .

The charge effect on the hindrance factors for diffusion and convection of a solute in pores II

The diffusion and convection of a solute suspended in a fluid across porous membranes are known to be reduced compared to those in a bulk solution, owing to the fluid mechanical interaction between the solute and the pore wall as well as steric restriction. If the solute and the pore wall are electrically charged, the electrostatic interaction between them could affect the hindrance to diffusion and convection. In this study, the transport of charged spherical solutes through charged circular cylindrical pores filled with an electrolyte solution containing small ions was studied numerically by using a fluid mechanical and electrostatic model. Based on a mean field theory, the electrostatic interaction energy between the solute and the pore wall was estimated from the Poisson-Boltzmann equation, and the charge effect on the solute transport was examined for the solute and pore wall of like charge. The results were compared with those obtained from the linearized form of the Poisson-Boltzmann equation, i.e.the Debye-Hückel equation. © 2012 The Japan Society of Fluid Mechanics and IOP Publishing Ltd.

Charge effects on hindrance factors for diffusion and convection of solute in pores I

The transport of a spherical solute through a long circular cylindrical pore filled with an electrolyte solution is studied numerically, in the presence of constant surface charge on the solute and the pore wall. Fluid dynamic analyses were carried out to calculate the flow field around the solute in the pore to evaluate the drag coefficients exerted on the solute. Electrical potentials around the solute in the electrolyte solution were computed based on a mean-field theory to provide the interaction energy between the charged solute and the pore wall. Combining the results of the fluid dynamic and electrostatic analyses, we estimated the rate of the diffusive and convective transport of the solute across the pore. Although the present estimates of the drag coefficients on the solute suggest more than 10% difference from existing studies, depending on the radius ratio of the solute relative to the pore and the radial position of the solute center in the pore, this difference leads to a minor effect on the hindrance factors. It was found that even at rather large ion concentrations, the repulsive electrostatic interaction between the charged solute and the pore wall of like charge could significantly reduce the transport rate of the solute.

Charge effects on the hindered transport of macromolecules across the endothelial surface glycocalyx layer

A fluid mechanical and electrostatic model for the transport of solute molecules across the vascular endothelial surface glycocalyx layer (EGL) was developed to study the charge effect on the diffusive and convective transport of the solutes. The solute was assumed to be a spherical particle with a constant surface charge density, and the EGL was represented as an array of periodically arranged circular cylinders of like charge, with a constant surface charge density. By combining the fluid mechanical analyses for the flow around a solute suspended in an electrolyte solution and the electrostatic analyses for the free energy of the interaction between the solute and cylinders based on a mean field theory, we estimated the transport coefficients of the solute across the EGL. Both of diffusive and convective transports are reduced compared to those for an uncharged system, due to the stronger exclusion of the solute that results from the repulsive electrostatic interaction. The model prediction for the reflection coefficient for serum albumin agreed well with experimental observations if the charge density in the EGL is ranged from approximately -10 to -30 mEq/l.

Asymptotic theory of wall-attached convection in a horizontal fluid layer with a vertical magnetic field

A horizontal fluid layer heated from below in the presence of a vertical magnetic field is considered. A simple asymptotic analysis is presented which demonstrates that a convection mode attached to the side walls of the layer sets in at Rayleigh numbers much below those required for the onset of convection in the bulk of the layer. The analysis complements an earlier analysis by Houchens [J. Fluid Mech. 469, 189 (2002)] which derived expressions for the critical Rayleigh number for the onset of convection in a vertical cylinder with an axial magnetic field in the cases of two aspect ratios. © 2008 American Institute of Physics.

The theory of on-line learning: a statistical physics approach

In this paper we review recent theoretical approaches for analysing the dynamics of on-line learning in multilayer neural networks using methods adopted from statistical physics. The analysis is based on monitoring a set of macroscopic variables from which the generalisation error can be calculated. A closed set of dynamical equations for the macroscopic variables is derived analytically and solved numerically. The theoretical framework is then employed for defining optimal learning parameters and for analysing the incorporation of second order information into the learning process using natural gradient descent and matrix-momentum based methods. We will also briefly explain an extension of the original framework for analysing the case where training examples are sampled with repetition.

The classical theory of field evaporation

The field evaporation literature has been carefully analysed and is shown to contain various confusions. After redefining consistent terminology, this thesis investigates the mechanisms of field evaporation, in particular, the relevance of the theoretical mechanisms by analysing the available experimental data. A new formalism `extended image-hump formalism' is developed and is used to devise several tests of whether the image-hump mechanism is operating. The general conclusion is that in most cases the Mueller mechanism is not operating and escape takes place via Gomer-type mechanisms.

Noisy random Boolean formulae:a statistical physics perspective

Properties of computing Boolean circuits composed of noisy logical gates are studied using the statistical physics methodology. A formula-growth model that gives rise to random Boolean functions is mapped onto a spin system, which facilitates the study of their typical behavior in the presence of noise. Bounds on their performance, derived in the information theory literature for specific gates, are straightforwardly retrieved, generalized and identified as the corresponding macroscopic phase transitions. The framework is employed for deriving results on error-rates at various function-depths and function sensitivity, and their dependence on the gate-type and noise model used. These are difficult to obtain via the traditional methods used in this field.

Signal processing for molecular and cellular biological physics:an emerging field

Recent advances in our ability to watch the molecular and cellular processes of life in action-such as atomic force microscopy, optical tweezers and Forster fluorescence resonance energy transfer-raise challenges for digital signal processing (DSP) of the resulting experimental data. This article explores the unique properties of such biophysical time series that set them apart from other signals, such as the prevalence of abrupt jumps and steps, multi-modal distributions and autocorrelated noise. It exposes the problems with classical linear DSP algorithms applied to this kind of data, and describes new nonlinear and non-Gaussian algorithms that are able to extract information that is of direct relevance to biological physicists. It is argued that these new methods applied in this context typify the nascent field of biophysical DSP. Practical experimental examples are supplied.