Generalized mean field approximation for parallel dynamics of the Ising model

The dynamics of the non-equilibrium Ising model with parallel updates is investigated using a generalized mean field approximation that incorporates multiple two-site correlations at any two time steps, which can be obtained recursively. The proposed method shows significant improvement in predicting local system properties compared to other mean field approximation techniques, particularly in systems with symmetric interactions. Results are also evaluated against those obtained from Monte Carlo simulations. The method is also employed to obtain parameter values for the kinetic inverse Ising modeling problem, where couplings and local field values of a fully connected spin system are inferred from data. © 2014 IOP Publishing Ltd and SISSA Medialab srl.

Variational mean-field algorithm for efficient inference in large systems of stochastic differential equations

This work introduces a Gaussian variational mean-field approximation for inference in dynamical systems which can be modeled by ordinary stochastic differential equations. This new approach allows one to express the variational free energy as a functional of the marginal moments of the approximating Gaussian process. A restriction of the moment equations to piecewise polynomial functions, over time, dramatically reduces the complexity of approximate inference for stochastic differential equation models and makes it comparable to that of discrete time hidden Markov models. The algorithm is demonstrated on state and parameter estimation for nonlinear problems with up to 1000 dimensional state vectors and compares the results empirically with various well-known inference methodologies.

Error-correcting codes on a Bethe-like lattice

We analyse Gallager codes by employing a simple mean-field approximation that distorts the model geometry and preserves important interactions between sites. The method naturally recovers the probability propagation decoding algorithm as a minimization of a proper free-energy. We find a thermodynamical phase transition that coincides with information theoretical upper-bounds and explain the practical code performance in terms of the free-energy landscape.

Advanced mean field methods:theory and practice

A major problem in modern probabilistic modeling is the huge computational complexity involved in typical calculations with multivariate probability distributions when the number of random variables is large. Because exact computations are infeasible in such cases and Monte Carlo sampling techniques may reach their limits, there is a need for methods that allow for efficient approximate computations. One of the simplest approximations is based on the mean field method, which has a long history in statistical physics. The method is widely used, particularly in the growing field of graphical models. Researchers from disciplines such as statistical physics, computer science, and mathematical statistics are studying ways to improve this and related methods and are exploring novel application areas. Leading approaches include the variational approach, which goes beyond factorizable distributions to achieve systematic improvements; the TAP (Thouless-Anderson-Palmer) approach, which incorporates correlations by including effective reaction terms in the mean field theory; and the more general methods of graphical models. Bringing together ideas and techniques from these diverse disciplines, this book covers the theoretical foundations of advanced mean field methods, explores the relation between the different approaches, examines the quality of the approximation obtained, and demonstrates their application to various areas of probabilistic modeling.

Gaussian processes for classification: mean field algorithms:mean-field algorithms

We derive a mean field algorithm for binary classification with Gaussian processes which is based on the TAP approach originally proposed in Statistical Physics of disordered systems. The theory also yields an approximate leave-one-out estimator for the generalization error which is computed with no extra computational cost. We show that from the TAP approach, it is possible to derive both a simpler 'naive' mean field theory and support vector machines (SVM) as limiting cases. For both mean field algorithms and support vectors machines, simulation results for three small benchmark data sets are presented. They show 1. that one may get state of the art performance by using the leave-one-out estimator for model selection and 2. the built-in leave-one-out estimators are extremely precise when compared to the exact leave-one-out estimate. The latter result is a taken as a strong support for the internal consistency of the mean field approach.

Online approximations for wind-field models

We study online approximations to Gaussian process models for spatially distributed systems. We apply our method to the prediction of wind fields over the ocean surface from scatterometer data. Our approach combines a sequential update of a Gaussian approximation to the posterior with a sparse representation that allows to treat problems with a large number of observations.

Developments and extensions of Roth's method of double Fourier series with applications to the solution of electromagnetic field problems

The first part of the thesis compares Roth's method with other methods, in particular the method of separation of variables and the finite cosine transform method, for solving certain elliptic partial differential equations arising in practice. In particular we consider the solution of steady state problems associated with insulated conductors in rectangular slots. Roth's method has two main disadvantages namely the slow rate of con­vergence of the double Fourier series and the restrictive form of the allowable boundary conditions. A combined Roth-separation of variables method is derived to remove the restrictions on the form of the boundary conditions and various Chebyshev approximations are used to try to improve the rate of convergence of the series. All the techniques are then applied to the Neumann problem arising from balanced rectangular windings in a transformer window. Roth's method is then extended to deal with problems other than those resulting from static fields. First we consider a rectangular insulated conductor in a rectangular slot when the current is varying sinusoidally with time. An approximate method is also developed and compared with the exact method.The approximation is then used to consider the problem of an insulated conductor in a slot facing an air gap. We also consider the exact method applied to the determination of the eddy-current loss produced in an isolated rectangular conductor by a transverse magnetic field varying sinusoidally with time. The results obtained using Roth's method are critically compared with those obtained by other authors using different methods. The final part of the thesis investigates further the application of Chebyshdev methods to the solution of elliptic partial differential equations; an area where Chebyshev approximations have rarely been used. A poisson equation with a polynomial term is treated first followed by a slot problem in cylindrical geometry.

Resonant gradient force on atom interacting with laser field

The gradient force, as a function of position and velocity, is derived for a two-level atom interacting with a standing-wave laser field. Basing on optical Bloch equations, the numerical solutions for the gradient force f_(|_;n) (n = 0, 1, 2, 3, 4, ...) pointing in the direction of the transverse of the laser beam are given. It is shown the higher order gradient force plays important role at strong intensity (G = 64), the contribution of them can not be neglected.

Approximation of photonic crystal fibres with large air holes by the step index fibre model

An equivalent step index fibre with a silica core and air cladding is used to model photonic crystal fibres with large air holes. We model this fibre for linear polarisation (we focus on the lowest few transverse modes of the electromagnetic field). The equivalent step index radius is obtained by equating the lowest two eigenvalues of the model to those calculated numerically for the photonic crystal fibres. The step index parameters thus obtained can then be used to calculate nonlinear parameters like the nonlinear effective area of a photonic crystal fibre or to model nonlinear few-mode interactions using an existing model.

Quantification of visual field loss in age-related macular degeneration

Presentation Purpose:To determine methods of quantifying the sensitivity loss in the central 10o visual field in a cross section of patients at various stages of age-related macular degeneration (AMD). Methods:Standard and short-wavelength automated perimetry (SAP and SWAP) visual fields were collected using program 10-2 of the Humphrey Field Analyzer, in 44 eyes of 27 patients with AMD and 41 eyes of 22 normal subjects. Stereoscopic fundus photographs were graded by two independent observers and the stage of disease determined. Global indices were compared for their ability to delineate the normal visual field from early stages of AMD and to differentiate between stages. Results:Mean Deviation (MD) and Pattern Standard Deviation (PSD) varied significantly with stage of disease in SAP (both p<0.001) and SWAP (both p<0.001), but post-hoc analysis revealed overlap of functional values between stages. Global indices of focal loss, PSD and local spatial variability (LSV) were the most sensitive to detecting differences between normal subjects and early stage AMD patients, in SAP and SWAP, respectively. Overall, defects were confined to the central 5°. SWAP defects were consistently greater in depth and area than those in SAP. The most vulnerable region of the 10° field to sensitivity loss with increasing stage of AMD was the central 1°, in which the sensitivity decline was -4.8dB per stage in SAP and -4.9dB per stage in SWAP. Based on the pattern deviation defect maps, a severity index of AMD visual field loss was derived. Threshold variability was considerably increased in late stage AMD eyes. Conclusions:Global indices of focal loss were more sensitive to the detection of early stage AMD from normal. The sensitivity decline with advancing stage of AMD was greater in SWAP compared to SAP, however the trend was not strong across all stages of disease. The less commonly used index LSV represents relatively statistically unmanipulated summary measure of focal loss. A new severity index is described which is sensitive to visual field change in AMD, measures visual field defects on a continuous scale and may serve as a useful measure of functional change in AMD in longitudinal studies. Keywords: visual fields • age-related macular degeneration • perimetry

Relationships between fundus image quantification and visual field status in age-related macular degeneration

Presentation Purpose:To relate structural change to functional change in age-related macular degeneration (AMD) in a cross-sectional population using fundus imaging and the visual field status. Methods:10 degree standard and SWAP visual fields and other standard functional clinical measures were acquired in 44 eyes of 27 patients at various stages of AMD, as well as fundus photographs. Retro-mode SLO images were captured in a subset of 29 eyes of 19 of the patients. Drusen area, measured by automated drusen segmentation software (Smith et al. 2005) was correlated with visual field data. Visual field defect position was compared to the position of the imaged drusen and deposits using custom software. Results:The effect of AMD stage on drusen area within the 6000µm was significant (One-way ANOVA: F = 17.231, p < 0.001), however the trend was not strong across all stages. There were significant linear relationships between visual field parameters and drusen area. The mean deviation (MD) declined by 3.00dB and 3.92dB for each log % drusen area for standard perimetry and SWAP, respectively. The visual field parameters of focal loss displayed the strongest correlations with drusen area. The number of pattern deviation (PD) defects increased by 9.30 and 9.68 defects per log % drusen area for standard perimetry and SWAP, respectively. Weaker correlations were found between drusen area and visual acuity, contrast sensitivity, colour vision and reading speed. 72.6% of standard PD defects and 65.2% of SWAP PD defects coincided with retinal signs of AMD on fundus photography. 67.5% of standard PD defects and 69.7% of SWAP PD defects coincided with deposits on retro-mode images. Conclusions:Perimetry exhibited a stronger relationship with drusen area than other measures of visual function. The structure-function relationship between visual field parameters and drusen area was linear. Overall the indices of focal loss had a stronger correlation with drusen area in SWAP than in standard perimetry. Visual field defects had a high coincidence proportion with retinal manifestations of AMD.Smith R.T. et al. (2005) Arch Ophthalmol 123:200-206.

Demonstration of 10 Gbit/s transmission over 900 km SMF with <400 ns adaptation time using full-field EDC

This reported work significantly extends the reach of 10Gbit/s on-off keying singlemode fibre (SMF) transmission using full-field based electronic dispersion compensation (EDC) to 900 km. In addition, the EDC balances the complexity and the adaptation capability by employing a simple dispersive transmission line with static parameters for coarse dispersion compensation and 16-state maximum likelihood sequence estimation with Gaussian approximation based channel training for adaptive impairment trimming. Improved adaptation times of less than 400 ns for a bit error rate target of 10-3 over distances ranging from 0 to 900 km are reported.

Side detection of strong radiation-mode out-coupling from blazed FBGs in single-mode and multimode fibers

We report on the effective side detection of radiation-mode out-coupling from blazed fiber Bragg gratings (BFBGs) fabricated in single-mode fiber (SMF) and multimode fiber (MMF). The far-field radiation power distribution from BFBGs have been measured achieving a high spatial-spectral resolution (0.17 mm/nm). We have also investigated comparatively the transmission-loss characteristics of BFBGs in both fiber types, fabricated using phase-mask and holographic inscription techniques. Our results reveal clearly that the radiation out-coupling from BFBGs is significantly stronger and spectrally more confined in MMF than in SMF.

Demonstration of 10 Gbit/s transmission over 900 km SMF with <400 ns adaptation time using full-field EDC

This reported work significantly extends the reach of 10Gbit/s on-off keying singlemode fibre (SMF) transmission using full-field based electronic dispersion compensation (EDC) to 900 km. In addition, the EDC balances the complexity and the adaptation capability by employing a simple dispersive transmission line with static parameters for coarse dispersion compensation and 16-state maximum likelihood sequence estimation with Gaussian approximation based channel training for adaptive impairment trimming. Improved adaptation times of less than 400 ns for a bit error rate target of 10-3 over distances ranging from 0 to 900 km are reported.