Synchronization processes in nonlinear systems and their relation to cortical oscillatory dynamics

This thesis was focused on theoretical models of synchronization to cortical dynamics as measured by magnetoencephalography (MEG). Dynamical systems theory was used in both identifying relevant variables for brain coordination and also in devising methods for their quantification. We presented a method for studying interactions of linear and chaotic neuronal sources using MEG beamforming techniques. We showed that such sources can be accurately reconstructed in terms of their location, temporal dynamics and possible interactions. Synchronization in low-dimensional nonlinear systems was studied to explore specific correlates of functional integration and segregation. In the case of interacting dissimilar systems, relevant coordination phenomena involved generalized and phase synchronization, which were often intermittent. Spatially-extended systems were then studied. For locally-coupled dissimilar systems, as in the case of cortical columns, clustering behaviour occurred. Synchronized clusters emerged at different frequencies and their boundaries were marked through oscillation death. The macroscopic mean field revealed sharp spectral peaks at the frequencies of the clusters and broader spectral drops at their boundaries. These results question existing models of Event Related Synchronization and Desynchronization. We re-examined the concept of the steady-state evoked response following an AM stimulus. We showed that very little variability in the AM following response could be accounted by system noise. We presented a methodology for detecting local and global nonlinear interactions from MEG data in order to account for residual variability. We found crosshemispheric nonlinear interactions of ongoing cortical rhythms concurrent with the stimulus and interactions of these rhythms with the following AM responses. Finally, we hypothesized that holistic spatial stimuli would be accompanied by the emergence of clusters in primary visual cortex resulting in frequency-specific MEG oscillations. Indeed, we found different frequency distributions in induced gamma oscillations for different spatial stimuli, which was suggestive of temporal coding of these spatial stimuli. Further, we addressed the bursting character of these oscillations, which was suggestive of intermittent nonlinear dynamics. However, we did not observe the characteristic-3/2 power-law scaling in the distribution of interburst intervals. Further, this distribution was only seldom significantly different to the one obtained in surrogate data, where nonlinear structure was destroyed. In conclusion, the work presented in this thesis suggests that advances in dynamical systems theory in conjunction with developments in magnetoencephalography may facilitate a mapping between levels of description int he brain. this may potentially represent a major advancement in neuroscience.

Exploiting uncertainty in nonlinear stochastic control problem

This work introduces a novel inversion-based neurocontroller for solving control problems involving uncertain nonlinear systems which could also compensate for multi-valued systems. The approach uses recent developments in neural networks, especially in the context of modelling statistical distributions, which are applied to forward and inverse plant models. Provided that certain conditions are met, an estimate of the intrinsic uncertainty for the outputs of neural networks can be obtained using the statistical properties of networks. More generally, multicomponent distributions can be modelled by the mixture density network. Based on importance sampling from these distributions a novel robust inverse control approach is obtained. This importance sampling provides a structured and principled approach to constrain the complexity of the search space for the ideal control law. The developed methodology circumvents the dynamic programming problem by using the predicted neural network uncertainty to localise the possible control solutions to consider. Convergence of the output error for the proposed control method is verified by using a Lyapunov function. Several simulation examples are provided to demonstrate the efficiency of the developed control method. The manner in which such a method is extended to nonlinear multi-variable systems with different delays between the input-output pairs is considered and demonstrated through simulation examples.

Random input problem for the nonlinear Schrödinger equation

We consider the random input problem for a nonlinear system modeled by the integrable one-dimensional self-focusing nonlinear Schrödinger equation (NLSE). We concentrate on the properties obtained from the direct scattering problem associated with the NLSE. We discuss some general issues regarding soliton creation from random input. We also study the averaged spectral density of random quasilinear waves generated in the NLSE channel for two models of the disordered input field profile. The first model is symmetric complex Gaussian white noise and the second one is a real dichotomous (telegraph) process. For the former model, the closed-form expression for the averaged spectral density is obtained, while for the dichotomous real input we present the small noise perturbative expansion for the same quantity. In the case of the dichotomous input, we also obtain the distribution of minimal pulse width required for a soliton generation. The obtained results can be applied to a multitude of problems including random nonlinear Fraunhoffer diffraction, transmission properties of randomly apodized long period Fiber Bragg gratings, and the propagation of incoherent pulses in optical fibers.

Mach bands and multiscale models of spatial vision:the role of first, second, and third derivative operators in encoding bars and edges

Ernst Mach observed that light or dark bands could be seen at abrupt changes of luminance gradient in the absence of peaks or troughs in luminance. Many models of feature detection share the idea that bars, lines, and Mach bands are found at peaks and troughs in the output of even-symmetric spatial filters. Our experiments assessed the appearance of Mach bands (position and width) and the probability of seeing them on a novel set of generalized Gaussian edges. Mach band probability was mainly determined by the shape of the luminance profile and increased with the sharpness of its corners, controlled by a single parameter (n). Doubling or halving the size of the images had no significant effect. Variations in contrast (20%-80%) and duration (50-300 ms) had relatively minor effects. These results rule out the idea that Mach bands depend simply on the amplitude of the second derivative, but a multiscale model, based on Gaussian-smoothed first- and second-derivative filtering, can account accurately for the probability and perceived spatial layout of the bands. A key idea is that Mach band visibility depends on the ratio of second- to first-derivative responses at peaks in the second-derivative scale-space map. This ratio is approximately scale-invariant and increases with the sharpness of the corners of the luminance ramp, as observed. The edges of Mach bands pose a surprisingly difficult challenge for models of edge detection, but a nonlinear third-derivative operation is shown to predict the locations of Mach band edges strikingly well. Mach bands thus shed new light on the role of multiscale filtering systems in feature coding. © 2012 ARVO.

Forecasting the UK/US exchange rate with divisia monetary models and neural networks

This paper compares the UK/US exchange rate forecasting performance of linear and nonlinear models based on monetary fundamentals, to a random walk (RW) model. Structural breaks are identified and taken into account. The exchange rate forecasting framework is also used for assessing the relative merits of the official Simple Sum and the weighted Divisia measures of money. Overall, there are four main findings. First, the majority of the models with fundamentals are able to beat the RW model in forecasting the UK/US exchange rate. Second, the most accurate forecasts of the UK/US exchange rate are obtained with a nonlinear model. Third, taking into account structural breaks reveals that the Divisia aggregate performs better than its Simple Sum counterpart. Finally, Divisia-based models provide more accurate forecasts than Simple Sum-based models provided they are constructed within a nonlinear framework.

Expressions for the nonlinear transmission performance of multi-mode optical fiber

We develop an analytical theory which allows us to identify the information spectral density limits of multimode optical fiber transmission systems. Our approach takes into account the Kerr-effect induced interactions of the propagating spatial modes and derives closed-form expressions for the spectral density of the corresponding nonlinear distortion. Experimental characterization results have confirmed the accuracy of the proposed models. Application of our theory in different FMF transmission scenarios has predicted a ~10% variation in total system throughput due to changes associated with inter-mode nonlinear interactions, in agreement with an observed 3dB increase in nonlinear noise power spectral density for a graded index four LP mode fiber. © 2013 Optical Society of America.

Semiconductor optical amplifier-based nonlinear optical-loop mirror with feedback

The behavior of a semiconductor optical amplifier (SOA)-based nonlinear loop mirror with feedback has been investigated as a potential device for all-optical signal processing. In the feedback device, input signal pulses (ones) are injected into the loop, and amplified reflected pulses are fed back into the loop as switching pulses. The feedback device has two stable modes of operation - block mode, where alternating blocks of ones and zeros are observed, and spontaneous clock division mode, where halving of the input repetition rate is achieved. Improved models of the feedback device have been developed to study its performance in different operating conditions. The feedback device could be optimized to give a choice of either of the two stable modes by shifting the arrival time of the switching pulses at the SOA. Theoretically, it was found possible to operate the device at only tens of fJ switching pulse energies if the SOA is biased to produce very high gain in the presence of internal loss. The clock division regime arises from the combination of incomplete SOA gain recovery and memory of the startup sequence that is provided by the feedback. Clock division requires a sufficiently high differential phase shift per unit differential gain, which is related to the SOA linewidth enhancement factor.

Nonlinear σ model for disordered superconductors

We suggest a variant of the nonlinear σ model for the description of disordered superconductors. The main distinction from existing models lies in the fact that the saddle point equation is solved nonperturbatively in the superconducting pairing field. It allows one to use the model both in the vicinity of the metal-superconductor transition and well below its critical temperature with full account for the self-consistency conditions. We show that the model reproduces a set of known results in different limiting cases, and apply it for a self-consistent description of the proximity effect at the superconductor-metal interface.

Fully probabilistic control for stochastic nonlinear control systems with input dependent noise

Robust controllers for nonlinear stochastic systems with functional uncertainties can be consistently designed using probabilistic control methods. In this paper a generalised probabilistic controller design for the minimisation of the Kullback-Leibler divergence between the actual joint probability density function (pdf) of the closed loop control system, and an ideal joint pdf is presented emphasising how the uncertainty can be systematically incorporated in the absence of reliable systems models. To achieve this objective all probabilistic models of the system are estimated from process data using mixture density networks (MDNs) where all the parameters of the estimated pdfs are taken to be state and control input dependent. Based on this dependency of the density parameters on the input values, explicit formulations to the construction of optimal generalised probabilistic controllers are obtained through the techniques of dynamic programming and adaptive critic methods. Using the proposed generalised probabilistic controller, the conditional joint pdfs can be made to follow the ideal ones. A simulation example is used to demonstrate the implementation of the algorithm and encouraging results are obtained.

Serum α-tocopherol has a nonlinear inverse association with periodontitis among US adults

Background: Previous experimental models suggest that vitamin E may ameliorate periodontitis. However, epidemiologic studies show inconsistent evidence in supporting this plausible association. Objective: We aimed to investigate the association between serum α-tocopherol (αT) and γ-tocopherol (γT) and periodontitis in a large cross-sectional US population. Methods: This study included 4708 participants in the 1999–2001 NHANES. Serum tocopherols were measured by HPLC and values were adjusted by total cholesterol (TC). Periodontal status was assessed by mean clinical attachment loss (CAL) and probing pocket depth (PPD). Total periodontitis (TPD) was defined as the sum of mild, moderate, and severe periodontitis. All measurements were performed by NHANES. Results: Means ± SDs of serum αT:TC ratio from low to high quartiles were 4.0 ± 0.4, 4.8 ± 0.2, 5.7 ± 0.4, and 9.1 ± 2.7 μmol/mmol. In multivariate regression models, αT:TC quartiles were inversely associated with mean CAL (P-trend = 0.06), mean PPD (P-trend < 0.001), and TPD (P-trend < 0.001) overall. Adjusted mean differences (95% CIs) between the first and fourth quartile of αT:TC were 0.12 mm (0.03, 0.20; P-difference = 0.005) for mean CAL and 0.12 mm (0.06, 0.17; P < 0.001) for mean PPD, whereas corresponding OR for TPD was 1.65 (95% CI: 1.26, 2.16; P-difference = 0.001). In a dose-response analysis, a clear inverse association between αT:TC and mean CAL, mean PPD, and TPD was observed among participants with relatively low αT:TC. No differences were seen in participants with higher αT:TC ratios. Participants with γT:TC ratio in the interquartile range showed a significantly lower mean PPD than those in the highest quartile. Conclusions: A nonlinear inverse association was observed between serum αT and severity of periodontitis, which was restricted to adults with normal but relatively low αT status. These findings warrant further confirmation in longitudinal or intervention settings.

Nonlinear inverse synthesis technique for optical links with lumped amplification

The nonlinear inverse synthesis (NIS) method, in which information is encoded directly onto the continuous part of the nonlinear signal spectrum, has been proposed recently as a promising digital signal processing technique for combating fiber nonlinearity impairments. However, because the NIS method is based on the integrability property of the lossless nonlinear Schrödinger equation, the original approach can only be applied directly to optical links with ideal distributed Raman amplification. In this paper, we propose and assess a modified scheme of the NIS method, which can be used effectively in standard optical links with lumped amplifiers, such as, erbium-doped fiber amplifiers (EDFAs). The proposed scheme takes into account the average effect of the fiber loss to obtain an integrable model (lossless path-averaged model) to which the NIS technique is applicable. We found that the error between lossless pathaveraged and lossy models increases linearly with transmission distance and input power (measured in dB). We numerically demonstrate the feasibility of the proposed NIS scheme in a burst mode with orthogonal frequency division multiplexing (OFDM) transmission scheme with advanced modulation formats (e.g., QPSK, 16QAM, and 64QAM), showing a performance improvement up to 3.5 dB; these results are comparable to those achievable with multi-step per span digital backpropagation.

A mixture density network approach to modelling and exploiting uncertainty in nonlinear control problems

In nonlinear and stochastic control problems, learning an efficient feed-forward controller is not amenable to conventional neurocontrol methods. For these approaches, estimating and then incorporating uncertainty in the controller and feed-forward models can produce more robust control results. Here, we introduce a novel inversion-based neurocontroller for solving control problems involving uncertain nonlinear systems which could also compensate for multi-valued systems. The approach uses recent developments in neural networks, especially in the context of modelling statistical distributions, which are applied to forward and inverse plant models. Provided that certain conditions are met, an estimate of the intrinsic uncertainty for the outputs of neural networks can be obtained using the statistical properties of networks. More generally, multicomponent distributions can be modelled by the mixture density network. Based on importance sampling from these distributions a novel robust inverse control approach is obtained. This importance sampling provides a structured and principled approach to constrain the complexity of the search space for the ideal control law. The developed methodology circumvents the dynamic programming problem by using the predicted neural network uncertainty to localise the possible control solutions to consider. A nonlinear multi-variable system with different delays between the input-output pairs is used to demonstrate the successful application of the developed control algorithm. The proposed method is suitable for redundant control systems and allows us to model strongly non-Gaussian distributions of control signal as well as processes with hysteresis. © 2004 Elsevier Ltd. All rights reserved.

Serum α-tocopherol has a nonlinear inverse association with periodontitis among US adults

Previous experimental models suggest that vitamin E may ameliorate periodontitis. However, epidemiologic studies show inconsistent evidence in supporting this plausible association. We aimed to investigate the association between serum α-tocopherol (αT) and γ-tocopherol (γT) and periodontitis in a large cross-sectional US population. This study included 4708 participants in the 1999–2001 NHANES. Serum tocopherols were measured by HPLC and values were adjusted by total cholesterol (TC). Periodontal status was assessed by mean clinical attachment loss (CAL) and probing pocket depth (PPD). Total periodontitis (TPD) was defined as the sum of mild, moderate, and severe periodontitis. All measurements were performed by NHANES. Means ± SDs of serum αT:TC ratio from low to high quartiles were 4.0 ± 0.4, 4.8 ± 0.2, 5.7 ± 0.4, and 9.1 ± 2.7 μmol/mmol. In multivariate regression models, αT:TC quartiles were inversely associated with mean CAL (P-trend = 0.06), mean PPD (P-trend < 0.001), and TPD (P-trend < 0.001) overall. Adjusted mean differences (95% CIs) between the first and fourth quartile of αT:TC were 0.12 mm (0.03, 0.20; P-difference = 0.005) for mean CAL and 0.12 mm (0.06, 0.17; P < 0.001) for mean PPD, whereas corresponding OR for TPD was 1.65 (95% CI: 1.26, 2.16; P-difference = 0.001). In a dose-response analysis, a clear inverse association between αT:TC and mean CAL, mean PPD, and TPD was observed among participants with relatively low αT:TC. No differences were seen in participants with higher αT:TC ratios. Participants with γT:TC ratio in the interquartile range showed a significantly lower mean PPD than those in the highest quartile. A nonlinear inverse association was observed between serum αT and severity of periodontitis, which was restricted to adults with normal but relatively low αT status. These findings warrant further confirmation in longitudinal or intervention settings.

Source localization of reaction-diffusion models for brain tumors

We propose a mathematically well-founded approach for locating the source (initial state) of density functions evolved within a nonlinear reaction-diffusion model. The reconstruction of the initial source is an ill-posed inverse problem since the solution is highly unstable with respect to measurement noise. To address this instability problem, we introduce a regularization procedure based on the nonlinear Landweber method for the stable determination of the source location. This amounts to solving a sequence of well-posed forward reaction-diffusion problems. The developed framework is general, and as a special instance we consider the problem of source localization of brain tumors. We show numerically that the source of the initial densities of tumor cells are reconstructed well on both imaging data consisting of simple and complex geometric structures.

Calculation of mutual information for nonlinear communication channel at large signal-to-noise ratio

Using the path-integral technique we examine the mutual information for the communication channel modeled by the nonlinear Schrödinger equation with additive Gaussian noise. The nonlinear Schrödinger equation is one of the fundamental models in nonlinear physics, and it has a broad range of applications, including fiber optical communications - the backbone of the internet. At large signal-to-noise ratio we present the mutual information through the path-integral, which is convenient for the perturbative expansion in nonlinearity. In the limit of small noise and small nonlinearity we derive analytically the first nonzero nonlinear correction to the mutual information for the channel.