Statnote 34 : the Kolmogorov-Smirnov (KS) test

The Kolmogorov-Smirnov (KS) test is a non-parametric test which can be used in two different circumstances. First, it can be used as an alternative to chi-square (?2) as a ‘goodness-of-fit’ test to compare whether a given ‘observed’ sample of observations conforms to an ‘expected’ distribution of results (KS, one-sample test). An example of the use of the one-sample test to determine whether a sample of observations was normally distributed was described previously. Second, it can be used as an alternative to the Mann-Whitney test to compare two independent samples of observations (KS, two-sample test). Hence, this statnote describes the use of the KS test with reference to two scenarios: (1) to compare the observed frequency (Fo) of soil samples containing cysts of the protozoan Naegleria collected each month for a year with an expected equal frequency (Fe) across months (one-sample test), and (2) to compare the abundance of bacteria on cloths and sponges sampled in a domestic kitchen environment (two-sample test).

Outlier detection with partial information:Application to emergency mapping

This paper, addresses the problem of novelty detection in the case that the observed data is a mixture of a known 'background' process contaminated with an unknown other process, which generates the outliers, or novel observations. The framework we describe here is quite general, employing univariate classification with incomplete information, based on knowledge of the distribution (the 'probability density function', 'pdf') of the data generated by the 'background' process. The relative proportion of this 'background' component (the 'prior' 'background' 'probability), the 'pdf' and the 'prior' probabilities of all other components are all assumed unknown. The main contribution is a new classification scheme that identifies the maximum proportion of observed data following the known 'background' distribution. The method exploits the Kolmogorov-Smirnov test to estimate the proportions, and afterwards data are Bayes optimally separated. Results, demonstrated with synthetic data, show that this approach can produce more reliable results than a standard novelty detection scheme. The classification algorithm is then applied to the problem of identifying outliers in the SIC2004 data set, in order to detect the radioactive release simulated in the 'oker' data set. We propose this method as a reliable means of novelty detection in the emergency situation which can also be used to identify outliers prior to the application of a more general automatic mapping algorithm. © Springer-Verlag 2007.

Quantifying short-term dynamics of Parkinson's disease using self-reported symptom data from an internet social network

Background: Parkinson’s disease (PD) is an incurable neurological disease with approximately 0.3% prevalence. The hallmark symptom is gradual movement deterioration. Current scientific consensus about disease progression holds that symptoms will worsen smoothly over time unless treated. Accurate information about symptom dynamics is of critical importance to patients, caregivers, and the scientific community for the design of new treatments, clinical decision making, and individual disease management. Long-term studies characterize the typical time course of the disease as an early linear progression gradually reaching a plateau in later stages. However, symptom dynamics over durations of days to weeks remains unquantified. Currently, there is a scarcity of objective clinical information about symptom dynamics at intervals shorter than 3 months stretching over several years, but Internet-based patient self-report platforms may change this. Objective: To assess the clinical value of online self-reported PD symptom data recorded by users of the health-focused Internet social research platform PatientsLikeMe (PLM), in which patients quantify their symptoms on a regular basis on a subset of the Unified Parkinson’s Disease Ratings Scale (UPDRS). By analyzing this data, we aim for a scientific window on the nature of symptom dynamics for assessment intervals shorter than 3 months over durations of several years. Methods: Online self-reported data was validated against the gold standard Parkinson’s Disease Data and Organizing Center (PD-DOC) database, containing clinical symptom data at intervals greater than 3 months. The data were compared visually using quantile-quantile plots, and numerically using the Kolmogorov-Smirnov test. By using a simple piecewise linear trend estimation algorithm, the PLM data was smoothed to separate random fluctuations from continuous symptom dynamics. Subtracting the trends from the original data revealed random fluctuations in symptom severity. The average magnitude of fluctuations versus time since diagnosis was modeled by using a gamma generalized linear model. Results: Distributions of ages at diagnosis and UPDRS in the PLM and PD-DOC databases were broadly consistent. The PLM patients were systematically younger than the PD-DOC patients and showed increased symptom severity in the PD off state. The average fluctuation in symptoms (UPDRS Parts I and II) was 2.6 points at the time of diagnosis, rising to 5.9 points 16 years after diagnosis. This fluctuation exceeds the estimated minimal and moderate clinically important differences, respectively. Not all patients conformed to the current clinical picture of gradual, smooth changes: many patients had regimes where symptom severity varied in an unpredictable manner, or underwent large rapid changes in an otherwise more stable progression. Conclusions: This information about short-term PD symptom dynamics contributes new scientific understanding about the disease progression, currently very costly to obtain without self-administered Internet-based reporting. This understanding should have implications for the optimization of clinical trials into new treatments and for the choice of treatment decision timescales.

The laminar-turbulent transition in a fibre laser

Studying the transition from a linearly stable coherent laminar state to a highly disordered state of turbulence is conceptually and technically challenging, and of great interest because all pipe and channel flows are of that type. In optics, understanding how a system loses coherence, as spatial size or the strength of excitation increases, is a fundamental problem of practical importance. Here, we report our studies of a fibre laser that operates in both laminar and turbulent regimes. We show that the laminar phase is analogous to a one-dimensional coherent condensate and the onset of turbulence is due to the loss of spatial coherence. Our investigations suggest that the laminar-turbulent transition in the laser is due to condensate destruction by clustering dark and grey solitons. This finding could prove valuable for the design of coherent optical devices as well as systems operating far from thermodynamic equilibrium. © 2013 Macmillan Publishers Limited.

Optical spectral broadening and supercontinuum generation in telecom applications

We overview the recent development in applications of spectral broadening and supercontinuum generation in the field of optical communications. Special attention is dedicated to recent results obtained in our research groups. © 2005 Elsevier Inc. All rights reserved.

Modeling of spectral and statistical properties of a random distributed feedback fiber laser

For the first time we report full numerical NLSE-based modeling of generation properties of random distributed feedback fiber laser based on Rayleigh scattering. The model which takes into account the random backscattering via its average strength only describes well power and spectral properties of random DFB fiber lasers. The influence of dispersion and nonlinearity on spectral and statistical properties is investigated. The evidence of non-gaussian intensity statistics is found. © 2013 Optical Society of America.

Temporal and statistical properties of the ytterbium doped fiber laser

Recently, temporal and statistical properties of quasi-CW fiber lasers have attracted a great attention. In particular, properties of Raman fiber laser (RFLs) have been studied both numerically and experimentally [1,2]. Experimental investigation is more challengeable, as the full generation optical bandwidth (typically hundreds of GHz for RFLs) is much bigger than real-time bandwidth of oscilloscopes (up to 60GHz for the newest models). So experimentally measured time dynamics is highly bandwidth averaged and do not provide precise information about overall statistical properties. To overpass this, one can use the spectral filtering technique to study temporal and statistical properties within optical bandwidth comparable with measurement bandwidth [3] or indirect measurements [4]. Ytterbium-doped fiber lasers (YDFL) are more suitable for experimental investigation, as their generation spectrum usually 10 times narrower. Moreover, recently ultra-narrow-band generation has been demonstrated in YDFL [5] which provides in principle possibility to measure time dynamics and statistics in real time using conventional oscilloscopes. © 2013 IEEE.

NLSE-based model of a random distributed feedback fiber laser

In this work we propose a NLSE-based model of power and spectral properties of the random distributed feedback (DFB) fiber laser. The model is based on coupled set of non-linear Schrödinger equations for pump and Stokes waves with the distributed feedback due to Rayleigh scattering. The model considers random backscattering via its average strength, i.e. we assume that the feedback is incoherent. In addition, this allows us to speed up simulations sufficiently (up to several orders of magnitude). We found that the model of the incoherent feedback predicts the smooth and narrow (comparing with the gain spectral profile) generation spectrum in the random DFB fiber laser. The model allows one to optimize the random laser generation spectrum width varying the dispersion and nonlinearity values: we found, that the high dispersion and low nonlinearity results in narrower spectrum that could be interpreted as four-wave mixing between different spectral components in the quasi-mode-less spectrum of the random laser under study could play an important role in the spectrum formation. Note that the physical mechanism of the random DFB fiber laser formation and broadening is not identified yet. We investigate temporal and statistical properties of the random DFB fiber laser dynamics. Interestingly, we found that the intensity statistics is not Gaussian. The intensity auto-correlation function also reveals that correlations do exist. The possibility to optimize the system parameters to enhance the observed intrinsic spectral correlations to further potentially achieved pulsed (mode-locked) operation of the mode-less random distributed feedback fiber laser is discussed.

Generation dynamics of the narrowband Yb-doped fiber laser

We present direct real-time experimental measurements and numerical modeling of temporal and statistical properties for the Ytterbiumdoped fiber laser with spectral bandwidth of ∼2 GHz. The obtained results demonstrate nearly exponential probability density function for intensity fluctuations. A significant decrease below the Gaussian probability has been experimentally observed for intensity fluctuations having value more than 2.5 of average intensity that may be treated as indication of some mode correlations. © 2013 Optical Society of America.

Stochasticity, periodicity and localized light structures in partially mode-locked fibre lasers

Physical systems with co-existence and interplay of processes featuring distinct spatio-temporal scales are found in various research areas ranging from studies of brain activity to astrophysics. The complexity of such systems makes their theoretical and experimental analysis technically and conceptually challenging. Here, we discovered that while radiation of partially mode-locked fibre lasers is stochastic and intermittent on a short time scale, it exhibits non-trivial periodicity and long-scale correlations over slow evolution from one round-trip to another. A new technique for evolution mapping of intensity autocorrelation function has enabled us to reveal a variety of localized spatio-temporal structures and to experimentally study their symbiotic co-existence with stochastic radiation. Real-time characterization of dynamical spatio-temporal regimes of laser operation is set to bring new insights into rich underlying nonlinear physics of practical active- and passive-cavity photonic systems.

Mode-locked fiber lasers with significant variability of generation regimes

We demonstrate a great variability of single-pulse (with only one pulse/wave-packet traveling along the cavity) generation regimes in fiber lasers passively mode-locked by non-linear polarization evolution (NPE) effect. Combining extensive numerical modeling and experimental studies, we identify multiple very distinct lasing regimes with a rich variety of dynamic behavior and a remarkably broad spread of key parameters (by an order of magnitude and more) of the generated pulses. Such a broad range of variability of possible lasing regimes necessitates developing techniques for control/adjustment of such key pulse parameters as duration, radiation spectrum, and the shape of the auto-correlation function. From a practical view point, availability of pulses/wave-packets with such different characteristics from the same laser makes it imperative to develop variability-aware designs with control techniques and methods to select appropriate application-oriented regimes. © 2014 The Authors.

Three key regimes of single pulse generation per round trip of all-normal-dispersion fiber lasers mode-locked with nonlinear polarization rotation

We show experimentally and numerically new transient lasing regime between stable single-pulse generation and noise-like generation. We characterize qualitatively all three regimes of single pulse generation per round-trip of all-normal-dispersion fiber lasers mode-locked due to effect of nonlinear polarization evolution. We study spectral and temporal features of pulses produced in all three regimes as well as compressibility of such pulses. Simple criteria are proposed to identify lasing regime in experiment. © 2012 Optical Society of America.

NLSE-based modelling of a random distributed feedback fiber laser

Random distributed feedback (DFB) fiber lasers have attracted a great attention since first demonstration [1]. Despite big advance in practical laser systems, random DFB fiber laser spectral properties are far away to be understood or even numerically modelled. Up to date, only generation power could be calculated and optimized numerically [1,2] or analytically [3] within the power balance model. However, spectral and statistical properties of random DFB fiber laser can not be found in this way. Here we present first numerical modelling of the random DFB fiber laser, including its spectral and statistical properties, using NLSE-based model. © 2013 IEEE.