Finite-size effects in on-line learning of multilayer neural networks

We complement recent advances in thermodynamic limit analyses of mean on-line gradient descent learning dynamics in multi-layer networks by calculating fluctuations possessed by finite dimensional systems. Fluctuations from the mean dynamics are largest at the onset of specialisation as student hidden unit weight vectors begin to imitate specific teacher vectors, increasing with the degree of symmetry of the initial conditions. In light of this, we include a term to stimulate asymmetry in the learning process, which typically also leads to a significant decrease in training time.

Belief propagation vs. TAP for decoding corrupted messages

We employ two different methods, based on belief propagation and TAP,for decoding corrupted messages encoded by employing Sourlas's method, where the code word comprises products of K bits selected randomly from the original message. We show that the equations obtained by the two approaches are similar and provide the same solution as the one obtained by the replica approach in some cases K=2. However, we also show that for K>=3 and unbiased messages the iterative solution is sensitive to the initial conditions and is likely to provide erroneous solutions; and that it is generally beneficial to use Nishimori's temperature, especially in the case of biased messages.

The belief in TAP

We show the similarity between belief propagation and TAP, for decoding corrupted messages encoded by Sourlas's method. The latter is a special case of the Gallager error- correcting code, where the code word comprises products of K bits selected randomly from the original message. We examine the efficacy of solutions obtained by the two methods for various values of K and show that solutions for K>=3 may be sensitive to the choice of initial conditions in the case of unbiased patterns. Good approximations are obtained generally for K=2 and for biased patterns in the case of K>=3, especially when Nishimori's temperature is being used.

Ultra high-speed transmission using dispersion managed solitons

This thesis presents the results of numerical modelling of ultra high-speed transmission using DM solitons. The theory of propagation in optical fibres is presented with specific reference to optical communication systems. This theory is then expanded to. incorporate dispersion-managed transmission and the dispersion managed soliton. The first part of this work focuses on ultra high-speed dispersion managed soliton propagation in short period dispersion maps. Initially, the cbaracteristics .of dispersion managed soliton propagation in short period dispersion maps are contrasted to those of the more conventional dispersion managed regime. These properties are then utilised to investigate transmission at single channel data rates of 80 Gbit/s, 160 Gbit/s and 320 Gbit/s. For all three data rates, the tolerable limits for transmission over 1000 km, 3000 km and·transoceanic distances are defined. A major limitation of these higher bjt rate systems arises from the problem of noise-induced interactions, which is where the.accumulation of timing jitter causes neighbouring dispersion-managed solitons to interact. In addition, the systems become more sensitive to initial conditions as the data rate increases, .. The second part of the work focuses on contrasting the performance of a range of propagation regimes, from quasi-linear through to soliton-like propagation at 40 Gbit/s for both single channel and WDM dispersion managed transmission. The results indicated that whilst the optimal single channel performance was achieved for soliton-like propagation, the optimal WDM performance was achieved for propagation regime that lay between quasi-linear and soliton-like.

Studies on the deactivation and reactivation of spent hydroprocessing catalyst

A study is reported on the deactivation of hydroprocessing catalysts and their reactivation by the removal of coke and metal foulants. The literature on hydrotreating catalyst deactivation by coke and metals deposition, the environmental problems associated with spent catalyst disposal, and its reactivation/rejuvenation process were reviewed. Experimental studies on catalyst deactivation involved problem analysis in industrial hydroprocessing operations, through characterization of the spent catalyst, and laboratory coking studies. A comparison was made between the characteristics of spent catalysts from fixed bed and ebullating bed residue hydroprocessing reactor units and the catalyst deactivation pattern in both types of reactor systems was examined. In the laboratory the nature of initial coke deposited on the catalyst surface and its role on catalyst deactivation were studied. The influence of initial coke on catalyst surface area and porosity was significant. Both catalyst acidity and feedstock quality had a remarkable influence on the amount and the nature of the initial coke. The hydroenitrogenation function (HDN) of the catalyst was found to be deactivated more rapidly by the initial coke than the hydrodesulphurization function (HDS). In decoking experiments, special attention was paid to the initial conditions of coke combustion, since the early stages of contact between the coke on the spent catalyst surface and the oxygen are crucial in the decoking process. An increase in initial combustion temperature above 440oC and the oxygen content of the regeneration gas above 5% vanadium led to considerable sintering of the catalyst. At temperatures above 700oC there was a substantial loss of molybdenum from the catalyst, and phase transformations in the alumina support. The preferred leaching route (coked vs decoked form of spent catalyst) and a comparison of different reagents (i.e., oxalic acid and tartaric acid) and promoters (i.e., Hydrogen Peroxide and Ferric Nitrate) for better selectivity in removing the major foulant (vanadium), characterization and performance evaluation of the treated catalysts and modelling of the leaching process were addressed in spent catalyst rejuvenation studies. The surface area and pore volume increased substantially with increasing vanadium extraction from the spent catalyst; the HDS activity showed a parallel increase. The selectivity for leaching of vanadium deposits was better, and activity recovery was higher, for catalyst rejuvenated by metal leaching prior to decoking.

Investigation of chaotic mixing in laminar fluid systems by the use of computational fluid dynamics

This work presents significant development into chaotic mixing induced through periodic boundaries and twisting flows. Three-dimensional closed and throughput domains are shown to exhibit chaotic motion under both time periodic and time independent boundary motions, A property is developed originating from a signature of chaos, sensitive dependence to initial conditions, which successfully quantifies the degree of disorder withjn the mixing systems presented and enables comparisons of the disorder throughout ranges of operating parameters, This work omits physical experimental results but presents significant computational investigation into chaotic systems using commercial computational fluid dynamics techniques. Physical experiments with chaotic mixing systems are, by their very nature, difficult to extract information beyond the recognition that disorder does, does not of partially occurs. The initial aim of this work is to observe whether it is possible to accurately simulate previously published physical experimental results through using commercial CFD techniques. This is shown to be possible for simple two-dimensional systems with time periodic wall movements. From this, and subsequent macro and microscopic observations of flow regimes, a simple explanation is developed for how boundary operating parameters affect the system disorder. Consider the classic two-dimensional rectangular cavity with time periodic velocity of the upper and lower walls, causing two opposing streamline motions. The degree of disorder within the system is related to the magnitude of displacement of individual particles within these opposing streamlines. The rationale is then employed in this work to develop and investigate more complex three-dimensional mixing systems that exhibit throughputs and time independence and are therefore more realistic and a significant advance towards designing chaotic mixers for process industries. Domains inducing chaotic motion through twisting flows are also briefly considered. This work concludes by offering possible advancements to the property developed to quantify disorder and suggestions of domains and associated boundary conditions that are expected to produce chaotic mixing.

Solids mixing and segregation in a gas spout-fluid bed-effect of the distributor design

This work is concerned with the assessment of a newer version of the spout-fluid bed where the gas is supplied from a common plenum and the distributor controls the operational phenomenon. Thus the main body of the work deals with the effect of the distributor design on the mixing and segregation of solids in a spout-filled bed. The effect of distributor design in the conventional fluidised bed and of variation of the gas inlet diameter in a spouted bed were also briefly investigated for purpose of comparison. Large particles were selected for study because they are becoming increasingly important in industrial fluidised beds but have not been thoroughly investigated. The mean particle diameters of the fraction ranged from 550 to 2400 mm, and their specific gravity from 0.97 to 2.45. Only work carried out with binary systems is reported here. The effect of air velocity, particle properties, bed height, the relative amount of jetsam and flotsam and initial conditions on the steady-state concentration profiles were assessed with selected distributors. The work is divided into three sections. Sections I and II deal with the fluidised bed and spouted bed systems. Section III covers the development of the spout-filled bed and its behaviour with reference to distributor design and it is shown how benefits of both spouting and fluidising phenomena can be exploited. In the fluidisation zone, better mixing is achieved by distributors which produce a large initial bubble diameter. Some common features exist between the behaviour of unidensity jetsam-rich systems and different density flotsam-rich systems. The shape factor does not seem to have an affect as long as it is only restricted to the minor component. However, in the case of the major component, particle shape significantly affects the final results. Studies of aspect ratio showed that there is a maximum (1.5) above which slugging occurs and the effect of the distributor design is nullified. A mixing number was developed for unidensity spherical rich systems, which proved to be extremely useful in quantifying the variation in mixing and segregation with changes in distributor design.

Nonlinear spectral shaping and optical rogue events in fiber-based systems

We provide an overview of our recent work on the shaping and stability of optical continua in the long pulse regime. Fibers with normal group-velocity dispersion at all-wavelengths are shown to allow for highly coherent continua that can be nonlinearly shaped using appropriate initial conditions. In contrast, supercontinua generated in the anomalous dispersion regime are shown to exhibit large fluctuations in the temporal and spectral domains that can be controlled using a carefully chosen seed. A particular example of this is the first experimental observation of the Peregrine soliton which constitutes a prototype of optical rogue-waves.

Parabolic optical pulses under the action of the third-order dispersion

Recent developments in nonlinear optics reveal an interesting class of pulses with a parabolic intensity profile in the energy-containing core and a linear frequency chirp that can propagate in a fiber with normal group-velocity dispersion. Parabolic pulses propagate in a stable selfsimilar manner, holding certain relations (scaling) between pulse power, width, and chirp parameter. In the additional presence of linear amplification, they enjoy the remarkable property of representing a common asymptotic state (or attractor) for arbitrary initial conditions. Analytically, self-similar (SS) parabolic pulses can be found as asymptotic, approximate solutions of the nonlinear Schr¨odinger equation (NLSE) with gain in the semi-classical (largeamplitude/small-dispersion) limit. By analogy with the well-known stable dynamics of solitary waves - solitons, these SS parabolic pulses have come to be known as similaritons. In practical fiber systems, inherent third-order dispersion (TOD) in the fiber always introduces a certain degree of asymmetry in the structure of the propagating pulse, eventually leading to pulse break-up. To date, there is no analytic theory of parabolic pulses under the action of TOD. Here, we develop aWKB perturbation analysis that describes the effect of weak TOD on the parabolic pulse solution of the NLSE in a fiber gain medium. The induced perturbation in phase and amplitude can be found to any order. The theoretical model predicts with sufficient accuracy the pulse structural changes induced by TOD, which are observed through direct numerical NLSE simulations.

Parabolic optical pulses under the action of the third-order dispersion

Recent developments in nonlinear optics reveal an interesting class of pulses with a parabolic intensity profile in the energy-containing core and a linear frequency chirp that can propagate in a fiber with normal group-velocity dispersion. Parabolic pulses propagate in a stable selfsimilar manner, holding certain relations (scaling) between pulse power, width, and chirp parameter. In the additional presence of linear amplification, they enjoy the remarkable property of representing a common asymptotic state (or attractor) for arbitrary initial conditions. Analytically, self-similar (SS) parabolic pulses can be found as asymptotic, approximate solutions of the nonlinear Schr¨odinger equation (NLSE) with gain in the semi-classical (largeamplitude/small-dispersion) limit. By analogy with the well-known stable dynamics of solitary waves - solitons, these SS parabolic pulses have come to be known as similaritons. In practical fiber systems, inherent third-order dispersion (TOD) in the fiber always introduces a certain degree of asymmetry in the structure of the propagating pulse, eventually leading to pulse break-up. To date, there is no analytic theory of parabolic pulses under the action of TOD. Here, we develop aWKB perturbation analysis that describes the effect of weak TOD on the parabolic pulse solution of the NLSE in a fiber gain medium. The induced perturbation in phase and amplitude can be found to any order. The theoretical model predicts with sufficient accuracy the pulse structural changes induced by TOD, which are observed through direct numerical NLSE simulations.

Nonlinear spectral shaping and optical rogue events in fiber-based systems

We provide an overview of our recent work on the shaping and stability of optical continua in the long pulse regime. Fibers with normal group-velocity dispersion at all-wavelengths are shown to allow for highly coherent continua that can be nonlinearly shaped using appropriate initial conditions. In contrast, supercontinua generated in the anomalous dispersion regime are shown to exhibit large fluctuations in the temporal and spectral domains that can be controlled using a carefully chosen seed. A particular example of this is the first experimental observation of the Peregrine soliton which constitutes a prototype of optical rogue-waves. © 2012 Elsevier Inc. All rights reserved.

Universality in the merging dynamics of parametric active contours:a study in MRI based lung segmentation

Measurement of lung ventilation is one of the most reliable techniques in diagnosing pulmonary diseases. The time-consuming and bias-prone traditional methods using hyperpolarized H 3He and 1H magnetic resonance imageries have recently been improved by an automated technique based on 'multiple active contour evolution'. This method involves a simultaneous evolution of multiple initial conditions, called 'snakes', eventually leading to their 'merging' and is entirely independent of the shapes and sizes of snakes or other parametric details. The objective of this paper is to show, through a theoretical analysis, that the functional dynamics of merging as depicted in the active contour method has a direct analogue in statistical physics and this explains its 'universality'. We show that the multiple active contour method has an universal scaling behaviour akin to that of classical nucleation in two spatial dimensions. We prove our point by comparing the numerically evaluated exponents with an equivalent thermodynamic model. © IOP Publishing Ltd and Deutsche Physikalische Gesellschaft.

Soliton radiation beat analysis of optical pulses generated from two continuous-wave lasers

We propose a fibre-based approach for generation of optical frequency combs (OFCs) with the aim of calibration of astronomical spectrographs in the low and medium-resolution range. This approach includes two steps: in the first step, an appropriate state of optical pulses is generated and subsequently moulded in the second step delivering the desired OFC. More precisely, the first step is realised by injection of two continuous-wave (CW) lasers into a conventional single-mode fibre, whereas the second step generates a broad OFC by using the optical solitons generated in step one as initial condition. We investigate the conversion of a bichromatic input wave produced by two initial CW lasers into a train of optical solitons, which happens in the fibre used as step one. Especially, we are interested in the soliton content of the pulses created in this fibre. For that, we study different initial conditions (a single cosine-hump, an Akhmediev breather, and a deeply modulated bichromatic wave) by means of soliton radiation beat analysis and compare the results to draw conclusion about the soliton content of the state generated in the first step. In case of a deeply modulated bichromatic wave, we observed the formation of a collective soliton crystal for low input powers and the appearance of separated solitons for high input powers. An intermediate state showing the features of both, the soliton crystal and the separated solitons, turned out to be most suitable for the generation of OFC for the purpose of calibration of astronomical spectrographs.

Thermalized polarization dynamics of a discrete optical-waveguide system with four-wave mixing

Statistical mechanics of two coupled vector fields is studied in the tight-binding model that describes propagation of polarized light in discrete waveguides in the presence of the four-wave mixing. The energy and power conservation laws enable the formulation of the equilibrium properties of the polarization state in terms of the Gibbs measure with positive temperature. The transition line T=∞ is established beyond which the discrete vector solitons are created. Also in the limit of the large nonlinearity an analytical expression for the distribution of Stokes parameters is obtained, which is found to be dependent only on the statistical properties of the initial polarization state and not on the strength of nonlinearity. The evolution of the system to the final equilibrium state is shown to pass through the intermediate stage when the energy exchange between the waveguides is still negligible. The distribution of the Stokes parameters in this regime has a complex multimodal structure strongly dependent on the nonlinear coupling coefficients and the initial conditions.

The use of driven equilibrium conditions in the measurement of NMR relaxation times

The further development of the use of NMR relaxation times in chemical, biological and medical research has perhaps been curtailed by the length of time these measurements often take. The DESPOT (Driven Equilibrium Single Pulse Observation of T1) method has been developed, which reduces the time required to make a T1 measurement by a factor of up to 100. The technique has been studied extensively herein and the thesis contains recommendations for its successful experimental application. Modified DESPOT type equations for use when T2 relaxation is incomplete or where off-resonance effects are thought to be significant are also presented. A recently reported application of the DESPOT technique to MR imaging gave good initial results but suffered from the fact that the images were derived from spin systems that were not driven to equilibrium. An approach which allows equilibrium to be obtained with only one non-acquisition sequence is presented herein and should prove invaluable in variable contrast imaging. A DESPOT type approach has also been successfully applied to the measurement of T1. T_1's can be measured, using this approach significantly faster than by the use of the classical method. The new method also provides a value for T1 simultaneously and therefore the technique should prove valuable in intermediate energy barrier chemical exchange studies. The method also gives rise to the possibility of obtaining simultaneous T1 and T1 MR images. The DESPOT technique depends on rapid multipulsing at nutation angles, normally less than 90^o. Work in this area has highlighted the possible time saving for spectral acquisition over the classical technique (90^o-5T_1)_n. A new method based on these principles has been developed which permits the rapid multipulsing of samples to give T_1 and M_0 ratio information. The time needed, however, is only slightly longer than would be required to determine the M_0 ratio alone using the classical technique. In ^1H decoupled ^13C spectroscopy the method also gives nOe ratio information for the individual absorptions in the spectrum.