Incorporating curvature information into on-line learning

We analyse the dynamics of a number of second order on-line learning algorithms training multi-layer neural networks, using the methods of statistical mechanics. We first consider on-line Newton's method, which is known to provide optimal asymptotic performance. We determine the asymptotic generalization error decay for a soft committee machine, which is shown to compare favourably with the result for standard gradient descent. Matrix momentum provides a practical approximation to this method by allowing an efficient inversion of the Hessian. We consider an idealized matrix momentum algorithm which requires access to the Hessian and find close correspondence with the dynamics of on-line Newton's method. In practice, the Hessian will not be known on-line and we therefore consider matrix momentum using a single example approximation to the Hessian. In this case good asymptotic performance may still be achieved, but the algorithm is now sensitive to parameter choice because of noise in the Hessian estimate. On-line Newton's method is not appropriate during the transient learning phase, since a suboptimal unstable fixed point of the gradient descent dynamics becomes stable for this algorithm. A principled alternative is to use Amari's natural gradient learning algorithm and we show how this method provides a significant reduction in learning time when compared to gradient descent, while retaining the asymptotic performance of on-line Newton's method.

Compositional semantics of dataflow networks with query-driven communication of exact values

We develop and study the concept of dataflow process networks as used for exampleby Kahn to suit exact computation over data types related to real numbers, such as continuous functions and geometrical solids. Furthermore, we consider communicating these exact objectsamong processes using protocols of a query-answer nature as introduced in our earlier work. This enables processes to provide valid approximations with certain accuracy and focusing on certainlocality as demanded by the receiving processes through queries. We define domain-theoretical denotational semantics of our networks in two ways: (1) directly, i. e. by viewing the whole network as a composite process and applying the process semantics introduced in our earlier work; and (2) compositionally, i. e. by a fixed-point construction similarto that used by Kahn from the denotational semantics of individual processes in the network. The direct semantics closely corresponds to the operational semantics of the network (i. e. it iscorrect) but very difficult to study for concrete networks. The compositional semantics enablescompositional analysis of concrete networks, assuming it is correct. We prove that the compositional semantics is a safe approximation of the direct semantics. Wealso provide a method that can be used in many cases to establish that the two semantics fully coincide, i. e. safety is not achieved through inactivity or meaningless answers. The results are extended to cover recursively-defined infinite networks as well as nested finitenetworks. A robust prototype implementation of our model is available.

Fast reconstruction of harmonic functions from Cauchy data using integral equation techniques

We consider the problem of stable determination of a harmonic function from knowledge of the solution and its normal derivative on a part of the boundary of the (bounded) solution domain. The alternating method is a procedure to generate an approximation to the harmonic function from such Cauchy data and we investigate a numerical implementation of this procedure based on Fredholm integral equations and Nyström discretization schemes, which makes it possible to perform a large number of iterations (millions) with minor computational cost (seconds) and high accuracy. Moreover, the original problem is rewritten as a fixed point equation on the boundary, and various other direct regularization techniques are discussed to solve that equation. We also discuss how knowledge of the smoothness of the data can be used to further improve the accuracy. Numerical examples are presented showing that accurate approximations of both the solution and its normal derivative can be obtained with much less computational time than in previous works.

Control of pattern formation by time-delay feedback with global and local contributions

We consider the suppression of spatiotemporal chaos in the complex GinzburgLandau equation by a combined global and local time-delay feedback. Feedback terms are implemented as a control scheme, i.e., they are proportional to the difference between the time-delayed state of the system and its current state. We perform a linear stability analysis of uniform oscillations with respect to space-dependent perturbations and compare with numerical simulations. Similarly, for the fixed-point solution that corresponds to amplitude death in the spatially extended system, a linear stability analysis with respect to space-dependent perturbations is performed and complemented by numerical simulations. © 2010 Elsevier B.V. All rights reserved.

Thermal properties of fibre Bragg gratings inscribed point-by-point by infrared femtosecond laser

Direct, point-by-point inscription of fibre Bragg gratings by an infrared femtosecond laser has been reported recently. Response of these gratings to annealing at temperatures in the range 500 to 1050°C is studied for the first time. Gratings inscribed by infrared femtosecond lasers were thermally stable at temperatures up to 900°C, representing a significant improvement in comparison with the 'common', UV-inscribed, gratings. Annealing at temperatures up to 700°C increased grating reflectivity. © IEE 2005.

Photoinduced modifications in fiber gratings inscribed directly by infrared femtosecond irradiation

The structure of fiber Bragg gratings inscribed pointby-point by an infrared femtosecond laser is studied by quantitative phase microscopy. Results show that these gratings present a central region with a depressed refractive index surrounded by an outer corona with increased refractive index. The refractive index profile suggests the presence of microvoids embedded in a region of the core. © 2006 IEEE.

Inscription of in-fibre photonic devices by an infrared femtosecond laser

In this work, a point by point method for the inscription of fibre Bragg gratings using a tightly focused infrared femtosecond laser is implemented for the first time. Fibre Bragg gratings are wavelength-selective, retro-reflectors which have become a key component in optical communications as well as offering great potential as a sensing tool. Standard methods of fabrication are based on UV inscription in fibre with a photosensitive core. Despite the high quality of the gratings, a number of disadvantages are associated with UV inscription, in particular, the requirements of a photosensitive fibre, the low thermal stability and the need to remove the protective coating prior to inscription. By combining the great flexibility offered by the point by point method with the advantages inherent to inscription by an infrared femtosecond laser, the previous disadvantages are overcome. The method here introduced, allows a fast inscription process at a rate of ~1mm/s, gratings of lengths between 1cm and 2cm exhibiting reflections in excess of 99%. Physical dimensions of these gratings differ significantly from those inscribed by other methods, in this case the grating is confined to a fraction of the cross section of the core, leading to strong and controllable birefringence and polarisation dependent loss. Finally, an investigation of the potential for their exploitation towards novel applications is carried out, devices such as directional bend sensors inscribed in single-mode fibre, superimposed but non-overlapping gratings, and single-mode, single-polarisation fibre lasers, were designed, fabricated and characterised based on point by point femtosecond inscription.

Structure of fiber gratings directly written by infrared femtosecond laser

Structural modification m gratings inscribed point-by-point by a femtosecond laser is investigated using quantitative phase microscopy. The gratings present a central region with a depressed refractive index surrounded by an outer corona with increased index. © 2006 Optical Society of America.

Advanced fibre gratings fabricated in standard and infrared glass fibres by ultraviolet and near-infrared-femtosecond lasers

In this thesis, I describe studies on fabrication, spectral characteristics and applications of tilted fibre gratings (TFGs) with small, large and 45° tilted structures and novel developments in fabrication of fibre Bragg gratings (FBGs) and long period gratings (LPGs) in normal silica and mid-infrared (mid-IR) glass fibres using near-IR femtosecond laser. One of the major contributions presented in this thesis is the systematic investigation of structures, inscription methods and spectral, polarisation dependent loss (PDL) and thermal characteristics of TFGs with small (<45°), large (>45°) and 45° tilted structures. I have experimentally characterised TFGs, obtaining relationships between the radiation angle, central wavelength of the radiation profile, Bragg resonance and the tilt angle, which are consistent with theoretical simulation based on the mode-coupling theory. Furthermore, thermal responses have been measured for these three types of TFGs, showing the transmission spectra of large and 45° TFGs are insensitive to the temperature change, unlike the normal and small angle tilted FBGs. Based on the distinctive optical properties, TFGs have been developed into interrogation system and sensors, which form the other significant contributions of the work presented in this thesis. The 10°-TFG based 800nm WDM interrogation system can function not just as an in-fibre spectrum analyser but also possess refractive index sensing capability. By utilising the unique polarisation properties, the 81 °-TFG based sensors are capable of sensing the transverse loading and twisting with sensitivities of 2.04pW/(kg/m) and 145.90pW/rad, repectively. The final but the most important contribution from the research work presented in this thesis is the development of novel grating inscription techniques using near-IR femtosecond laser. A number of LPGs and FBGs were successfully fabricated in normal silica and mid-IR glass fibres using point-by-point and phase-mask techniques. LPGs and 1st and 2nd order FBGs have been fabricated in these mid-IR glass fibres showing resonances covering the wavelength range from 1200 to 1700nm with the strengths up to 13dB. In addition, the thermal and strain sensitivities of these gratings have been systematically investigated. All the results from these initial but systematic works will provide useful function characteristics information for future fibre grating based devices and applications in mid-IR range.

On bandwidth request mechanism with piggyback in fixed IEEE 802.16 networks

This paper investigates the random channel access mechanism specified in the IEEE 802.16 standard for the uplink traffic in a Point-to-MultiPoint (PMP) network architecture. An analytical model is proposed to study the impacts of the channel access parameters, bandwidth configuration and piggyback policy on the performance. The impacts of physical burst profile and non-saturated network traffic are also taken into account in the model. Simulations validate the proposed analytical model. It is observed that the bandwidth utilization can be improved if the bandwidth for random channel access can be properly configured according to the channel access parameters, piggyback policy and network traffic.

Performance comparison of OFDM bandwidth request schemes in fixed IEEE 802.16 networks

IEEE 802.16 standard specifies two contention based bandwidth request schemes working with OFDM physical layer specification in point-to-multipoint (PMP) architecture, the mandatory one used in region-full and the optional one used in region-focused. This letter presents a unified analytical model to study the bandwidth efficiency and channel access delay performance of the two schemes. The impacts of access parameters, available bandwidth and subchannelization have been taken into account. The model is validated by simulations. The mandatory scheme is observed to perform closely to the optional one when subchannelization is active for both schemes.

Micro-fabrication of advanced photonic devices by means of direct point-by-point femtosecond inscription in silica

We present recent results on experimental micro-fabrication and numerical modeling of advanced photonic devices by means of direct writing by femtosecond laser. Transverse inscription geometry was routinely used to inscribe and modify photonic devices based on waveguiding structures. Typically, standard commercially available fibers were used as a template with a pre-fabricated waveguide. Using a direct, point-by-point inscription by infrared femtosecond laser, a range of fiber-based photonic devices was fabricated including Fiber Bragg Gratings (FBG) and Long Period Gratings (LPG). Waveguides with a core of a couple of microns, periodic structures, and couplers have been also fabricated in planar geometry using the same method.

Micro-fabrication of advanced photonic devices by means of direct point-by-point femtosecond inscription in silica

We present recent results on experimental micro-fabrication and numerical modeling of advanced photonic devices by means of direct writing by femtosecond laser. Transverse inscription geometry was routinely used to inscribe and modify photonic devices based on waveguiding structures. Typically, standard commercially available fibers were used as a template with a pre-fabricated waveguide. Using a direct, point-by-point inscription by infrared femtosecond laser, a range of fiber-based photonic devices was fabricated including Fiber Bragg Gratings (FBG) and Long Period Gratings (LPG). Waveguides with a core of a couple of microns, periodic structures, and couplers have been also fabricated in planar geometry using the same method.