Curvature-driven smoothing: a learning algorithm for feed-forward networks

The performance of feed-forward neural networks in real applications can be often be improved significantly if use is made of a-priori information. For interpolation problems this prior knowledge frequently includes smoothness requirements on the network mapping, and can be imposed by the addition to the error function of suitable regularization terms. The new error function, however, now depends on the derivatives of the network mapping, and so the standard back-propagation algorithm cannot be applied. In this paper, we derive a computationally efficient learning algorithm, for a feed-forward network of arbitrary topology, which can be used to minimize the new error function. Networks having a single hidden layer, for which the learning algorithm simplifies, are treated as a special case.

Incorporating curvature information into on-line learning

We analyse the dynamics of a number of second order on-line learning algorithms training multi-layer neural networks, using the methods of statistical mechanics. We first consider on-line Newton's method, which is known to provide optimal asymptotic performance. We determine the asymptotic generalization error decay for a soft committee machine, which is shown to compare favourably with the result for standard gradient descent. Matrix momentum provides a practical approximation to this method by allowing an efficient inversion of the Hessian. We consider an idealized matrix momentum algorithm which requires access to the Hessian and find close correspondence with the dynamics of on-line Newton's method. In practice, the Hessian will not be known on-line and we therefore consider matrix momentum using a single example approximation to the Hessian. In this case good asymptotic performance may still be achieved, but the algorithm is now sensitive to parameter choice because of noise in the Hessian estimate. On-line Newton's method is not appropriate during the transient learning phase, since a suboptimal unstable fixed point of the gradient descent dynamics becomes stable for this algorithm. A principled alternative is to use Amari's natural gradient learning algorithm and we show how this method provides a significant reduction in learning time when compared to gradient descent, while retaining the asymptotic performance of on-line Newton's method.

Effect of vesicle size on tissue localization and immunogenicity of liposomal DNA vaccines

The formulation of plasmid DNA (pDNA) in cationic liposomes is a promising strategy to improve the potency of DNA vaccines. In this respect, physicochemical parameters such as liposome size may be important for their efficacy. The aim of the current study was to investigate the effect of vesicle size on the in vivo performance of liposomal pDNA vaccines after subcutaneous vaccination in mice. The tissue distribution of cationic liposomes of two sizes, 500 nm (PDI 0.6) and 140 nm (PDI 0.15), composed of egg PC, DOPE and DOTAP, with encapsulated OVA-encoding pDNA, was studied by using dual radiolabeled pDNA-liposomes. Their potency to elicit cellular and humoral immune responses was investigated upon application in a homologous and heterologous vaccination schedule with 3 week intervals. It was shown that encapsulation of pDNA into cationic lipsomes resulted in deposition at the site of injection, and strongest retention was observed at large vesicle size. The vaccination studies demonstrated a more robust induction of OVA-specific, functional CD8+ T-cells and higher antibody levels upon vaccination with small monodisperse pDNA-liposomes, as compared to large heterodisperse liposomes or naked pDNA. The introduction of a PEG-coating on the small cationic liposomes resulted in enhanced lymphatic drainage, but immune responses were not improved when compared to non-PEGylated liposomes. In conclusion, it was shown that the physicochemical properties of the liposomes are of crucial importance for their performance as pDNA vaccine carrier, and cationic charge and small size are favorable properties for subcutaneous DNA vaccination.

Phakometric measurement of ocular surface radii of curvature, axial separations and alignment in relaxed and accommodated human eyes

Measurements (autokeratometry, A-scan ultrasonography and video ophthalmophakometry) of ocular surface radii, axial separations and alignment were made in the horizontal meridian of nine emmetropes (aged 20-38 years) with relaxed (cycloplegia) and active accommodation (mean ± 95% confidence interval: 3.7 ± 1.1 D). The anterior chamber depth (-1.5 ± 0.3 D) and both crystalline lens surfaces (front 3.1 ± 0.8 D; rear 2.1 ± 0.6 D) contributed to dioptric vergence changes that accompany accommodation. Accommodation did not alter ocular surface alignment. Ocular misalignment in relaxed eyes is mainly because of eye rotation (5.7 ± 1.6° temporally) with small amounts of lens tilt (0.2 ± 0.8° temporally) and decentration (0.1 ± 0.1 mm nasally) but these results must be viewed with caution as we did not account for corneal asymmetry. Comparison of calculated and empirically derived coefficients (upon which ocular surface alignment calculations depend) revealed that negligible inherent errors arose from neglect of ocular surface asphericity, lens gradient refractive index properties, surface astigmatism, effects of pupil size and centration, assumed eye rotation axis position and use of linear equations for analysing Purkinje image shifts. © 2004 The College of Optometrists.

Phakometric measurement of ocular surface radius of curvature and alignment: evaluation of method with physical model eyes

Ophthalmophakometric measurements of ocular surface radius of curvature and alignment were evaluated on physical model eyes encompassing a wide range of human ocular dimensions. The results indicated that defocus errors arising from imperfections in the ophthalmophakometer camera telecentricity and light source collimation were smaller than experimental errors. Reasonable estimates emerged for anterior lens surface radius of curvature (accuracy: 0.02–0.10 mm; precision 0.05–0.09 mm), posterior lens surface radius of curvature (accuracy: 0.10–0.55 mm; precision 0.06–0.20 mm), eye rotation (accuracy: 0.00–0.32°; precision 0.06–0.25°), lens tilt (accuracy: 0.00–0.33°; precision 0.05–0.98°) and lens decentration (accuracy: 0.00–0.07 mm; precision 0.00–0.07 mm).

Environmental scanning electron microscope imaging of vesicle systems

The structural characteristics of liposomes have been widely investigated and there is certainly a strong understanding of their morphological characteristics. Imaging of these systems, using techniques such as freeze-fracturing methods, transmission electron microscopy, and cryo-electron imaging, has allowed us to appreciate their bilayer structures and factors that influence this. However, there are a few methods that study these systems in their natural hydrated state; commonly, the liposomes are visualized after drying, staining and/or fixation of the vesicles. Environmental scanning electron microscopy (ESEM) offers the ability to image a liposome in its hydrated state without the need for prior sample preparation. We were the first to use ESEM to study the liposomes and niosomes, and have been able to dynamically follow the hydration of lipid films and changes in liposome suspensions as water condenses onto, or evaporates from, the sample in real-time. This provides an insight into the resistance of liposomes to coalescence during dehydration, thereby providing an alternative assay for liposome formulation and stability.

The effect of corneal thickness and corneal curvature on pneumatonometer measurements

Purpose. The purpose of this study was to investigate the influence of corneal topography and thickness on intraocular pressure (IOP) and pulse amplitude (PA) as measured using the Ocular Blood Flow Analyzer (OBFA) pneumatonometer (Paradigm Medical Industries, Utah, USA). Methods. 47 university students volunteered for this cross-sectional study: mean age 20.4 yrs, range 18 to 28 yrs; 23 male, 24 female. Only the measurements from the right eye of each participant were used. Central corneal thickness and mean corneal radius were measured using Scheimpflug biometry and corneal topographic imaging respectively. IOP and PA measurements were made with the OBFA pneumatonometer. Axial length was measured using A-scan ultrasound, due to its known correlation with these corneal parameters. Stepwise multiple regression analysis was used to identify those components that contributed significant variance to the independent variables of IOP and PA. Results. The mean IOP and PA measurements were 13.1 (SD 3.3) mmHg and 3.0 (SD 1.2) mmHg respectively. IOP measurements made with the OBFA pneumatonometer correlated significantly with central corneal thickness (r = +0.374, p = 0.010), such that a 10 mm change in CCT was equivalent to a 0.30 mmHg change in measured IOP. PA measurements correlated significantly with axial length (part correlate = -0.651, p < 0.001) and mean corneal radius (part correlate = +0.459, p < 0.001) but not corneal thickness. Conclusions. IOP measurements taken with the OBFA pneumatonometer are correlated with corneal thickness, but not axial length or corneal curvature. Conversely, PA measurements are unaffected by corneal thickness, but correlated with axial length and corneal radius. These parameters should be taken into consideration when interpreting IOP and PA measurements made with the OBFA pneumatonometer.

The interrogation and multiplexing of long period grating curvature sensors using a Bragg grating based, derivative spectroscopy technique

A long period grating is interrogated with a fibre Bragg grating using a derivative spectroscopy technique. A quasi-linear relationship between the output of the sensing scheme and the curvature experienced by the long period grating is demonstrated, with a sensitivity of 5.05 m and with an average curvature resolution of 2.9 × 10-2 m-1. In addition, the feasibility of multiplexing an in-line series of long period gratings with this interrogation scheme is demonstrated with two pairs of fibre Bragg gratings and long period gratings. With this arrangement the cross-talk error between channels was less than ± 2.4 × 10-3 m-1.

The vesicle size of DDA:TDB liposomal adjuvants plays a role in the cell-mediated immune response but has no significant effect on antibody production

The use of cationic liposomes as experimental adjuvants for subunit peptide of protein vaccines is well documented. Recently the cationic liposome CAF01, composed of dimethyldioctadecylammonium (DDA) and trehalose dibehenate (TDB), has entered Phase I clinical trials for use in a tuberculosis (TB) vaccine. CAF01 liposomes are a heterogeneous population with a mean vesicle size of 500 nm; a strong retention of antigen at the injection site and a Th1-biassed immune response are noted. The purpose of this study was to investigate whether CAF01 liposomes of significantly different vesicle sizes exhibited altered pharmacokinetics in vivo and cellular uptake with activation in vitro. Furthermore, the immune response against the TB antigen Ag85B-ESAT-6 was followed when various sized CAF01 liposomes were used as vaccine adjuvants. The results showed no differences in vaccine (liposome or antigen) draining from the injection site, however, significant differences in the movement of liposomes to the popliteal lymph node were noted. Liposome uptake by THP-1 vitamin D3 stimulated macrophage-like cells did not show a liposome size-dependent pattern of uptake. Finally, whilst there were no significant differences in the IgG1/2 regardless of the liposome size used as a delivery vehicle for Ag85B-ESAT-6, vesicle size has a size dependent effect on cell proliferation and IL-10 production with larger liposomes (in excess of 2 µm) promoting the highest proliferation and lowest IL-10 responses, yet vesicles of ~500 nm promoting higher IFN-? cytokine production from splenocytes and higher IL-1ß at the site of injection.

Manipulation of the surface pegylation in combination with reduced vesicle size of cationic liposomal adjuvants modifies their clearance kinetics from the injection site, and the rate and type of T cell response

The mechanism behind the immunostimulatory effect of the cationic liposomal vaccine adjuvant dimethyldioctadecylammonium and trehalose 6,6′- dibehenate (DDA:TDB) has been linked to the ability of these cationic vesicles to promote a depot after administration, with the liposomal adjuvant and the antigen both being retained at the injection site. This can be attributed to their cationic nature, since reduction in vesicle size does not influence their distribution profile yet neutral or anionic liposomes have more rapid clearance rates. Therefore the aim of this study was to investigate the impact of a combination of reduced vesicle size and surface pegylation on the biodistribution and adjuvanticity of the formulations, in a bid to further manipulate the pharmacokinetic profiles of these adjuvants. From the biodistribution studies, it was found that with small unilamellar vesicles (SUVs), 10% PEGylation of the formulation could influence liposome retention at the injection site after 4 days, whilst higher levels (25 mol%) of PEG blocked the formation of a depot and promote clearance to the draining lymph nodes. Interestingly, whilst the use of 10% PEG in the small unilamellar vesicles did not block the formation of a depot at the site of injection, it did result in earlier antibody response rates and switch the type of T cell responses from a Th1 to a Th2 bias suggesting that the presence of PEG in the formulation not only control the biodistribution of the vaccine, but also results in different types of interactions with innate immune cells. © 2012 Elsevier B.V.

Surfactant vesicle-mediated delivery of DNA vaccines via the subcutaneous route

Compared to naked DNA immunisation, entrapment of plasmid-based DNA vaccines into liposomes by the dehydration-rehydration method has shown to enhance both humoural and cell-mediated immune responses to encoded antigens administered by a variety of routes. In this paper we have compared the potency of lipid-based and non-ionic surfactant based vesicle carrier systems for DNA vaccines after subcutaneous immunisation. Plasmid pI.18Sfi/NP containing the nucleoprotein (NP) gene of A/Sichuan/2/87 (H3N2) influenza virus in the pI.18 expression vector was incorporated by the dehydration-rehydration method into various vesicle formulations. The DRV method, entailing mixing of small unilamellar vesicles (SUV) with DNA, followed by dehydration and rehydration, yielded high DNA vaccine incorporation values (85-97% of the DNA used) in all formulations. Studies on vesicle size revealed lipid-based systems formed cationic submicron size vesicles whilst constructs containing a non-ionic surfactant had significantly large z-average diameters (>1500 nm). Subcutaneous vesicle-mediated DNA immunisation employing two DRV(DNA) formulations as well as naked DNA revealed that humoural responses (immunoglobulin total IgG, and subclasses IgG 1 and 1gG 2a) engendered by the plasmid encoded nucleoprotein were substantially higher after dosing twice, 28 days apart with 10 μg DRV-entrapped DNA compared to naked DNA. Comparison between the lipid and non-ionic based vesicle formulations revealed no significant difference in stimulated antibody production. These results suggest that, not only can DNA be effectively entrapped within a range of lipid and non-ionic based vesicle formulations using the DRV method but that such DRV vesicles containing DNA may be a useful system for subcutaneous delivery of DNA vaccines. © 2004 Elsevier B.V. All rights reserved.

Comparison of vesicle based antigen delivery systems for delivery of hepatitis B surface antigen

There is a clinical need for a more effective vaccine against hepatitis B, and in particular vaccines that may be suitable for therapeutic administration. This study assesses the potential of cationic surfactant vesicle based formulations using two agents; the cationic amine containing [N-(N′,N′-dimethylaminoethane)-carbamoyl] cholesterol (DC-Chol) or dimethyl dioctadecylammonium bromide (DDA) with hepatitis B surface antigen (HBsAg). Synthetic mycobacterial cord factor, trehalose 6,6′-dibehenate (TDB) has been used as an adjuvant and the addition of 1-monopalmitoyl glycerol (C16:0) (MP) and cholesterol (Chol) to DDA-TDB is assessed for its potential to facilitate formation of dehydration-rehydration vesicles (DRV) at room temperature, and the effect of this on immune responses. A DRV formulation is directly compared to an adsorbed formulation of the same composition and preparation protocol (MP:dioleoyl phosphoethanolamine (DOPE):Chol:DC-Chol) and the direct substitution of MP with phosphatidylcholine (PC) is also compared in DRV antigen-entrapped formulations. MP and Chol were shown to facilitate the use of DDA-TDB in DRV formulations prepared at room temperature, whilst there was marginal alteration of immunogenicity (a reduction in HBsAg-specific IL-2). The HBsAg adsorbed DRV formulation was not significantly different from the HBsAg entrapped DRV formulation. Overall, DDA formulations incorporating TDB showed markedly increased antigen specific splenocyte proliferation and elicited cytokine production concomitant with a strong T cell driven response, delineating formulations that may be useful for further evaluation of their clinical potential. © 2007 Elsevier B.V. All rights reserved.

Optical bend sensor for vector curvature measurement based on Bragg grating in eccentric core polymer optical fibre

We present an optical bend sensor based on a Bragg grating written in an eccentric core polymer optical fibre. The grating wavelength shifts are studied as a function of bend curvature and fibre orientation and the device exhibits strong fibre orientation dependence, wide bend curvature range of ± 22.7 m-1 and high bend sensitivity of 63 pm/m-1, which is 80 times higher than the reported sensor based on an offset-FBG in standard single mode silica fibre.

The interrogation and multiplexing of long period grating curvature sensors using a Bragg grating based, derivative spectroscopy technique

A long period grating is interrogated with a fibre Bragg grating using a derivative spectroscopy technique. A quasi-linear relationship between the output of the sensing scheme and the curvature experienced by the long period grating is demonstrated, with a sensitivity of 5.05 m and with an average curvature resolution of 2.9 × 10-2 m-1. In addition, the feasibility of multiplexing an in-line series of long period gratings with this interrogation scheme is demonstrated with two pairs of fibre Bragg gratings and long period gratings. With this arrangement the cross-talk error between channels was less than ± 2.4 × 10-3 m-1.

Dynamic two-axis curvature measurement using multicore fiber Bragg gratings interrogated by arrayed waveguide gratings

We describe the use of arrayed waveguide gratings (AWGs) in the interrogation of fiber Bragg gratings (FBGs) for dynamic strain measurement. The ratiometric AWG output was calibrated in a static deflection experiment over a ±200 με range. Dynamic strain measurement was demonstrated with a FBG in a conventional single-mode fiber mounted on the surface of a vibrating cantilever and on a piezoelectric actuator, giving a resolution of 0.5 με at 2.4 kHz. We present results of this technique extended to measure the dynamic differential strain between two FBG pairs within a multicore fiber. An arbitrary cantilever oscillation of the multicore fiber was determined from curvature measurements in two orthogonal axes at 1125 Hz with a resolution of 0.05 m-1. © 2006 Optical Society of America.