The role of biases in on-line learning of two-layer networks

The influence of biases on the learning dynamics of a two-layer neural network, a normalized soft-committee machine, is studied for on-line gradient descent learning. Within a statistical mechanics framework, numerical studies show that the inclusion of adjustable biases dramatically alters the learning dynamics found previously. The symmetric phase which has often been predominant in the original model all but disappears for a non-degenerate bias task. The extended model furthermore exhibits a much richer dynamical behavior, e.g. attractive suboptimal symmetric phases even for realizable cases and noiseless data.

Sparse on-line Gaussian processes

We develop an approach for sparse representations of Gaussian Process (GP) models (which are Bayesian types of kernel machines) in order to overcome their limitations for large data sets. The method is based on a combination of a Bayesian online algorithm together with a sequential construction of a relevant subsample of the data which fully specifies the prediction of the GP model. By using an appealing parametrisation and projection techniques that use the RKHS norm, recursions for the effective parameters and a sparse Gaussian approximation of the posterior process are obtained. This allows both for a propagation of predictions as well as of Bayesian error measures. The significance and robustness of our approach is demonstrated on a variety of experiments.

Sparse on-line Gaussian processes

We develop an approach for sparse representations of Gaussian Process (GP) models (which are Bayesian types of kernel machines) in order to overcome their limitations for large data sets. The method is based on a combination of a Bayesian online algorithm together with a sequential construction of a relevant subsample of the data which fully specifies the prediction of the GP model. By using an appealing parametrisation and projection techniques that use the RKHS norm, recursions for the effective parameters and a sparse Gaussian approximation of the posterior process are obtained. This allows both for a propagation of predictions as well as of Bayesian error measures. The significance and robustness of our approach is demonstrated on a variety of experiments.

Risk-based maintenance model for offshore oil and gas pipelines:a case study

Offshore oil and gas pipelines are vulnerable to environment as any leak and burst in pipelines cause oil/gas spill resulting in huge negative Impacts on marine lives. Breakdown maintenance of these pipelines is also cost-intensive and time-consuming resulting in huge tangible and intangible loss to the pipeline operators. Pipelines health monitoring and integrity analysis have been researched a lot for successful pipeline operations and risk-based maintenance model is one of the outcomes of those researches. This study develops a risk-based maintenance model using a combined multiple-criteria decision-making and weight method for offshore oil and gas pipelines in Thailand with the active participation of experienced executives. The model's effectiveness has been demonstrated through real life application on oil and gas pipelines in the Gulf of Thailand. Practical implications. Risk-based inspection and maintenance methodology is particularly important for oil pipelines system, as any failure in the system will not only affect productivity negatively but also has tremendous negative environmental impact. The proposed model helps the pipelines operators to analyze the health of pipelines dynamically, to select specific inspection and maintenance method for specific section in line with its probability and severity of failure.

A model of service performance enhancement:the role of transactional and transformational leadership

This paper is concerned with the ways in which transactional and transformational leadership styles can improve the service performance of front-line staff. Past literature on services marketing has indicated the importance of leadership but has largely ignored the parallel literature in which leadership styles have been conceptualized and operationalized (e.g., sales management, organizational psychology). This paper seeks to build upon existing services marketing theory by introducing the role of leadership styles in enhancing service performance. Consequently, a conceptual framework of the effect of transactional and transformational leadership styles on service performance, anchored in a crossdisciplinary literature review, is developed. Managerial implications and future research directions are also discussed.

A model of transactional and transformational leadership for services personnel

This paper is concerned with the effects that leadership styles (i.e., transactional and transformational) can have upon the level of front-line employees’ service delivery quality. Previous literature has mostly looked at leadership and its effects upon subordinates within a sales, psychology, or human resources context. However, due to the idiosyncrasies inherent in services (i.e., intangibility, heterogeneity, perishability, and inseparability), it is likely that, in such a context, different leadership styles will effect performance outcomes. Consequently, this paper seeks to expand the services marketing literature by developing a conceptual framework of leadership style effects adapted to the field of services marketing. Of particular importance are the effects that leadership styles have upon front-line employee “motivators” and service-related job outcomes. Specific hypotheses are developed and future research directions are also presented for consideration.

PCB assembly line assignment:a genetic algorithm approach

Purpose – This paper sets out to study a production-planning problem for printed circuit board (PCB) assembly. A PCB assembly company may have a number of assembly lines for production of several product types in large volume. Design/methodology/approach – Pure integer linear programming models are formulated for assigning the product types to assembly lines, which is the line assignment problem, with the objective of minimizing the total production cost. In this approach, unrealistic assignment, which was suffered by previous researchers, is avoided by incorporating several constraints into the model. In this paper, a genetic algorithm is developed to solve the line assignment problem. Findings – The procedure of the genetic algorithm to the problem and a numerical example for illustrating the models are provided. It is also proved that the algorithm is effective and efficient in dealing with the problem. Originality/value – This paper studies the line assignment problem arising in a PCB manufacturing company in which the production volume is high.

Feasibility studies of an on-line identification technique

This thesis is concerned with the study of a non-sequential identification technique, so that it may be applied to the identification of process plant mathematical models from process measurements with the greatest degree of accuracy and reliability. In order to study the accuracy of the technique under differing conditions, simple mathematical models were set up on a parallel hybrid. computer and these models identified from input/output measurements by a small on-line digital computer. Initially, the simulated models were identified on-line. However, this method of operation was found not suitable for a thorough study of the technique due to equipment limitations. Further analysis was carried out in a large off-line computer using data generated by the small on-line computer. Hence identification was not strictly on-line. Results of the work have shovm that the identification technique may be successfully applied in practice. An optimum sampling period is suggested, together with noise level limitations for maximum accuracy. A description of a double-effect evaporator is included in this thesis. It is proposed that the next stage in the work will be the identification of a mathematical model of this evaporator using the teclmique described.

Spectral pattern, grouping, and the pitches of complex tones and their components

Harmonically related components are typically heard as a unified entity with a rich timbre and a pitch corresponding to the fundamental frequency. Mistuning a component generally has four consequences: (i) the global pitch of the complex shifts in the same direction as the mistuning; (ii) the component makes a reduced contribution to global pitch; (iii) the component is heard out as a separate sound with a pure timbre; (iv) its pitch differs from that of a pure tone of equal frequency in a small but systematic way. Local interactions between neighbouring components cannot explain these effects; instead they are usually explained in terms of the global operation of a single harmonic-template mechanism. However, several observations indicate that separate mechanisms govern the selection of spectral components for perceptual fusion and for the computation of global pitch. First, an increase in mistuning causes a harmonic to be heard out before it begins to be excluded from the computation of global pitch. Second, a single even harmonic added to an odd-harmonic complex is typically more salient than its odd neighbours. Third, the mistuning of a component in frequency-shifted stimuli, or stimuli with a moderate spectral stretch, results in changes in salience and component pitch like those seen for harmonic stimuli. Fourth, the global pitch of frequency-shifted stimuli is predicted well by the weighted fit of a harmonic template, but, with the exception of the lowest component, the fusion of individual partials for shifted stimuli is best predicted by the common pattern of spectral spacing. Fifth, our sensitivity to spectral pattern is surprisingly resistant to random variations in component spacing induced by applying mistunings to several harmonics at once. These findings are evaluated in the context of an autocorrelogram model of the proposed pitch/grouping dissociation. © S. Hirzel Verlag · EAA.

Nonlinear loop mirror-based all-optical signal processing in fiber-optic communications

All-optical data processing is expected to play a major role in future optical communications. The fiber nonlinear optical loop mirror (NOLM) is a valuable tool in optical signal processing applications. This paper presents an overview of our recent advances in developing NOLM-based all-optical processing techniques for application in fiber-optic communications. The use of in-line NOLMs as a general technique for all-optical passive 2R (reamplification, reshaping) regeneration of return-to-zero (RZ) on-off keyed signals in both high-speed, ultralong-distance transmission systems and terrestrial photonic networks is reviewed. In this context, a theoretical model enabling the description of the stable propagation of carrier pulses with periodic all-optical self-regeneration in fiber systems with in-line deployment of nonlinear optical devices is presented. A novel, simple pulse processing scheme using nonlinear broadening in normal dispersion fiber and loop mirror intensity filtering is described, and its employment is demonstrated as an optical decision element at a RZ receiver as well as an in-line device to realize a transmission technique of periodic all-optical RZ-nonreturn-to-zero-like format conversion. The important issue of phase-preserving regeneration of phase-encoded signals is also addressed by presenting a new design of NOLM based on distributed Raman amplification in the loop fiber. © 2008 Elsevier Inc. All rights reserved.

The spectral sensitivity of long period gratings fabricated in elliptical core D-shaped optical fibre

Long period gratings (LPGs) were written into a D-shaped optical fibre that has an elliptical core with a W-shaped refractive index profile and the first detailed investigation of such LPGs is presented. The LPGs’ attenuation bands were found to be sensitive to the polarisation of the interrogating light with a spectral separation of about 15 nm between the two orthogonal polarisation states. A finite element method was successfully used to model many of the behavioural features of the LPGs. In addition, two spectrally overlapping attenuation bands corresponding to orthogonal polarisation states were observed; modelling successfully reproduced this spectral feature. The spectral sensitivity of both orthogonal states was experimentally measured with respect to temperature and bending. These LPG devices produced blue and red wavelength shifts depending upon the orientation of the bend with measured maximum sensitivities of -3.56 and +6.51 nm m, suggesting that this type of fibre LPG may be useful as a shape/bend orientation sensor with reduced errors associated with polarisation dependence. The use of neighbouring bands to discriminate between temperature and bending was also demonstrated, leading to an overall curvature error of ±0.14 m-1 and an overall temperature error of ±0.3 °C with a maximum polarisation dependence error of ±8 × 10-2 m-1 for curvature and ±5 × 10-2 °C for temperature.

Response normalization and blur adaptation:data and multi-scale model

Adapting to blurred or sharpened images alters perceived blur of a focused image (M. A. Webster, M. A. Georgeson, & S. M. Webster, 2002). We asked whether blur adaptation results in (a) renormalization of perceived focus or (b) a repulsion aftereffect. Images were checkerboards or 2-D Gaussian noise, whose amplitude spectra had (log-log) slopes from -2 (strongly blurred) to 0 (strongly sharpened). Observers adjusted the spectral slope of a comparison image to match different test slopes after adaptation to blurred or sharpened images. Results did not show repulsion effects but were consistent with some renormalization. Test blur levels at and near a blurred or sharpened adaptation level were matched by more focused slopes (closer to 1/f) but with little or no change in appearance after adaptation to focused (1/f) images. A model of contrast adaptation and blur coding by multiple-scale spatial filters predicts these blur aftereffects and those of Webster et al. (2002). A key proposal is that observers are pre-adapted to natural spectra, and blurred or sharpened spectra induce changes in the state of adaptation. The model illustrates how norms might be encoded and recalibrated in the visual system even when they are represented only implicitly by the distribution of responses across multiple channels.

Interaction of quinolone antibiotics with the human intestinal CACO-2 cell model

The transport of a group of quinolone antibiotics across the human intestinal model, Caco-2 cells, was investigated. It was found that the transport of the quinolones generally correlated with the lipophilicity of the compounds, indicating the passive diffusional transcellular processes were involved. However, it was observed that the transport in both directions apical-to-basolateral and basolateral-to-apical was not equivalent, and polarised transport occurred. For all the quinolones studied except, BMS-284756-01, it was found that the basolateral-to-apical transport was significantly greater than the apical-to-basolateral transport. This finding suggested that the quinolones underwent a process of active secretion. The pKas and logPs for the quinolones were determined using potentiometric titrations. The measured logP values were compared with those determined using theoretical methods. The theoretical methods for calculating logP including the Moriguchi method correlated poorly with the measured logP values. Further investigations revealed that there may be an active transporter involved in the apical-to-basolateral transport of quinolones as well. This mechanism was sensitive to competing quinolones, but, it was unaffected by the metabolic inhibitor combination of sodium azide (15mM) with 2-deoxy-D-glucose (50mM). The basolateral-to-apical transport of quinolones was found to be sensitive to inhibition by a number of different inhibitors. The metabolic inhibitors, sodium azide (15mM) with 2-deoxy-D-glucose (50mM) and 2,4-dinitrophenol (1mM), were able to reduce the basolateral-to-apical transport of quinolones. A reduction in temperature from 37°C to 2°C caused an 80-fold decrease in the transport of gatifloxacin in both directions, however, this effect was not sufficient to abolish the greater basolateral-to-apical secretion. As with apical-to-basolateral transport, it was found that quinolones competed with gatifloxacin for basolateral-to-apical transport, both ofloxacin (100μM) and norfloxacin (100μM) significantly (P<0.003) decreased the basolateral-to-apical transport of gatifloxacin; however, ciprofloxacin (100μM and 300μM) had no effect. A number of inhibitors of various transport systems were also investigated. It was found that the anion transport inhibitor, probenecid (100 μM) had a significant inhibitory effect on the basolateral-to-apical transport of ciprofloxacin (P=0.039), while the cation transport inhibitor cimetidine (100μM and 500μM) had no effect. The organic anion exchange inhibitor 4,4'diisothiocyanostilbene-2-2' -disulphonic acid DIDS (400μM) also had a significant inhibitory effect (P=O.O 13). The PgP inhibitor and anion exchange inhibitor verapamil (400Mμ) was able to completely abolish the basolateral-to-apical secretion of gatifloxacin and bring it into line with the apical-to-basolateral flux. In conclusion, the apical-to-basolateral and basolateral-toapical transport of quinolones involved an active component. The basolateral-to-apical secretion was abolished by a verapamil (400μM), a bisubstrate for PgP and the anion transporter.

Development of a co-culture model of the human lungs for toxicity testing and identification of biomarkers of inhalation toxicity

The airway epithelium is the first point of contact in the lung for inhaled material, including infectious pathogens and particulate matter, and protects against toxicity from these substances by trapping and clearance via the mucociliary escalator, presence of a protective barrier with tight junctions and initiation of a local inflammatory response. The inflammatory response involves recruitment of phagocytic cells to neutralise and remove and invading materials and is oftern modelled using rodents. However, development of valid in vitro airway epithelial models is of great importance due to the restrictions on animal studies for cosmetic compound testing implicit in the 7th amendment to the European Union Cosmetics Directive. Further, rodent innate immune responses have fundamental differences to human. Pulmonary endothelial cells and leukocytes are also involved in the innate response initiated during pulmonary inflammation. Co-culture models of the airways, in particular where epithelial cells are cultured at air liquid interface with the presence of tight junctions and differentiated mucociliary cells, offer a solution to this problem. Ideally validated models will allow for detection of early biomarkers of response to exposure and investigation into inflammatory response during exposure. This thesis describes the approaches taken towards developing an in vitro epithelial/endothelial cell model of the human airways and identification biomarkers of response to exposure to xenobiotics. The model comprised normal human primary microvascular endothelial cells and the bronchial epithelial cell line BEAS-2B or normal human bronchial epithelial cells. BEAS-2B were chosen as their characterisation at air liquid interface is limited but they are robust in culture, thereby predicted to provide a more reliable test system. Proteomics analysis was undertaken on challenged cells to investigate biomarkers of exposure. BEAS-2B morphology was characterised at air liquid interface compared with normal human bronchial epithelial cells. The results indicate that BEAS-2B cells at an air liquid interface form tight junctions as shown by expression of the tight junction protein zonula occludens-1. To this author’s knowledge this is the first time this result has been reported. The inflammatory response of BEAS-2B (measured as secretion of the inflammatory mediators interleukin-8 and -6) air liquid interface mono-cultures to Escherichia coli lipopolysaccharide or particulate matter (fine and ultrafine titanium dioxide) was comparable to published data for epithelial cells. Cells were also exposed to polymers of “commercial interest” which were in the nanoparticle range (and referred to particles hereafter). BEAS-2B mono-cultures showed an increased secretion of inflammatory mediators after challenge. Inclusion of microvascular endothelial cells resulted in protection against LPS- and particle- induced epithelial toxicity, measured as cell viability and inflammatory response, indicating the importance of co-cultures for investigations into toxicity. Two-dimensional proteomic analysis of lysates from particle-challenged cells failed to identify biomarkers of toxicity due to assay interference and experimental variability. Separately, decreased plasma concentrations of serine protease inhibitors, and the negative acute phase proteins transthyretin, histidine-rich glycoprotein and alpha2-HS glycoprotein were identified as potential biomarkers of methyl methacrylate/ethyl methacrylate/butylacrylate treatment in rats.

Self-calibrated, multi-spectral photometric stereo for 3D face capture

This paper addresses the problem of obtaining 3d detailed reconstructions of human faces in real-time and with inexpensive hardware. We present an algorithm based on a monocular multi-spectral photometric-stereo setup. This system is known to capture high-detailed deforming 3d surfaces at high frame rates and without having to use any expensive hardware or synchronized light stage. However, the main challenge of such a setup is the calibration stage, which depends on the lights setup and how they interact with the specific material being captured, in this case, human faces. For this purpose we develop a self-calibration technique where the person being captured is asked to perform a rigid motion in front of the camera, maintaining a neutral expression. Rigidity constrains are then used to compute the head's motion with a structure-from-motion algorithm. Once the motion is obtained, a multi-view stereo algorithm reconstructs a coarse 3d model of the face. This coarse model is then used to estimate the lighting parameters with a stratified approach: In the first step we use a RANSAC search to identify purely diffuse points on the face and to simultaneously estimate this diffuse reflectance model. In the second step we apply non-linear optimization to fit a non-Lambertian reflectance model to the outliers of the previous step. The calibration procedure is validated with synthetic and real data.