Noise, regularizers, and unrealizable scenarios in online learning from restricted training sets

We study the dynamics of on-line learning in multilayer neural networks where training examples are sampled with repetition and where the number of examples scales with the number of network weights. The analysis is carried out using the dynamical replica method aimed at obtaining a closed set of coupled equations for a set of macroscopic variables from which both training and generalization errors can be calculated. We focus on scenarios whereby training examples are corrupted by additive Gaussian output noise and regularizers are introduced to improve the network performance. The dependence of the dynamics on the noise level, with and without regularizers, is examined, as well as that of the asymptotic values obtained for both training and generalization errors. We also demonstrate the ability of the method to approximate the learning dynamics in structurally unrealizable scenarios. The theoretical results show good agreement with those obtained by computer simulations.

Examining crystallographic orientation dependence of hardness of silica stishovite

We conducted nanoindentation to explore the hardness and elastic properties of silica stishovite, synthesized at high pressure and quenched to ambient conditions. A total of 10 crystallographic orientations were examined on selected grains with a maximum load of 4 or 20 mN. We observed discontinuity in the load-displacement curve (pop-in) for the [2 5 over(1, -)] and [6 2 over(1, -)] grains subjected to a maximum load of 20 mN. The single-crystal hardness at high plastic deformation is quasi-isotropic with an average of 32 ± 1 GPa, similar to the polycrystalline hardness reported earlier; the theoretical hardness determined from the experiments is about 54 ± 3 GPa. These two hardnesses suggest that stishovite is one of the hardest oxides. The measured indentation moduli are close to the predictions at low load (minor plasticity) but are considerably lower at high load (high plasticity). Both indentation hardness and modulus decrease with increasing plasticity. Our results underscore the necessity of considering the degree of plastic deformation when interpreting hardness and elastic moduli from indentation experiments. © 2007 Elsevier B.V. All rights reserved.

Benefit segmentation of international travelers to Macau, China

The purpose of this study is threefold: (1) to identify the underlying benefits sought by international visitors to Macau, China, which has emerged as a popular gambling destination in Asia; (2) to segment tourists visiting Macau by employing a cluster analysis based on the benefits sought; and (3) to examine any salient differences between the segment groups with regard to their behavioral characteristics, socio-economic characteristics, and demographic profiles. A convenience sample was used to collect data in the Macau International Airport, in the Macau Ferry Terminal, and at the border gate with Mainland China. A total 1,513 useful surveys were retained for data analysis. Cluster analysis discloses four distinct clusters: "convention and business seekers," "family and vacation seekers," "gambling and shopping seekers," and "multi-purpose seekers." Based on the results of our findings, several managerial implications are discussed. © Taylor & Francis Group, LLC.

Single-cell analysis for bioprocessing

Cell population heterogeneity has attracted great interest for understanding the individual cellular performances in their response to external stimuli and in the production of targeted products. Physical characterization of single cells and analysis of dynamic gene expression, synthesized proteins, and cellular metabolites from one single cell are reviewed. Advanced techniques have been developed to achieve high-throughput and ultrahigh resolution or sensitivity. Single cell capture methods are discussed as well. How to make use of cellular heterogeneities for maximizing cellular productivity is still in the infant stage, and control strategies will be formulated after the causes for heterogeneity have been elucidated.

Identifying spatially overlapping local cortical networks with MEG

Recent modelling studies (Hadjipapas et al. [2009]: Neuroimage 44:1290-1303) have shown that it may be possible to distinguish between different neuronal populations on the basis of their macroscopically measured (EEG/MEG) mean field. We set out to test whether the different orientation columns contributing to a signal at a specific cortical location could be identified based on the measured MEG signal. We used 1.5deg square, static, obliquely oriented grating stimuli to generate sustained gamma oscillations in a focal region of primary visual cortex. We then used multivariate classifier methods to predict the orientation (left or right oblique) of the stimuli based purely on the time-series data from this one location. Both the single trial evoked response (0-300 ms) and induced post-transient power spectra (300-2,300 ms, 20-70 Hz band) due to the different stimuli were classifiable significantly above chance in 11/12 and 10/12 datasets respectively. Interestingly, stimulus-specific information is preserved in the sustained part of the gamma oscillation, long after perception has occurred and all neuronal transients have decayed. Importantly, the classification of this induced oscillation was still possible even when the power spectra were rank-transformed showing that the different underlying networks give rise to different characteristic temporal signatures. © 2009 Wiley-Liss, Inc.