Deep learning via semi-supervised embedding

We show how nonlinear embedding algorithms popular for use with shallow semi-supervised learning techniques such as kernel methods can be applied to deep multilayer architectures, either as a regularizer at the output layer, or on each layer of the architecture. This provides a simple alternative to existing approaches to deep learning whilst yielding competitive error rates compared to those methods, and existing shallow semi-supervised techniques.

Olfactory traces and spatial learning in rats.

We conducted an experiment to assess the use of olfactory traces for spatial orientation in an open environment in rats, Rattus norvegicus. We trained rats to locate a food source at a fixed location from different starting points, in the presence or absence of visual information. A single food source was hidden in an array of 19 petri dishes regularly arranged in an open-field arena. Rats were trained to locate the food source either in white light (with full access to distant visuospatial information) or in darkness (without any visual information). In both cases, the goal was in a fixed location relative to the spatial frame of reference. The results of this experiment revealed that the presence of noncontrolled olfactory traces coherent with the spatial frame of reference enables rats to locate a unique position as accurately in darkness as with full access to visuospatial information. We hypothesize that the olfactory traces complement the use of other orientation mechanisms, such as path integration or the reliance on visuospatial information. This experiment demonstrates that rats can rely on olfactory traces for accurate orientation, and raises questions about the establishment of such traces in the absence of any other orientation mechanism. Copyright 1998 The Association for the Study of Animal Behaviour.

Influence of local environmental olfactory cues on place learning in rats

The aim of the present study was to assess the influence of local environmental olfactory cues on place learning in rats. We developed a new experimental design allowing the comparison of the use of local olfactory and visual cues in spatial and discrimination learning. We compared the effect of both types of cues on the discrimination of a single food source in an open-field arena. The goal was either in a fixed or in a variable location, and could be indicated by local olfactory and/or visual cues. The local cues enhanced the discrimination of the goal dish, whether it was in a fixed or in a variable location. However, we did not observe any overshadowing of the spatial information by the local olfactory or visual cue. Rats relied primarily on distant visuospatial information to locate the goal, neglecting local information when it was in conflict with the spatial information.

A behavioral study of alpha-1b adrenergic receptor knockout mice: increased reaction to novelty and selectively reduced learning capacities.

Knockout mice lacking the alpha-1b adrenergic receptor were tested in behavioral experiments. Reaction to novelty was first assessed in a simple test in which the time taken by the knockout mice and their littermate controls to enter a second compartment was compared. Then the mice were tested in an open field to which unknown objects were subsequently added. Special novelty was introduced by moving one of the familiar objects to another location in the open field. Spatial behavior and memory were further studied in a homing board test, and in the water maze. The alpha-1b knockout mice showed an enhanced reactivity to new situations. They were faster to enter the new environment, covered longer paths in the open field, and spent more time exploring the new objects. They reacted like controls to modification inducing spatial novelty. In the homing board test, both the knockout mice and the control mice seemed to use a combination of distant visual and proximal olfactory cues, showing place preference only if the two types of cues were redundant. In the water maze the alpha-1b knockout mice were unable to learn the task, which was confirmed in a probe trial without platform. They were perfectly able, however, to escape in a visible platform procedure. These results confirm previous findings showing that the noradrenergic pathway is important for the modulation of behaviors such as reaction to novelty and exploration, and suggest that this is mediated, at least partly, through the alpha-1b adrenergic receptors. The lack of alpha-1b adrenergic receptors in spatial orientation does not seem important in cue-rich tasks but may interfere with orientation in situations providing distant cues only.

Accurate performance of a rat model of schizophrenia in the water maze depends on visual cue availability and stability: a distortion in cognitive mapping abilities?

Rats were treated postnatally (PND 5-16) with BSO (l-buthionine-(S,R)-sulfoximine) in an animal model of schizophrenia based on transient glutathione deficit. The BSO treated rats were impaired in patrolling a maze or a homing table when adult, yet demonstrated preserved escape learning, place discrimination and reversal in a water maze task [37]. In the present work, BSO rats' performance in the water maze was assessed in conditions controlling for the available visual cues. First, in a completely curtained environment with two salient controlled cues, BSO rats showed little accuracy compared to control rats. Secondly, pre-trained BSO rats were impaired in reaching the familiar spatial position when curtains partially occluded different portions of the room environment in successive sessions. The apparently preserved place learning in a classical water maze task thus appears to require the stability and the richness of visual landmarks from the surrounding environment. In other words, the accuracy of BSO rats in place and reversal learning is impaired in a minimal cue condition or when the visual panorama changes between trials. However, if the panorama remains rich and stable between trials, BSO rats are equally efficient in reaching a familiar position or in learning a new one. This suggests that the BSO accurate performance in the water maze does not satisfy all the criteria for a cognitive map based navigation on the integration of polymodal cues. It supports the general hypothesis of a binding deficit in BSO rats.

Dynamic visual information plays a critical role for spatial navigation in water but not on solid ground.

In the Morris water maze (MWM) task, proprioceptive information is likely to have a poor accuracy due to movement inertia. Hence, in this condition, dynamic visual information providing information on linear and angular acceleration would play a critical role in spatial navigation. To investigate this assumption we compared rat's spatial performance in the MWM and in the homing hole board (HB) tasks using a 1.5 Hz stroboscopic illumination. In the MWM, rats trained in the stroboscopic condition needed more time than those trained in a continuous light condition to reach the hidden platform. They expressed also little accuracy during the probe trial. In the HB task, in contrast, place learning remained unaffected by the stroboscopic light condition. The deficit in the MWM was thus complete, affecting both escape latency and discrimination of the reinforced area, and was thus task specific. This dissociation confirms that dynamic visual information is crucial to spatial navigation in the MWM whereas spatial navigation on solid ground is mediated by a multisensory integration, and thus less dependent on visual information.

Olfactory and/or visual cues for spatial navigation through ontogeny: olfactory cues enable the use of visual cues

This study analyzed the spatial memory capacities of rats in darkness with visual and/or olfactory cues through ontogeny. Tests were conducted with the homing board, where rats had to find the correct escape hole. Four age groups (24 days, 48 days, 3-6 months, and 12 months) were trained in 3 conditions: (a) 3 identical light cues; (b) 5 different olfactory cues; and (c) both types of cues, followed by removal of the olfactory cues. Results indicate that immature rats first take into account olfactory information but are unable to orient with only the help of discrete visual cues. Olfaction enables the use of visual information by 48-day-old rats. Visual information predominantly supports spatial cognition in adult and 12-month-old rats. Results point out cooperation between vision and olfaction for place navigation during ontogeny in rats.

Spatial learning by rats across visually disconnected environments

Experiments were designed to examine some properties of spatial representations in rats. Adult subjects were trained to escape through a hole at a fixed position in a large circular arena (see Schenk 1989). The experiments were conducted in the dark, with a limited number of controlled visual light cues in order to assess the minimal cue requirement for place learning. Three identical light cues (shape, height and distance from the table) were used. Depending on the condition, they were either permanently on, or alternatively on or off, depending on the position of the rat in the field. Two questions were asked: a) how many identical visual cues were necessary for spatial discrimination in the dark, and b) could rats integrate the relative positions of separate cues, under conditions in which the rat was never allowed to perceive all three cues simultaneously. The results suggest that rats are able to achieve a place discrimination task even if the three cues necessary for efficient orientation can never be seen simultaneously. A dissociation between the discrimination of the spatial position of the goal and the capacity to reach it by a direct path suggests that a reduced number of cues might require prolonged locomotion to allow an accurate orientation in the environment.

MENTAL IMAGERY IN PERCEPTUAL LEARNING

L'imagerie mentale est définie comme une expérience similaire à la perception mais se déroulant en l'absence d'une stimulation physique. Des recherches antérieures ont montré que l'imagerie mentale améliore la performance dans certains domaines, comme par exemple le domaine moteur. Cependant, son rôle dans l'apprentissage perceptif n'a pas encore été étudié. L'apprentissage perceptif correspond à l'amélioration permanente des performances suite à la répétition de la même tâche. Cette thèse présente une série des résultats empiriques qui montrent que l'apprentissage perceptif peut aussi être achevé en l'absence des stimuli physiques. En effet, imaginer des stimuli visuels amène à une meilleure performance avec les stimuli réels. Donc, les processus sous-jacents l'apprentissage perceptif ne sont pas uniquement déclenchés par les stimuli sensoriels, mais également par des signaux internes. En plus, l'apprentissage perceptif à travers l'imagerie mentale ne se réalise que seule-ment quand les stimuli ne sont pas (complètement) présents, mais gaiement quand les stimuli montrés ne sont pas utiles quant à la résolution de la tâche. - Mental imagery is described as an experience that resembles pereeptnal ex-perience but which occurs in the absence ef a physical stimulation. Despite its beneficial effects in, among others, motor performance, the role of mental imagery m perceptual learning has not yet been addressed. Here we focus on a specific sensory modality: vision. Perceptual learning is the ability to improve perception in a stable way through the repetition of a given task Here I demonstrate by a series of empirical results that a perceptual improve¬ment can also occur in the absence of a stimulation. Imagining visual stimuli is sufficient for successful perceptual learning. Hence, processes underlying perceptual learning are not only stimulus-driven but can also be driven by internally generated signals. Moreover, I also show that perceptual learning via mental imagery can occur not only when physical stimuli are (partially) absent, but also in conditions where stimuli are uninformative with respect to the task that has to be learned.

Deep sclerectomy combined with trabeculectomy in pediatric glaucoma

Résumé : Ce travail porte sur l'étude rétrospective d'une série de jeunes patients opérés de glaucomes pédiatriques. Le but est d'évaluer le résultat au long cours d'une intervention chirurgicale combinant une sclérectomie profonde et une trabéculectomie (sclérectomie profonde pénétrante). Durant la période de mars 1997 à octobre 2006, 28 patients on été suivis pour évaluer le résultat de cette chirurgie effectuées sur 35 yeux. Un examen ophtalmologique complet a été pratiqué avant la chirurgie, 1 et 7 jours, puis 1, 2, 3, 4, 6, 9, 12 mois, enfin tous les 6 mois après l'opération. Les critères d'évaluation du résultat postopératoire sont : les changements de pression intraoculaire, le traitement antiglaucomateux adjuvant, le taux de complication, le nombre de reprises chirurgicales,- l'erreur de réfraction, la meilleure acuité visuelle corrigée, l'état et le diamètre de la cornée. L'âge moyen est de 3.6 ± 4.5 ans et le suivi moyen de 3.6 ± 2.9 ans. La pression intraoculaire préopératoire de 31.9 ± 11.5 mmHg baisse de 58.3% (p<0.005) à la fin du suivi. Sur les 14 patients dont l'acuité visuelle a pu être mesurée, 8 (57.1 %) ont une acuité égale ou supérieure à 5/10e, 3 (21.4%) une acuité de 2/10e après intervention. Le taux de succès cumulatif complet à 9 ans est de 52.3%, le succès relatif 70.6%. Les complications menaçant la vision (8.6%) ont été plus fréquentes dans les cas de glaucome réfractaire. Pour conclure la sclérectomie profonde combinée à une trabéculectomie est une technique chirurgicale développée afin de contrôler la pression intraoculaire dans les cas de glaucomes congénitaux, juvéniles et secondaires. Les résultats intermédiaires sont encourageants et prometteurs. Les cas préalablement opérés avant cette nouvelle technique ont cependant un pronostic moins favorable. Le nombre de complications menaçant la vision est essentiellement lié à la sévérité du glaucome et au nombre d'interventions préalables. Abstract : Purpose : To evaluate the outcomes of combined deep sclerectomy and trabeculectomy (penetrating deep sclerectomy) in pediatric glaucoma. Design : Retrospective, non-consecutive, non-comparative, interventional case series. Participants : Children suffering from pediatric glaucoma who underwent surgery between March 1997 and October 2006 were included in this study. Methods : A primary combined deep sclerectomy and trabeculectomy was performed in 35 eyes of 28 patients. Complete examinations were performed before surgery, postoperatively at 1 and 7 days, at 1, 2, 3, 4, 6, 9, 12 months and then every 6 months after surgery. Main Outcome Measures : Surgical outcome was assessed in terms of intraocular pressure (IOP) change, additional glaucoma medication, complication rate, need for surgical revision, as well as refractive errors, best corrected visual acuity (BCVA), and corneal clarity and diameters. Results : The mean age before surgery was 3.6 ± 4.5 years, and the mean follow-up was 3.5 ± 2.9 years. The mean preoperative IOP was 31.9 ± 11.5 mmHg. At the end of follow-up, the mean IOP decreased by 58.3% (p<0.005), and from 14 patients with available BCVA 8 patients (57.1 %) achieved. 0.5 (20/40) or better, 3 (21.4%) 0.2 (20/100), and 2 (14.3%) 0.1 (20/200) in their better eye. The mean refractive error (spherical equivalent) at final follow-up visits was +0.83 ± 5.4. Six patients (43%) were affected by myopia. The complete and qualified success rates, based on a cumulative survival curve, after- 9 years were 52.3% and 70.6%, respectively (p<0.05). Sight threatening complications were more common (8.6%) in refractory glaucomas. Conclusions : Combined deep sclerectomy and trabeculectomy is a surgical technique developed to control IOP in congenital, secondary and juvenile glaucomas. The intermediate results are satisfactory and promising. Previous classic glaucoma surgeries performed before this new technique had less favourable results. The number of sight threatening complications is related to the severity of glaucoma and number of previous surgeries.

Quantitative distribution of parvalbumin, calretinin, and calbindin D-28k immunoreactive neurons in the visual cortex of normal and Alzheimer cases.

The distribution of parvalbumin (PV), calretinin (CR), and calbindin (CB) immunoreactive neurons was studied with the help of an image analysis system (Vidas/Zeiss) in the primary visual area 17 and associative area 18 (Brodmann) of Alzheimer and control brains. In neither of these areas was there a significant difference between Alzheimer and control groups in the mean number of PV, CR, or CB immunoreactive neuronal profiles, counted in a cortical column going from pia to white matter. Significant differences in the mean densities (numbers per square millimeter of cortex) of PV, CR, and CB immunoreactive neuronal profiles were not observed either between groups or areas, but only between superficial, middle, and deep layers within areas 17 and 18. The optical density of the immunoreactive neuropil was also similar in Alzheimer and controls, correlating with the numerical density of immunoreactive profiles in superficial, middle, and deep layers. The frequency distribution of neuronal areas indicated significant differences between PV, CR, and CB immunoreactive neuronal profiles in both areas 17 and 18, with more large PV than CR and CB positive profiles. There were also significantly more small and less large PV and CR immunoreactive neuronal profiles in Alzheimer than in controls. Our data show that, although the brain pathology is moderate to severe, there is no prominent decrease of PV, CR and CB positive neurons in the visual cortex of Alzheimer brains, but only selective changes in neuronal perikarya.

Electrical neuroimaging of memory discrimination based on single-trial multisensory learning.

Multisensory experiences influence subsequent memory performance and brain responses. Studies have thus far concentrated on semantically congruent pairings, leaving unresolved the influence of stimulus pairing and memory sub-types. Here, we paired images with unique, meaningless sounds during a continuous recognition task to determine if purely episodic, single-trial multisensory experiences can incidentally impact subsequent visual object discrimination. Psychophysics and electrical neuroimaging analyses of visual evoked potentials (VEPs) compared responses to repeated images either paired or not with a meaningless sound during initial encounters. Recognition accuracy was significantly impaired for images initially presented as multisensory pairs and could not be explained in terms of differential attention or transfer of effects from encoding to retrieval. VEP modulations occurred at 100-130ms and 270-310ms and stemmed from topographic differences indicative of network configuration changes within the brain. Distributed source estimations localized the earlier effect to regions of the right posterior temporal gyrus (STG) and the later effect to regions of the middle temporal gyrus (MTG). Responses in these regions were stronger for images previously encountered as multisensory pairs. Only the later effect correlated with performance such that greater MTG activity in response to repeated visual stimuli was linked with greater performance decrements. The present findings suggest that brain networks involved in this discrimination may critically depend on whether multisensory events facilitate or impair later visual memory performance. More generally, the data support models whereby effects of multisensory interactions persist to incidentally affect subsequent behavior as well as visual processing during its initial stages.

Deep sclerectomy combined with trabeculectomy in pediatric glaucoma.

PURPOSE: To evaluate the outcomes of combined deep sclerectomy and trabeculectomy (penetrating deep sclerectomy) in pediatric glaucoma. DESIGN: Retrospective, nonconsecutive, noncomparative, interventional case series. PARTICIPANTS: Children suffering from pediatric glaucoma who underwent surgery between March 1997 and October 2006 were included in this study. METHODS: A primary combined deep sclerectomy and trabeculectomy was performed in 35 eyes of 28 patients. Complete examinations were performed before surgery, postoperatively at 1 and 7 days, at 1, 2, 3, 4, 6, 9, and 12 months, and then every 6 months after surgery. MAIN OUTCOME MEASURES: Surgical outcome was assessed in terms of intraocular pressure (IOP) change, additional glaucoma medication, complication rate, need for surgical revision, as well as refractive errors, best-corrected visual acuity (BCVA), and corneal clarity and diameters. RESULTS: The mean age before surgery was 3.6+/-4.5 years, and the mean follow-up was 3.5+/-2.9 years. The mean preoperative IOP was 31.9+/-11.5 mmHg. At the end of follow-up, the mean IOP decreased by 58.3% (P&lt;0.005), and from 14 patients with available BCVA 8 patients (57.1%) achieved 0.5 (20/40) or better, 3 (21.4%) 0.2 (20/100), and 2 (14.3%) 0.1 (20/200) in their better eye. The mean refractive error (spherical equivalent [SE]) at final follow-up visits was +0.83+/-5.4. Six patients (43%) were affected by myopia. The complete and qualified success rates, based on a cumulative survival curve, after 9 years were 52.3% and 70.6%, respectively (P&lt;0.05). Sight-threatening complications were more common (8.6%) in refractory glaucomas. CONCLUSIONS: Combined deep sclerectomy and trabeculectomy is an operative technique developed to control IOP in congenital, secondary, and juvenile glaucomas. The intermediate results are satisfactory and promising. Previous classic glaucoma surgeries performed before this new technique had less favorable results. The number of sight-threatening complications is related to the severity of glaucoma and number of previous surgeries. FINANCIAL DISCLOSURE(S): The authors have no proprietary or commercial interest in any materials discussed in this article.

Absence of snapshot memory of the target view interferes with place navigation learning by rats in the water maze

Contribution of visual and nonvisual mechanisms to spatial behavior of rats in the Morris water maze was studied with a computerized infrared tracking system, which switched off the room lights when the subject entered the inner circular area of the pool with an escape platform. Naive rats trained under light-dark conditions (L-D) found the escape platform more slowly than rats trained in permanent light (L). After group members were swapped, the L-pretrained rats found under L-D conditions the same target faster and eventually approached latencies attained during L navigation. Performance of L-D-trained rats deteriorated in permanent darkness (D) but improved with continued D training. Thus L-D navigation improves gradually by procedural learning (extrapolation of the start-target azimuth into the zero-visibility zone) but remains impaired by lack of immediate visual feedback rather than by absence of the snapshot memory of the target view.