The efficacy of single-trial multisensory memories.

This review article summarizes evidence that multisensory experiences at one point in time have long-lasting effects on subsequent unisensory visual and auditory object recognition. The efficacy of single-trial exposure to task-irrelevant multisensory events is its ability to modulate memory performance and brain activity to unisensory components of these events presented later in time. Object recognition (either visual or auditory) is enhanced if the initial multisensory experience had been semantically congruent and can be impaired if this multisensory pairing was either semantically incongruent or entailed meaningless information in the task-irrelevant modality, when compared to objects encountered exclusively in a unisensory context. Processes active during encoding cannot straightforwardly explain these effects; performance on all initial presentations was indistinguishable despite leading to opposing effects with stimulus repetitions. Brain responses to unisensory stimulus repetitions differ during early processing stages (-100 ms post-stimulus onset) according to whether or not they had been initially paired in a multisensory context. Plus, the network exhibiting differential responses varies according to whether or not memory performance is enhanced or impaired. The collective findings we review indicate that multisensory associations formed via single-trial learning exert influences on later unisensory processing to promote distinct object representations that manifest as differentiable brain networks whose activity is correlated with memory performance. These influences occur incidentally, despite many intervening stimuli, and are distinguishable from the encoding/learning processes during the formation of the multisensory associations. The consequences of multisensory interactions that persist over time to impact memory retrieval and object discrimination.

Comparison of three commercially available radio frequency coils for human brain imaging at 3 Tesla.

OBJECTIVE: To evaluate a transverse electromagnetic (TEM), a circularly polarized (CP) (birdcage), and a 12-channel phased array head coil at the clinical field strength of B0 = 3T in terms of signal-to-noise ratio (SNR), signal homogeneity, and maps of the effective flip angle alpha. MATERIALS AND METHODS: SNR measurements were performed on low flip angle gradient echo images. In addition, flip angle maps were generated for alpha(nominal) = 30 degrees using the double angle method. These evaluation steps were performed on phantom and human brain data acquired with each coil. Moreover, the signal intensity variation was computed for phantom data using five different regions of interest. RESULTS: In terms of SNR, the TEM coil performs slightly better than the CP coil, but is second to the smaller 12-channel coil for human data. As expected, both the TEM and the CP coils show superior image intensity homogeneity than the 12-channel coil, and achieve larger mean effective flip angles than the combination of body and 12-channel coil with reduced radio frequency power deposition. CONCLUSION: At 3T the benefits of TEM coil design over conventional lumped element(s) coil design start to emerge, though the phased array coil retains an advantage with respect to SNR performance.

Do we truly see what we think we see? The role of cognitive bias in pathological interpretation.

In the histomorphological grading of prostate carcinoma, pathologists have regularly assigned comparable scores for the architectural Gleason and the now-obsolete nuclear World Health Organization (WHO) grading systems. Although both systems demonstrate good correspondence between grade and survival, they are based on fundamentally different biological criteria. We tested the hypothesis that this apparent concurrence between the two grading systems originates from an interpretation bias in the minds of diagnostic pathologists, rather than reflecting a biological reality. Three pathologists graded 178 prostatectomy specimens, assigning Gleason and WHO scores on glass slides and on digital images of nuclei isolated out of their architectural context. The results were analysed with respect to interdependencies among the grading systems, to tumour recurrence (PSA relapse > 0.1 ng/ml at 48 months) and robust nuclear morphometry, as assessed by computer-assisted image analysis. WHO and Gleason grades were strongly correlated (r = 0.82) and demonstrated identical prognostic power. However, WHO grades correlated poorly with nuclear morphology (r = 0.19). Grading of nuclei isolated out of their architectural context significantly improved accuracy for nuclear morphology (r = 0.55), but the prognostic power was virtually lost. In conclusion, the architectural organization of a tumour, which the pathologist cannot avoid noticing during initial slide viewing at low magnification, unwittingly influences the subsequent nuclear grade assignment. In our study, the prognostic power of the WHO grading system was dependent on visual assessment of tumour growth pattern. We demonstrate for the first time the influence a cognitive bias can have in the generation of an error in diagnostic pathology and highlight a considerable problem in histopathological tumour grading.

Sexual dimorphism of the human mandible: demonstration by elliptical Fourier analysis.

A new quantitative approach of the mandibular sexual dimorphism, based on computer-aided image analysis and elliptical Fourier analysis of the mandibular outline in lateral view is presented. This method was applied to a series of 117 dentulous mandibles from 69 male and 48 female individuals native of Rhenish countries. Statistical discriminant analysis of the elliptical Fourier harmonics allowed the demonstration of a significant sexual dimorphism in 97.1% of males and 91.7% of females, i.e. in a higher proportion than in previous studies using classical metrical approaches. This original method opens interesting perspectives for increasing the accuracy of sex identification in current anthropological practice and in forensic procedures.

Role of the superior parietal lobules in letter-identity processing within strings: FMRI evidence from skilled and dyslexic readers.

Traditionally, the ventral occipito-temporal (vOT) area, but not the superior parietal lobules (SPLs), is thought as belonging to the neural system of visual word recognition. However, some dyslexic children who exhibit a visual attention span disorder - i.e. poor multi-element parallel processing - further show reduced SPLs activation when engaged in visual multi-element categorization tasks. We investigated whether these parietal regions further contribute to letter-identity processing within strings. Adult skilled readers and dyslexic participants with a visual attention span disorder were administered a letter-string comparison task under fMRI. Dyslexic adults were less accurate than skilled readers to detect letter identity substitutions within strings. In skilled readers, letter identity differs related to enhanced activation of the left vOT. However, specific neural responses were further found in the superior and inferior parietal regions, including the SPLs bilaterally. Two brain regions that are specifically related to substituted letter detection, the left SPL and the left vOT, were less activated in dyslexic participants. These findings suggest that the left SPL, like the left vOT, may contribute to letter string processing.

Wear of two artificial tooth materials in vivo: a 12-month pilot study.

STATEMENT OF PROBLEM: Wear of methacrylate artificial teeth resulting in vertical loss is a problem for both dentists and patients. PURPOSE: The purpose of this study was to quantify wear of artificial teeth in vivo and to relate it to subject and tooth variables. MATERIAL AND METHODS: Twenty-eight subjects treated with complete dentures received 2 artificial tooth materials (polymethyl methacrylate (PMMA)/double-cross linked PMMA fillers; 35%/59% (SR Antaris DCL, SR Postaris DCL); experimental 48%/46%). At baseline and after 12 months, impressions of the dentures were poured with improved stone. After laser scanning, the casts were superimposed and matched. Maximal vertical loss (mm) and volumetric loss (mm(3)) were calculated for each tooth and log-transformed to reduce variability. Volumetric loss was related to the occlusally active surface area. Linear mixed models were used to study the influence of the factors jaw, tooth, and material on adjusted (residual) wear values (alpha=.05). RESULTS: Due to drop outs (n=5) and unmatchable casts (n=3), 69% of all teeth were analyzed. Volumetric loss had a strong linear relationship to surface area (P<.001); this was less pronounced for vertical loss (P=.004). The factor showing the highest influence was the subject. Wear was tooth dependent (increasing from incisors to molars). However, these differences diminished once the wear rates were adjusted for occlusal area, and only a few remained significant (anterior versus posterior maxillary teeth). Another influencing factor was the age of the subject. CONCLUSIONS: Clinical wear of artificial teeth is higher than previously measured or expected. The presented method of analyzing wear of artificial teeth using a laser-scanning device seemed suitable.

Organizing principles across the senses

ABSTRACT This thesis is composed of two main parts. The first addressed the question of whether the auditory and somatosensory systems, like their visual counterpart, comprise parallel functional pathways for processing identity and spatial attributes (so-called `what' and `where' pathways, respectively). The second part examined the independence of control processes mediating task switching across 'what' and `where' pathways in the auditory and visual modalities. Concerning the first part, electrical neuroimaging of event-related potentials identified the spatio-temporal mechanisms subserving auditory (see Appendix, Study n°1) and vibrotactile (see Appendix, Study n°2) processing during two types of blocks of trials. `What' blocks varied stimuli in their frequency independently of their location.. `Where' blocks varied the same stimuli in their location independently of their frequency. Concerning the second part (see Appendix, Study n°3), a psychophysical task-switching paradigm was used to investigate the hypothesis that the efficacy of control processes depends on the extent of overlap between the neural circuitry mediating the different tasks at hand, such that more effective task preparation (and by extension smaller switch costs) is achieved when the anatomical/functional overlap of this circuitry is small. Performance costs associated with switching tasks and/or switching sensory modalities were measured. Tasks required the analysis of either the identity or spatial location of environmental objects (`what' and `where' tasks, respectively) that were presented either visually or acoustically on any given trial. Pretrial cues informed participants of the upcoming task, but not of the sensory modality. - In the audio-visual domain, the results showed that switch costs between tasks were significantly smaller when the sensory modality of the task switched versus when it repeated. In addition, switch costs between the senses were correlated only when the sensory modality of the task repeated across trials and not when it switched. The collective evidence not only supports the independence of control processes mediating task switching and modality switching, but also the hypothesis that switch costs reflect competitive interterence between neural circuits that in turn can be diminished when these neural circuits are distinct. - In the auditory and somatosensory domains, the findings show that a segregation of location vs. recognition information is observed across sensory systems and that these happen around 100ms for both sensory modalities. - Also, our results show that functionally specialized pathways for audition and somatosensation involve largely overlapping brain regions, i.e. posterior superior and middle temporal cortices and inferior parietal areas. Both these properties (synchrony of differential processing and overlapping brain regions) probably optimize the relationships across sensory modalities. - Therefore, these results may be indicative of a computationally advantageous organization for processing spatial anal identity information.

Differentiation of focal liver lesions: usefulness of parametric imaging with contrast-enhanced US.

Purpose: To evaluate whether parametric imaging with contrast material-enhanced ultrasonography (US) is superior to visual assessment for the differential diagnosis of focal liver lesions (FLLs). Materials and Methods: This study had institutional review board approval, and verbal patient informed consent was obtained. Between August 2005 and October 2008, 146 FLLs in 145 patients (63 women, 82 men; mean age, 62.5 years; age range, 22-89 years) were imaged with real-time low-mechanical-index contrast-enhanced US after a bolus injection of 2.4 mL of a second-generation contrast agent. Clips showing contrast agent uptake kinetics (including arterial, portal, and late phases) were recorded and subsequently analyzed off-line with dedicated image processing software. Analysis of the dynamic vascular patterns (DVPs) of lesions with respect to adjacent parenchyma allowed mapping DVP signatures on a single parametric image. Cine loops of contrast-enhanced US and results from parametric imaging of DVP were assessed separately by three independent off-site readers who classified each lesion as benign, malignant, or indeterminate. Sensitivity, specificity, accuracy, and positive and negative predictive values were calculated for both techniques. Interobserver agreement (κ statistics) was determined. Results: Sensitivities for visual interpretation of cine loops for the three readers were 85.0%, 77.9%, and 87.6%, which improved significantly to 96.5%, 97.3%, and 96.5% for parametric imaging, respectively (P < .05, McNemar test), while retaining high specificity (90.9% for all three readers). Accuracy scores of parametric imaging were higher than those of conventional contrast-enhanced US for all three readers (P < .001, McNemar test). Interobserver agreement increased with DVP parametric imaging compared with conventional contrast-enhanced US (change of κ from 0.54 to 0.99). Conclusion: Parametric imaging of DVP improves diagnostic performance of contrast-enhanced US in the differentiation between malignant and benign FLLs; it also provides excellent interobserver agreement.

Cognitive disorganisation in schizotypy is associated with deterioration in visual backward masking.

To understand the causes of schizophrenia, a search for stable markers (endophenotypes) is ongoing. In previous years, we have shown that the shine-through visual backward masking paradigm meets the most important characteristics of an endophenotype. Here, we tested masking performance differences between healthy students with low and high schizotypy scores as determined by the self-report O-Life questionnaire assessing schizotypy along three dimensions, i.e. positive schizotypy (unusual experiences), cognitive disorganisation, and negative schizotypy (introvertive anhedonia). Forty participants performed the shine-through backward masking task and a classical cognitive test, the Wisconsin Card Sorting Task (WCST). We found that visual backward masking was impaired for students scoring high as compared to low on the cognitive disorganisation dimension, whereas the positive and negative schizotypy dimensions showed no link to masking performance. We also found group differences for students scoring high and low on the cognitive disorganisation factor for the WCST. These findings indicate that the shine-through paradigm is sensitive to differences in schizotypy which are closely linked with the pathological expression in schizophrenia.

Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment.

Multisensory interactions are observed in species from single-cell organisms to humans. Important early work was primarily carried out in the cat superior colliculus and a set of critical parameters for their occurrence were defined. Primary among these were temporal synchrony and spatial alignment of bisensory inputs. Here, we assessed whether spatial alignment was also a critical parameter for the temporally earliest multisensory interactions that are observed in lower-level sensory cortices of the human. While multisensory interactions in humans have been shown behaviorally for spatially disparate stimuli (e.g. the ventriloquist effect), it is not clear if such effects are due to early sensory level integration or later perceptual level processing. In the present study, we used psychophysical and electrophysiological indices to show that auditory-somatosensory interactions in humans occur via the same early sensory mechanism both when stimuli are in and out of spatial register. Subjects more rapidly detected multisensory than unisensory events. At just 50 ms post-stimulus, neural responses to the multisensory 'whole' were greater than the summed responses from the constituent unisensory 'parts'. For all spatial configurations, this effect followed from a modulation of the strength of brain responses, rather than the activation of regions specifically responsive to multisensory pairs. Using the local auto-regressive average source estimation, we localized the initial auditory-somatosensory interactions to auditory association areas contralateral to the side of somatosensory stimulation. Thus, multisensory interactions can occur across wide peripersonal spatial separations remarkably early in sensory processing and in cortical regions traditionally considered unisensory.

Advanced Kernel Methods For Remote Sensing Image Classification

Résumé Suite aux recentes avancées technologiques, les archives d'images digitales ont connu une croissance qualitative et quantitative sans précédent. Malgré les énormes possibilités qu'elles offrent, ces avancées posent de nouvelles questions quant au traitement des masses de données saisies. Cette question est à la base de cette Thèse: les problèmes de traitement d'information digitale à très haute résolution spatiale et/ou spectrale y sont considérés en recourant à des approches d'apprentissage statistique, les méthodes à noyau. Cette Thèse étudie des problèmes de classification d'images, c'est à dire de catégorisation de pixels en un nombre réduit de classes refletant les propriétés spectrales et contextuelles des objets qu'elles représentent. L'accent est mis sur l'efficience des algorithmes, ainsi que sur leur simplicité, de manière à augmenter leur potentiel d'implementation pour les utilisateurs. De plus, le défi de cette Thèse est de rester proche des problèmes concrets des utilisateurs d'images satellite sans pour autant perdre de vue l'intéret des méthodes proposées pour le milieu du machine learning dont elles sont issues. En ce sens, ce travail joue la carte de la transdisciplinarité en maintenant un lien fort entre les deux sciences dans tous les développements proposés. Quatre modèles sont proposés: le premier répond au problème de la haute dimensionalité et de la redondance des données par un modèle optimisant les performances en classification en s'adaptant aux particularités de l'image. Ceci est rendu possible par un système de ranking des variables (les bandes) qui est optimisé en même temps que le modèle de base: ce faisant, seules les variables importantes pour résoudre le problème sont utilisées par le classifieur. Le manque d'information étiquétée et l'incertitude quant à sa pertinence pour le problème sont à la source des deux modèles suivants, basés respectivement sur l'apprentissage actif et les méthodes semi-supervisées: le premier permet d'améliorer la qualité d'un ensemble d'entraînement par interaction directe entre l'utilisateur et la machine, alors que le deuxième utilise les pixels non étiquetés pour améliorer la description des données disponibles et la robustesse du modèle. Enfin, le dernier modèle proposé considère la question plus théorique de la structure entre les outputs: l'intègration de cette source d'information, jusqu'à présent jamais considérée en télédétection, ouvre des nouveaux défis de recherche. Advanced kernel methods for remote sensing image classification Devis Tuia Institut de Géomatique et d'Analyse du Risque September 2009 Abstract The technical developments in recent years have brought the quantity and quality of digital information to an unprecedented level, as enormous archives of satellite images are available to the users. However, even if these advances open more and more possibilities in the use of digital imagery, they also rise several problems of storage and treatment. The latter is considered in this Thesis: the processing of very high spatial and spectral resolution images is treated with approaches based on data-driven algorithms relying on kernel methods. In particular, the problem of image classification, i.e. the categorization of the image's pixels into a reduced number of classes reflecting spectral and contextual properties, is studied through the different models presented. The accent is put on algorithmic efficiency and the simplicity of the approaches proposed, to avoid too complex models that would not be used by users. The major challenge of the Thesis is to remain close to concrete remote sensing problems, without losing the methodological interest from the machine learning viewpoint: in this sense, this work aims at building a bridge between the machine learning and remote sensing communities and all the models proposed have been developed keeping in mind the need for such a synergy. Four models are proposed: first, an adaptive model learning the relevant image features has been proposed to solve the problem of high dimensionality and collinearity of the image features. This model provides automatically an accurate classifier and a ranking of the relevance of the single features. The scarcity and unreliability of labeled. information were the common root of the second and third models proposed: when confronted to such problems, the user can either construct the labeled set iteratively by direct interaction with the machine or use the unlabeled data to increase robustness and quality of the description of data. Both solutions have been explored resulting into two methodological contributions, based respectively on active learning and semisupervised learning. Finally, the more theoretical issue of structured outputs has been considered in the last model, which, by integrating outputs similarity into a model, opens new challenges and opportunities for remote sensing image processing.

Evidence for segregated and integrative connectivity patterns in the human Basal Ganglia.

Detailed knowledge of the anatomy and connectivity pattern of cortico-basal ganglia circuits is essential to an understanding of abnormal cortical function and pathophysiology associated with a wide range of neurological and neuropsychiatric diseases. We aim to study the spatial extent and topography of human basal ganglia connectivity in vivo. Additionally, we explore at an anatomical level the hypothesis of coexistent segregated and integrative cortico-basal ganglia loops. We use probabilistic tractography on magnetic resonance diffusion weighted imaging data to segment basal ganglia and thalamus in 30 healthy subjects based on their cortical and subcortical projections. We introduce a novel method to define voxel-based connectivity profiles that allow representation of projections from a source to more than one target region. Using this method, we localize specific relay nuclei within predefined functional circuits. We find strong correlation between tractography-based basal ganglia parcellation and anatomical data from previously reported invasive tracing studies in nonhuman primates. Additionally, we show in vivo the anatomical basis of segregated loops and the extent of their overlap in prefrontal, premotor, and motor networks. Our findings in healthy humans support the notion that probabilistic diffusion tractography can be used to parcellate subcortical gray matter structures on the basis of their connectivity patterns. The coexistence of clearly segregated and also overlapping connections from cortical sites to basal ganglia subregions is a neuroanatomical correlate of both parallel and integrative networks within them. We believe that this method can be used to examine pathophysiological concepts in a number of basal ganglia-related disorders.

Model-based Segmentation and Image Fusion of 3D Computed Tomography and 3D Ultrasound of the Eye for Radiotherapy Planning

For radiotherapy treatment planning of retinoblastoma inchildhood, Computed Tomography (CT) represents thestandard method for tumor volume delineation, despitesome inherent limitations. CT scan is very useful inproviding information on physical density for dosecalculation and morphological volumetric information butpresents a low sensitivity in assessing the tumorviability. On the other hand, 3D ultrasound (US) allows ahigh accurate definition of the tumor volume thanks toits high spatial resolution but it is not currentlyintegrated in the treatment planning but used only fordiagnosis and follow-up. Our ultimate goal is anautomatic segmentation of gross tumor volume (GTV) in the3D US, the segmentation of the organs at risk (OAR) inthe CT and the registration of both. In this paper, wepresent some preliminary results in this direction. Wepresent 3D active contour-based segmentation of the eyeball and the lens in CT images; the presented approachincorporates the prior knowledge of the anatomy by usinga 3D geometrical eye model. The automated segmentationresults are validated by comparing with manualsegmentations. Then, for the fusion of 3D CT and USimages, we present two approaches: (i) landmark-basedtransformation, and (ii) object-based transformation thatmakes use of eye ball contour information on CT and USimages.

Dyslexia in a French-Spanish bilingual girl: behavioural and neural modulations following a visual attention span intervention.

We report the case study of a French-Spanish bilingual dyslexic girl, MP, who exhibited a severe visual attention (VA) span deficit but preserved phonological skills. Behavioural investigation showed a severe reduction of reading speed for both single items (words and pseudo-words) and texts in the two languages. However, performance was more affected in French than in Spanish. MP was administered an intensive VA span intervention programme. Pre-post intervention comparison revealed a positive effect of intervention on her VA span abilities. The intervention further transferred to reading. It primarily resulted in faster identification of the regular and irregular words in French. The effect of intervention was rather modest in Spanish that only showed a tendency for faster word reading. Text reading improved in the two languages with a stronger effect in French but pseudo-word reading did not improve in either French or Spanish. The overall results suggest that VA span intervention may primarily enhance the fast global reading procedure, with stronger effects in French than in Spanish. MP underwent two fMRI sessions to explore her brain activations before and after VA span training. Prior to the intervention, fMRI assessment showed that the striate and extrastriate visual cortices alone were activated but none of the regions typically involved in VA span. Post-training fMRI revealed increased activation of the superior and inferior parietal cortices. Comparison of pre- and post-training activations revealed significant activation increase of the superior parietal lobes (BA 7) bilaterally. Thus, we show that a specific VA span intervention not only modulates reading performance but further results in increased brain activity within the superior parietal lobes known to housing VA span abilities. Furthermore, positive effects of VA span intervention on reading suggest that the ability to process multiple visual elements simultaneously is one cause of successful reading acquisition.

Remaining rod activity mediates visual behavior in adult Rpe65-/- mice.

Purpose: C57/Bl6, Cpfl1-/- (Cone photoreceptors function loss 1; pure rod function), Gnat1alpha-/- (rod alpha-transducin; pure cone function) and Rpe65-/-;Rho-/- double knock-out mice were studied in order to distinguish the respective contributions of the different photoreceptor (PR) systems that enable light perception and mediate a visual reflex in adult Rpe65-/- mice using a simple behavioural procedure. Methods: Visual function was estimated using a rotating automatized optomotor drum covered with vertical black and white stripes at spatial frequencies of 0.025 to 0.5 cycles per degree (cpd) in both photopic and scotopic conditions. To evaluate the contribution as well as the light intensity threshold of each PR system, we tested the mouse strains with different luminances. Results: Stripe rotation elicits head movements in wild-type (WT) animals in photopic and scotopic conditions depending on the spatial frequency, whereas Cpfl1-/- mice show a reduced activity in the photopic condition and Gnat1alpha-/- mice an almost absent response in the scotopic condition. Interestingly, a robust visual response is obtained with Rpe65-/- knockout mice at 0.075 cpd and 0.1 cpd in the photopic condition. The residual rod function in the Rpe65-/- animals was demonstrated by testing Rpe65-/-;Rho-/- mice that present no response in photopic conditions. Conclusions: The optomotor test is a simple method to estimate the visual function, and to evaluate the respective contributions of rod and cone systems. Using this test, we demonstrate that in Rpe65-/- mice, devoid of functional cones and of detectable 11-cis-retinal protein, rods mimic in part the cone function by mediating vision in photopic conditions.