Pathways that make voices - White matter changes in auditory hallucinations

BACKGROUND: The origin of auditory hallucinations, which are one of the core symptoms of schizophrenia, is still a matter of debate. It has been hypothesized that alterations in connectivity between frontal and parietotemporal speech-related areas might contribute to the pathogenesis of auditory hallucinations. These networks are assumed to become dysfunctional during the generation and monitoring of inner speech. Magnetic resonance diffusion tensor imaging is a relatively new in vivo method to investigate the directionality of cortical white matter tracts. OBJECTIVE: To investigate, using diffusion tensor imaging, whether previously described abnormal activation patterns observed during auditory hallucinations relate to changes in structural interconnections between the frontal and parietotemporal speech-related areas. METHODS: A 1.5 T magnetic resonance scanner was used to acquire twelve 5-mm slices covering the Sylvian fissure. Fractional anisotropy was assessed in 13 patients prone to auditory hallucinations, in 13 patients without auditory hallucinations, and in 13 healthy control subjects. Structural magnetic resonance imaging was conducted in the same session. Based on an analysis of variance, areas with significantly different fractional anisotropy values between groups were selected for a confirmatory region of interest analysis. Additionally, descriptive voxel-based t tests between the groups were computed. RESULTS: In patients with hallucinations, we found significantly higher white matter directionality in the lateral parts of the temporoparietal section of the arcuate fasciculus and in parts of the anterior corpus callosum compared with control subjects and patients without hallucinations. Comparing patients with hallucinations with patients without hallucinations, we found significant differences most pronounced in the left hemispheric fiber tracts, including the cingulate bundle. CONCLUSION: Our findings suggest that during inner speech, the alterations of white matter fiber tracts in patients with frequent hallucinations lead to abnormal coactivation in regions related to the acoustical processing of external stimuli. This abnormal activation may account for the patients' inability to distinguish self-generated thoughts from external stimulation.

Moving along the mental time line influences the processing of future related words

Abstract concepts like numbers or time are thought to be represented in the more concrete domain of space and the sensorimotor system. For example, thinking of past or future events has a physical manifestation in backward or forward body sway, respectively. In the present study, we investigated the reverse effect: can passive whole-body motion influence the processing of temporal information? Participants were asked to categorize verbal stimuli to the concepts future or past while they were displaced forward and backward (Experiment 1), or upward and downward (Experiment 2). The results showed that future related verbal stimuli were categorized faster during forward as compared to backward motion. This finding supports the view that temporal events are represented along a mental time line and that the sensorimotor system is linked to that representation. We showed that body motion is not just an epiphenomenon of temporal thoughts. Passive whole-body motion can influence higher-order temporal cognition.

Magnetic resonance spectroscopy investigations of functionally defined language areas in schizophrenia patients with and without auditory hallucinations

Background: Cerebral dysfunction occurring in mental disorders can show metabolic disturbances which are limited to circumscribed brain areas. Auditory hallucinations have been shown to be related to defined cortical areas linked to specific language functions. Here, we investigated if the study of metabolic changes in auditory hallucinations requires a functional rather than an anatomical definition of their location and size to allow a reliable investigation by magnetic resonance spectroscopy (MRS). Methods: Schizophrenia patients with (AH; n = 12) and without hallucinations (NH; n = 8) and healthy controls (HC; n = 11) underwent a verbal fluency task in functional MRI (fMRI) to functionally define Broca's and Wernicke's areas. Left and right Heschl's gyri were defined anatomically. Results: The mean distances in native space between the fMRI-defined regions and a corresponding anatomically defined area were 12.4 ± 6.1 mm (range: 2.7–36.1 mm) for Broca's area and 16.8 ± 6.2 mm (range: 4.5–26.4 mm) for Wernicke's area, respectively. Hence, the spatial variance was of similar extent as the size of the investigated regions. Splitting the investigations into a single voxel examination in the frontal brain and a spectroscopic imaging part for the more homogeneous field areas led to good spectral quality for almost all spectra. In Broca's area, there was a significant group effect (p = 0.03) with lower levels of N-acetyl-aspartate (NAA) in NH compared to HC (p = 0.02). There were positive associations of NAA levels in the left Heschl's gyrus with total (p = 0.03) and negative (p = 0.006) PANSS scores. In Broca's area, there was a negative association of myo-inositol levels with total PANSS scores (p = 0.008). Conclusion: This study supports the neurodegenerative hypothesis of schizophrenia only in a frontal region whereas the results obtained from temporal regions are in contrast to the majority of previous studies. Future research should test the hypothesis raised by this study that a functional definition of language regions is needed if neurochemical imbalances are expected to be restricted to functional foci.

The Neural Substrates of Multisensory Speech Perception

Comprehending speech is one of the most important human behaviors, but we are only beginning to understand how the brain accomplishes this difficult task. One key to speech perception seems to be that the brain integrates the independent sources of information available in the auditory and visual modalities in a process known as multisensory integration. This allows speech perception to be accurate, even in environments in which one modality or the other is ambiguous in the context of noise. Previous electrophysiological and functional magnetic resonance imaging (fMRI) experiments have implicated the posterior superior temporal sulcus (STS) in auditory-visual integration of both speech and non-speech stimuli. While evidence from prior imaging studies have found increases in STS activity for audiovisual speech compared with unisensory auditory or visual speech, these studies do not provide a clear mechanism as to how the STS communicates with early sensory areas to integrate the two streams of information into a coherent audiovisual percept. Furthermore, it is currently unknown if the activity within the STS is directly correlated with strength of audiovisual perception. In order to better understand the cortical mechanisms that underlie audiovisual speech perception, we first studied the STS activity and connectivity during the perception of speech with auditory and visual components of varying intelligibility. By studying fMRI activity during these noisy audiovisual speech stimuli, we found that STS connectivity with auditory and visual cortical areas mirrored perception; when the information from one modality is unreliable and noisy, the STS interacts less with the cortex processing that modality and more with the cortex processing the reliable information. We next characterized the role of STS activity during a striking audiovisual speech illusion, the McGurk effect, to determine if activity within the STS predicts how strongly a person integrates auditory and visual speech information. Subjects with greater susceptibility to the McGurk effect exhibited stronger fMRI activation of the STS during perception of McGurk syllables, implying a direct correlation between strength of audiovisual integration of speech and activity within an the multisensory STS.

The temporal impulse response function in infantile nystagmus.

Despite rapid to-and-fro motion of the retinal image that results from their incessant involuntary eye movements, persons with infantile nystagmus (IN) rarely report the perception of motion smear. We performed two experiments to determine if the reduction of perceived motion smear in persons with IN is associated with an increase in the speed of the temporal impulse response. In Experiment 1, increment thresholds were determined for pairs of successively presented flashes of a long horizontal line, presented on a 65-cd/m2 background field. The stimulus-onset asynchrony (SOA) between the first and second flash varied from 5.9 to 234 ms. In experiment 2, temporal contrast sensitivity functions were determined for a 3-cpd horizontal square-wave grating that underwent counterphase flicker at temporal frequencies between 1 and 40 Hz. Data were obtained for 2 subjects with predominantly pendular IN and 8 normal observers in Experiment 1 and for 3 subjects with IN and 4 normal observers in Experiment 2. Temporal impulse response functions (TIRFs) were estimated as the impulse response of a linear second-order system that provided the best fit to the increment threshold data in Experiment 1 and to the temporal contrast sensitivity functions in Experiment 2. Estimated TIRFs of the subjects with pendular IN have natural temporal frequencies that are significantly faster than those of normal observers (ca. 13 vs. 9 Hz), indicating an accelerated temporal response to visual stimuli. This increase in response speed is too small to account by itself for the virtual absence of perceived motion smear in subjects with IN, and additional neural mechanisms are considered.

The human vestibular cortex revealed by coordinate-based activation likelihood estimation meta-analysis.

The vestibular system contributes to the control of posture and eye movements and is also involved in various cognitive functions including spatial navigation and memory. These functions are subtended by projections to a vestibular cortex, whose exact location in the human brain is still a matter of debate (Lopez and Blanke, 2011). The vestibular cortex can be defined as the network of all cortical areas receiving inputs from the vestibular system, including areas where vestibular signals influence the processing of other sensory (e.g. somatosensory and visual) and motor signals. Previous neuroimaging studies used caloric vestibular stimulation (CVS), galvanic vestibular stimulation (GVS), and auditory stimulation (clicks and short-tone bursts) to activate the vestibular receptors and localize the vestibular cortex. However, these three methods differ regarding the receptors stimulated (otoliths, semicircular canals) and the concurrent activation of the tactile, thermal, nociceptive and auditory systems. To evaluate the convergence between these methods and provide a statistical analysis of the localization of the human vestibular cortex, we performed an activation likelihood estimation (ALE) meta-analysis of neuroimaging studies using CVS, GVS, and auditory stimuli. We analyzed a total of 352 activation foci reported in 16 studies carried out in a total of 192 healthy participants. The results reveal that the main regions activated by CVS, GVS, or auditory stimuli were located in the Sylvian fissure, insula, retroinsular cortex, fronto-parietal operculum, superior temporal gyrus, and cingulate cortex. Conjunction analysis indicated that regions showing convergence between two stimulation methods were located in the median (short gyrus III) and posterior (long gyrus IV) insula, parietal operculum and retroinsular cortex (Ri). The only area of convergence between all three methods of stimulation was located in Ri. The data indicate that Ri, parietal operculum and posterior insula are vestibular regions where afferents converge from otoliths and semicircular canals, and may thus be involved in the processing of signals informing about body rotations, translations and tilts. Results from the meta-analysis are in agreement with electrophysiological recordings in monkeys showing main vestibular projections in the transitional zone between Ri, the insular granular field (Ig), and SII.

Negative bias of processing ambiguously cued emotional stimuli.

Daily we cope with upcoming potentially disadvantageous events. Therefore, it makes sense to be prepared for the worst case. Such a 'pessimistic' bias is reflected in brain activation during emotion processing. Healthy individuals underwent functional neuroimaging while viewing emotional stimuli that were earlier cued ambiguously or unambiguously concerning their emotional valence. Presentation of ambiguously announced pleasant pictures compared with unambiguously announced pleasant pictures resulted in increased activity in the ventrolateral prefrontal, premotor and temporal cortex, and in the caudate nucleus. This was not the case for the respective negative conditions. This indicates that pleasant stimuli after ambiguous cueing provided 'unexpected' emotional input, resulting in the adaptation of brain activity. It strengthens the hypothesis of a 'pessimistic' bias of brain activation toward ambiguous emotional events.

First valence, then arousal: the temporal dynamics of brain electric activity evoked by emotional stimuli

The temporal dynamics of the neural activity that implements the dimensions valence and arousal during processing of emotional stimuli were studied in two multi-channel ERP experiments that used visually presented emotional words (experiment 1) and emotional pictures (experiment 2) as stimulus material. Thirty-two healthy subjects participated (mean age 26.8 +/- 6.4 years, 24 women). The stimuli in both experiments were selected on the basis of verbal reports in such a way that we were able to map the temporal dynamics of one dimension while controlling for the other one. Words (pictures) were centrally presented for 450 (600) ms with interstimulus intervals of 1,550 (1,400) ms. ERP microstate analysis of the entire epochs of stimulus presentations parsed the data into sequential steps of information processing. The results revealed that in several microstates of both experiments, processing of pleasant and unpleasant valence (experiment 1, microstate #3: 118-162 ms, #6: 218-238 ms, #7: 238-266 ms, #8: 266-294 ms; experiment 2, microstate #5: 142-178 ms, #6: 178-226 ms, #7: 226-246 ms, #9: 262-302 ms, #10: 302-330 ms) as well as of low and high arousal (experiment 1, microstate #8: 266-294 ms, #9: 294-346 ms; experiment 2, microstate #10: 302-330 ms, #15: 562-600 ms) involved different neural assemblies. The results revealed also that in both experiments, information about valence was extracted before information about arousal. The last microstate of valence extraction was identical with the first microstate of arousal extraction.

Differential recruitment of brain networks during visuospatial and color processing: Evidence from ERP microstates

Recent functional magnetic resonance imaging (fMRI) studies consistently revealed contributions of fronto-parietal and related networks to the execution of a visuospatial judgment task, the so-called "Clock Task". However, due to the low temporal resolution of fMRI, the exact cortical dynamics and timing of processing during task performance could not be resolved until now. In order to clarify the detailed cortical activity and temporal dynamics, 14 healthy subjects performed an established version of the "Clock Task", which comprises a visuospatial task (angle discrimination) and a control task (color discrimination) with the same stimulus material, in an electroencephalography (EEG) experiment. Based on the time-resolved analysis of network activations (microstate analysis), differences in timing between the angle compared to the color discrimination task were found after sensory processing in a time window starting around 200ms. Significant differences between the two tasks were observed in an analysis window from 192ms to 776ms. We divided this window in two parts: an early phase - from 192ms to ∼440ms, and a late phase - from ∼440ms to 776ms. For both tasks, the order of network activations and the types of networks were the same, but, in each phase, activations for the two conditions were dominated by differing network states with divergent temporal dynamics. Our results provide an important basis for the assessment of deviations in processing dynamics during visuospatial tasks in clinical populations.

Statistical Learning, Syllable Processing, and Speech Production in Healthy Hearing and Hearing-Impaired Preschool Children: A Mismatch Negativity Study

OBJECTIVES The objectives of the present study were to investigate temporal/spectral sound-feature processing in preschool children (4 to 7 years old) with peripheral hearing loss compared with age-matched controls. The results verified the presence of statistical learning, which was diminished in children with hearing impairments (HIs), and elucidated possible perceptual mediators of speech production. DESIGN Perception and production of the syllables /ba/, /da/, /ta/, and /na/ were recorded in 13 children with normal hearing and 13 children with HI. Perception was assessed physiologically through event-related potentials (ERPs) recorded by EEG in a multifeature mismatch negativity paradigm and behaviorally through a discrimination task. Temporal and spectral features of the ERPs during speech perception were analyzed, and speech production was quantitatively evaluated using speech motor maximum performance tasks. RESULTS Proximal to stimulus onset, children with HI displayed a difference in map topography, indicating diminished statistical learning. In later ERP components, children with HI exhibited reduced amplitudes in the N2 and early parts of the late disciminative negativity components specifically, which are associated with temporal and spectral control mechanisms. Abnormalities of speech perception were only subtly reflected in speech production, as the lone difference found in speech production studies was a mild delay in regulating speech intensity. CONCLUSIONS In addition to previously reported deficits of sound-feature discriminations, the present study results reflect diminished statistical learning in children with HI, which plays an early and important, but so far neglected, role in phonological processing. Furthermore, the lack of corresponding behavioral abnormalities in speech production implies that impaired perceptual capacities do not necessarily translate into productive deficits.

Prestimulus default mode activity influences depth of processing and recognition in an emotional memory task

Low self-referential thoughts are associated with better concentration, which leads to deeper encoding and increases learning and subsequent retrieval. There is evidence that being engaged in externally rather than internally focused tasks is related to low neural activity in the default mode network (DMN) promoting open mind and the deep elaboration of new information. Thus, reduced DMN activity should lead to enhanced concentration, comprehensive stimulus evaluation including emotional categorization, deeper stimulus processing, and better long-term retention over one whole week. In this fMRI study, we investigated brain activation preceding and during incidental encoding of emotional pictures and on subsequent recognition performance. During fMRI, 24 subjects were exposed to 80 pictures of different emotional valence and subsequently asked to complete an online recognition task one week later. Results indicate that neural activity within the medial temporal lobes during encoding predicts subsequent memory performance. Moreover, a low activity of the default mode network preceding incidental encoding leads to slightly better recognition performance independent of the emotional perception of a picture. The findings indicate that the suppression of internally-oriented thoughts leads to a more comprehensive and thorough evaluation of a stimulus and its emotional valence. Reduced activation of the DMN prior to stimulus onset is associated with deeper encoding and enhanced consolidation and retrieval performance even one week later. Even small prestimulus lapses of attention influence consolidation and subsequent recognition performance. Hum Brain Mapp, 2015. © 2015 Wiley Periodicals, Inc.

Visual-auditory differences in duration discrimination of intervals in the subsecond and second range

A common finding in time psychophysics is that temporal acuity is much better for auditory than for visual stimuli. The present study aimed to examine modality-specific differences in duration discrimination within the conceptual framework of the Distinct Timing Hypothesis. This theoretical account proposes that durations in the lower milliseconds range are processed automatically while longer durations are processed by a cognitive mechanism. A sample of 46 participants performed two auditory and visual duration discrimination tasks with extremely brief (50-ms standard duration) and longer (1000-ms standard duration) intervals. Better discrimination performance for auditory compared to visual intervals could be established for extremely brief and longer intervals. However, when performance on duration discrimination of longer intervals in the 1-s range was controlled for modality-specific input from the sensory-automatic timing mechanism, the visual-auditory difference disappeared completely as indicated by virtually identical Weber fractions for both sensory modalities. These findings support the idea of a sensory-automatic mechanism underlying the observed visual-auditory differences in duration discrimination of extremely brief intervals in the millisecond range and longer intervals in the 1-s range. Our data are consistent with the notion of a gradual transition from a purely modality-specific, sensory-automatic to a more cognitive, amodal timing mechanism. Within this transition zone, both mechanisms appear to operate simultaneously but the influence of the sensory-automatic timing mechanism is expected to continuously decrease with increasing interval duration.

Multi-temporal mapping of seagrass cover, species and biomass of the Eastern Banks, Moreton Bay, Australia, with links to shapefiles

The spatial and temporal dynamics of seagrasses have been studied from the leaf to patch (100 m**2) scales. However, landscape scale (> 100 km**2) seagrass population dynamics are unresolved in seagrass ecology. Previous remote sensing approaches have lacked the temporal or spatial resolution, or ecologically appropriate mapping, to fully address this issue. This paper presents a robust, semi-automated object-based image analysis approach for mapping dominant seagrass species, percentage cover and above ground biomass using a time series of field data and coincident high spatial resolution satellite imagery. The study area was a 142 km**2 shallow, clear water seagrass habitat (the Eastern Banks, Moreton Bay, Australia). Nine data sets acquired between 2004 and 2013 were used to create seagrass species and percentage cover maps through the integration of seagrass photo transect field data, and atmospherically and geometrically corrected high spatial resolution satellite image data (WorldView-2, IKONOS and Quickbird-2) using an object based image analysis approach. Biomass maps were derived using empirical models trained with in-situ above ground biomass data per seagrass species. Maps and summary plots identified inter- and intra-annual variation of seagrass species composition, percentage cover level and above ground biomass. The methods provide a rigorous approach for field and image data collection and pre-processing, a semi-automated approach to extract seagrass species and cover maps and assess accuracy, and the subsequent empirical modelling of seagrass biomass. The resultant maps provide a fundamental data set for understanding landscape scale seagrass dynamics in a shallow water environment. Our findings provide proof of concept for the use of time-series analysis of remotely sensed seagrass products for use in seagrass ecology and management.

Processing Pipeline for Digitalizing the Lineage Tree of Early Zebrafish Embryogenesis from Multiharmonic Imaging

The reconstruction of the cell lineage tree of early zebrafish embryogenesis requires the use of in-vivo microscopy imaging and image processing strategies. Second (SHG) and third harmonic generation (THG) microscopy observations in unstained zebrafish embryos allows to detect cell divisions and cell membranes from 1-cell to 1K-cell stage. In this article, we present an ad-hoc image processing pipeline for cell tracking and cell membranes segmentation enabling the reconstruction of the early zebrafish cell lineage tree until the 1K-cell stage. This methodology has been used to obtain digital zebrafish embryos allowing to generate a quantitative description of early zebrafish embryogenesis with minute temporal accuracy and μm spatial resolution

Inner-Hair Cells Parameterized-Hardware Implementation for Personalized Auditory Nerve Stimulation

In this paper the hardware implementation of an inner hair cell model is presented. Main features of the design are the use of Meddis’ transduction structure and the methodology for Design with Reusability. Which allows future migration to new hardware and design refinements for speech processing and custom-made hearing aids