Dissociating verbal and nonverbal audiovisual object processing

This fMRI study investigates how audiovisual integration differs for verbal stimuli that can be matched at a phonological level and nonverbal stimuli that can be matched at a semantic level. Subjects were presented simultaneously with one visual and one auditory stimulus and were instructed to decide whether these stimuli referred to the same object or not. Verbal stimuli were simultaneously presented spoken and written object names, and nonverbal stimuli were photographs of objects simultaneously presented with naturally occurring object sounds. Stimulus differences were controlled by including two further conditions that paired photographs of objects with spoken words and object sounds with written words. Verbal matching, relative to all other conditions, increased activation in a region of the left superior temporal sulcus that has previously been associated with phonological processing. Nonverbal matching, relative to all other conditions, increased activation in a right fusiform region that has previously been associated with structural and conceptual object processing. Thus, we demonstrate how brain activation for audiovisual integration depends on the verbal content of the stimuli, even when stimulus and task processing differences are controlled.

Auditory - Visual Matching in Learning Disabilities : Intervention Studies from Finland and Sweden

The present thesis discusses relevant issues in education: 1) learning disabilities including the role of comorbidity in LDs, and 2) the use of research-based interventions. This thesis consists of a series of four studies (three articles), which deepens the knowledge of the field of special education. Intervention studies (N=242) aimed to examine whether training using a nonverbal auditory-visual matching computer program had a remedial effect in different learning disabilities, such as developmental dyslexia, Attention Deficit Disorder (ADD) and Specific Language Impairment (SLI). These studies were conducted in both Finland and Sweden. The intervention’s non-verbal character made an international perspective possible. The results of the intervention studies confirmed, that the auditory-visual matching computer program, called Audilex had positive intervention effects. In Study I of children with developmental dyslexia there were also improvements in reading skills, specifically in reading nonsense words and reading speed. These improvements in tasks, which are thought to rely on phonological processing, suggest that such reading difficulties in dyslexia may stem in part from more basic perceptual difficulties, including those required to manage the visual and auditory components of the decoding task. In Study II the intervention had a positive effect on children with dyslexia; older students with dyslexia and surprisingly, students with ADD also benefited from this intervention. In conclusion, the role of comorbidity was apparent. An intervention effect was evident also in students’ school behavior. Study III showed that children with SLI experience difficulties very similar to those of children with dyslexia in auditory-visual matching. Children with language-based learning disabilities, such as dyslexia and SLI benefited from the auditory-visual matching intervention. Also comorbidity was evident among these children; in addition to formal diagnoses, comorbidity was explored with an assessment inventory, which was developed for this thesis. Interestingly, an overview of the data of this thesis shows positive intervention effects in all studies despite learning disability, language, gender or age. These findings have been described by a concept inter-modal transpose. Self-evidently these issues need further studies. In learning disabilities the aim in the future will also be to identify individuals at risk rather than by deficit; this aim can be achieved by using research-based interventions, intensified support in general education and inclusive special education. Keywords: learning disabilities, developmental dyslexia, attention deficit disorder, specific language impairment, language-based learning disabilities, comorbidity, auditory-visual matching, research-based interventions, inter-modal transpose

Functional magnetic resonance imaging of impaired sensory prediction in schizophrenia.

IMPORTANCE: Forward models predict the sensory consequences of planned actions and permit discrimination of self- and non-self-elicited sensation; their impairment in schizophrenia is implied by an abnormality in behavioral force-matching and the flawed agency judgments characteristic of positive symptoms, including auditory hallucinations and delusions of control. OBJECTIVE: To assess attenuation of sensory processing by self-action in individuals with schizophrenia and its relation to current symptom severity. DESIGN, SETTING, AND PARTICIPANTS: Functional magnetic resonance imaging data were acquired while medicated individuals with schizophrenia (n = 19) and matched controls (n = 19) performed a factorially designed sensorimotor task in which the occurrence and relative timing of action and sensation were manipulated. The study took place at the neuroimaging research unit at the Institute of Cognitive Neuroscience, University College London, and the Maudsley Hospital. RESULTS: In controls, a region of secondary somatosensory cortex exhibited attenuated activation when sensation and action were synchronous compared with when the former occurred after an unexpected delay or alone. By contrast, reduced attenuation was observed in the schizophrenia group, suggesting that these individuals were unable to predict the sensory consequences of their own actions. Furthermore, failure to attenuate secondary somatosensory cortex processing was predicted by current hallucinatory severity. CONCLUSIONS AND RELEVANCE: Although comparably reduced attenuation has been reported in the verbal domain, this work implies that a more general physiologic deficit underlies positive symptoms of schizophrenia.

Effects of amisulpride, risperidone and chlorpromazine on auditory and visual latent inhibition, prepulse inhibition, executive function and eye movements in healthy volunteers.

In view of the evidence that cognitive deficits in schizophrenia are critically important for long-term outcome, it is essential to establish the effects that the various antipsychotic compounds have on cognition, particularly second-generation drugs. This parallel group, placebo-controlled study aimed to compare the effects in healthy volunteers (n = 128) of acute doses of the atypical antipsychotics amisulpride (300 mg) and risperidone (3 mg) to those of chlorpromazine (100 mg) on tests thought relevant to the schizophrenic process: auditory and visual latent inhibition, prepulse inhibition of the acoustic startle response, executive function and eye movements. The drugs tested were not found to affect auditory latent inhibition, prepulse inhibition or executive functioning as measured by the Cambridge Neuropsychological Test Battery and the FAS test of verbal fluency. However, risperidone disrupted and amisulpride showed a trend to disrupt visual latent inhibition. Although amisulpride did not affect eye movements, both risperidone and chlorpromazine decreased peak saccadic velocity and increased antisaccade error rates, which, in the risperidone group, correlated with drug-induced akathisia. It was concluded that single doses of these drugs appear to have little effect on cognition, but may affect eye movement parameters in accordance with the amount of sedation and akathisia they produce. The effect risperidone had on latent inhibition is likely to relate to its serotonergic properties. Furthermore, as the trend for disrupted visual latent inhibition following amisulpride was similar in nature to that which would be expected with amphetamine, it was concluded that its behaviour in this model is consistent with its preferential presynaptic dopamine antagonistic activity in low dose and its efficacy in the negative symptoms of schizophrenia.

Auditory sensory memory and working memory processes in children with normal hearing and cochlear implants.

There can be wide variation in the level of oral/aural language ability that prelingually hearing-impaired children develop after cochlear implantation. Automatic perceptual processing mechanisms have come under increasing scrutiny in attempts to explain this variation. Using mismatch negativity methods, this study explored associations between auditory sensory memory mechanisms and verbal working memory function in children with cochlear implants and a group of hearing controls of similar age. Whilst clear relationships were observed in the hearing children between mismatch activation and working memory measures, this association appeared to be disrupted in the implant children. These findings would fit with the proposal that early auditory deprivation and a degraded auditory signal can cause changes in the processes underpinning the development of oral/aural language skills in prelingually hearing-impaired children with cochlear implants and thus alter their developmental trajectory

Auditory false perceptions are mediated by psychosis risk factors

Introduction. Auditory hallucinations exist in psychotic disorders as well as the general population. Proneness to hallucinations, as measured by positive schizotypy, predicts false perceptions during an auditory signal detection task (Barkus, Stirling, Hopkins, McKie, & Lewis, 2007). Our aim was to replicate this result and extend it by examining effects of age and sex, both important demographic predictors of psychosis.

Method. A sample of 76 healthy volunteers split into 15-17 years (n = 46) and 19 years plus (n = 30) underwent a signal detection task designed to detect propensity towards false perceptions under ambiguous auditory conditions. Scores on the Unusual Experiences subscale (UE) of the O-LIFE schizotypy scale, IQ, and a measure of working memory were also assessed.

Results. We replicated our initial finding (Barkus et al., 2007): High scores on positive schizotypy were associated with false perceptions. Younger participants who scored highly on positive schizotypy reported significantly more false perceptions compared to other groups (p = .04). Older participants who had had an imaginary friend reported more false perceptions during the signal detection task (p <. 01).

Conclusions. Younger participants seem most vulnerable to the effects of positive schizotypal traits in terms of a signal detection deficit that underlies auditory hallucinations. Schizotypy may have greatest impact closer to the risk period for development of psychotic disorders.

Lexical access across languages: a multinomial model of auditory distraction

Recall in many types of verbal memory task is reliably disrupted by the presence of auditory distracters, with verbal distracters frequently proving the most disruptive (Beaman, 2005). A multinomial processing tree model (Schweickert, 1993) is applied to the effects on free recall of background speech from a known or an unknown language. The model reproduces the free recall curve and the impact on memory of verbal distracters for which a lexical entry exists (i.e., verbal items from a known language). The effects of semantic relatedness of distracters within a language is found to depend upon a redintegrative factor thought to reflect the contribution of the speech-production system. The differential impacts of known and unknown languages cannot be accounted for in this way, but the same effects of distraction are observed amongst bilinguals, regardless of distracter-language.

Fundamental deficits of auditory perception in Wernicke’s aphasia

Objective: This work investigates the nature of the comprehension impairment in Wernicke’s aphasia, by examining the relationship between deficits in auditory processing of fundamental, non-verbal acoustic stimuli and auditory comprehension. Wernicke’s aphasia, a condition resulting in severely disrupted auditory comprehension, primarily occurs following a cerebrovascular accident (CVA) to the left temporo-parietal cortex. Whilst damage to posterior superior temporal areas is associated with auditory linguistic comprehension impairments, functional imaging indicates that these areas may not be specific to speech processing but part of a network for generic auditory analysis. Methods: We examined analysis of basic acoustic stimuli in Wernicke’s aphasia participants (n = 10) using auditory stimuli reflective of theories of cortical auditory processing and of speech cues. Auditory spectral, temporal and spectro-temporal analysis was assessed using pure tone frequency discrimination, frequency modulation (FM) detection and the detection of dynamic modulation (DM) in “moving ripple” stimuli. All tasks used criterion-free, adaptive measures of threshold to ensure reliable results at the individual level. Results: Participants with Wernicke’s aphasia showed normal frequency discrimination but significant impairments in FM and DM detection, relative to age- and hearing-matched controls at the group level (n = 10). At the individual level, there was considerable variation in performance, and thresholds for both frequency and dynamic modulation detection correlated significantly with auditory comprehension abilities in the Wernicke’s aphasia participants. Conclusion: These results demonstrate the co-occurrence of a deficit in fundamental auditory processing of temporal and spectrotemporal nonverbal stimuli in Wernicke’s aphasia, which may have a causal contribution to the auditory language comprehension impairment Results are discussed in the context of traditional neuropsychology and current models of cortical auditory processing.

Auditory distraction in memory tasks: Can it be controlled?

Irrelevant sound accompanying the processes of encoding and retrieval of verbal events impairs memory performance. However, the degree of impairment is highly dependent on a range of factors. Some of them lie outside rememberers’ control, like the semantic content of distracting sound or the nature of a test used to assess memory. Others, like a strategy used to encode memoranda, rest under control of the rememberer. In this paper the factors that modulate memory impairment are outlined and discussed in terms of multiple mechanisms contributing to memory impairment under auditory distraction. The mechanisms of a capture of attention by distraction, interference of automatic seriation of distraction and voluntary seriation of memoranda, semantic inhibition of distraction, and blocking of memoranda by semantically related distracters are described. Results that demonstrate how these mechanisms determine memory impairment under auditory distraction are also discussed. Particular attention is devoted to the possibility of voluntary control over the workings of these mechanisms and the conditions under which the negative impact of auditory distraction upon memory performance could be minimised.

Hallucinations as a trauma-based memory: implications for psychological interventions

The relationship between hallucinations and life events is a topic of significant clinical importance. This review discusses the extent to which auditory and visual hallucinations may be directly related to traumatic events. Evidence suggests that intrusive images occur frequently within individuals who also report hallucinatory experiences. However, there has been limited research specifically investigating the extent to which hallucinations are the re-experiencing of a traumatic event. Our current theoretical understanding of these relationships, along with methodological difficulties associated with research in this area, are considered. Recent clinical studies, which adopt interventions aimed at the symptoms of post-traumatic stress disorder in people diagnosed with a psychotic disorder, are reviewed. There is a need for the development of evidence-based interventions in this area.

Relationship between verbal working memory and the SCAN-C in children with specific language impairment

Purpose: An ongoing concern with the evaluation of auditory processing disorders is the extent that assessment instruments are influenced by higher order cognitive functions. This study examined the relationship between verbal working memory and performance on the Test for Auditory Processing Disorders in Children--Revised (SCAN-C; Keith, 2000b) in children with specific language impairment (SLI) and typically developing (TD) children.

Method: Sixteen children with SLI and 16 TD children ages 8/4 to 11 years participated in the study. The children were presented with the SCAN-C and tests measuring verbal working memory.

Results: Initial comparisons revealed that the SLI group obtained significantly lower scores than the TD group on the SCAN-C. However, after controlling for verbal working memory, significant differences between the 2 groups were no longer observed. Correlational analyses revealed that the composite score from the SCAN-C was related to all tests assessing verbal working memory.

Conclusions: Performance on the SCAN-C may be related to working memory functioning. As a consequence, it is unclear whether difficulty on this task should be viewed as a problem with auditory processing or a problem with verbal working memory.

Verbal and visual stimulation effects on rectus femoris and biceps femoris muscles during isometric and concentric

Abstract Background: Coactivation may be both desirable (injury prevention) or undesirable (strength measurement). In this context, different styles of muscle strength stimulus have being investigated. In this study we evaluated the effects of verbal and visual stimulation on rectus femoris and biceps femoris muscles contraction during isometric and concentric. Methods: We investigated 13 men (age =23.1 ± 3.8 years old; body mass =75.6 ± 9.1 kg; height =1.8 ± 0.07 m). We used the isokinetic dynamometer BIODEX device and an electromyographic (EMG) system. We evaluated the maximum isometric and isokinetic knee extension and flexion at 60°/s. The following conditions were evaluated: without visual nor verbal command (control); verbal command; visual command and; verbal and visual command. In relation to the concentric contraction, the volunteers performed five reciprocal and continuous contractions at 60°/s. With respect to isometric contractions it was made three contractions of five seconds for flexion and extension in a period of one minute. Results: We found that the peak torque during isometric flexion was higher in the subjects in the VVC condition (p > 0.05). In relation to muscle coactivation, the subjects presented higher values at the control condition (p > 0.05). Conclusion We suggest that this type of stimulus is effective for the lower limbs.

Specific attentional impairments and complex visual hallucinations in eye disease

OBJECTIVE: To test the prediction by the Perception and Attention Deficit (PAD) model of complex visual hallucinations that cognitive impairment, specifically in visual attention, is a key risk factor for complex hallucinations in eye disease. METHODS: Two studies of elderly patients with acquired eye disease investigated the relationship between complex visual hallucinations (CVH) and impairments in general cognition and verbal attention (Study 1) and between CVH, selective visual attention and visual object perception (Study 2). The North East Visual Hallucinations Inventory was used to classify CVH. RESULTS: In Study 1, there was no relationship between CVH (n=10/39) and performance on cognitive screening or verbal attention tasks. In Study 2, participants with CVH (n=11/31) showed poorer performance on a modified Stroop task (p<0.05), a novel imagery-based attentional task (p<0.05) and picture (p<0.05) but not silhouette naming (p=0.13) tasks. Performance on these tasks correctly classified 83% of the participants as hallucinators or non-hallucinators. CONCLUSIONS: The results suggest that, consistent with the PAD model, complex visual hallucinations in people with acquired eye disease are associated with visual attention impairment.

Validation of the LittlEARS((R)) Auditory Questionnaire in children with normal hearing

OBJECTIVES: With more children receiving cochlear implants during infancy, there is a need for validated assessments of pre-verbal and early verbal auditory skills. The LittlEARS Auditory Questionnaire is presented here as the first module of the LittlEARS test battery. The LittlEARS Auditory Questionnaire was developed and piloted to assess the auditory behaviour of normal hearing children and hearing impaired children who receive a cochlear implant or hearing aid prior to 24 months of age. This paper presents results from two studies: one validating the LittlEARS Auditory Questionnaire on children with normal hearing who are German speaking and a second validating the norm curves found after adaptation and administration of the questionnaire to children with normal hearing in 15 different languages. METHODS: Scores from a group of 218 German and Austrian children with normal hearing between 5 days and 24 months of age were used to create a norm curve. The questionnaire was adapted from the German original into English and then 15 other languages to date. Regression curves were found based on parental responses from 3309 normal hearing infants and toddlers. Curves for each language were compared to the original German validation curve. RESULTS: The results of the first study were a norm curve which reflects the age-dependence of auditory behaviour, reliability and homogeneity as a measure of auditory behaviour, and calculations of expected and critical values as a function of age. Results of the second study show that the regression curves found for all the adapted languages are essentially equal to the German norm curve, as no statistically significant differences were found. CONCLUSIONS: The LittlEARS Auditory Questionnaire is a valid, language-independent tool for assessing the early auditory behaviour of infants and toddlers with normal hearing. The results of this study suggest that the LittlEARS Auditory Questionnaire could also be very useful for documenting children's progress with their current amplification, providing evidence of the need for implantation, or highlighting the need for follow-up in other developmental areas.

The subjective present and its modulation in clinical contexts

Time is a basic dimension in psychology, underlying behavior and experience. Timing and time perception constitute implicit processes that are often inaccessible to the individual person. Research in this field has shown that timing is involved in many areas of clinical significance. In the projects presented here, we combine timing with seemingly different fields of research, such as psychopathology, perceptual grouping, and embodied cognition. Focusing on the time scale of the subjective present, we report findings from three different clinical studies: (1) We studied perceived causality in schizophrenia patients, finding that perceptual grouping (‘binding’, ‘Gestalt formation’), which leads to visual causality perceptions, did not distinguish between patients and healthy controls. Patients however did integrate context (provided by the temporal distribution of auditory context stimuli) less into perceptions, in significant contrast to controls. This is consistent with reports of higher inaccuracy in schizophrenia patients’ temporal processing. (2) In a project on auditory Gestalt perception we investigated auditory perceptual grouping in schizophrenia patients. The mean dwell time was positively related to how much patients were prone to auditory hallucinations. Dwell times of auditory Gestalts may be regarded as operationalizations of the subjective present; findings thus suggested that patients with hallucinations had a shorter present. (3) The movement correlations of interacting individuals were used to study the non-verbal synchrony between therapist and patient in psychotherapy sessions. We operationalized the duration of an embodied ‘social present’ by the statistical significance of such associations, finding a window of roughly 5.7 seconds in conversing dyads.We discuss that temporal scales of nowness may be modifiable, e.g., by mindfulness. This yields promising goals for future research on timing in the clinical context: psychotherapeutic techniques may alter binding processes, hence the subjective present of individuals, and may affect the social present in therapeutic interactions.