Cognitive and Visual Speech Contributions to Speech Perception in Challenging Listening Conditions

Speech perception routinely takes place in noisy or degraded listening environments, leading to ambiguity in the identity of the speech token. Here, I present one review paper and two experimental papers that highlight cognitive and visual speech contributions to the listening process, particularly in challenging listening environments. First, I survey the literature linking audiometric age-related hearing loss and cognitive decline and review the four proposed causal mechanisms underlying this link. I argue that future research in this area requires greater consideration of the functional overlap between hearing and cognition. I also present an alternative framework for understanding causal relationships between age-related declines in hearing and cognition, with emphasis on the interconnected nature of hearing and cognition and likely contributions from multiple causal mechanisms. I also provide a number of testable hypotheses to examine how impairments in one domain may affect the other. In my first experimental study, I examine the direct contribution of working memory (through a cognitive training manipulation) on speech in noise comprehension in older adults. My results challenge the efficacy of cognitive training more generally, and also provide support for the contribution of sentence context in reducing working memory load. My findings also challenge the ubiquitous use of the Reading Span test as a pure test of working memory. In a second experimental (fMRI) study, I examine the role of attention in audiovisual speech integration, particularly when the acoustic signal is degraded. I demonstrate that attentional processes support audiovisual speech integration in the middle and superior temporal gyri, as well as the fusiform gyrus. My results also suggest that the superior temporal sulcus is sensitive to intelligibility enhancement, regardless of how this benefit is obtained (i.e., whether it is obtained through visual speech information or speech clarity). In addition, I also demonstrate that both the cingulo-opercular network and motor speech areas are recruited in difficult listening conditions. Taken together, these findings augment our understanding of cognitive contributions to the listening process and demonstrate that memory, working memory, and executive control networks may flexibly be recruited in order to meet listening demands in challenging environments.

Testing times

The paper describes the experimental genesis of a series of prints that examines how sight influences perception, designed to engage an audience of varying visual abilities.

1° level of automation: the effectiveness of adaptive cruise control on driving and visual behaviour

The research activities have allowed the analysis of the driver assistance systems, called Advanced Driver Assistance Systems (ADAS) in relation to road safety. The study is structured according to several evaluation steps, related to definite on-site tests that have been carried out with different samples of users, according to their driving experience with the ACC. The evaluation steps concern: •The testing mode and the choice of suitable instrumentation to detect the driver’s behaviour in relation to the ACC. •The analysis modes and outputs to be obtained, i.e.: - Distribution of attention and inattention; - Mental workload; - The Perception-Reaction Time (PRT), the Time To Collision (TTC) and the Time Headway (TH). The main purpose is to assess the interaction between vehicle drivers and ADAS, highlighting the inattention and variation of the workloads they induce regarding the driving task. The research project considered the use of a system for monitoring visual behavior (ASL Mobile Eye-XG - ME), a powerful GPS that allowed to record the kinematic data of the vehicle (Racelogic Video V-BOX) and a tool for reading brain activity (Electroencephalographic System - EEG). Just during the analytical phase, a second and important research objective was born: the creation of a graphical interface that would allow exceeding the frame count limit, making faster and more effective the labeling of the driver’s points of view. The results show a complete and exhaustive picture of the vehicle-driver interaction. It has been possible to highlight the main sources of criticalities related to the user and the vehicle, in order to concretely reduce the accident rate. In addition, the use of mathematical-computational methodologies for the analysis of experimental data has allowed the optimization and verification of analytical processes with neural networks that have made an effective comparison between the manual and automatic methodology.

O aluno com deficiência visual nas aulas de educação física : análise do processo inclusivo = The student with visual impairments : analysis of inclusive process

Universidade Estadual de Campinas . Faculdade de Educação Física

A variação da acuidade visual durante esforços fisicos em atletas com baixa visão

Universidade Estadual de Campinas . Faculdade de Educação Física

Influence of separate and mixed experimental designs on reaction times to two simple visual stimuli

Testing contexts have been shown to critically influence experimental results in psychophysical studies. One of these contexts that show important modulation of the behavioral effects of different stimulatory conditions is the separate (blocked) or mixed presentation of these stimulatory conditions. The study presents evidence that the apparent discriminabilities of two target stimuli can change according to which of these two testing contexts is used. A cross inside a ring and a vertical line inside a ring were presented as go stimuli in a go/no-go reaction time task. In one experiment, each of these stimuli was presented to a different group of volunteers and in another experiment they were presented to the same group of volunteers, randomly mixed in the blocks of trials. Similar reaction times were obtained for the two stimuli in the first experiment, and different reaction times (faster for the cross) in the second experiment. The latter result indicates that the two stimuli have different discriminabilities from the no-go stimulus; the cross having greater discriminability. This difference is however masked, presumably by the adoption of specific compensatory attentional sets, in a separate testing context.

Percepções de escolares com deficiência visual em relação ao seu processo de escolarização

A promoção da inclusão escolar de pessoas com deficiência visual demanda que os profissionais conheçam as percepções que estes alunos têm a respeito de suas limitações e possibilidades. Neste estudo, foram identificadas características e percepções de escolares com deficiência visual em relação ao seu processo de reabilitação. Foi realizado um estudo descritivo transversal com escolares de 12 anos e mais, inseridos no sistema público de um município do Estado de São Paulo. Aplicou-se questionário mediante entrevista. Obteve-se população de 26 alunos, sendo 46,2% com visão subnormal e 53,8% com cegueira, com média de idade de 17,1 anos. A repetência escolar foi declarada por 73,1%. Entre as dificuldades escolares decorrentes da cegueira, sobressaiu-se a leitura de livros didáticos e, entre as decorrentes da visão subnormal, a visualização da lousa. O nível de escolaridade mostrou-se baixo em relação à média de idade. Evidenciaram-se percepções coerentes em relação à problemática da inclusão escolar.

Perception of difficulties with vision-related activities of daily living among patients undergoing unilateral posterior capsulotomy

OBJECTIVES: To assess the influence of Nd:YAG (neodymium: yttrium-aluminum- garnet) laser unilateral posterior capsulotomy on visual acuity and patients' perception of difficulties with vision-related activities of daily life. METHODS: We conducted an interventional survey that included 48 patients between 40 and 80 years of age with uni- or bilateral pseudophakia, posterior capsule opacification, and visual acuity <0.30 (logMAR) in one eye who were seen at a Brazilian university hospital. All patients underwent posterior capsulotomy using an Nd:YAG laser. Before and after the intervention, patients were asked to complete a questionnaire that was developed in an exploratory study. RESULTS: Before posterior capsulotomy, the median visual acuity (logMAR) of the included patients was 0.52 (range 0.30-1.60). After posterior capsulotomy, the median visual acuity of the included patients improved to 0.10 (range 0.0-0.52). According to the subjects' perceptions, their ability to perform most of their daily life activities improved after the intervention (p<0.05). CONCLUSIONS: After patients underwent posterior capsulotomy with an Nd:YAG laser, a significant improvement in the visual acuity of the treated eye was observed. Additionally, subjects felt that they experienced less difficulty performing most of their vision-dependent activities of daily living.

Letters and cities: reading the urban environment with the help of perception theories

When wandering around a city such as Sao Paulo, we are surrounded by letters, numbers and symbols. These elements form part of an environment full of signs in many shapes and sizes that compete for our attention. Our perception of these elements contributes towards our spatial guidance and sense of place. The idea of `reading` the city, or urban environment, was introduced by Kevin Lynch, for whom reading the urban structure follows on from recognizing or identifying its numerous visual elements, not necessarily verbal ones. Beginning with a brief bibliographic review of perception theories, this article combines concepts from environmental psychology with concerns brought up by the fields of information design and epigraphy studies, setting out the basis of a methodological proposal for the study of typography and lettering in the urban environment.

Hitting a moving target: Perception and action in the timing of rapid interceptions

Different interceptive tasks and modes of interception (hitting or capturing) do not necessarily involve similar control processes. Control based on preprogramming of movement parameters is possible for actions with brief movement times but is now widely rejected; continuous perceptuomotor control models are preferred for all types of interception. The rejection of preprogrammed control and acceptance of continuous control is evaluated for the timing of rapidly executed, manual hitting actions. It is shown that a preprogrammed control model is capable of providing a convincing account of observed behavior patterns that avoids many of the arguments that have been raised against it. Prominent continuous perceptual control models are analyzed within a common framework and are shown to be interpretable as feedback control strategies. Although these models can explain observations of on-line adjustments to movement, they offer only post hoc explanations for observed behavior patterns in hitting tasks and are not directly supported by data. It is proposed that rapid manual hitting tasks make up a class of interceptions for which a preprogrammed strategy is adopted-a strategy that minimizes the role of visual feedback. Such a strategy is effective when the task demands a high degree of temporal accuracy.

An unexpected role for visual feedback in vehicle steering control

Some motor tasks can be completed, quite literally, with our eyes shut. Most people can touch their nose without looking or reach for an object after only a brief glance at its location. This distinction leads to one of the defining questions of movement control: is information gleaned prior to starting the movement sufficient to complete the task (open loop), or is feedback about the progress of the movement required (closed loop)? One task that has commanded considerable interest in the literature over the years is that of steering a vehicle, in particular lane-correction and lane-changing tasks. Recent work has suggested that this type of task can proceed in a fundamentally open loop manner [1 and 2], with feedback mainly serving to correct minor, accumulating errors. This paper reevaluates the conclusions of these studies by conducting a new set of experiments in a driving simulator. We demonstrate that, in fact, drivers rely on regular visual feedback, even during the well-practiced steering task of lane changing. Without feedback, drivers fail to initiate the return phase of the maneuver, resulting in systematic errors in final heading. The results provide new insight into the control of vehicle heading, suggesting that drivers employ a simple policy of “turn and see,” with only limited understanding of the relationship between steering angle and vehicle heading.

Patterns of brain asymmetry in the perception of positive and negative facial expressions

The divided visual field technique was used to investigate the pattern of brain asymmetry in the perception of positive/approach and negative/withdrawal facial expressions. A total of 80 undergraduate students (65 female, 15 male) were distributed in five experimental groups in order to investigate separately the perception of expressions of happiness, surprise, fear, sadness, and the neutral face. In each trial a target and a distractor expression were presented simultaneously in a computer screen for 150 ms and participants had to determine the side (left or right) on which the target expression was presented. Results indicated that expressions of happiness and fear were identified faster when presented in the left visual field, suggesting an advantage of the right hemisphere in the perception of these expressions. Fewer judgement errors and faster reaction times were also observed for the matching condition in which emotional faces were presented in the left visual field and neutral faces in the right visual field. Other results indicated that positive expressions (happiness and surprise) were perceived faster and more accurately than negative ones (sadness and fear). Main results tend to support the right hemisphere hypothesis, which predicts a better performance of the right hemisphere to perceive emotions, as opposed to the approach-withdrawal hypothesis.

Trigeminal pain and quantitative sensory testing in painful peripheral diabetic neuropathy

Objective: To evaluate patients with Diabetes Mellitus type 2 and painful peripheral neuropathy in order to investigate oral complaints and facial somatosensory findings. Research design and methods: Case-control study; 29 patients (12 women, mean age 57.86 yo) with Diabetes Mellitus type 2 and 31 age-gender-matched controls were evaluated with a standardized protocol for general characteristics, orofacial pain, research diagnostic criteria for temporomandibular disorders, visual analogue scale and McGill Pain questionnaire, and a systematic protocol of quantitative sensory testing for bilateral facial sensitivity at the areas innervated by the trigeminal branches, which included the thermal detection by ThermoSensi 2, tactile evaluation with vonFrey filaments, and superficial pain thresholds with a superficial algometer (Micromar). Statistical analysis was performed with Wilcoxon, chi-square, confidence intervals and Spearman (p < 0.05). Results: Orofacial pain was reported by 55.2% of patients, and the most common descriptor was fatigue (50%); 17.2% had burning mouth. Myofascial temporomandibular disorders were diagnosed in 9(31%) patients. The study group showed higher sensory thresholds of pain at the right maxillary branch (p = 0.017) but sensorial differences were not associated with pain (p = 0.608). Glycemia and HbA(1c) were positively correlated with the quantitative sensory testing results of pain (p < 0.05) and cold (p = 0.044) perceptions. Higher pain thresholds were correlated with higher glycemia and glycated hemoglobin (p = 0.027 and p = 0.026). Conclusions: There was a high prevalence of orofacial pain and burning mouth was the most common complaint. The association of loss of pain sensation and higher glycemia and glycated hemoglobin can be of clinical use for the follow-up of DM complications. (C) 2010 Elsevier Ltd. All rights reserved.

Abnormal Visual Activation in Parkinson`s Disease Patients

Among nonmotor symptoms observed in Parkinson`s disease (PD) dysfunction in the visual system, including hallucinations, has a significant impact in their quality of life. To further explore the visual system in PD patients we designed two fMRI experiments comparing 18 healthy volunteers with 16 PD patients without visual complaints in two visual fMRI paradigms: the flickering checkerboard task and a facial perception paradigm. PD patients displayed a decreased activity in the primary visual cortex (Broadmann area 17) bilaterally as compared to healthy volunteers during flickering checkerboard task and increased activity in fusiform gyms (Broadmann area 37) during facial perception paradigm. Our findings confirm the notion that PD patients show significant changes in the visual cortex system even before the visual symptoms are clinically evident. Further studies are necessary to evaluate the contribution of these abnormalities to the development visual symptoms in PD. (C) 2010 Movement Disorder Society

Modulation of Auditory and Visual Processing by Delta-9-Tetrahydrocannabinol and Cannabidiol: an fMRI Study

Although the effects of cannabis on perception are well documented, little is known about their neural basis or how these may contribute to the formation of psychotic symptoms. We used functional magnetic resonance imaging (fMRI) to assess the effects of Delta-9-tetrahydrocannabinol (THC) and cannabidiol (CBD) during visual and auditory processing in healthy volunteers. In total, 14 healthy volunteers were scanned on three occasions. Identical 10mg THC, 600mg CBD, and placebo capsules were allocated in a balanced double-blinded pseudo-randomized crossover design. Plasma levels of each substance, physiological parameters, and measures of psychopathology were taken at baseline and at regular intervals following ingestion of substances. Volunteers listened passively to words read and viewed a radial visual checkerboard in alternating blocks during fMRI scanning. Administration of THC was associated with increases in anxiety, intoxication, and positive psychotic symptoms, whereas CBD had no significant symptomatic effects. THC decreased activation relative to placebo in bilateral temporal cortices during auditory processing, and increased and decreased activation in different visual areas during visual processing. CBD was associated with activation in right temporal cortex during auditory processing, and when contrasted, THC and CBD had opposite effects in the right posterior superior temporal gyrus, the right-sided homolog to Wernicke`s area. Moreover, the attenuation of activation in this area (maximum 61, -15, -2) by THC during auditory processing was correlated with its acute effect on psychotic symptoms. Single doses of THC and CBD differently modulate brain function in areas that process auditory and visual stimuli and relate to induced psychotic symptoms. Neuropsychopharmacology (2011) 36, 1340-1348; doi:10.1038/npp.2011.17; published online 16 March 2011