Cognitive and Visual Speech Contributions to Speech Perception in Challenging Listening Conditions

Speech perception routinely takes place in noisy or degraded listening environments, leading to ambiguity in the identity of the speech token. Here, I present one review paper and two experimental papers that highlight cognitive and visual speech contributions to the listening process, particularly in challenging listening environments. First, I survey the literature linking audiometric age-related hearing loss and cognitive decline and review the four proposed causal mechanisms underlying this link. I argue that future research in this area requires greater consideration of the functional overlap between hearing and cognition. I also present an alternative framework for understanding causal relationships between age-related declines in hearing and cognition, with emphasis on the interconnected nature of hearing and cognition and likely contributions from multiple causal mechanisms. I also provide a number of testable hypotheses to examine how impairments in one domain may affect the other. In my first experimental study, I examine the direct contribution of working memory (through a cognitive training manipulation) on speech in noise comprehension in older adults. My results challenge the efficacy of cognitive training more generally, and also provide support for the contribution of sentence context in reducing working memory load. My findings also challenge the ubiquitous use of the Reading Span test as a pure test of working memory. In a second experimental (fMRI) study, I examine the role of attention in audiovisual speech integration, particularly when the acoustic signal is degraded. I demonstrate that attentional processes support audiovisual speech integration in the middle and superior temporal gyri, as well as the fusiform gyrus. My results also suggest that the superior temporal sulcus is sensitive to intelligibility enhancement, regardless of how this benefit is obtained (i.e., whether it is obtained through visual speech information or speech clarity). In addition, I also demonstrate that both the cingulo-opercular network and motor speech areas are recruited in difficult listening conditions. Taken together, these findings augment our understanding of cognitive contributions to the listening process and demonstrate that memory, working memory, and executive control networks may flexibly be recruited in order to meet listening demands in challenging environments.

Cold acclimation of chill coma mechanisms in the locust CNS

Temperature has profound effects on the neural function and behaviour of insects. When exposed to low temperature, migratory locusts (Locusta migratoria) enter chill coma (neuromuscular paralysis) and can resume normal body functions after returning to normal temperature. Our laboratory has studied phenomena underlying environmental stress-induced comas in locusts and found that they are associated with a sudden loss of K+ homeostasis and also a temporary electrical silence in the central nervous system (CNS). However, the mechanisms underlying chill coma entry and recovery are not well understood, particularly the role of the CNS has not been determined. Here, I investigated neural function during chill coma in the locust by measuring electrical activity in the CNS. As pre-exposure to moderately low temperatures, either chronically (cold acclimation) or acutely (rapid cold hardening; RCH), has been found to improve the insect’s cold tolerance, I also determined cold acclimation and RCH protocols that will improve the locust's cold tolerance and whether these protocols affect neural shutdown during chill coma in the locust. With an implanted thermocouple in the thorax, I determined the temperature associated with a loss of responsiveness (CTmin) in intact male adult locusts. In parallel experiments, I recorded field potential (FP) in the metathoracic ganglion (MTG) in semi-intact preparations to determine the temperature that would induce neural shutdown. I found that acclimation at 10 ˚C and RCH at 4 ˚C reduced chill coma recovery time (CCRT) in intact animal preparations and RCH at 4 ˚C for 4 hours reduced the temperature at neural shutdown in semi-intact preparations. These results suggest that pre-exposure to cold can improve the locust's resistance to chill coma and support the notion that the CNS has a role in determining entry into and exit from chill coma in locusts.