Navigation assistance for wayfinding in the virtual environments: taxonomy and a survey

Efficient Navigation is essential for the user-acceptance of the Virtual Environments (VEs), but it is also inherently, a difficult task to perform. Resulting research in the area provides users with great variety of navigation assistance in VEs however it is still known to be inadequate, complex and suffers through many limitations. In this paper we discuss the task of navigation in the virtual environments and record the wayfinding assistance currently available for the VEs. The paper introduces taxonomy of navigation and categorizes the aids on basis of the functions performed. The paper provides views on current work performed in the area of non-speech auditory aids. Further we conclude by providing views on the important areas that require further investigation and research.

Room reflections and constancy in speech-like sounds: within-band effects

The experiment asks whether constancy in hearing precedes or follows grouping. Listeners heard speech-like sounds comprising 8 auditory-filter shaped noise-bands that had temporal envelopes corresponding to those arising in these filters when a speech message is played. The „context‟ words in the message were “next you‟ll get _to click on”, into which a “sir” or “stir” test word was inserted. These test words were from an 11-step continuum that was formed by amplitude modulation. Listeners identified the test words appropriately and quite consistently, even though they had the „robotic‟ quality typical of this type of 8-band speech. The speech-like effects of these sounds appears to be a consequence of auditory grouping. Constancy was assessed by comparing the influence of room reflections on the test word across conditions where the context had either the same level of reflections, or where it had a much lower level. Constancy effects were obtained with these 8-band sounds, but only in „matched‟ conditions, where the room reflections were in the same bands in both the context and the test word. This was not the case in a comparison „mismatched‟ condition, and here, no constancy effects were found. It would appear that this type of constancy in hearing precedes the across-channel grouping whose effects are so apparent in these sounds. This result is discussed in terms of the ubiquity of grouping across different levels of representation.

Perceptual constancy, reverberation, and grouping: within-band effects

Perceptual constancy effects are observed when differing amounts of reverberation are applied to a context sentence and a test‐word embedded in it. Adding reverberation to members of a “sir”‐“stir” test‐word continuum causes temporal‐envelope distortion, which has the effect of eliciting more sir responses from listeners. If the same amount of reverberation is also applied to the context sentence, the number of sir responses decreases again, indicating an “extrinsic” compensation for the effects of reverberation. Such a mechanism would effect perceptual constancy of phonetic perception when temporal envelopes vary in reverberation. This experiment asks whether such effects precede or follow grouping. Eight auditory‐filter shaped noise‐bands were modulated with the temporal envelopes that arise when speech is played through these filters. The resulting “gestalt” percept is the appropriate speech rather than the sound of noise‐bands, presumably due to across‐channel “grouping.” These sounds were played to listeners in “matched” conditions, where reverberation was present in the same bands in both context and test‐word, and in “mismatched” conditions, where the bands in which reverberation was added differed between context and test‐word. Constancy effects were obtained in matched conditions, but not in mismatched conditions, indicating that this type of constancy in hearing precedes across‐channel grouping.

Room-acoustic factors in attentional tracking

In a “busy” auditory environment listeners can selectively attend to one of several simultaneous messages by tracking one listener's voice characteristics. Here we ask how well other cues compete for attention with such characteristics, using variations in the spatial position of sound sources in a (virtual) seminar room. Listeners decided which of two simultaneous target words belonged in an attended “context” phrase when it was played with a simultaneous “distracter” context that had a different wording. Talker difference was in competition with a position difference, so that the target‐word chosen indicates which cue‐type the listener was tracking. The main findings are that room‐acoustic factors provide some tracking cues, whose salience increases with distance separation. This increase is more prominent in diotic conditions, indicating that these cues are largely monaural. The room‐acoustic factors might therefore be the spectral‐ and temporal‐envelope effects of reverberation on the timbre of speech. By contrast, the salience of cues associated with differences in sounds' bearings tends to decrease with distance, and these cues are more effective in dichotic conditions. In other conditions, where a distance and a bearing difference cooperate, they can completely override a talker difference at various distances.

On the nature and cause of Specific Language Impairment: a view from sentence processing and infant research

This paper addresses the nature and cause of Specific Language Impairment (SLI) by reviewing recent research in sentence processing of children with SLI compared to typically developing (TD) children and research in infant speech perception. These studies have revealed that children with SLI are sensitive to syntactic, semantic, and real-world information, but do not show sensitivity to grammatical morphemes with low phonetic saliency, and they show longer reaction times than age-matched controls. TD children from the age of 4 show trace reactivation, but some children with SLI fail to show this effect, which resembles the pattern of adults and TD children with low working memory. Finally, findings from the German Language Development (GLAD) Project have revealed that a group of children at risk for SLI had a history of an auditory delay and impaired processing of prosodic information in the first months of their life, which is not detectable later in life. Although this is a single project that needs to be replicated with a larger group of children, it provides preliminary support for accounts of SLI which make an explicit link between an early deficit in the processing of phonology and later language deficits, and the Computational Complexity Hypothesis that argues that the language deficit in children with SLI lies in difficulties integrating different types of information at the interfaces.

Constancy in the perception of speech when the level of room-reflections varies

A speech message played several metres from the listener in a room is usually heard to have much the same phonetic content as it does when played nearby, even though the different amounts of reflected sound make the temporal envelopes of these signals very different. To study this ‘constancy’ effect, listeners heard speech messages and speech-like sounds comprising 8 auditory-filter shaped noise-bands that had temporal envelopes corresponding to those in these filters when the speech message is played. The ‘contexts’ were “next you’ll get _to click on”, into which a “sir” or “stir” test word was inserted. These test words were from an 11-step continuum, formed by amplitude modulation. Listeners identified the test words appropriately, even in the 8-band conditions where the speech had a ‘robotic’ quality. Constancy was assessed by comparing the influence of room reflections on the test word across conditions where the context had either the same level of room reflections (i.e. from the same, far distance), or where it had a much lower level (i.e. from nearby). Constancy effects were obtained with both the natural- and the 8-band speech. Results are considered in terms of the degree of ‘matching’ between the context’s and test-word’s bands.

Non-word repetition in adolescents with Specific Language Impairment and Autism plus Language Impairments: a qualitative analysis

Non-word repetition (NWR) was investigated in adolescents with typical development, Specific Language Impairment (SLI) and Autism Plus language Impairment (ALI) (n = 17, 13, 16, and mean age 14;4, 15;4, 14;8 respectively). The study evaluated the hypothesis that poor NWR performance in both groups indicates an overlapping language phenotype (Kjelgaard & Tager-Flusberg, 2001). Performance was investigated both quantitatively, e.g. overall error rates, and qualitatively, e.g. effect of length on repetition, proportion of errors affecting phonological structure, and proportion of consonant substitutions involving manner changes. Findings were consistent with previous research (Whitehouse, Barry, & Bishop, 2008) demonstrating a greater effect of length in the SLI group than the ALI group, which may be due to greater short-term memory limitations. In addition, an automated count of phoneme errors identified poorer performance in the SLI group than the ALI group. These findings indicate differences in the language profiles of individuals with SLI and ALI, but do not rule out a partial overlap. Errors affecting phonological structure were relatively frequent, accounting for around 40% of phonemic errors, but less frequent than straight Consonant-for-Consonant or vowel-for-vowel substitutions. It is proposed that these two different types of errors may reflect separate contributory mechanisms. Around 50% of consonant substitutions in the clinical groups involved manner changes, suggesting poor auditory-perceptual encoding. From a clinical perspective algorithms which automatically count phoneme errors may enhance sensitivity of NWR as a diagnostic marker of language impairment. Learning outcomes: Readers will be able to (1) describe and evaluate the hypothesis that there is a phenotypic overlap between SLI and Autism Spectrum Disorders (2) describe differences in the NWR performance of adolescents with SLI and ALI, and discuss whether these differences support or refute the phenotypic overlap hypothesis, and (3) understand how computational algorithms such as the Levenshtein Distance may be used to analyse NWR data.

The separate but related origins of the recency and the modality effect in free recall

The recency effect found in free recall can be accounted for almost entirely in terms of the recall of ordered sequences of items. It is such sequences, presented at the end of the stimulus list but recalled at the very beginning of the response protocol, which produce a recency effect. Such sequences are recalled at the beginning of the response protocol equally often following auditory and visual presentation. These same stimulus sequences are also frequently recalled other than initially in the response protocol following auditory presentation. However, such responses are rarely found following visual presentation. The modality effect in free recall, the advantage of auditory over visual presentation, can be substantially accounted for in these terms. Theoretical and procedural implications of these data are discussed.

Effect of phonetic complexity on word reading and repetition in deep dyslexia

This investigation moves beyond the traditional studies of word reading to identify how the production complexity of words affects reading accuracy in an individual with deep dyslexia (JO). We examined JO’s ability to read words aloud while manipulating both the production complexity of the words and the semantic context. The classification of words as either phonetically simple or complex was based on the Index of Phonetic Complexity. The semantic context was varied using a semantic blocking paradigm (i.e., semantically blocked and unblocked conditions). In the semantically blocked condition words were grouped by semantic categories (e.g., table, sit, seat, couch,), whereas in the unblocked condition the same words were presented in a random order. JO’s performance on reading aloud was also compared to her performance on a repetition task using the same items. Results revealed a strong interaction between word complexity and semantic blocking for reading aloud but not for repetition. JO produced the greatest number of errors for phonetically complex words in semantically blocked condition. This interaction suggests that semantic processes are constrained by output production processes which are exaggerated when derived from visual rather than auditory targets. This complex relationship between orthographic, semantic, and phonetic processes highlights the need for word recognition models to explicitly account for production processes.

Temporal-envelope constancy of speech in rooms and the perceptual weighting of frequency bands

Three experiments measured constancy in speech perception, using natural-speech messages or noise-band vocoder versions of them. The eight vocoder-bands had equally log-spaced center-frequencies and the shapes of corresponding “auditory” filters. Consequently, the bands had the temporal envelopes that arise in these auditory filters when the speech is played. The “sir” or “stir” test-words were distinguished by degrees of amplitude modulation, and played in the context; “next you’ll get _ to click on.” Listeners identified test-words appropriately, even in the vocoder conditions where the speech had a “noise-like” quality. Constancy was assessed by comparing the identification of test-words with low or high levels of room reflections across conditions where the context had either a low or a high level of reflections. Constancy was obtained with both the natural and the vocoded speech, indicating that the effect arises through temporal-envelope processing. Two further experiments assessed perceptual weighting of the different bands, both in the test word and in the context. The resulting weighting functions both increase monotonically with frequency, following the spectral characteristics of the test-word’s [s]. It is suggested that these two weighting functions are similar because they both come about through the perceptual grouping of the test-word’s bands.

A cognitive and psycholinguistic investigation of neologisms

Background: Jargon aphasia with neologisms (i.e., novel nonword utterances) is a challenging language disorder that lacks a definitive theoretical description as well as clear treatment recommendations (Marshall, 2006). Aim: The aims of this two part investigation were to determine the source of neologisms in an individual with jargon aphasia (FF), to identify potential facilitatory semantic and/or phonological cuing effects in picture naming, and to determine whether the timing of the cues relative to the target picture mediated the cuing advantage. Methods and Procedures: FF’s underlying linguistic deficits were determined using several cognitive and linguistic tests. A series of computerized naming experiments using a modified version of the 175 item-Philadelphia Naming Test (Roach, Schwartz, Martin, Grewal, & Brecher, 1996) manipulated the cue type (semantic versus phonological) and relatedness (related versus unrelated). In a follow-up experiment, the relative timing of phonological cues was manipulated to test the effect of timing on the cuing advantage. The accuracy of naming responses and error patterns were analyzed. Outcome and Results: FF’s performance on the linguistic and cognitive test battery revealed a severe naming impairment with relatively spared word and nonword repetition, auditory comprehension of words and monitoring, and fairly well preserved semantic abilities. This performance profile was used to evaluate various explanations for neologisms including a loss of phonological codes, monitoring failure, and impairments in semantic system. The primary locus of his deficit appears to involve the connection between semantics to phonology, specifically, when word production involves accessing the phonological forms following semantic access. FF showed a significant cuing advantage only for phonological cues in picture naming, particularly when the cue preceded or coincided with the onset of the target picture. Conclusions: When integrated with previous findings, the results from this study suggest that the core deficit of this and at least some other jargon aphasics is in the connection from semantics to phonology. The facilitative advantage of phonological cues could potentially be exploited in future clinical and research studies to test the effectiveness of these cues for enhancing naming performance in individuals like FF.

Inhibitory control in memory: evidence for negative priming in free recall

Cognitive control mechanisms—such as inhibition—decrease the likelihood that goal-directed activity is ceded to irrelevant events. Here, we use the action of auditory distraction to show how retrieval from episodic long-term memory is affected by competitor inhibition. Typically, a sequence of to-be-ignored spoken distracters drawn from the same semantic category as a list of visually-presented to-be-recalled items impairs free recall performance. In line with competitor inhibition theory (Anderson, 2003), free recall was worse for items on a probe trial if they were a repeat of distracter items presented during the previous, prime, trial (Experiment 1). This effect was only produced when the distracters were dominant members of the same category as the to-be-recalled items on the prime. For prime trials in which distracters were low-dominant members of the to-be-remembered item category or were unrelated to that category—and hence not strong competitors for retrieval—positive priming was found (Experiments 2 & 3). These results are discussed in terms of inhibitory approaches to negative priming and memory retrieval.

Constrained principal component analysis reveals functionally connected load-dependent networks involved in multiple stages of working memory

Constrained principal component analysis (CPCA) with a finite impulse response (FIR) basis set was used to reveal functionally connected networks and their temporal progression over a multistage verbal working memory trial in which memory load was varied. Four components were extracted, and all showed statistically significant sensitivity to the memory load manipulation. Additionally, two of the four components sustained this peak activity, both for approximately 3 s (Components 1 and 4). The functional networks that showed sustained activity were characterized by increased activations in the dorsal anterior cingulate cortex, right dorsolateral prefrontal cortex, and left supramarginal gyrus, and decreased activations in the primary auditory cortex and "default network" regions. The functional networks that did not show sustained activity were instead dominated by increased activation in occipital cortex, dorsal anterior cingulate cortex, sensori-motor cortical regions, and superior parietal cortex. The response shapes suggest that although all four components appear to be invoked at encoding, the two sustained-peak components are likely to be additionally involved in the delay period. Our investigation provides a unique view of the contributions made by a network of brain regions over the course of a multiple-stage working memory trial.

Bridging a yawning chasm: EEG investigations into the debate concerning the role of the human mirror neuron system in contagious yawning

Ongoing debate in the literature concerns whether there is a link between contagious yawning and the human mirror neuron system (hMNS). One way of examining this issue is with the use of the electroencephalogram (EEG) to measure changes in mu activation during the observation of yawns. Mu oscillations are seen in the alpha bandwidth of the EEG (8–12 Hz) over sensorimotor areas. Previous work has shown that mu suppression is a useful index of hMNS activation and is sensitive to individual differences in empathy. In two experiments, we presented participants with videos of either people yawning or control stimuli. We found greater mu suppression for yawns than for controls over right motor and premotor areas, particularly for those scoring higher on traits of empathy. In a third experiment, auditory recordings of yawns were compared against electronically scrambled versions of the same yawns. We observed greater mu suppression for yawns than for the controls over right lateral premotor areas. Again, these findings were driven by those scoring highly on empathy. The results from these experiments support the notion that the hMNS is involved in contagious yawning, emphasise the link between contagious yawning and empathy, and stress the importance of good control stimuli.

Revealing and quantifying the impaired phonological analysis underpinning impaired comprehension in Wernicke’s aphasia

Wernicke’s aphasia is a condition which results in severely disrupted language comprehension following a lesion to the left temporo-parietal region. A phonological analysis deficit has traditionally been held to be at the root of the comprehension impairment in WA, a view consistent with current functional neuroimaging which finds areas in the superior temporal cortex responsive to phonological stimuli. However behavioural evidence to support the link between a phonological analysis deficit and auditory comprehension has not been yet shown. This study extends seminal work by Blumstein et al. (1977) to investigate the relationship between acoustic-phonological perception, measured through phonological discrimination, and auditory comprehension in a case series of Wernicke’s aphasia participants. A novel adaptive phonological discrimination task was used to obtain reliable thresholds of the phonological perceptual distance required between nonwords before they could be discriminated. Wernicke’s aphasia participants showed significantly elevated thresholds compared to age and hearing matched control participants. Acoustic-phonological thresholds correlated strongly with auditory comprehension abilities in Wernicke’s aphasia. In contrast, nonverbal semantic skills showed no relationship with auditory comprehension. The results are evaluated in the context of recent neurobiological models of language and suggest that impaired acoustic-phonological perception underlies the comprehension impairment in Wernicke’s aphasia and favour models of language which propose a leftward asymmetry in phonological analysis.