Use of auditory cues for wayfinding assistance in virtual environment: music aids route decision

This paper addresses the crucial problem of wayfinding assistance in the Virtual Environments (VEs). A number of navigation aids such as maps, agents, trails and acoustic landmarks are available to support the user for navigation in VEs, however it is evident that most of the aids are visually dominated. This work-in-progress describes a sound based approach that intends to assist the task of 'route decision' during navigation in a VE using music. Furthermore, with use of musical sounds it aims to reduce the cognitive load associated with other visually as well as physically dominated tasks. To achieve these goals, the approach exploits the benefits provided by music to ease and enhance the task of wayfinding, whilst making the user experience in the VE smooth and enjoyable.

The role of spectral- and temporal-envelope room-acoustic cues in auditory selective attention

Listeners can attend to one of several simultaneous messages by tracking one speaker’s voice characteristics. Using differences in the location of sounds in a room, we ask how well cues arising from spatial position compete with these characteristics. Listeners decided which of two simultaneous target words belonged in an attended “context” phrase when it was played simultaneously with a different “distracter” context. Talker difference was in competition with position difference, so the response indicates which cue‐type the listener was tracking. Spatial position was found to override talker difference in dichotic conditions when the talkers are similar (male). The salience of cues associated with differences in sounds, bearings decreased with distance between listener and sources. These cues are more effective binaurally. However, there appear to be other cues that increase in salience with distance between sounds. This increase is more prominent in diotic conditions, indicating that these cues are largely monaural. Distances between spectra calculated using a gammatone filterbank (with ERB‐spaced CFs) of the room’s impulse responses at different locations were computed, and comparison with listeners’ responses suggested some slight monaural loudness cues, but also monaural “timbre” cues arising from the temporal‐ and spectral‐envelope differences in the speech from different locations.

The use of cues to convergence and accommodation in naive, uninstructed participants

A remote haploscopic video refractor was used to assess vergence and accommodation responses in a group of 32 emmetropic, orthophoric, symptom free, young adults naïve to vision experiments in a minimally instructed setting. Picture targets were presented at four positions between 2 m and 33 cm. Blur, disparity and looming cues were presented in combination or separately to asses their contributions to the total near response in a within-subjects design. Response gain for both vergence and accommodation reduced markedly whenever disparity was excluded, with much smaller effects when blur and proximity were excluded. Despite the clinical homogeneity of the participant group there were also some individual differences.

Accommodation and vergence response gains to different near cues characterize specific esotropias

Aim. To describe preliminary findings of how the profile of the use of blur, disparity and proximal cues varies between non-strabismic groups and those with different types of esotropia. Design. Case control study Methodology. A remote haploscopic photorefractor measured simultaneous convergence and accommodation to a range of targets containing all combinations of binocular disparity, blur and proximal (looming) cues. 13 constant esotropes, 16 fully accommodative esotropes, and 8 convergence excess esotropes were compared with age and refractive error matched controls, and 27 young adult emmetropic controls. All wore full refractive correction if not emmetropic. Response AC/A and CA/C ratios were also assessed. Results. Cue use differed between the groups. Even esotropes with constant suppression and no binocular vision (BV) responded to disparity in cues. The constant esotropes with weak BV showed trends for more stable responses and better vergence and accommodation than those without any BV. The accommodative esotropes made less use of disparity cues to drive accommodation (p=0.04) and more use of blur to drive vergence (p=0.008) than controls. All esotropic groups failed to show the strong bias for better responses to disparity cues found in the controls, with convergence excess esotropes favoring blur cues. AC/A and CA/C ratios existed in an inverse relationship in the different groups. Accommodative lag of >1.0D at 33cm was common (46%) in the pooled esotropia groups compared with 11% in typical children (p=0.05). Conclusion. Esotropic children use near cues differently from matched non-esotropic children in ways characteristic to their deviations. Relatively higher weighting for blur cues was found in accommodative esotropia compared to matched controls.

Developmental changes in the balance of disparity, blur and looming/proximity cues to drive ocular alignment and focus

Accurate co-ordination of accommodation and convergence is necessary to view near objects and develop fine motor co-ordination. We used a remote haploscopic videorefraction paradigm to measure longitudinal changes in simultaneous ocular accommodation and vergence to targets at different depths, and to all combinations of blur, binocular disparity, and change-in-size (“proximity”) cues. Infants were followed longitudinally and compared to older children and young adults, with the prediction that sensitivity to different cues would change during development. Mean infant responses to the most naturalistic condition were similar to those of adults from 6-7 weeks (accommodation) and 8-9 weeks (vergence). Proximity cues influenced responses most in infants less than 14 weeks of age, but sensitivity declined thereafter. Between 12-28 weeks of age infants were equally responsive to all three cues, while in older children and adults manipulation of disparity resulted in the greatest changes in response. Despite rapid development of visual acuity (thus increasing availability of blur cues), responses to blur were stable throughout development. Our results suggest that during much of infancy, vergence and accommodation responses are not dependent on the development of specific depth cues, but make use of any cues available to drive appropriate changes in response.

Consolidation power of extrinsic rewards: reward cues enhance long-term memory for irrelevant past events

Recent research suggests that extrinsic rewards promote memory consolidation through dopaminergic modulation processes. However, no conclusive behavioral evidence exists given that the influence of extrinsic reward on attention and motivation during encoding and consolidation processes are inherently confounded. The present study provides behavioral evidence that extrinsic rewards (i.e., monetary incentives) enhance human memory consolidation independently of attention and motivation. Participants saw neutral pictures, followed by a reward or control cue in an unrelated context. Our results (and a direct replication study) demonstrated that the reward cue predicted a retrograde enhancement of memory for the preceding neutral pictures. This retrograde effect was observed only after a delay, not immediately upon testing. An additional experiment showed that emotional arousal or unconscious resource mobilization cannot explain the retrograde enhancement effect. These results provide support for the notion that the dopaminergic memory consolidation effect can result from extrinsic reward. (PsycINFO Database Record (c) 2013 APA, all rights reserved)(journal abstract)

Association learning for emotional harbinger cues: When do previous emotional associations impair and when do they facilitate subsequent learning of new associations?

Neutral cues that predict emotional events (emotional harbingers) acquire emotional properties and attract attention. Given the importance of emotional harbingers for future survival, it is desirable to flexibly learn new facts about emotional harbingers when needed. However, recent research revealed that it is harder to learn new associations for emotional harbingers than cues that predict non-emotional events (neutral harbingers). In the current study, we addressed whether this impaired association learning for emotional harbingers is altered by one’s awareness of the contingencies between cues and emotional outcomes. Across 3 studies, we found that one’s awareness of the contingencies determines subsequent association learning of emotional harbingers. Emotional harbingers produced worse association learning than neutral harbingers when people were not aware of the contingencies between cues and emotional outcomes, but produced better association learning when people were aware of the contingencies. These results suggest that emotional harbingers do not always suffer from impaired association learning and can show facilitated learning depending on one’s contingency awareness.

Humans use predictive kinematic models to calibrate visual cues to three-dimensional surface slant

When the sensory consequences of an action are systematically altered our brain can recalibrate the mappings between sensory cues and properties of our environment. This recalibration can be driven by both cue conflicts and altered sensory statistics, but neither mechanism offers a way for cues to be calibrated so they provide accurate information about the world, as sensory cues carry no information as to their own accuracy. Here, we explored whether sensory predictions based on internal physical models could be used to accurately calibrate visual cues to 3D surface slant. Human observers played a 3D kinematic game in which they adjusted the slant of a surface so that a moving ball would bounce off the surface and through a target hoop. In one group, the ball’s bounce was manipulated so that the surface behaved as if it had a different slant to that signaled by visual cues. With experience of this altered bounce, observers recalibrated their perception of slant so that it was more consistent with the assumed laws of kinematics and physical behavior of the surface. In another group, making the ball spin in a way that could physically explain its altered bounce eliminated this pattern of recalibration. Importantly, both groups adjusted their behavior in the kinematic game in the same way, experienced the same set of slants and were not presented with low-level cue conflicts that could drive the recalibration. We conclude that observers use predictive kinematic models to accurately calibrate visual cues to 3D properties of world.

Dyspnea-related cues engage the prefrontal cortex - evidence from functional brain imaging in COPD

Dyspnea is the major source of disability in chronic obstructive pulmonary disease (COPD). In COPD, environmental cues (e.g. the prospect of having to climb stairs) become associated with dyspnea, and may trigger dyspnea even before physical activity commences. We hypothesised that brain activation relating to such cues would be different between COPD patients and healthy controls, reflecting greater engagement of emotional mechanisms in patients. Methods: Using FMRI, we investigated brain responses to dyspnea-related word cues in 41 COPD patients and 40 healthy age-matched controls. We combined these findings with scores of self-report questionnaires thus linking the FMRI task with clinically relevant measures. This approach was adapted from studies in pain that enables identification of brain networks responsible for pain processing despite absence of a physical challenge. Results: COPD patients demonstrate activation in the medial prefrontal cortex (mPFC), and anterior cingulate cortex (ACC) which correlated with the visual analogue scale (VAS) response to word cues. This activity independently correlated with patient-reported questionnaires of depression, fatigue and dyspnea vigilance. Activation in the anterior insula, lateral prefrontal cortex (lPFC) and precuneus correlated with the VAS dyspnea scale but not the questionnaires. Conclusions: Our findings suggest that engagement of the brain's emotional circuitry is important for interpretation of dyspnea-related cues in COPD, and is influenced by depression, fatigue, and vigilance. A heightened response to salient cues is associated with increased symptom perception in chronic pain and asthma, and our findings suggest such mechanisms may be relevant in COPD.

The effect of cues on young children’s abilities to discriminate among thoughts, feelings and behaviours

Objective: To determine if cues help young children discriminate among thoughts, feelings and behaviours. Participants: Ninety-six children aged 4–7 years from three schools in Norwich, UK. Design: Within each age band (4, 5, 6, 7), children were randomised to the cue or the no cue condition on a stratified basis ensuring that equal numbers of boys and girls from each school were in each of the eight cells (cue condition×age). Cues were glove puppets and post boxes. The effect of IQ was controlled. Measures: A discrimination task, in which children were asked to identify a thought, a feeling and a behaviour from each of six brief stories, and a brief IQ assessment were administered to children individually. Results: There was a significant effect of age and cue condition on performance; older children and those who were presented with the cue performed better. There were no gender differences and no interaction between cue condition and age. Conclusion: Many young children discriminated among thoughts, feelings and behaviours suggesting that they may be able to engage in this aspect of cognitive behaviour therapy. Simple cues (puppets and posting boxes) improved children’s performance and these may be useful therapeutic tools with young children.

Motion Cues Analysis for Parkinson Gait Recognition

Background: Previous assessment methods for PG recognition used sensor mechanisms for PG that may cause discomfort. In order to avoid stress of applying wearable sensors, computer vision (CV) based diagnostic systems for PG recognition have been proposed. Main constraints in these methods are the laboratory setup procedures: Novel colored dresses for the patients were specifically designed to segment the test body from a specific colored background. Objective: To develop an image processing tool for home-assessment of Parkinson Gait(PG) by analyzing motion cues extracted during the gait cycles. Methods: The system is based on the idea that a normal body attains equilibrium during the gait by aligning the body posture with the axis of gravity. Due to the rigidity in muscular tone, persons with PD fail to align their bodies with the axis of gravity. The leaned posture of PD patients appears to fall forward. Whereas a normal posture exhibits a constant erect posture throughout the gait. Patients with PD walk with shortened stride angle (less than 15 degrees on average) with high variability in the stride frequency. Whereas a normal gait exhibits a constant stride frequency with an average stride angle of 45 degrees. In order to analyze PG, levodopa-responsive patients and normal controls were videotaped with several gait cycles. First, the test body is segmented in each frame of the gait video based on the pixel contrast from the background to form a silhouette. Next, the center of gravity of this silhouette is calculated. This silhouette is further skeletonized from the video frames to extract the motion cues. Two motion cues were stride frequency based on the cyclic leg motion and the lean frequency based on the angle between the leaned torso tangent and the axis of gravity. The differences in the peaks in stride and lean frequencies between PG and normal gait are calculated using Cosine Similarity measurements. Results: High cosine dissimilarity was observed in the stride and lean frequencies between PG and normal gait. High variations are found in the stride intervals of PG whereas constant stride intervals are found in the normal gait. Conclusions: We propose an algorithm as a source to eliminate laboratory constraints and discomfort during PG analysis. Installing this tool in a home computer with a webcam allows assessment of gait in the home environment.

The effect of contextual cues on children`s ability to remember an occurence of a repeated event

Purpose. This study examined the usefulness of contextual cues in enhancing the accuracy of children's narrative accounts of an occurrence of a repeated event.

Method. Children aged 6 to 7 years took part in the same staged event four times whereby 16 target details varied in each occurrence (e.g. the colour of a cloak varied each time). Three days later, the children's free recall of the final occurrence was elicited. This occurrence was identified in one of two ways. Either it was identified via the temporal term 'last', or else the term 'last' was combined with a feature related to the environmental context or setting that was unique to the occurrence (i.e., the interviewer referred to a new object that was worn throughout the occurrence or a new person who carried out the event). For each condition, performance was compared to that of children who experienced the event only once.

Results. Children's memory of details specific to the target occurrence was better after the single than the repeated event. However for both event types, children who were given the contextual and temporal cue performed better than those who were given the temporal cue only. The benefit of using a contextual cue did not result in an increase in errors.

Conclusion. Contextual cues (generated by an interviewer) can facilitate children's recall of an occurrence of an event. However, further research needs to determine whether this finding would generalize to a more practical situation where the child (rather than the interviewer) generates the cues.

Reactivity to alcohol-related cues: relationship among cue type, motivational processes, and personality

This study examined the relationship between personality traits implicated in the drinking literature (i.e., sensation seeking and anxiety) and reactivity to 2 different alcohol cues. The opportunity to consume alcohol was manipulated, and differences in urge and affective reactivity were assessed. Gray’s (1987) model of impulsive sensation seeking and anxiety was adopted to investigate relationships between personality and responses to the appetitive (consumption) and aversive (no consumption, nonrewarding) alcohol cues in 40 regular social drinkers. The consumption cue produced increases in appetitive motivation and positive correlations with sensation-seeking traits. The no-consumption cue produced increases in aversive motivation and positive correlations with anxiety-related traits. It was concluded that Gray’s model of impulsive sensation seeking and anxiety may provide a useful framework for examining the personality correlates of cue reactivity to different cues.

The influence of sensitivity to reward on reactivity to alcohol-related cues

Aims. To investigate the role of sensitivity to reward in mediating social drinkers' reactivity to alcohol cues. Design. A standard cue-reactivity paradigm was employed. Two groups of social drinkers (heavy and ight) were assessed after exposure to the sight, smell and taste of a neutral cue (water) and then an alcohol cue (glass of beer). Setting. Sessions were conducted in a laboratory based environment. Participants. Twenty heavy (12 males, eight females) and 18 light social drinkers (seven males, 11 females) were recruited; mean age was 23.6 years. Measurements. The Card Arranging Reward Responsivity Objective Test (CARROT), assessing behavioural responsiveness to a monetary incentive; urge to drink; positive affect; and the BAS scales, assessing sensitivity to reward. Findings. Heavy drinkers displayed a significant increase in responsivity to rewards (i.e. CARROT) and self-reported urge to drink, bur not positive affect, after exposure to alcohol. For the heavy drinkers, heightened sensitivity to reward (i.e. BAS scales) was significantly related to cue-elicited urge to drink and positive affect. Conclusion. The results are consistent with a conditioned appetitive motivational model of alcohol use and suggest that Gray's theory of personality may be of some benefit in explaining variation in reactivity responses.