Auditory localisation reversals and the role of torso-related cues

Human auditory localisation reversals are explored using mixture distribution analysis techniques. This is validated for front/back reversals and subsequently shown to provide evidence for up/down reversals as distinct classes of mis-localisation. Torso-related localisation cues are identified and also shown to provide a source for resolving these reversals in some listeners.

Spatial and temporal disparities in aurally aided visual search

Research over the last decade has shown that auditorily cuing the location of visual targets reduces the time taken to locate and identify targets for both free-field and virtually presented sounds. The first study conducted for this thesis confirmed these findings over an extensive region of free-field space. However, the number of sound locations that are measured and stored in the data library of most 3-D audio spatial systems is limited, so that there is often a discrepancy in position between the cued and physical location of the target. Sampling limitations in the systems also produce temporal delays in which the stored data can be conveyed to operators. To investigate the effects of spatial and temporal disparities in audio cuing of visual search, and to provide evidence to alleviate concerns that psychological research lags behind the capabilities to design and implement synthetic interfaces, experiments were conducted to examine (a) the magnitude of spatial separation, and (b) the duration of temporal delay that intervened between auditory spatial cues and visual targets to alter response times to locate targets and discriminate their shape, relative to when the stimuli were spatially aligned, and temporally synchronised, respectively. Participants listened to free-field sound localisation cues that were presented with a single, highly visible target that could appear anywhere across 360° of azimuthal space on the vertical mid-line (spatial separation), or extended to 45° above and below the vertical mid-line (temporal delay). A vertical or horizontal spatial separation of 40° between the stimuli significantly increased response times, while separations of 30° or less did not reach significance. Response times were slowed at most target locations when auditory cues occurred 770 msecs prior to the appearance of targets, but not with similar durations of temporal delay (i.e., 440 msecs or less). When sounds followed the appearance of targets, the stimulus onset asynchrony that affected response times was dependent on target location, and ranged from 440 msecs at higher elevations and rearward of participants, to 1,100 msecs on the vertical mid-line. If targets appeared in the frontal field of view, no delay of acoustical stimulation affected performance. Finally, when conditions of spatial separation and temporal delay were combined, visual search times were degraded with a shorter stimulus onset asynchrony than when only the temporal relationship between the stimuli was varied, but responses to spatial separation were unaffected. The implications of the results for the development of synthetic audio spatial systems to aid visual search tasks was discussed.

Separating the contributions of hearing, lexical knowledge and speech production to speech perception scores in children with hearing impairments.

Open-set word and sentence speech-perception test scores are commonly used as a measure of hearing abilities in children and adults using cochlear implants and/or hearing aids. These tests are usually presented auditorily with a verbal response. In the case of children, scores are typically lower and more variable than for adults with hearing impairments using similar devices. It is difficult to interpret children's speech-perception scores without considering the effects of lexical knowledge and speech-production abilities on their responses. This study postulated a simple mathematical model to describe the effects of hearing, lexical knowledge, and speech production on the perception test scores for monosyllabic words by children with impaired hearing. Thirty-three primary-school children with impaired hearing, fitted with hearing aids and/or cochlear implants, were evaluated using speech-perception, reading-aloud, speech-production, and language measures. These various measures were incorporated in the mathematical model, which revealed that performance in an open-set word-perception test in the auditory-alone mode is strongly dependent on residual hearing levels, lexical knowledge, and speech-production abilities. Further applications of the model provided an estimate of the effect of each component on the overall speech-perception score for each child.

User-centered design and evaluation of an interactive visual-haptic-auditory interface : a user study on assembly

Utilizing user-centred system design and evaluation method has become an increasingly important tool to foster better usability in the field of virtual environments (VEs). In recent years, although it is still the norm that designers and developers are concerning the technological advancement and striving for designing impressive multimodal multisensory interfaces, more and more awareness are aroused among the development team that in order to produce usable and useful interfaces, it is essential to have users in mind during design and validate a new design from users' perspective. In this paper, we describe a user study carried out to validate a newly developed haptically enabled virtual training system. By taking consideration of the complexity of individual differences on human performance, adoption and acceptance of haptic and audio-visual I/O devices, we address how well users learn, perform, adapt to and perceive object assembly training. We also explore user experience and interaction with the system, and discuss how multisensory feedback affects user performance, perception and acceptance. At last, we discuss how to better design VEs that enhance users perception, their interaction and motor activity.

The perception of racism in ambiguous scenarios

Recent theorising on the nature of racism suggests that over the last few decades it has come to be expressed in more subtle and ambiguous ways because while many Whites proclaim egalitarian values, their cognitions and behaviour are influenced by prejudices that are buried deep in their psyche. This leads to the possibility that those who perpetrate and those who experience racism may have different interpretations of events that involve racism. Essed (1991) has suggested that because they are exposed to racism systematically, those who experience racism are in a good position to detect it if they have both knowledge of normal behaviour for particular situations, and a general knowledge of racism. Using Essed's model of the assessment of racist events, the descriptions of six videotaped ambiguously racist scenarios given by 40 Caucasian students and 40 Asian students were analysed to determine whether situational or general knowledge of racism was evident. Contrary to expectations, the Asian students, who belong to a group targeted with racism in Australia, were less likely to see racism in the scenarios. Finding the scenarios to be acceptable indicated a lack of situational knowledge and, hence, an inability to use general knowledge of racism if it exists. The role of cultural values in the application of situational knowledge is discussed, and further empirical investigations of Essed's model are proposed.

Psychological correlates of perception of sexual intent in women

In a sample of 183 men and 186 women, the authors assessed (a) the relative contributions of gender and level of nonverbal social cues to the perception of a female actor's sexual intent during a videotaped social interaction with a man and (b) the association between those variables and personality traits implicated in faulty sexual-information processing. The authors assessed those variables while the participants viewed 1 of 3 film segments depicting a female-male interaction. The authors experimentally manipulated eye contact, touch, physical proximity, and female clothing. At all levels of those nonverbal cues, the men perceived more sexual intent in the female actor than did the women. The perception of the female actor's sexual intent increased as the nonverbal cues in the film segments were magnified: Both actors displayed more eye contact, touch, and physical proximity, and the female actor wore more revealing clothing. Relative to the women, the men demonstrated greater sexual preoccupation and reduced sociosexual effectiveness, variables associated with inferring greater sexual intent in the female actor.

Visual perception of action categories and the "bowl-throw" decision in cricket.

Cricket umpires, cricket bowlers, and physical education students (who were knowledgeable about the rules of cricket), were shown 72 videotaped point-light displays of cricket deliveries with varying extents of elbow flexion such that they ranged from highly “bowl-like” to highly “throw-like”. The observers made a bowl-throw decision about each display, and the umpires and bowlers reported their confidence on a 5-point scale. The percentage of displays reported as a “bowl” was 59, 40, and 44 for the umpires, bowlers, and students respectively. Umpires made significantly more bowl decisions than both the bowlers and students, but there was no difference between the latter groups. Umpires were significantly more confident than the bowlers in both their bowl and throw decisions. Thus, in an experimental setting, with no apparent costs or benefits associated with their decision-makin, umpires “called” a bowler significantly less frequently for throwing than other knowledgeable observers. The procedures devised for this experiment demonstrate that psychophysical methods can be applied to the problem of discrete action-category nominations in sport (e.g., bowl or throw, walk or run).

Visual perception of movement kinematics and the acquisition of "action prototypes"

Recognizing a class of movements as belonging to a "nominal" action category, such as walking, running, or throwing, is a fundamental human ability. Three experiments were undertaken to test the hypothesis that common ("prototypical") features of moving displays could be learned by observation. Participants viewed moving stick-figure displays resembling forearm flexion movements in the saggital plane. Four displays (presentation displays) were first presented in which one or more movement dimensions were combined with 2 respective cues: direction (up, down), speed (fast, slow), and extent (long, short). Eight test displays were then shown, and the observer indicated whether each test display was like or unlike those previously seen. The results showed that without corrective feedback, a single cue (e.g., up or down) could be correctly recognized, on average, with the proportion correct between .66 and .87. When two cues were manipulated (e.g., up and slow), recognition accuracy remained high, ranging between .72 and .89. Three-cue displays were also easily identified. These results provide the first empirical demonstration of action-prototype learning for categories of human action and show how apparently complex kinematic patterns can be categorized in terms of common features or cues. It was also shown that probability of correct recognition of kinematic properties was reduced when the set of 4 presentation displays were more variable with respect to their shared kinematic property, such as speed or amplitude. Finally, while not conclusive, the results (from 2 of the 3 experiments) did suggest that similarity (or "likeness") with respect to a common kinematic property (or properties) is more easily recognized than dissimilarity.