Spatial audition in a static virtual environment : the role of auditory-visual interaction

The integration of the auditory modality in virtual reality environments is known to promote the sensations of immersion and presence. However it is also known from psychophysics studies that auditory-visual interaction obey to complex rules and that multisensory conflicts may disrupt the adhesion of the participant to the presented virtual scene. It is thus important to measure the accuracy of the auditory spatial cues reproduced by the auditory display and their consistency with the spatial visual cues. This study evaluates auditory localization performances under various unimodal and auditory-visual bimodal conditions in a virtual reality (VR) setup using a stereoscopic display and binaural reproduction over headphones in static conditions. The auditory localization performances observed in the present study are in line with those reported in real conditions, suggesting that VR gives rise to consistent auditory and visual spatial cues. These results validate the use of VR for future psychophysics experiments with auditory and visual stimuli. They also emphasize the importance of a spatially accurate auditory and visual rendering for VR setups.

Judgments of duration, figure-ground contrast, and size for words and nonwords

Does the word-superiority effect on letter discrimination result in a word-superiority effect on duration judgments? We examined this question in five experiments. In the first four experiments, we have demonstrated that (1) words shown for 32-80 msec were judged as presented longer than non-words shown for the same duration; (2) this word-superiority effect persists if the stimuli are shown for an objective duration of up to 250 msec; and (3) these effects can be extended to judgments of figure-ground contrast and letter size. These findings extend existing data on effects of processing fluency on perceptual judgments. In Experiment 5, we found that duration judgments were higher for words than for pronounceable nonwords, and duration judgments were higher for pronounceable non-words than for nonpronounceable nonwords. We discuss the implications of this finding for the discrepancy-attribution hypothesis.

Weber fractions and time-order errors for long and short durations: Implications for modeling

Using a weighted up-down procedure, in each of eight conditions 28 participants compared durations of auditory (noise bursts) or visual (LED flashes) intervals; filled or unfilled with 3-ms markers; with or without feedback. Standards (Sts) were 100 and 1000 ms, and the ISI 900 ms. Intermixedly, presentation orders were St-Comparison (Co) and Co-St. TOEs were positive for St=100-ms and negative for St=1000 ms. Weber fractions (WFs, JND/St) were lowered by feedback. For visual-filled and visual-empty, WFs were highest for St=100 ms. For auditory-filled and visual-empty, St interacted with Order: lowest WFs occurred for St-Co with St=1000 ms, but for Co-St with St=100 ms. Lowest average WFs occurred with St-Co for visual-filled, but with Co-St for visual-empty. The results refute the generalization of better discrimination with St-Co than with Co-St (”type-B effect”), and support the notion of sensation weighting: flexibly differential impact weights of the compared durations in generating the response.

Mechanisms of perceptual learning of depth discrimination in random dot stereograms.

Perceptual learning is a training induced improvement in performance. Mechanisms underlying the perceptual learning of depth discrimination in dynamic random dot stereograms were examined by assessing stereothresholds as a function of decorrelation. The inflection point of the decorrelation function was defined as the level of decorrelation corresponding to 1.4 times the threshold when decorrelation is 0%. In general, stereothresholds increased with increasing decorrelation. Following training, stereothresholds and standard errors of measurement decreased systematically for all tested decorrelation values. Post training decorrelation functions were reduced by a multiplicative constant (approximately 5), exhibiting changes in stereothresholds without changes in the inflection points. Disparity energy model simulations indicate that a post-training reduction in neuronal noise can sufficiently account for the perceptual learning effects. In two subjects, learning effects were retained over a period of six months, which may have application for training stereo deficient subjects.

The temporal impulse response function in infantile nystagmus.

Despite rapid to-and-fro motion of the retinal image that results from their incessant involuntary eye movements, persons with infantile nystagmus (IN) rarely report the perception of motion smear. We performed two experiments to determine if the reduction of perceived motion smear in persons with IN is associated with an increase in the speed of the temporal impulse response. In Experiment 1, increment thresholds were determined for pairs of successively presented flashes of a long horizontal line, presented on a 65-cd/m2 background field. The stimulus-onset asynchrony (SOA) between the first and second flash varied from 5.9 to 234 ms. In experiment 2, temporal contrast sensitivity functions were determined for a 3-cpd horizontal square-wave grating that underwent counterphase flicker at temporal frequencies between 1 and 40 Hz. Data were obtained for 2 subjects with predominantly pendular IN and 8 normal observers in Experiment 1 and for 3 subjects with IN and 4 normal observers in Experiment 2. Temporal impulse response functions (TIRFs) were estimated as the impulse response of a linear second-order system that provided the best fit to the increment threshold data in Experiment 1 and to the temporal contrast sensitivity functions in Experiment 2. Estimated TIRFs of the subjects with pendular IN have natural temporal frequencies that are significantly faster than those of normal observers (ca. 13 vs. 9 Hz), indicating an accelerated temporal response to visual stimuli. This increase in response speed is too small to account by itself for the virtual absence of perceived motion smear in subjects with IN, and additional neural mechanisms are considered.