3-D Audio in Mobile Communication Devices: Effects of Self-Created and External Sounds on Presence in Auditory Virtual Environments

This article describes a series of experiments which were carried out to measure the sense of presence in auditory virtual environments. Within the study a comparison of self-created signals to signals created by the surrounding environment is drawn. Furthermore, it is investigated if the room characteristics of the simulated environment have consequences on the perception of presence during vocalization or when listening to speech. Finally the experiments give information about the influence of background signals on the sense of presence. In the experiments subjects rated the degree of perceived presence in an auditory virtual environment on a perceptual scale. It is described which parameters have the most influence on the perception of presence and which ones are of minor influence. The results show that on the one hand an external speaker has more influence on the sense of presence than an adequate presentation of one’s own voice. On the other hand both room reflections and adequately presented background signals significantly increase the perceived presence in the virtual environment.

Event-related potential P300 microstate topography during visual one- and two-dimensional tasks in chronic schizophrenics

Reports on left-lateralized abnormalities of component P300 of event-related brain potentials (ERP) in schizophrenics typically did not vary task difficulties. We collected 16-channel ERP in 13 chronic, medicated schizophrenics (25±4.9 years) and 13 matched controls in a visual P300 paradigm with targets defined by one or two stimulus dimensions (C1: color; C2: color and tilt); subjects key-pressed to targets. The mean target-ERP map landscapes were assessed numerically by the locations of the positive and negative map-area centroids. The centroids' time-space trajectories were searched for the P300 microstate landscape defined by the positive centroid posterior of the negative centroid. At P300 microstate centre latencies in C1, patients' maps tended to a right shift of the positive centroid (p<0.10); in C2 the anterior centroid was more posterior (p<0.07) and the posterior (positive) centroid more anterior (p<0.03), but without leftright difference. Duration of P300 microstate in C2 was shorter in patients (232 vs 347 ms;p<0.03) and the latency of maximal strength of P300 microstate increased significantly in patients (C1: 459 vs 376 ms; C2: 585 vs 525 ms). In summary only the one-dimensional task C1 supported left-sided abnormalities; the two-dimensional task C2 produced abnormal P300 microstate map landscapes in schizophrenics, but no abnormal lateralization. Thus, information processing involved clearly aberrant neural populations in schizophrenics, different when processing one and two stimulus dimensions. The lack of lateralization in the two-dimensional task supported the view that left-temporal abnormality in schizophrenics is only one of several task-dependent aberrations.

Event-related electric microstates of the brain differ between words with visual and abstract meaning

The present study shows that different neural activity during mental imagery and abstract mentation can be assigned to well-defined steps of the brain's information-processing. During randomized visual presentation of single, imagery-type and abstract-type words, 27 channel event-related potential (ERP) field maps were obtained from 25 subjects (sequence-divided into a first and second group for statistics). The brain field map series showed a sequence of typical map configurations that were quasi-stable for brief time periods (microstates). The microstates were concatenated by rapid map changes. As different map configurations must result from different spatial patterns of neural activity, each microstate represents different active neural networks. Accordingly, microstates are assumed to correspond to discrete steps of information-processing. Comparing microstate topographies (using centroids) between imagery- and abstract-type words, significantly different microstates were found in both subject groups at 286–354 ms where imagery-type words were more right-lateralized than abstract-type words, and at 550–606 ms and 606–666 ms where anterior-posterior differences occurred. We conclude that language-processing consists of several, well-defined steps and that the brain-states incorporating those steps are altered by the stimuli's capacities to generate mental imagery or abstract mentation in a state-dependent manner.

Prestimulus EEG microstates influence visual event-related potential microstates in field maps with 47 channels

The influence of the immediate prestimulus EEG microstate (sub-second epoch of stable topography/map landscape) on the map landscape of visually evoked 47-channel event-related potential (ERP) microstates was examined using the frequent, non-target stimuli of a cognitive paradigm (12 volunteers). For the two most frequent prestimulus microstate classes (oriented left anterior-right posterior and right anterior-left posterior), ERP map series were selectively averaged. The post-stimulus ERP grand average map series was segmented into microstates; 10 were found. The centroid locations of positive and negative map areas were extracted as landscape descriptors. Significant differences (MANOVAs and t-tests) between the two prestimulus classes were found in four of the ten ERP microstates. The relative orientation of the two ERP microstate classes was the same as prestimulus in some ERP microstates, but reversed in others. — Thus, brain electric microstates at stimulus arrival influence the landscapes of the post-stimulus ERP maps and therefore, information processing; prestimulus microstate effects differed for different post-stimulus ERP microstates.

Intelligence is related to specific processes in visual change detection: Fixed-links modeling of hit rate and reaction time

By means of fixed-links modeling, the present study identified different processes of visual short-term memory (VSTM) functioning and investigated how these processes are related to intelligence. We conducted an experiment where the participants were presented with a color change detection task. Task complexity was manipulated through varying the number of presented stimuli (set size). We collected hit rate and reaction time (RT) as indicators for the amount of information retained in VSTM and speed of VSTM scanning, respectively. Due to the impurity of these measures, however, the variability in hit rate and RT was assumed to consist not only of genuine variance due to individual differences in VSTM retention and VSTM scanning but also of other, non-experimental portions of variance. Therefore, we identified two qualitatively different types of components for both hit rate and RT: (1) non-experimental components representing processes that remained constant irrespective of set size and (2) experimental components reflecting processes that increased as a function of set size. For RT, intelligence was negatively associated with the non-experimental components, but was unrelated to the experimental components assumed to represent variability in VSTM scanning speed. This finding indicates that individual differences in basic processing speed, rather than in speed of VSTM scanning, differentiates between high- and low-intelligent individuals. For hit rate, the experimental component constituting individual differences in VSTM retention was positively related to intelligence. The non-experimental components of hit rate, representing variability in basal processes, however, were not associated with intelligence. By decomposing VSTM functioning into non-experimental and experimental components, significant associations with intelligence were revealed that otherwise might have been obscured.

Characteristics of visual hallucinations in Parkinson disease dementia and dementia with Lewy bodies

OBJECTIVE Parkinson disease dementia (PDD) and dementia with Lewy bodies (DLB) have overlapping clinical and pathologic features. Recurrent visual hallucinations (RVH) are common in both disorders. The authors have compared details of hallucination characteristics and associated neuropsychiatric features in DLB and PDD. METHODS This is a descriptive, cross-sectional study using the Institute of Psychiatry Visual Hallucinations Interview (IP-VHI) to explore self-reported frequency, duration, and phenomenology of RVH in PDD and DLB. The caregivers' ratings of hallucinations and other neuropsychiatric features were elicited with the Neuropsychiatric Inventory (NPI). RESULTS Fifty-six patients (35 PDD; 21 DLB) with RVH were assessed. Hallucination characteristics were similar in both disorders. Simple hallucinations were rare. Most patients experienced complex hallucinations daily, normally lasting minutes. They commonly saw people or animals and the experiences were usually perceived as unpleasant. NPI anxiety scores were higher in PDD. Neuropsychiatric symptoms coexisting with hallucinations were apathy, sleep disturbance, and anxiety. CONCLUSIONS Patients with mild to moderate dementia can provide detailed information about their hallucinations. Characteristics of RVH were similar in PDD and DLB, and phenomenology suggests the involvement of dorsal and ventral visual pathways in their generation. The coexistence of RVH with anxiety, apathy, and sleep disturbance is likely to impair patients' quality of life and may have treatment implications.

QoE-aware Multiple Path Video Transmission for Wireless Multimedia Sensor Networks

Wireless Multimedia Sensor Networks (WMSNs) promise a wide scope of emerging potential applications in both civilian and military areas, which require visual and audio information to enhance the level of collected information. The transmission of multimedia content requires a minimal video quality level from the user’s perspective. However, links in WMSN communi- cations are typically unreliable, as they often experience fluctuations in quality and weak connectivity, and thus, the routing protocol must evaluate the routes by using end-to-end link quality information to increase the packet delivery ratio. Moreover, the use multiple paths together with key video metrics can enhance the video quality level. In this paper, we propose a video-aware multiple path hierarchical routing protocol for efficient multimedia transmission over WMSN, called video-aware MMtransmission. This protocol finds node-disjoint multiple paths, and implements an end-to-end link quality estimation with minimal over- head to score the paths. Thus, our protocol assures multimedia transmission with Quality of Experience (QoE) and energy-efficiency support. The simula- tion results show the benefits of video-aware MMtransmission for disseminating video content by means of energy-efficiency and QoE analysis.

The assessment of visual short-term memory in considering the underlying processes and their relation to psychometric intelligence

By means of fixed-links modeling the present study assessed processes involved in visual short-term memory functioning and investigates how these processes are related to intelligence. Using a color change detection task, short-term memory demands increased across three experimental conditions as a function of number of presented stimuli. We measured amount of information retained in visual short-term memory by hit rate as well as speed of visual short-term memory scanning by reaction time. For both measures, fixed-links modeling revealed a constant process reflecting processes irrespective of task manipulation as well as two increasing processes reflecting the increasing short-term memory demands. For visual short-term memory scanning, a negative association between intelligence and the constant process was found but no relationship between intelligence and the increasing processes. Thus, basic processing speed, rather than speed influenced by visual short-term memory demands, differentiates between high- and low-intelligent individuals. Intelligence was positively related to the experimental processes of shortterm memory retention but not to the constant process. In sum, significant associations with intelligence were only obtained when the specific processes of short-term memory were decomposed emphasizing the importance of a thorough assessment of cognitive processes when investigating their relation to intelligence.

The gender typicality of faces and its impact on visual processing and on hiring decisions

Past research has shown that the gender typicality of applicants’ faces affects leadership selection irrespective of a candidate’s gender: A masculine facial appearance is congruent with masculine-typed leadership roles, thus masculine-looking applicants are hired more certainly than feminine-looking ones. In the present study, we extended this line of research by investigating hiring decisions for both masculine- and feminine-typed professional roles. Furthermore, we used eye tracking to examine the visual exploration of applicants’ portraits. Our results indicate that masculine-looking applicants were favored for the masculine-typed role (leader) and feminine-looking applicants for the feminine-typed role (team member). Eye movement patterns showed that information about gender category and facial appearance was integrated during first fixations of the portraits. Hiring decisions, however, were not based on this initial analysis, but occurred at a second stage, when the portrait was viewed in the context of considering the applicant for a specific job.

Narrated PowerPoints and Audio Podcasts in Clinical Teaching: One Clerkship's Experience

Introduction: Clinical medical education is increasingly utilizing novel technological approaches in order to supplement traditional lecture-based didactics. The Neurology Core Clerkship at Baylor College of Medicine is a four week required course taken by clinical medical students. Given the large amount of information to be disseminated in a short period of time, part of the didactic material has been provided online in the form of narrated PowerPoint files or lecture audio tracks along with stand-alone PowerPoint files. The narrated files are generated using the native PowerPoint narration function while the stand-alone audio files are created as MP3 format files using an inexpensive digital recording device. [See PDF for complete abstract]

Performance on auditory and visual temporal informationprocessing is related to psychometric intelligence

The present study investigated the relationship between psychometric intelligence and temporal resolution power (TRP) as simultaneously assessed by auditory and visual psychophysical timing tasks. In addition, three different theoretical models of the functional relationship between TRP and psychometric intelligence as assessed by means of the Adaptive Matrices Test (AMT) were developed. To test the validity of these models, structural equation modeling was applied. Empirical data supported a hierarchical model that assumed auditory and visual modality-specific temporal processing at a first level and amodal temporal processing at a second level. This second-order latent variable was substantially correlated with psychometric intelligence. Therefore, the relationship between psychometric intelligence and psychophysical timing performance can be explained best by a hierarchical model of temporal information processing.

Patient and Informant Views on Visual Hallucinations in Parkinson Disease.

OBJECTIVE Visual hallucinations (VHs) are a very personal experience, and it is not clear whether information about them is best provided by informants or patients. Some patients may not share their hallucinatory experiences with caregivers to avoid distress or for fear of being labeled insane, and others do not have informants at all, which limits the use of informant-based questionnaires. The aim of this study was to compare patient and caregiver views about VHs in Parkinson disease (PD), using the North-East Visual Hallucinations Interview (NEVHI). METHODS Fifty-nine PD patient-informant pairs were included. PD patients and informants were interviewed separately about VHs using the NEVHI. Informants were additionally interviewed using the four-item version of the Neuropsychiatric Inventory. Inter-reliability and concurrent validity of the different measures were compared. RESULTS VHs were more commonly reported by patients than informants. The inter-rater agreement between NEVHI-patient and NEVHI-informant was moderate for complex VHs (Cohen's kappa = 0.44; 95% confidence interval [CI]: 0.13-0.75; t = 3.43, df = 58, p = 0.001) and feeling of presence (Cohen's kappa = 0.35; 95% CI: 0.00-0.70; t = 2.75, df = 58, p = 0.006), but agreement was poor for illusions (Cohen's kappa = 0.25; 95% CI: -0.07-0.57; t = 2.36, df = 58, p = 0.018) and passage hallucinations (Cohen's kappa = 0.16; 95% CI: -0.04-0.36; t = 2.26, df = 58, p = 0.024). CONCLUSION When assessing VHs in PD patients, it is best to rely on patient information, because not all patients share the details of their hallucinations with their caregivers.

Response to neoadjuvant treatment of invasive ductal breast carcinomas including outcome evaluation: MRI analysis by an automatic CAD system in comparison to visual evaluation

BACKGROUND The aim of this study was to evaluate imaging-based response to standardized neoadjuvant chemotherapy (NACT) regimen by dynamic contrast-enhanced magnetic resonance mammography (DCE-MRM), whereas MR images were analyzed by an automatic computer-assisted diagnosis (CAD) system in comparison to visual evaluation. MRI findings were correlated with histopathologic response to NACT and also with the occurrence of metastases in a follow-up analysis. PATIENTS AND METHODS Fifty-four patients with invasive ductal breast carcinomas received two identical MRI examinations (before and after NACT; 1.5T, contrast medium gadoteric acid). Pre-therapeutic images were compared with post-therapeutic examinations by CAD and two blinded human observers, considering morphologic and dynamic MRI parameters as well as tumor size measurements. Imaging-assessed response to NACT was compared with histopathologically verified response. All clinical, histopathologic, and DCE-MRM parameters were correlated with the occurrence of distant metastases. RESULTS Initial and post-initial dynamic parameters significantly changed between pre- and post-therapeutic DCE-MRM. Visually evaluated DCE-MRM revealed sensitivity of 85.7%, specificity of 91.7%, and diagnostic accuracy of 87.0% in evaluating the response to NACT compared to histopathology. CAD analysis led to more false-negative findings (37.0%) compared to visual evaluation (11.1%), resulting in sensitivity of 52.4%, specificity of 100.0%, and diagnostic accuracy of 63.0%. The following dynamic MRI parameters showed significant associations to occurring metastases: Post-initial curve type before NACT (entire lesions, calculated by CAD) and post-initial curve type of the most enhancing tumor parts after NACT (calculated by CAD and manually). CONCLUSIONS In the accurate evaluation of response to neoadjuvant treatment, CAD systems can provide useful additional information due to the high specificity; however, they cannot replace visual imaging evaluation. Besides traditional prognostic factors, contrast medium-induced dynamic MRI parameters reveal significant associations to patient outcome, i.e. occurrence of distant metastases.

The Neuroscience of Visual Hallucinations

Each year, some two million people in the United Kingdom experience visual hallucinations. Infrequent, fleeting visual hallucinations, often around sleep, are a usual feature of life. In contrast, consistent, frequent, persistent hallucinations during waking are strongly associated with clinical disorders; in particular delirium, eye disease, psychosis, and dementia. Research interest in these disorders has driven a rapid expansion in investigatory techniques, new evidence, and explanatory models. In parallel, a move to generative models of normal visual function has resolved the theoretical tension between veridical and hallucinatory perceptions. From initial fragmented areas of investigation, the field has become increasingly coherent over the last decade. Controversies and gaps remain, but for the first time the shapes of possible unifying models are becoming clear, along with the techniques for testing these. This book provides a comprehensive survey of the neuroscience of visual hallucinations and the clinical techniques for testing these. It brings together the very latest evidence from cognitive neuropsychology, neuroimaging, neuropathology, and neuropharmacology, placing this within current models of visual perception. Leading researchers from a range of clinical and basic science areas describe visual hallucinations in their historical and scientific context, combining introductory information with up-to-date discoveries. They discuss results from the main investigatory techniques applied in a range of clinical disorders. The final section outlines future research directions investigating the potential for new understandings of veridical and hallucinatory perceptions, and for treatments of problematic hallucinations. Fully comprehensive, this is an essential reference for clinicians in the fields of the psychology and psychiatry of hallucinations, as well as for researchers in departments, research institutes and libraries. It has strong foundations in neuroscience, cognitive science, optometry, psychiatry, psychology, clinical medicine, and philosophy. With its lucid explanation and many illustrations, it is a clear resource for educators and advanced undergraduate and graduate students.

Larger visual stimuli are perceived to last longer from time to time: The internal clock is not affected by nontemporal visual stimulus size

Performance on interval timing is often explained by the assumption of an internal clock based on neural counting. According to this account, a neural pacemaker generates pulses, and the number of pulses relating to a physical time interval is recorded by a counter. Thus, the number of accumulated pulses is the internal representation of this interval. Several studies demonstrated that large visual stimuli are perceived to last longer than smaller ones presented for the same duration. The present study was designed to investigate whether nontemporal visual stimulus size directly affects the internal clock. For this purpose, a temporal reproduction task was applied. Sixty participants were randomly assigned to one of two experimental conditions with stimulus size being experimentally varied within either the target or the reproduction interval. A direct effect of nontemporal stimulus size on the pacemaker-counter system should become evident irrespective of whether stimulus size was experimentally varied within the target or the reproduction interval. An effect of nontemporal stimulus size on reproduced duration only occurred when stimulus size was varied during the target interval. This finding clearly argues against the notion that nontemporal visual stimulus size directly affects the internal clock. Furthermore, our findings ruled out a decisional bias as a possible cause of the observed differential effect of stimulus size on reproduced duration. Rather the effect of stimulus size appeared to originate from the memory stage of temporal information processing at which the timing signal from the pacemaker-counter component is encoded in reference memory.