Transcending the self in immersive virtual reality

Cognitive neuroscientists have discovered various experimental setups that suggest that our body representation is surprisingly flexible, where the brain can easily be tricked into the illusion that a rubber hand is your hand or that a manikin body is your body. These multisensory illusions work well in immersive virtual reality (IVR). What is even more surprising is that such embodiment induces perceptual, attitudinal and behavioural changes that are concomitant with the displayed body type. Here we outline some recent findings in this field, and suggest that this offers a powerful tool for neuroscience, psychology and a new path for IVR.

Role of Selected Spectral Attributes in the Perception of Synthetic Vowels

This thesis is an experimental study regarding the identification and discrimination of vowels, studied using synthetic stimuli. The acoustic attributes of synthetic stimuli vary, which raises the question of how different spectral attributes are linked to the behaviour of the subjects. The spectral attributes used are formants and spectral moments (centre of gravity, standard deviation, skewness and kurtosis). Two types of experiments are used, related to the identification and discrimination of the stimuli, respectively. The discrimination is studied by using both the attentive procedures that require a response from the subject, and the preattentive procedures that require no response. Together, the studies offer information about the identification and discrimination of synthetic vowels in 15 different languages. Furthermore, this thesis discusses the role of various spectral attributes in the speech perception processes. The thesis is divided into three studies. The first is based only on attentive methods, whereas the other two concentrate on the relationship between identification and discrimination experiments. The neurophysiological methods (EEG recordings) reveal the role of attention in processing, and are used in discrimination experiments, while the results reveal differences in perceptual processes based on the language, attention and experimental procedure.

The Connectivity of Musical Aptitude and Foreign Language Learning Skills: Neural and Behavioural Evidence

Given the structural and acoustical similarities between speech and music, and possible overlapping cerebral structures in speech and music processing, a possible relationship between musical aptitude and linguistic abilities, especially in terms of second language pronunciation skills, was investigated. Moreover, the laterality effect of the mother tongue was examined with both adults and children by means of dichotic listening scores. Finally, two event-related potential studies sought to reveal whether children with advanced second language pronunciation skills and higher general musical aptitude differed from children with less-advanced pronunciation skills and less musical aptitude in accuracy when preattentively processing mistuned triads and music / speech sound durations. The results showed a significant relationship between musical aptitude, English language pronunciation skills, chord discrimination ability, and sound-change-evoked brain activation in response to musical stimuli (durational differences and triad contrasts). Regular music practice may also have a modulatory effect on the brain’s linguistic organization and cause altered hemispheric functioning in those who have regularly practised music for years. Based on the present results, it is proposed that language skills, both in production and discrimination, are interconnected with perceptual musical skills.

Color ad spectral image assessment using novel quality and fidelity techniques

The ongoing development of the digital media has brought a new set of challenges with it. As images containing more than three wavelength bands, often called spectral images, are becoming a more integral part of everyday life, problems in the quality of the RGB reproduction from the spectral images have turned into an important area of research. The notion of image quality is often thought to comprise two distinctive areas – image quality itself and image fidelity, both dealing with similar questions, image quality being the degree of excellence of the image, and image fidelity the measure of the match of the image under study to the original. In this thesis, both image fidelity and image quality are considered, with an emphasis on the influence of color and spectral image features on both. There are very few works dedicated to the quality and fidelity of spectral images. Several novel image fidelity measures were developed in this study, which include kernel similarity measures and 3D-SSIM (structural similarity index). The kernel measures incorporate the polynomial, Gaussian radial basis function (RBF) and sigmoid kernels. The 3D-SSIM is an extension of a traditional gray-scale SSIM measure developed to incorporate spectral data. The novel image quality model presented in this study is based on the assumption that the statistical parameters of the spectra of an image influence the overall appearance. The spectral image quality model comprises three parameters of quality: colorfulness, vividness and naturalness. The quality prediction is done by modeling the preference function expressed in JNDs (just noticeable difference). Both image fidelity measures and the image quality model have proven to be effective in the respective experiments.

Espai corporal i praxi constructiva grafomotora a l'edat pre-escolar

En totes les investigacions sobre I'evolució ontogeneticadel nen es parteix d'una serie de pressuposits que,plantejats d'una manera explícita o no, determinen el seuenfoc i les seves conclusions teoriques. La relació existententre desenvolupament i aprenentatge n'es un dels mesimportants. Aquesta relació pot considerar-se com a unidireccional(a/ el desenvolupament es una condició previaa I'aprenentatge o b/ I'aprenentatge és desenvolupament)o be com a mútua i interdependent

Contribució de la psicomotricitat al desenvolupament de les capacitats i a l'adquisició de competències en Educació infantil

L’article pretén posar de manifest la contribució que es fa des de la pràctica psicomotriu al desenvolupament de les capacitats definides en l’actual currículum d’educació infantil. Entenem la psicomotricitat com la pràctica educativa que implica la globalitat de l’infant, mobilitzant les seves estructures motores, socioafectives i intel·lectuals. També atén el seu procés global a partir de les vivències corporals plaents que l’activitat motriu li proporciona. La sessió de psicomotricitat és un espai d’aprenentatge on els petits aprenen a aprendre, a saber fer i a saber ser i a estar en relació amb els altres

Bowing the violin : a case study for auditory-motor pattern modelling in the context of music performance

This project addresses methodological and technological challenges in the development of multi-modal data acquisition and analysis methods for the representation of instrumental playing technique in music performance through auditory-motor patterning models. The case study is violin playing: a multi-modal database of violin performances has been constructed by recording different musicians while playing short exercises on different violins. The exercise set and recording protocol have been designed to sample the space defined by dynamics (from piano to forte) and tone (from sul tasto to sul ponticello), for each bow stroke type being played on each of the four strings (three different pitches per string) at two different tempi. The data, containing audio, video, and motion capture streams, has been processed and segmented to facilitate upcoming analyses. From the acquired motion data, the positions of the instrument string ends and the bow hair ribbon ends are tracked and processed to obtain a number of bowing descriptors suited for a detailed description and analysis of the bow motion patterns taking place during performance. Likewise, a number of sound perceptual attributes are computed from the audio streams. Besides the methodology and the implementation of a number of data acquisition tools, this project introduces preliminary results from analyzing bowing technique on a multi-modal violin performance database that is unique in its class. A further contribution of this project is the data itself, which will be made available to the scientific community through the repovizz platform.

Visuaalinen haku ja silmänliikkeet : tutkimuksia havaintokentästä

Artikkeli perustuu Helena Ojanpään väitöskirjaan Visual search and eye movements : Studies of perceptual span (HY 2006).

Näköjärjestelmää peilaamassa

Kirjallisuusarvostelu

“IT’S ALL RIGHT”. Multimodal rightward spatial bias modified by age and praxis

The general goal of the present work was to study whether spatial perceptual asymmetry initially observed in linguistic dichotic listening studies is related to the linguistic nature of the stimuli and/or is modality-specific, as well as to investigate whether the spatial perceptual/attentional asymmetry changes as a function of age and sensory deficit via praxis. Several dichotic listening studies with linguistic stimuli have shown that the inherent perceptual right ear advantage (REA), which presumably results from the left lateralized linguistic functions (bottom-up processes), can be modified with executive functions (top-down control). Executive functions mature slowly during childhood, are well developed in adulthood, and decline as a function of ageing. In Study I, the purpose was to investigate with a cross-sectional experiment from a lifespan perspective the age-related changes in top-down control of REA for linguistic stimuli in dichotic listening with a forced-attention paradigm (DL). In Study II, the aim was to determine whether the REA is linguistic-stimulus-specific or not, and whether the lifespan changes in perceptual asymmetry observed in dichotic listening would exist also in auditory spatial attention tasks that put load on attentional control. In Study III, using visual spatial attention tasks, mimicking the auditory tasks applied in Study II, it was investigated whether or not the stimulus-non-specific rightward spatial bias found in auditory modality is a multimodal phenomenon. Finally, as it has been suggested that the absence of visual input in blind participants leads to improved auditory spatial perceptual and cognitive skills, the aim in Study IV was to determine, whether blindness modifies the ear advantage in DL. Altogether 180-190 right-handed participants between 5 and 79 years of age were studied in Studies I to III, and in Study IV the performance of 14 blind individuals was compared with that of 129 normally sighted individuals. The results showed that only rightward spatial bias was observed in tasks with intensive attentional load, independent of the type of stimuli (linguistic vs. non-linguistic) or the modality (auditory vs. visual). This multimodal rightward spatial bias probably results from a complex interaction of asymmetrical perceptual, attentional, and/or motor mechanisms. Most importantly, the strength of the rightward spatial bias changed as a function of age and augmented praxis due to sensory deficit. The efficiency of the performance in spatial attention tasks and the ability to overcome the rightward spatial bias increased during childhood, was at its best in young adulthood, and decreased as a function of ageing. Between the ages of 5 and 11 years probably at first develops movement and impulse control, followed by the gradual development of abilities to inhibit distractions and disengage attention. The errors especially in bilateral stimulus conditions suggest that a mild phenomenon resembling extinction can be observed throughout the lifespan, but especially the ability to distribute attention to multiple targets simultaneously decreases in the course of ageing. Blindness enhances the processing of auditory bilateral linguistic stimuli, the ability to overcome a stimulus-driven laterality effect related to speech sound perception, and the ability to direct attention to an appropriate spatial location. It was concluded that the ability to voluntarily suppress and inhibit the multimodal rightward spatial bias changes as a function of age and praxis due to sensory deficit and probably reflects the developmental level of executive functions.

Cognitive Auditory Evoked Potentials in Investigation of Hearing Discrimination

Preattentive perception of occasional deviating stimuli in the stream of standard stimuli can be recorded with cognitive event-related potential (ERP) mismatch negativity (MMN). The earlier detection of stimuli at the auditory cortex can be examined with N1 and P2 ERPs. The MMN recording does not require co-operation, it correlates with perceptual threshold, and even complex sounds can be used as stimuli. The aim of this study was to examine different aspects that should be considered when measuring discrimination of hearing with ERPs. The MMN was found to be stimulusintensity- dependent. As the intensity of sine wave stimuli was increased from 40 to 80 dB HL, MMN mean amplitudes increased. The effect of stimulus frequency on the MMN was studied so that the pitch difference would be equal in each stimulus block according to the psychophysiological mel scale or the difference limen of frequency (DLF). However, the blocks differed from each other. The contralateral white noise masking (50 dB EML) was found to attenuate the MMN amplitude when the right ear was stimulated. The N1 amplitude was attenuated and, in contrast, P2 amplitude was not affected by contralateral white noise masking. The perception and production of vowels by four postlingually deafened patients with a cochlear implant were studied. The MMN response could be elicited in the patient with the best vowel perception abilities. The results of the studies show that concerning the MMN recordings, the stimulus parameters and recording procedure design have a great influence on the results.

Alterations in The States and Contents of Consciousness: Empirical and Theoretical Aspects

The main purpose of the present doctoral thesis is to investigate subjective experiences and cognitive processes in four different types of altered states of consciousness: naturally occurring dreaming, cognitively induced hypnosis, pharmacologically induced sedation, and pathological psychosis. Both empirical and theoretical research is carried out, resulting in four empirical and four theoretical studies. The thesis begins with a review of the main concepts used in consciousness research, the most influential philosophical and neurobiological theories of subjective experience, the classification of altered states of consciousness, and the main empirical methods used to study consciousness alterations. Next, findings of the original studies are discussed, as follows. Phenomenal consciousness is found to be dissociable from responsiveness, as subjective experiences do occur in unresponsive states, including anaesthetic-induced sedation and natural sleep, as demonstrated by post-awakening subjective reports. Two new tools for the content analysis of subjective experiences and dreams are presented, focusing on the diversity, complexity and dynamics of phenomenal consciousness. In addition, a new experimental paradigm of serial awakenings from non-rapid eye movement sleep is introduced, which enables more rapid sampling of dream reports than has been available in previous studies. It is also suggested that lucid dreaming can be studied using transcranial brain stimulation techniques and systematic analysis of pre-lucid dreaming. For blind judges, dreams of psychotic patients appear to be indistinguishable from waking mentation reports collected from the same patients, which indicates a close resemblance of these states of mind. However, despite phenomenological similarities, dreaming should not be treated as a uniform research model of psychotic or intact consciousness. Contrary to this, there seems to be a multiplicity of routes of how different states of consciousness can be associated. For instance, seemingly identical time perception distortions in different alterations of consciousness may have diverse underlying causes for these distortions. It is also shown that altered states do not necessarily exhibit impaired cognitive processing compared to a baseline waking state of consciousness: a case study of time perception in a hypnotic virtuoso indicates a more consistent perceptual timing under hypnosis than in a waking state. The thesis ends with a brief discussion of the most promising new perspectives for the study of alterations of consciousness.

The attentional modulation of the flash-lag effect

If a dot is flashed in perfect alignment with a pair of dots rotating around the visual fixation point, most observers perceive the rotating dots as being ahead of the flashing dot (flash-lag effect). This perceptual effect has been interpreted to result from the perceptual extrapolation of the moving dots, the differential visual latencies between flashing and moving stimuli, as well as the modulation of attentional mechanisms. Here we attempted to uncouple the attentional effects brought about by the spatial predictability of the flashing dot from the sensory effects dependent on its visual eccentricity. The stimulus was a pair of dots rotating clockwise around the fixation point. Another dot was flashed at either the upper right or the lower left of the visual field according to three separate blocked situations: fixed, alternate and random positions. Twenty-four participants had to judge, in all three situations, the location of the rotating dots in relation to the imaginary line connecting the flashing dot and the fixation point at the moment the dot was flashed. The flash-lag effect was observed in all three situations, and a clear influence of the spatial predictability of the flashing dot on the magnitude of the perceptual phenomenon was revealed, independently of sensory effects related to the eccentricity of the stimulus in the visual field. These findings are consistent with our proposal that, in addition to sensory factors, the attentional set modulates the magnitude of the differential latencies that give rise to the flash-lag phenomenon.

Modulation of the perception of temporal order by attentional and pre-attentional factors

When two stimuli are presented simultaneously to an observer, the perceived temporal order does not always correspond to the actual one. In three experiments we examined how the location and spatial predictability of visual stimuli modulate the perception of temporal order. Thirty-two participants had to report the temporal order of appearance of two visual stimuli. In Experiment 1, both stimuli were presented at the same eccentricity and no perceptual asynchrony between them was found. In Experiment 2, one stimulus was presented close to the fixation point and the other, peripheral, stimulus was presented in separate blocks in two eccentricities (4.8º and 9.6º). We found that the peripheral stimulus was perceived to be delayed in relation to the central one, with no significant difference between the delays obtained in the two eccentricities. In Experiment 3, using three eccentricities (2.5º, 7.3º and 12.1º) for the presentation of the peripheral stimulus, we compared a condition in which its location was highly predictable with two other conditions in which its location was progressively less predictable. Here, the perception of the peripheral stimulus was also delayed in relation to the central one, with this delay depending on both the eccentricity and predictability of the stimulus. We argue that attentional deployment, manipulated by the spatial predictability of the stimulus, seems to play an important role in the temporal order perception of visual stimuli. Yet, under whichever condition of spatial predictability, basic sensory and attentional processes are unavoidably entangled and both factors must concur to the perception of temporal order.

Interhemispheric connections between primary visual areas: beyond the midline rule

In the last five years, a number of detailed anatomical, electrophysiological, optical imaging and simulation studies performed in a variety of non-human species have revealed that the functional organization of callosal connections between primary visual areas is more elaborate than previously thought. Callosal cell bodies and terminals are clustered in columns whose correspondence to features mapped in the visual cortex, such as orientation and ocularity, are starting to be understood. Callosal connections are not restricted to the vertical midline representation nor do they establish merely point-to-point retinotopic correspondences across the hemispheres, as traditionally believed. In addition, anatomical studies have revealed the existence of an ipsilateral component of callosal axons. The aim of this short review is to propose how these new data can be integrated into an updated scheme of the circuits responsible for assembling the primary visual field map.