Spatial Perception and Cognition in Multichannel Audio for Electroacoustic Music

Listeners experience electroacoustic music as full of significance and meaning, and they experience spatiality as one of the factors contributing to its meaningfulness. If we want to understand spatiality in electroacoustic music, we must understand how the listener’s mental processes give rise to the experience of meaning. In electroacoustic music as in everyday life, these mental processes unite the peripheral auditory system with human spatial cognition. In the discussion that follows we consider a range of the listener’s mental processes relating space and meaning from the perceptual attributes of spatial imagery to the spatial reference frames for places and navigation. When considering multichannel loudspeaker systems in particular, an important part of the discussion is focused on the distinctive and idiomatic ways in which this particular mode of sound production contributes to and situates meaning. These idiosyncrasies include the phenomenon of image dispersion, the important consequences of the precedence effect and the influence of source characteristics on spatial imagery. These are discussed in close relation to the practicalities of artistic practice and to the potential for artistic meaning experienced by the listener.

Emotion and architectural environments : a case for Functional Near Infrared Spectroscopy (fNIRS) in assessing emotional responses to spatial environments

Collaboration between neuroscience and architecture is emerging as a key field of research as demonstrated in recent times by development of the Academy of Neuroscience for Architecture (ANFA) and other societies. Neurological enquiry of affect and spatial experience from a design perspective remains in many instances unchartered. Research using portable near infrared spectroscopy (fNIRs) - an emerging non-invasive neuro-imaging device, is proving convincing in its ability to detect emotional responses to visual, spatio-auditory and task based stimuli. This innovation provides a firm basis to potentially track cortical activity in the appraisal of architectural environments. Additionally, recent neurological studies have sought to explore the manifold sensory abilities of the visually impaired to better understand spatial perception in general. Key studies reveal that early blind participants perform as well as sighted due to higher auditory and somato-sensory spatial acuity. Studies also report pleasant and unpleasant emotional responses within certain interior environments revealing a deeper perceptual sensitivity than would be expected. Comparative fNIRS studies between the sighted and blind concerning spatial experience has the potential to provide greater understanding of emotional responses to architectural environments. Supported by contemporary theories of architectural aesthetics, this paper presents a case for the use of portable fNIRS imaging in the assessment of emotional responses to spatial environments experienced by both blind and sighted. The aim of the paper is to outline the implications of fNIRS upon spatial research and practice within the field of architecture and points to a potential taxonomy of particular formations of space and affect.

Affective sensing + wearable imaging: Vision impairment and implications for spatial enquiry

Recent interest in affect and the body have mobilized a contemporary review of aesthetics and phenomenology within architecture to unpack how environments affect spatial experience. Emerging spatial studies within the neuro-sciences, and their implications for architectural research as raised by architectural theorists Juhani Pallasmaa (2014) and Harry Mallgrave (2013) has been well supported by a raft of scientists and institutions including the prestigious Salk Institute. Although there has been some headway in spatial studies of the vision impaired (Cattaneo et al, 2011) to understand the role of their non-visual systems in assisting navigation and location, little is discussed in terms of their other abilities in sensing particular qualities of space which impinge upon emotion. This paper reviews a collection of studies exploring face vision and echo-location, amongst others, which provide insight into what might be termed affective perception of the vision impaired, and how further interplay between this research and the architectural field can contribute new knowledge regarding space and affect. By engaging with themes from the Aesthetics, Phenomenology and indeed Neuro-science fields, the paper provides background of current and potential cross disciplinary research, and highlights the role wearable technologies can play in enhancing knowledge of affective spatial experience.

Conversions of Relief: on the perception of depth in drawings

Of the many ways in which depth can be intimated in drawings, perspective has undoubtedly been one of the most frequently examined. But there is also an equally rich history associated with other forms of pictorial representation. Alternatives to perspective became particularly significant in the early twentieth century as artists and architects, intent on throwing off the conventions of their predecessors, looked to new ways of depicting depth. In architecture, this tendency was exemplified by Modernism’s preference for parallel projection – most notably axonometric and oblique. The use of these techniques gave architects the opportunity to convey a new and uniquely modern form of spatial expression. At once shallow and yet expansive, a key feature of these drawings was their ability to support perceptual ambiguity. This paper will consider the philosophy and science of vision, out of which these preoccupations emerged. In this context, the nineteenth-century discovery of stereopsis and the invention of the stereoscope will be used to illustrate the way in which attempts to test the limits of spatial perception led to an opening up of visual experience; and provided a definition of visual experience that could encompass the representational ambiguities later exploited by the early twentieth-century avant-garde.

Evidence for unusual spatial location coding in Williams syndrome: an explanation for the local bias in visuo-spatial construction tasks?

Individuals with Williams syndrome (WS) display poor visuo-spatial cognition relative to verbal abilities. Furthermore, whilst perceptual abilities are delayed, visuo-spatial construction abilities are comparatively even weaker, and are characterised by a local bias. We investigated whether his differentiation in visuo-spatial abilities can be explained by a deficit in coding spatial location in WS. This can be measured by assessing participants' understanding of the spatial relations between objects within a visual scene. Coordinate and categorical spatial relations were investigated independently in four participant groups: 21 individuals with WS; 21 typically developing (TD) children matched for non-verbal ability; 20 typically developing controls of a lower non-verbal ability; and 21 adults. A third task measured understanding of visual colour relations. Results indicated first, that the comprehension of categorical and coordinate spatial relations is equally poor in WS. Second, that the comprehension of visual relations is also at an equivalent level to spatial relational understanding in this population. These results can explain the difference in performance on visuo-spatial perception and construction tasks in WS. In addition, both the WS and control groups displayed response biases in the spatial tasks. However, the direction of bias differed across the groups. This finding is explored in relation to current theories of spatial location coding. (c) 2005 Elsevier Inc. All rights reserved.

The effects of yoked prisms on body posture and egocentric perception in a normal population

The principal theme of this thesis is the effect of yoked prisms on body posture and egocentric perception. Yoked prisms have been clinically used in the management of a variety of visual and neuro-motor dysfunctions. Most studies have been conducted in pathological populations by studying the effects of prismatic adaptation, without distinguishing short and long term effects. In this study, postural and perceptual prismatic effects have been studied by preventing prism adaptation. A healthy population was selected in order to investigate the immediate prismatic effects, when there is no obvious benefit from their use for the individual. Posturography was used to assess changes in weight distribution and shifts in centre of pressure (barycentre). In addition, photographic analyses were used to assess effects on posture on the x and z axis. Experiments with space board and visual midline shift were used for the evaluation of spatial perception and egocentric localisation. One pair of 8 Δ yoked prisms base left (BL) and one pair of 8 Δ yoked prisms base up (BU) were applied randomly and compared to a pair of plano lenses. Results suggest that immediate prismatic effects take place on a perceptual level and are reflected on an altered body posture respectively without significant changes in weight distribution. Yoked prisms BL showed a rightward rotational effect on spatial perception by expanding space on the z axis when viewing through the base of the prism and constricting space through the apex of the prism. Body posture responded respectively to what was visually perceived by altering posture. A rightward shift and tilt of the head was recorded along with the hips shift and shoulders tilt in the dame direction. Additionally, right shoulder shifted backwards and an angular midline shift to the right was recorded. The egocentric localisation was affected by shifting the midline perception to the left. Yoked prisms BU resulted on a head shift forward and a reduction of the head-neck angle by bringing the chin closer to the chest. The egocentric localisation was altered on the vertical axis providing subjects the perception that their eye level was higher during the experiment. In conclusion, yoked prisms seemed to induce changes in body posture, mainly in the upper body and head, without any significant changes in weight distribution. These changes are partially reflected in spatial perception tests and egocentric localisation before any prismatic adaptation takes place.

The relationship between early and intermediate level spatial vision during typical development and in autism spectrum disorder

Certaines recherches ont investigué le traitement visuel de bas et de plus hauts niveaux chez des personnes neurotypiques et chez des personnes ayant un trouble du spectre de l’autisme (TSA). Cependant, l’interaction développementale entre chacun de ces niveaux du traitement visuel n’est toujours pas bien comprise. La présente thèse a donc deux objectifs principaux. Le premier objectif (Étude 1) est d’évaluer l’interaction développementale entre l’analyse visuelle de bas niveaux et de niveaux intermédiaires à travers différentes périodes développementales (âge scolaire, adolescence et âge adulte). Le second objectif (Étude 2) est d’évaluer la relation fonctionnelle entre le traitement visuel de bas niveaux et de niveaux intermédiaires chez des adolescents et des adultes ayant un TSA. Ces deux objectifs ont été évalué en utilisant les mêmes stimuli et procédures. Plus précisément, la sensibilité de formes circulaires complexes (Formes de Fréquences Radiales ou FFR), définies par de la luminance ou par de la texture, a été mesurée avec une procédure à choix forcés à deux alternatives. Les résultats de la première étude ont illustré que l’information locale des FFR sous-jacents aux processus visuels de niveaux intermédiaires, affecte différemment la sensibilité à travers des périodes développementales distinctes. Plus précisément, lorsque le contour est défini par de la luminance, la performance des enfants est plus faible comparativement à celle des adolescents et des adultes pour les FFR sollicitant la perception globale. Lorsque les FFR sont définies par la texture, la sensibilité des enfants est plus faible comparativement à celle des adolescents et des adultes pour les conditions locales et globales. Par conséquent, le type d’information locale, qui définit les éléments locaux de la forme globale, influence la période à laquelle la sensibilité visuelle atteint un niveau développemental similaire à celle identifiée chez les adultes. Il est possible qu’une faible intégration visuelle entre les mécanismes de bas et de niveaux intermédiaires explique la sensibilité réduite des FFR chez les enfants. Ceci peut être attribué à des connexions descendantes et horizontales immatures ainsi qu’au sous-développement de certaines aires cérébrales du système visuel. Les résultats de la deuxième étude ont démontré que la sensibilité visuelle en autisme est influencée par la manipulation de l’information locale. Plus précisément, en présence de luminance, la sensibilité est seulement affectée pour les conditions sollicitant un traitement local chez les personnes avec un TSA. Cependant, en présence de texture, la sensibilité est réduite pour le traitement visuel global et local. Ces résultats suggèrent que la perception de formes en autisme est reliée à l’efficacité à laquelle les éléments locaux (luminance versus texture) sont traités. Les connexions latérales et ascendantes / descendantes des aires visuelles primaires sont possiblement tributaires d’un déséquilibre entre les signaux excitateurs et inhibiteurs, influençant ainsi l’efficacité à laquelle l’information visuelle de luminance et de texture est traitée en autisme. Ces résultats supportent l’hypothèse selon laquelle les altérations de la perception visuelle de bas niveaux (local) sont à l’origine des atypies de plus hauts niveaux chez les personnes avec un TSA.

The relationship between early and intermediate level spatial vision during typical development and in autism spectrum disorder

Certaines recherches ont investigué le traitement visuel de bas et de plus hauts niveaux chez des personnes neurotypiques et chez des personnes ayant un trouble du spectre de l’autisme (TSA). Cependant, l’interaction développementale entre chacun de ces niveaux du traitement visuel n’est toujours pas bien comprise. La présente thèse a donc deux objectifs principaux. Le premier objectif (Étude 1) est d’évaluer l’interaction développementale entre l’analyse visuelle de bas niveaux et de niveaux intermédiaires à travers différentes périodes développementales (âge scolaire, adolescence et âge adulte). Le second objectif (Étude 2) est d’évaluer la relation fonctionnelle entre le traitement visuel de bas niveaux et de niveaux intermédiaires chez des adolescents et des adultes ayant un TSA. Ces deux objectifs ont été évalué en utilisant les mêmes stimuli et procédures. Plus précisément, la sensibilité de formes circulaires complexes (Formes de Fréquences Radiales ou FFR), définies par de la luminance ou par de la texture, a été mesurée avec une procédure à choix forcés à deux alternatives. Les résultats de la première étude ont illustré que l’information locale des FFR sous-jacents aux processus visuels de niveaux intermédiaires, affecte différemment la sensibilité à travers des périodes développementales distinctes. Plus précisément, lorsque le contour est défini par de la luminance, la performance des enfants est plus faible comparativement à celle des adolescents et des adultes pour les FFR sollicitant la perception globale. Lorsque les FFR sont définies par la texture, la sensibilité des enfants est plus faible comparativement à celle des adolescents et des adultes pour les conditions locales et globales. Par conséquent, le type d’information locale, qui définit les éléments locaux de la forme globale, influence la période à laquelle la sensibilité visuelle atteint un niveau développemental similaire à celle identifiée chez les adultes. Il est possible qu’une faible intégration visuelle entre les mécanismes de bas et de niveaux intermédiaires explique la sensibilité réduite des FFR chez les enfants. Ceci peut être attribué à des connexions descendantes et horizontales immatures ainsi qu’au sous-développement de certaines aires cérébrales du système visuel. Les résultats de la deuxième étude ont démontré que la sensibilité visuelle en autisme est influencée par la manipulation de l’information locale. Plus précisément, en présence de luminance, la sensibilité est seulement affectée pour les conditions sollicitant un traitement local chez les personnes avec un TSA. Cependant, en présence de texture, la sensibilité est réduite pour le traitement visuel global et local. Ces résultats suggèrent que la perception de formes en autisme est reliée à l’efficacité à laquelle les éléments locaux (luminance versus texture) sont traités. Les connexions latérales et ascendantes / descendantes des aires visuelles primaires sont possiblement tributaires d’un déséquilibre entre les signaux excitateurs et inhibiteurs, influençant ainsi l’efficacité à laquelle l’information visuelle de luminance et de texture est traitée en autisme. Ces résultats supportent l’hypothèse selon laquelle les altérations de la perception visuelle de bas niveaux (local) sont à l’origine des atypies de plus hauts niveaux chez les personnes avec un TSA.

Learning to think spatially : what do students 'see' in numeracy test items?

Learning to think spatially in mathematics involves developing proficiency with graphics. This paper reports on 2 investigations of spatial thinking and graphics. The first investigation explored the importance of graphics as 1 of 3 communication systems (i.e. text, symbols, graphics) used to provide information in numeracy test items. The results showed that graphics were embedded in at least 50 % of test items across 3 year levels. The second investigation examined 11 – 12-year-olds’ performance on 2 mathematical tasks which required substantial interpretation of graphics and spatial thinking. The outcomes revealed that many students lacked proficiency in the basic spatial skills of visual memory and spatial perception and the more advanced skills of spatial orientation and spatial visualisation. This paper concludes with a reaffirmation of the importance of spatial thinking in mathematics and proposes ways to capitalize on graphics in learning to think spatially.

Wearable neuroimaging and emotion : investigating emotional responses to architectural environments with functional near-infrared spectroscopy (fNIRS)

Supported by contemporary theories of architectural aesthetics and neuro-aesthetics this paper presents a case for the use of portable fNIRS imaging in the assessment of emotional responses to spatial environments experienced by both blind and sighted. The aim of the paper is to outline the implications of fNIRS for spatial research and practice within the field of architecture, thereby suggesting a potential taxonomy of particular formations of space and affect. Empirical neurological study of affect and spatial experience from an architectural design perspective remains in many instances unchartered. Clinical research using the portable non-invasive neuro-imaging device, functional near infrared spectroscopy (fNIRS) is proving convincing in its ability to detect emotional responses to visual, spatio-auditory and task based stimuli, providing a firm basis to potentially track cortical activity in the appraisal of architectural environments. Additionally, recent neurological studies have sought to explore the manifold sensory abilities of the visually impaired to better understand spatial perception in general. Key studies reveal that early blind participants perform as well as sighted due to higher auditory and somato-sensory spatial acuity. For instance, face vision enables the visually impaired to detect environments through skin pressure, enabling at times an instantaneous impression of the layout of an unfamiliar environment. Studies also report pleasant and unpleasant emotional responses such as ‘weightedness’ or ‘claustrophobia’ within certain interior environments, revealing a deeper perceptual sensitivity then would be expected. We conclude with justification that comparative fNIRS studies between the sighted and blind concerning spatial experience have the potential to provide greater understanding of emotional responses to architectural environments.

Sensory information and associative cues used in food detection by wild vervet monkeys.

Understanding animals' spatial perception is a critical step toward discerning their cognitive processes. The spatial sense is multimodal and based on both the external world and mental representations of that world. Navigation in each species depends upon its evolutionary history, physiology, and ecological niche. We carried out foraging experiments on wild vervet monkeys (Chlorocebus pygerythrus) at Lake Nabugabo, Uganda, to determine the types of cues used to detect food and whether associative cues could be used to find hidden food. Our first and second set of experiments differentiated between vervets' use of global spatial cues (including the arrangement of feeding platforms within the surrounding vegetation) and/or local layout cues (the position of platforms relative to one another), relative to the use of goal-object cues on each platform. Our third experiment provided an associative cue to the presence of food with global spatial, local layout, and goal-object cues disguised. Vervets located food above chance levels when goal-object cues and associative cues were present, and visual signals were the predominant goal-object cues that they attended to. With similar sample sizes and methods as previous studies on New World monkeys, vervets were not able to locate food using only global spatial cues and local layout cues, unlike all five species of platyrrhines thus far tested. Relative to these platyrrhines, the spatial location of food may need to stay the same for a longer time period before vervets encode this information, and goal-object cues may be more salient for them in small-scale space.

Designing for dementia : an assessment of the impact of the physical environment on wayfinding success for residents in long term care settings

It is acknowledged that one of the consequences of the ageing process is cognitive decline, which leads to an increase in the incidence of illnesses such as dementia. This has become ever more relevant due to the projected increase in the ageing demographic. Dementia affects visuo-spatial perception, causing difficulty with wayfinding, even during the early stages of the disease. The literature widely recognises the physical environment’s role in alleviating symptoms of dementia and improving quality of life for residents. It also identifies the lack of available housing options for older people with dementia and consequently the current stock is ill-equipped to provide adequate support.
Recent statistics indicate that 80% of those residing in nursing or residential care homes have some form of dementia or severe memory problems. The shift towards institutional care settings, the need for specialist support and care, places a greater impetus on the need for a person-centred approach to tackle issues related to wayfinding and dementia.
This thesis therefore aims to improve design for dementia in nursing and residential care settings in the context of Northern Ireland. This will be undertaken in order to provide a better understanding of how people with dementia experience the physical environment and to highlight features of the design that assist with wayfinding. Currently there are limited guidelines on design for dementia, meaning that many of these are theoretical, anecdotal and not definitive. Hence a greater verification to address the less recognised design issues is required. This is intended to ultimately improve quality of life, wellbeing, independence and uphold the dignity of people with dementia living in nursing or residential care homes.
The research design uses a mixed methods approach. A thorough preparation and consideration of ethical issues informed the methodology. The various facets were also trialled and piloted to identify any ethical, technological, methodological, data collection and analysis issues. The protocol was then amended to improve or resolve any of the aforementioned issues. Initially a questionnaire based on leading design recommendations was conducted with home managers. Semi-structured interviews were developed from this and conducted with staff and resident’s next of kin. An evidence-based approach was used to design a study which used ethnographic methods, including a wayfinding task. This followed a repeated measures design which would be used to actively engage residents with dementia in the research. Complementary to the wayfinding task, conversational and semi-structured interviews were used to promote dialogue and direct responses with the person with dementia. In addition to this, Space Syntax methodologies were used to examine the physical properties of the architectural layout. This was then cross-examined with interview responses and data from the wayfinding tasks.
A number of plan typologies were identified and were determined as synonymous with decision point types which needed to be made during the walks. The empirical work enabled the synthesis of environmental features which support wayfinding.
Results indicate that particular environmental features are associated with improved performance on the wayfinding tasks. By enhancing design for dementia, through identifying the attributes, challenges with wayfinding may be overcome and the benefits of the physical environment can be seen to promote wellbeing.
The implications of this work mean that the environmental features which have been highlighted from the project can be used to inform guidelines, thus adding to existing knowledge. Future work would involve the dissemination of this information and the potential for it to be made into design standards or regulations which champion design for dementia. These would increase awareness for designers and stakeholders undertaking new projects, extensions or refurbishments.
A person-centred, evidence-based design was emphasised throughout the project which guaranteed an in-depth study. There were limitations due to the available resources, time and funding. Future research would involve testing the identified environmental features within a specific environment to enable measured observation of improvements.

Finding a way: Long term care homes to support dementia

An ageing demographic has increased the number of people with dementia. Although dementia is commonly associated with memory loss, other early symptoms include difficulty with wayfinding. Dementia alters visuo-spatial perception and the processes used to interpret the physical environment. The role of the design of the physical environment for people with dementia has gained increased recognition. Despite this, design for dementia is often overlooked, focusing on issues relating to physical impairment. This paper presents the results of a PhD study and aims to examine the role of the design of the physical environment in supporting wayfinding for people with dementia living in long-term care settings in Northern Ireland. Mixed methods combined the observation of wayfinding walks and conversational style interviews to elicit perspectives and experiences of residents with dementia. The findings aim to promote well-being for those with dementia living in long-term care settings.