Sensory auditory processing and intuitive sound detection : an investigation of musical experts and nonexperts

The auditory system can detect occasional changes (deviants) in acoustic regularities without the need for subjects to focus their attention on the sound material. Deviant detection is reflected in the elicitation of the mismatch negativity component (MMN) of the event-related potentials. In the studies presented in this thesis, the MMN is used to investigate the auditory abilities for detecting similarities and regularities in sound streams. To investigate the limits of these processes, professional musicians have been tested in some of the studies. The results show that auditory grouping is already more advanced in musicians than in nonmusicians and that the auditory system of musicians can, unlike that of nonmusicians, detect a numerical regularity of always four tones in a series. These results suggest that sensory auditory processing in musicians is not only a fine tuning of universal abilities, but is also qualitatively more advanced than in nonmusicians. In addition, the relationship between the auditory change-detection function and perception is examined. It is shown that, contrary to the generally accepted view, MMN elicitation does not necessarily correlate with perception. The outcome of the auditory change-detection function can be implicit and the implicit knowledge of the sound structure can, after training, be utilized for behaviorally correct intuitive sound detection. These results illustrate the automatic character of the sensory change detection function.

Cortical processing of musical pitch as reflected by behavioural and electrophysiological evidence

In a musical context, the pitch of sounds is encoded according to domain-general principles not confined to music or even to audition overall but common to other perceptual and cognitive processes (such as multiple pattern encoding and feature integration), and to domain-specific and culture-specific properties related to a particular musical system only (such as the pitch steps of the Western tonal system). The studies included in this thesis shed light on the processing stages during which pitch encoding occurs on the basis of both domain-general and music-specific properties, and elucidate the putative brain mechanisms underlying pitch-related music perception. Study I showed, in subjects without formal musical education, that the pitch and timbre of multiple sounds are integrated as unified object representations in sensory memory before attentional intervention. Similarly, multiple pattern pitches are simultaneously maintained in non-musicians' sensory memory (Study II). These findings demonstrate the degree of sophistication of pitch processing at the sensory memory stage, requiring neither attention nor any special expertise of the subjects. Furthermore, music- and culture-specific properties, such as the pitch steps of the equal-tempered musical scale, are automatically discriminated in sensory memory even by subjects without formal musical education (Studies III and IV). The cognitive processing of pitch according to culture-specific musical-scale schemata hence occurs as early as at the sensory-memory stage of pitch analysis. Exposure and cortical plasticity seem to be involved in musical pitch encoding. For instance, after only one hour of laboratory training, the neural representations of pitch in the auditory cortex are altered (Study V). However, faulty brain mechanisms for attentive processing of fine-grained pitch steps lead to inborn deficits in music perception and recognition such as those encountered in congenital amusia (Study VI). These findings suggest that predispositions for exact pitch-step discrimination together with long-term exposure to music govern the acquisition of the automatized schematic knowledge of the music of a particular culture that even non-musicians possess.

Space in Musical Semiosis : An Abductive Theory of the Musical Composition Process

Space in musical semiosis is a study of musical meaning, spatiality and composition. Earlier studies on musical composition have not adequately treated the problems of musical signification. Here, composition is considered an epitomic process of musical signification. Hence the core problems of composition theory are core problems of musical semiotics. The study employs a framework of naturalist pragmatism, based on C. S. Peirce’s philosophy. It operates on concepts such as subject, experience, mind and inquiry, and incorporates relevant ideas of Aristotle, Peirce and John Dewey into a synthetic view of esthetic, practic, and semiotic for the benefit of grasping musical signification process as a case of semiosis in general. Based on expert accounts, music is depicted as real, communicative, representational, useful, embodied and non-arbitrary. These describe how music and the musical composition process are mental processes. Peirce’s theories are combined with current morphological theories of cognition into a view of mind, in which space is central. This requires an analysis of space, and the acceptance of a relativist understanding of spatiality. This approach to signification suggests that mental processes are spatially embodied, by virtue of hard facts of the world, literal representations of objects, as well as primary and complex metaphors each sharing identities of spatial structures. Consequently, music and the musical composition process are spatially embodied. Composing music appears as a process of constructing metaphors—as a praxis of shaping and reshaping features of sound, representable from simple quality dimensions to complex domains. In principle, any conceptual space, metaphorical or literal, may set off and steer elaboration, depending on the practical bearings on the habits of feeling, thinking and action, induced in musical communication. In this sense, it is evident that music helps us to reorganize our habits of feeling, thinking, and action. These habits, in turn, constitute our existence. The combination of Peirce and morphological approaches to cognition serves well for understanding musical and general signification. It appears both possible and worthwhile to address a variety of issues central to musicological inquiry in the framework of naturalist pragmatism. The study may also contribute to the development of Peircean semiotics.

Aristotle on the Perception of Perception : Seeing, Remembering, and Sleeping

This study is an inquiry into three related topics in Aristotle’s psychology: the perception of seeing, the perception of past perception, and the perception of sleeping. Over the past decades, Aristotle’s account of the perception of perception has been studied in numerous articles and chapters of books. However, there is no monograph that attempts to give a comprehensive analysis of this account and to assess its relation and significance to Aristotle’s psychological theory in general as well as to other theories pertaining to the topics (e.g. theories of consciousness), be they ancient, medieval, modern, or contemporary. This study intends to fill this gap and to further the research into Aristotle’s philosophy and into the philosophy of mind. The present study is based on an accurate analysis of the sources, on their Platonic background, and on later interpretations within the commentary tradition up to the present. From a methodological point of view, this study represents systematically orientated research into the history of philosophy, in which special attention is paid to the philosophical problems inherent in the sources, to the distinctions drawn, and to the arguments put forward as well as to their philosophical assessment. In addition to contributing many new findings concerning the topics under discussion, this study shows that Aristotle’s account of the perception of perception substantially differs from many later theories of consciousness. This study also suggests that Aristotle be regarded as a consistent direct realist, not only in respect of sense perception, but also in respect of memory.

Social perception and cognition : processing of gestures, postures and facial expressions in the human brain

Humans are a social species with the internal capability to process social information from other humans. To understand others behavior and to react accordingly, it is necessary to infer their internal states, emotions and aims, which are conveyed by subtle nonverbal bodily cues such as postures, gestures, and facial expressions. This thesis investigates the brain functions underlying the processing of such social information. Studies I and II of this thesis explore the neural basis of perceiving pain from another person s facial expressions by means of functional magnetic resonance imaging (fMRI) and magnetoencephalography (MEG). In Study I, observing another s facial expression of pain activated the affective pain system (previously associated with self-experienced pain) in accordance with the intensity of the observed expression. The strength of the response in anterior insula was also linked to the observer s empathic abilities. The cortical processing of facial pain expressions advanced from the visual to temporal-lobe areas at similar latencies (around 300 500 ms) to those previously shown for emotional expressions such as fear or disgust. Study III shows that perceiving a yawning face is associated with middle and posterior STS activity, and the contagiousness of a yawn correlates negatively with amygdalar activity. Study IV explored the brain correlates of interpreting social interaction between two members of the same species, in this case human and canine. Observing interaction engaged brain activity in very similar manner for both species. Moreover, the body and object sensitive brain areas of dog experts differentiated interaction from noninteraction in both humans and dogs whereas in the control subjects, similar differentiation occurred only for humans. Finally, Study V shows the engagement of the brain area associated with biological motion when exposed to the sounds produced by a single human being walking. However, more complex pattern of activation, with the walking sounds of several persons, suggests that as the social situation becomes more complex so does the brain response. Taken together, these studies demonstrate the roles of distinct cortical and subcortical brain regions in the perception and sharing of others internal states via facial and bodily gestures, and the connection of brain responses to behavioral attributes.

Perception of surface brightness

The human visual system has adapted to function in different lighting environments and responds to contrast instead of the amount of light as such. On the one hand, this ensures constancy of perception, for example, white paper looks white both in bright sunlight and in dim moonlight, because contrast is invariant to changes in overall light level. On the other hand, the brightness of the surfaces has to be reconstructed from the contrast signal because no signal from surfaces as such is conveyed to the visual cortex. In the visual cortex, the visual image is decomposed to local features by spatial filters that are selective for spatial frequency, orientation, and phase. Currently it is not known, however, how these features are subsequently integrated to form objects and object surfaces. In this thesis the integration mechanisms of achromatic surfaces were studied by psychophysically measuring the spatial frequency and orientation tuning of brightness perception. In addition, the effect of textures on the spread of brightness and the effect of phase of the inducing stimulus on brightness were measured. The novel findings of the thesis are that (1) a narrow spatial frequency band, independent of stimulus size and complexity, mediates brightness information (2) figure-ground brightness illusions are narrowly tuned for orientation (3) texture borders, without any luminance difference, are able to block the spread of brightness, and (4) edges and even- and odd-symmetric Gabors have a similar antagonistic effect on brightness. The narrow spatial frequency tuning suggests that only a subpopulation of neurons in V1 is involved in brightness perception. The independence of stimulus size and complexity indicates that the narrow tuning reflects hard-wired processing in the visual system. Further, it seems that figure-ground segregation and mechanisms integrating contrast polarities are closely related to the low level mechanisms of brightness perception. In conclusion, the results of the thesis suggest that a subpopulation of neurons in visual cortex selectively integrates information from different contrast polarities to reconstruct surface brightness.

Feeling Better, Performing Better? Holistically-Oriented Top Performance and Well-Being (HOPE) : Performance Enhancement and Its Perceived Impacts on Musicians

Most musicians choose a career in music based on their love of the art and a desire to share it with others. However, being a performing musician is highly demanding. Despite considerable evidence of the great frequency of performance-related problems (e.g. debilitating performance anxiety) among professional musicians or aspiring musicians in the current Western classical music tradition these problems are seldom discussed openly. The existing system offers musicians very little help in learning how to build sustainable performance success into their musical career. This study it is first of its kind in Finland which addresses the issue on larger scale in a systematic way. I devised the HOPE intervention (Holistically-Oriented Top Performance and Well-Being Enhancement), in order to learn how to integrate professional peak performance and a sense of personal well-being into the lives and careers of musicians. Unlike most interventions in previous research, the HOPE intervention is explicitly holistic and aims at enhancing the whole musician, not just alleviating performance anxiety. Earlier research has not in principle focused on musicians´ psychological well-being or on their subjective perceptions. The main purpose of the study is to understand the perceived impacts of the specially devised HOPE intervention on the participants and particularly in four key areas: performing, playing or singing well-being, and overall (performing, playing or singing and well-being combined). Furthermore, it is hoped that a deeper understanding of performers´ development will be gained. The research method is interdisciplinary and mainly qualitative. The primary data consist of a series of linked questionnaires (before and after the intervention) and semi-structured follow-up interviews collected during action research-oriented HOPE intervention courses for music majors in the Sibelius Academy. With the longitudinal group called Hope 1, the core data were collected during a nine month HOPE intervention course and from follow-up interviews conducted six months later in 2003-2004. The core data of Hope 1 (nine participants) are compared with the perceived impacts on fifty-three other participants in the HOPE courses during the period since their inception, 2001-2006. The focus is particularly on participants´ subjective perceptions. Results of the study suggest that the HOPE intervention is beneficial in enhancing overall performance capacity, including music performance, and a personal sense of well-being in a music university setting. The findings indicate that within all key areas significant positive changes take place between the beginning and the end of a HOPE intervention course. The longitudinal data imply that the perceived positive changes are still ongoing six months after the HOPE intervention course is finished. The biggest change takes place within the area of performing and the smallest, in participants´ perception of their playing or singing. The main impacts include reduced feelings of stress and anxiety (an enhanced sense of well-being) as well as increased sense of direction and control in one's life. Since the results of the present research gave no other reason to believe otherwise, it is to be expected that the HOPE intervention and the results of the study can be exploited in other areas of human activity as well, especially where continuous professional top performance is a prerequisite such as in business or sports. Keywords: performance enhancement, professional top performance, subjective well-being, subjective perceptions, holism, coaching, music performance anxiety, studying music, music.

Acquisition of focus by normal hearing and Cochlear implanted children

Two experiments investigated the perception of compound vs. phrasal stress and narrow focus in normally hearing children and children with Cochlear Implants (CI). Additionally, we investigated whether musical experience would predict children’s performance in these tasks. The results showed no difference between CI and normal-hearing (NH) children in either experiment. However, whereas we found no clear effect of age in the children’s stress detection, there was a clear age related trajectory in the ability to recognise (narrow) focus. Moreover, this trend was similar to what has been found previously for English children. Importantly, prior music experience was significantly linked to CI children’s perception of focus.

Music in the recovering brain

Listening to music involves a widely distributed bilateral network of brain regions that controls many auditory perceptual, cognitive, emotional, and motor functions. Exposure to music can also temporarily improve mood, reduce stress, and enhance cognitive performance as well as promote neural plasticity. However, very little is currently known about the relationship between music perception and auditory and cognitive processes or about the potential therapeutic effects of listening to music after neural damage. This thesis explores the interplay of auditory, cognitive, and emotional factors related to music processing after a middle cerebral artery (MCA) stroke. In the acute recovery phase, 60 MCA stroke patients were randomly assigned to a music listening group, an audio book listening group, or a control group. All patients underwent neuropsychological assessments, magnetoencephalography (MEG) measurements, and magnetic resonance imaging (MRI) scans repeatedly during a six-month post-stroke period. The results revealed that amusia, a deficit of music perception, is a common and persistent deficit after a stroke, especially if the stroke affects the frontal and temporal brain areas in the right hemisphere. Amusia is clearly associated with deficits in both auditory encoding, as indicated by the magnetic mismatch negativity (MMNm) response, and domain-general cognitive processes, such as attention, working memory, and executive functions. Furthermore, both music and audio book listening increased the MMNm, whereas only music listening improved the recovery of verbal memory and focused attention as well as prevented a depressed and confused mood during the first post-stroke months. These findings indicate a close link between musical, auditory, and cognitive processes in the brain. Importantly, they also encourage the use of listening to music as a rehabilitative leisure activity after a stroke and suggest that the auditory environment can induce long-term plastic changes in the recovering brain.