Social perception and cognition : processing of gestures, postures and facial expressions in the human brain

Humans are a social species with the internal capability to process social information from other humans. To understand others behavior and to react accordingly, it is necessary to infer their internal states, emotions and aims, which are conveyed by subtle nonverbal bodily cues such as postures, gestures, and facial expressions. This thesis investigates the brain functions underlying the processing of such social information. Studies I and II of this thesis explore the neural basis of perceiving pain from another person s facial expressions by means of functional magnetic resonance imaging (fMRI) and magnetoencephalography (MEG). In Study I, observing another s facial expression of pain activated the affective pain system (previously associated with self-experienced pain) in accordance with the intensity of the observed expression. The strength of the response in anterior insula was also linked to the observer s empathic abilities. The cortical processing of facial pain expressions advanced from the visual to temporal-lobe areas at similar latencies (around 300 500 ms) to those previously shown for emotional expressions such as fear or disgust. Study III shows that perceiving a yawning face is associated with middle and posterior STS activity, and the contagiousness of a yawn correlates negatively with amygdalar activity. Study IV explored the brain correlates of interpreting social interaction between two members of the same species, in this case human and canine. Observing interaction engaged brain activity in very similar manner for both species. Moreover, the body and object sensitive brain areas of dog experts differentiated interaction from noninteraction in both humans and dogs whereas in the control subjects, similar differentiation occurred only for humans. Finally, Study V shows the engagement of the brain area associated with biological motion when exposed to the sounds produced by a single human being walking. However, more complex pattern of activation, with the walking sounds of several persons, suggests that as the social situation becomes more complex so does the brain response. Taken together, these studies demonstrate the roles of distinct cortical and subcortical brain regions in the perception and sharing of others internal states via facial and bodily gestures, and the connection of brain responses to behavioral attributes.

Neuronal oscillations in gamma- and alpha-frequency bands: from object representations to sensory awareness

The synchronization of neuronal activity, especially in the beta- (14-30 Hz) /gamma- (30 80 Hz) frequency bands, is thought to provide a means for the integration of anatomically distributed processing and for the formation of transient neuronal assemblies. Thus non-stimulus locked (i.e. induced) gamma-band oscillations are believed to underlie feature binding and the formation of neuronal object representations. On the other hand, the functional roles of neuronal oscillations in slower theta- (4 8 Hz) and alpha- (8 14 Hz) frequency bands remain controversial. In addition, early stimulus-locked activity has been largely ignored, as it is believed to reflect merely the physical properties of sensory stimuli. With human neuromagnetic recordings, both the functional roles of gamma- and alpha-band oscillations and the significance of early stimulus-locked activity in neuronal processing were examined in this thesis. Study I of this thesis shows that even the stimulus-locked (evoked) gamma oscillations were sensitive to high-level stimulus features for speech and non-speech sounds, suggesting that they may underlie the formation of early neuronal object representations for stimuli with a behavioural relevance. Study II shows that neuronal processing for consciously perceived and unperceived stimuli differed as early as 30 ms after stimulus onset. This study also showed that the alpha band oscillations selectively correlated with conscious perception. Study III, in turn, shows that prestimulus alpha-band oscillations influence the subsequent detection and processing of sensory stimuli. Further, in Study IV, we asked whether phase synchronization between distinct frequency bands is present in cortical circuits. This study revealed prominent task-sensitive phase synchrony between alpha and beta/gamma oscillations. Finally, the implications of Studies II, III, and IV to the broader scientific context are analysed in the last study of this thesis (V). I suggest, in this thesis that neuronal processing may be extremely fast and that the evoked response is important for cognitive processes. I also propose that alpha oscillations define the global neuronal workspace of perception, action, and consciousness and, further, that cross-frequency synchronization is required for the integration of neuronal object representations into global neuronal workspace.

Cortical processing of musical pitch as reflected by behavioural and electrophysiological evidence

In a musical context, the pitch of sounds is encoded according to domain-general principles not confined to music or even to audition overall but common to other perceptual and cognitive processes (such as multiple pattern encoding and feature integration), and to domain-specific and culture-specific properties related to a particular musical system only (such as the pitch steps of the Western tonal system). The studies included in this thesis shed light on the processing stages during which pitch encoding occurs on the basis of both domain-general and music-specific properties, and elucidate the putative brain mechanisms underlying pitch-related music perception. Study I showed, in subjects without formal musical education, that the pitch and timbre of multiple sounds are integrated as unified object representations in sensory memory before attentional intervention. Similarly, multiple pattern pitches are simultaneously maintained in non-musicians' sensory memory (Study II). These findings demonstrate the degree of sophistication of pitch processing at the sensory memory stage, requiring neither attention nor any special expertise of the subjects. Furthermore, music- and culture-specific properties, such as the pitch steps of the equal-tempered musical scale, are automatically discriminated in sensory memory even by subjects without formal musical education (Studies III and IV). The cognitive processing of pitch according to culture-specific musical-scale schemata hence occurs as early as at the sensory-memory stage of pitch analysis. Exposure and cortical plasticity seem to be involved in musical pitch encoding. For instance, after only one hour of laboratory training, the neural representations of pitch in the auditory cortex are altered (Study V). However, faulty brain mechanisms for attentive processing of fine-grained pitch steps lead to inborn deficits in music perception and recognition such as those encountered in congenital amusia (Study VI). These findings suggest that predispositions for exact pitch-step discrimination together with long-term exposure to music govern the acquisition of the automatized schematic knowledge of the music of a particular culture that even non-musicians possess.

Human brain mechanisms of auditory and audiovisual selective attention

Selective attention refers to the process in which certain information is actively selected for conscious processing, while other information is ignored. The aim of the present studies was to investigate the human brain mechanisms of auditory and audiovisual selective attention with functional magnetic resonance imaging (fMRI), electroencephalography (EEG) and magnetoencephalography (MEG). The main focus was on attention-related processing in the auditory cortex. It was found that selective attention to sounds strongly enhances auditory cortex activity associated with processing the sounds. In addition, the amplitude of this attention-related modulation was shown to increase with the presentation rate of attended sounds. Attention to the pitch of sounds and to their location appeared to enhance activity in overlapping auditory-cortex regions. However, attention to location produced stronger activity than attention to pitch in the temporo-parietal junction and frontal cortical regions. In addition, a study on bimodal attentional selection found stronger audiovisual than auditory or visual attention-related modulations in the auditory cortex. These results were discussed in light of Näätänen s attentional-trace theory and other research concerning the brain mechanisms of selective attention.

Cortical representations for phonological quantity

Different languages use temporal speech cues in different linguistic functions. In Finnish, speech-sound duration is used as the primary cue for the phonological quantity distinction ― i.e., a distinction between short and long phonemes. For the second-language (L2) learners of Finnish, quantity is often difficult to master if speech-sound duration plays a less important role in the phonology of their native language (L1). The present studies aimed to investigate the cortical representations for phonological quantity in native speakers and L2 users of Finnish by using behavioral and electrophysiological methods. Since long-term memory representations for different speech units have been previously shown to participate in the elicitation of the mismatch negativity (MMN) brain response, MMN was used to compare the neural representation for quantity between native speakers and L2 users of Finnish. The results of the studies suggested that native Finnish speakers' MMN response to quantity was determined by the activation of native-language phonetic prototypes rather than by phoneme boundaries. In addition, native speakers seemed to process phoneme quantity and quality independently from each other by separate brain representations. The cross-linguistic MMN studies revealed that, in native speakers of Finnish, the MMN response to duration or quantity-degree changes was enhanced in amplitude selectively in speech sounds, whereas this pattern was not observed in L2 users. Native speakers' MMN enhancement is suggested to be due to the pre-attentive activation of L1 prototypes for quantity. In L2 users, the activation of L2 prototypes or other L2 learning effects were not reflected in the MMN, with one exception. Even though L2 users failed to show native-like brain responses to duration changes in a vowel that was similar in L1 and L2, their duration MMN response was native-like for an L2 vowel with no counterpart in L1. Thus, the pre-attentive activation of L2 users' representations was determined by the degree of similarity of L2 sounds to L1 sounds. In addition, behavioral experiments suggested that the establishment of representations for L2 quantity may require several years of language exposure.

Koko talo soi : Klemetti-Opisto suomalaisen musiikkikulttuurin kehittäjänä 1953-1968

This study aims to examine the operations and significance of the Klemetti Institute (Klemetti-Opisto) as a developer of Finnish music culture from 1953 to 1968 during the term of office of the Institute s founder and first director, Arvo Vainio. The Klemetti Institute was originally established as a choir institute, but soon expanded to offer a wide range of music courses. In addition to providing courses for choir leaders and singers, the Institute began its orchestral activities as early as the mid-1950s. Other courses included ear training seminars as well as courses for young people s music instructors and in playing the kantele (a Finnish string instrument) and solo singing. More than 20 types of courses were offered over the 16-year period. The Klemetti Institute s courses were incorporated into the folk high school courses offered by the Orivesi Institute (Oriveden Opisto) and were organised during the summer months of June and July. In addition to funding based on the Folk High School Act, financial assistance was obtained from various foundations and funds, such as the Wihuri Foundation. This study is linked to the context of historical research. I examine the Klemetti Institute s operations chronologically, classifying instruction into different course types, and analyse concert activities primarily in the section on the Institute s student union. The source material includes the Klemetti Institute archives, which consist of Arvo Vainio s correspondence, student applications, register books and cards, journals and student lists, course albums and nearly all issues of the Klemettiläinen bulletin. In addition, I have used focused interviews and essays to obtain extensive data from students and teachers. I concentrate on primary school teachers, who accounted for the majority of course participants. A total of more than 2,300 people participated in the courses, nearly half of whom took courses during at least two summers. Primary school teachers accounted for 50% to 70% of the participants in most courses and constituted an even larger share of participants in some courses, such as the music instructor course. The Klemetti Institute contributed to the expansion throughout Finland of a new ideal for choral tone. This involved delicate singing which strives for tonal purity and expressiveness. Chamber choirs had been virtually unheard of in Finland, but the Klemetti Institute Chamber Choir popularised them. Chamber choirs are characterised by an extensive singing repertoire ranging from the Middle Ages to the present. As the name suggests, chamber choirs were originally rather small mixed choirs. Delicate singing meant the avoidance of extensive vibrato techniques and strong, heavy forte sounds, which had previously been typical of Finnish choirs. Those opposing and shunning this new manner of singing called it ghost singing . The Klemetti Institute s teachers included Finland s most prominent pedagogues and artists. As the focused essays, or reminiscences as I call them, show, their significance for the students was central. I examine extensively the Klemetti Institute s enthusiastic atmosphere, which during the early years was characterised by what some writers described as a hunger for music . In addition to distributing a new tonal ideal and choir repertoire, the Klemetti Institute also distributed new methods of music education, thus affecting the music teaching of Finnish primary schools, in particular. The Orff approach, which included various instruments, became well known, although some of Orff s ideas, such as improvisation and physical exercise, were initially unfamiliar. More important than the Orff approach was the in-depth teaching at the Klemetti Institute of the Hungarian ear training method known as the Kodály method. Many course participants were among those launching specialist music classes in schools, and the method became the foundation for music teaching in many such schools. The Klemetti Institute was also a pioneer in organising orchestra camps for young people. The Klemetti Institute promoted Finnish music culture and played an important role in the continuing music education of primary school teachers. Keywords: adult education, Grundtvigian philosophy, popular enlightenment, Klemetti Institute, Kodály method, choir singing, choir conducting, music history, music education, music culture, music camp, Orff approach, Orff-Schulwerk, Orivesi Institute, instrument teaching, free popular education, communality, solo singing, voice production

Determining and quantifying components of an aquaculture soundscape.

Recirculating aquaculture systems have a unique anthropogenic-based soundscape which is characterized by the type of equipment utilized, the structural configuration of walls, tanks, equipment, the substrate the tanks are situated on and even the activities of the personnel operating the facility. The soundscape of recirculation facilities is inadequately understood and remains poorly characterized, although it is generally accepted that the dominant sounds found in such facilities are within the hearing range of fish. The objective of this study was to evaluate the soundscape in a recirculating aquaculture facility from an intra-tank perspective and determine how the soundscape is shaped by a range of characteristics within the facility. Sounds were recorded across an operating aquaculture facility including different tank designs. The sounds recorded fell within previously measured pressure level ranges for recirculating systems, with the highest maximum sound pressure level (SPL) recorded at 124 dB re 1 mu Pa-2/Hz (with an FFT bin width of 46.9 Hz, centered at 187.5 Hz). The soundscape within the tanks was stratified and positively correlated with depth, the highest sound pressure occurring at the base of the tanks. Each recording of the soundscape was dominated by a frequency component of 187.5 Hz (corresponding centre of the 4th 46.9 Hz FFT analysis bin) that produced the highest observed SPL Analysis of sound recordings revealed that this peak SPL was associated with the acoustic signature of the pump. The soundscape was also evaluated for impacts of tank hood position, time of day, transient sounds and airstone particle size types, all of which were found to appreciably influence sound levels and structure within the tank environment. This study further discusses the distinctiveness of the soundscape, how it is shaped by the various operating components and considers the aquaculture soundscape in relation to natural soundscapes found within aquatic tropical environments.

Temporal variation of tonal spectrum of tambura

Tambura is an essential drone accompaniment used in Indian music concerts. It acts as an immediate reference of pitch for both the artists and listeners. The four strings of Tambura are tuned to the frequency ratio :1:1: . Careful listening to Tambura sound reveals that the tonal spectrum is not stationary but is time varying. The object of this study is to make a detailed spectrum analysis to find out the nature of temporal variation of the tonal spectrum of Tambura sound. Results of the analysis are correlated with perceptual evaluation conducted in a controlled acoustic environment. A significant result of this study is to demonstrate the presence of several notes which are normally not noticed even by a professional artist. The effect of bridge in Tambura in producing the so called “live tone” is explained through time and frequency parameters of Tambura sounds.

Content-based birdcall retrieval from environmental audio

This research investigates techniques to analyse long duration acoustic recordings to help ecologists monitor birdcall activities. It designs a generalized algorithm to identify a broad range of bird species. It allows ecologists to search for arbitrary birdcalls of interest, rather than restricting them to just a very limited number of species on which the recogniser is trained. The algorithm can help ecologists find sounds of interest more efficiently by filtering out large volumes of unwanted sounds and only focusing on birdcalls.

Opioid dependence: Brain structure and function : a magnetic resonance imaging, neuropsychological, and electromagnetic study

Background: Opiod dependence is a chronic severe brain disorder associated with enormous health and social problems. The relapse back to opioid abuse is very high especially in early abstinence, but neuropsychological and neurophysiological deficits during opioid abuse or soon after cessation of opioids are scarcely investigated. Also the structural brain changes and their correlations with the length of opioid abuse or abuse onset age are not known. In this study the cognitive functions, neural basis of cognitive dysfunction, and brain structural changes was studied in opioid-dependent patients and in age and sex matched healthy controls. Materials and methods: All subjects participating in the study, 23 opioid dependents of whom, 15 were also benzodiazepine and five cannabis co-dependent and 18 healthy age and sex matched controls went through Structured Clinical Interviews (SCID) to obtain DSM-IV axis I and II diagnosis and to exclude psychiatric illness not related to opioid dependence or personality disorders. Simultaneous magnetoencephalography (MEG) and electroencephalography (EEG) measurements were done on 21 opioid-dependent individuals on the day of hospitalization for withdrawal therapy. The neural basis of auditory processing was studied and pre-attentive attention and sensory memory were investigated. During the withdrawal 15 opioid-dependent patients participated in neuropsychological tests, measuring fluid intelligence, attention and working memory, verbal and visual memory, and executive functions. Fifteen healthy subjects served as controls for the MEG-EEG measurements and neuropsychological assessment. The brain magnetic resonance imaging (MRI) was obtained from 17 patients after approximately two weeks abstinence, and from 17 controls. The areas of different brain structures and the absolute and relative volumes of cerebrum, cerebral white and gray matter, and cerebrospinal fluid (CSF) spaces were measured and the Sylvian fissure ratio (SFR) and bifrontal ratio were calculated. Also correlation between the cerebral measures and neuropsychological performance was done. Results: MEG-EEG measurements showed that compared to controls the opioid-dependent patients had delayed mismatch negativity (MMN) response to novel sounds in the EEG and P3am on the contralateral hemisphere to the stimulated ear in MEG. The equivalent current dipole (ECD) of N1m response was stronger in patients with benzodiazepine co-dependence than those without benzodiazepine co-dependence or controls. In early abstinence the opioid dependents performed poorer than the controls in tests measuring attention and working memory, executive function and fluid intelligence. Test results of the Culture Fair Intelligence Test (CFIT), testing fluid intelligence, and Paced Auditory Serial Addition Test (PASAT), measuring attention and working memory correlated positively with the days of abstinence. MRI measurements showed that the relative volume of CSF was significantly larger in opioid dependents, which could also be seen in visual analysis. Also Sylvian fissures, expressed by SFR were wider in patients, which correlated negatively with the age of opioid abuse onset. In controls the relative gray matter volume had a positive correlation with composite cognitive performance, but this correlation was not found in opioid dependents in early abstinence. Conclusions: Opioid dependents had wide Sylvian fissures and CSF spaces indicating frontotemporal atrophy. Dilatation of Sylvian fissures correlated with the abuse onset age. During early withdrawal cognitive performance of opioid dependents was impaired. While intoxicated the pre-attentive attention to novel stimulus was delayed and benzodiazepine co-dependence impaired sound detection. All these changes point to disturbances on frontotemporal areas.

Long time, no see? (DIY walking)

Building on the launch of an early prototype at Balance Unbalance 2013, we now offer a fully realised experience of the ‘Long Time, No See?’ site specific walking/visualisation project for conference users to engage with on a do it yourself basis, either before, during or after the event. ‘Long Time, No See?’ is a new form of participatory, environmental futures project, designed for individuals and groups. It uses a smartphone APP to guide processes of individual or group walking at any chosen location—encouraging walkers to think in radical new ways about how to best prepare for ‘stormy’ environmental futures ahead. As part of their personal journeys participants’ contribute site-specific micro narratives in the form of texts, images and sounds, captured via the APP during the loosely ‘guided’ walk. These responses are then uploaded and synthesised into an ever-building audiovisual and generative artwork/‘map’ of future-thinking affinities, viewable both online at long-time-no-see.org (in Chrome) (and at the same time on a large screen visualisations at QUT’s Cube Centre in Brisbane Australia). The artwork therefore spans both participants’ mobile devices and laptops. If desired outcomes can also be presented publicly in large screen format at the conference. ‘Long Time, No See?’ has been developed over the past two years by a team of leading Australian artists, designers, urban/environmental planners and programmers.

Is there a difference in sound acoustics between aspirating versus non-aspirating swallows in children with dysphagia?

Cervical auscultation (CA) may be used to complement the clinical feeding examination when assessing for oropharyngeal aspiration (OPA). Data exists on the acoustic properties of normal and abnormal swallowing sounds in adults and children. However, there are no published paediatric studies comparing the acoustic properties of sounds comparing OPA with non-OPA swallows. We aimed to determine if there is an acoustic difference between modified barium swallow (MBS)-identified OPA and non-OPA swallow sounds in children.

Orienting to emotion in computer-mediated Cognitive Behavioural Therapy

Exploring emotions is a defining feature of psychotherapy. This study explores how therapists explore emotions when they cannot see or hear their clients. In analysing 1,279 sessions of online text-based Cognitive Behavioural Therapy (CBT) we focused on therapists’ commiserations (e.g., “I’m sorry to hear that”) and their affective inferences (e.g., “that sounds very scary for you”). Both practices routinely prefaced moves to pursue a range of therapeutic activities, many of which did not prioritise sustained focus on the emotion that had just been oriented to. By separating message composition from message transmission, the modality used for these therapy sessions enabled therapists to combine orientations to emotion with attempts to shift the focus of discussion. Our analysis finds that although physically co-present and computer-mediated psychotherapy share a common focus on emotional experience, the modality used for therapy can be relevant in the design and use of these orientations. Data are in British English.

Binaural Localization and Masking

Binaural experiments are described which indicate that the ability of the brain to localize a desired sound and to suppress undesired sounds coming from other directions can be traced in part to the different times of arrival of a sound at the two ears. It is suggested that the brain inserts a time delay in one of the two nerve paths associated with the ears so as to be able to compare, and thus concentrate on, those sounds arriving at the ears with this particular time of arrival distance.The ability to perceive weak sounds binaurally in the presence of noise is shown to be a simple function of the direction of the desired sound and noise. An explanation is given for the effect reported by Koenig that front and rear confusion is avoided by head movements.

Working with Identities Promoting Student Teachers Professional Development

The starting point of the study was that good teaching requires a teacher to be aware of the sources of his or her pedagogical decisions; that is, personal values, beliefs and understandings. From this perspective, a teacher s professional development refers to a process of extending one s self-knowledge. The aim of this study was to promote student teachers' professional development with the help of identity work. Identity work refers to reflecting on both personal and professional experiences. Identity work consists of student teachers self-reflection on their life experiences (self-identity) and video diary-based reflection on their classroom practice (professional identity). The research questions of the study were 1) how is identity work manifested by the participants? and 2) what is the potential of identity work in promoting student teachers professional development? The research data was collected from four student teachers in the academic year 2007-2008; the research group had 24 meetings during the research process. Student teachers take part in a multimode teacher education programme, where students work as ordinary teachers in schools during their university studies. The data collection was conducted by using two methods: participants narratives based on autobiographical writings and video diaries based on participants lessons. Narrative research data was analysed by employing qualitative methods and strategies as they were needed in the research. The research results revealed four different ways of working with identities, each of them revealing different aspects of and approaches to identity work. The results also showed that identity work has the potential to promote professional development. As the research progressed, there were visible changes in the participants reflection. However, despite encouraging results, some issues should be critically questioned. Although reflection sounds attractive and fruitful as a tool for promoting professional development, there are also difficulties and obstacles. On the basis of the results, a proposal for promoting student teachers professional development is offered. Keywords: Teacher identity, identity work, reflection, teacher professional development