Human brain mechanisms of auditory and audiovisual selective attention

Selective attention refers to the process in which certain information is actively selected for conscious processing, while other information is ignored. The aim of the present studies was to investigate the human brain mechanisms of auditory and audiovisual selective attention with functional magnetic resonance imaging (fMRI), electroencephalography (EEG) and magnetoencephalography (MEG). The main focus was on attention-related processing in the auditory cortex. It was found that selective attention to sounds strongly enhances auditory cortex activity associated with processing the sounds. In addition, the amplitude of this attention-related modulation was shown to increase with the presentation rate of attended sounds. Attention to the pitch of sounds and to their location appeared to enhance activity in overlapping auditory-cortex regions. However, attention to location produced stronger activity than attention to pitch in the temporo-parietal junction and frontal cortical regions. In addition, a study on bimodal attentional selection found stronger audiovisual than auditory or visual attention-related modulations in the auditory cortex. These results were discussed in light of Näätänen s attentional-trace theory and other research concerning the brain mechanisms of selective attention.

Kirurgisen operaation teatteri : Teatterillinen kuva ja ihmismuodon esitettävyys avantgardistisen väkivallan näkökulmasta

Dissertation considers the birth of modernist and avant-gardist authorship as a reaction against mass society and massculture. Radical avant-gardism is studied as figurative violence done against the human form. The main argument claims avant-gardist authorship to be an act of masculine autogenesis. This act demands human form to be worked to an elementary state of disarticulateness, then to be reformed to the model of the artist's own psychophysical and idiosyncratic vision and experience. This work is connected to concrete mass, mass of pigment, charcoal, film, or flesh. This mass of the figure is worked to create a likeness in the nervous system of the spectator. The act of violence against the human figure is intended to shock the spectator. This shock is also a state of emotional and perceptional massification. I use theatrical image as heuristic tool and performance analysis, connecting figure and spectator into a larger image, which is constituted by relationships of mimesis, where figure presents the likeness of the spectator and spectator the likeness of the figure. Likeness is considered as both gestural - social mimetic - and sensuous - kinesthetically mimetic. Through this kind of construction one can describe and contextualize the process of violent autogenesis using particular images as case studies. Avant-gardist author is the author of theatrical image, not particular figure, and through act of massification the nervous system of the spectator is also part of this image. This is the most radical form and ideology of avant-gardist and modernist authorship or imagerial will to power. I construct a model of gestural-mimic performer to explicate the nature of violence done for human form in specific works, in Mann's novella Death in Venice, in Schiele's and Artaud's selfportaits, in Francis Bacon's paintings, in Beckett's shortplat NOT I, in Orlan's chirurgical performance Operation Omnipresense, in Cindy Sherman's Film/Stills, in Diamanda Galás's recording Vena Cava and in Hitchcock's Psycho. Masspsychology constructed a phobic picture of human form's plasticity and capability to be constituted by influencies coming both inside and outside - childhood, atavistic organic memories, urban field of nervous impulses, unconsciousness, capitalist (image)market and democratic masspolitics. Violence is then antimimetic and antitheatrical, a paradoxical situation, considering that massmedias and massaudiences created an enormous fascination about possibilities of theatrical and hypnotic influence in artistic elites. The problem was how to use theatrical image without coming as author under influence. In this work one possible answer is provided: by destructing the gestural-mimetic performer, by eliminating representations of mimic body techniques from the performer of human (a painted figure, a photographed figure, a filmed figure or an acted figure, audiovisual or vocal) figure. This work I call the chirurgical operation, which also indicates co-option with medical portraitures or medico-cultural diagnoses of human form. Destruction of the autonomy of the performer was a parallel process to constructing the new mass media audience as passive, plastic, feminine. The process created an image of a new kind of autotelic masculine author-hero, freed from human form in its bourgeois, aristocratic, classical and popular versions.

Seeing and hearing speech, sounds, and signs: functional magnetic resonance studies on fluent and dyslexic readers

Speech has both auditory and visual components (heard speech sounds and seen articulatory gestures). During all perception, selective attention facilitates efficient information processing and enables concentration on high-priority stimuli. Auditory and visual sensory systems interact at multiple processing levels during speech perception and, further, the classical motor speech regions seem also to participate in speech perception. Auditory, visual, and motor-articulatory processes may thus work in parallel during speech perception, their use possibly depending on the information available and the individual characteristics of the observer. Because of their subtle speech perception difficulties possibly stemming from disturbances at elemental levels of sensory processing, dyslexic readers may rely more on motor-articulatory speech perception strategies than do fluent readers. This thesis aimed to investigate the neural mechanisms of speech perception and selective attention in fluent and dyslexic readers. We conducted four functional magnetic resonance imaging experiments, during which subjects perceived articulatory gestures, speech sounds, and other auditory and visual stimuli. Gradient echo-planar images depicting blood oxygenation level-dependent contrast were acquired during stimulus presentation to indirectly measure brain hemodynamic activation. Lip-reading activated the primary auditory cortex, and selective attention to visual speech gestures enhanced activity within the left secondary auditory cortex. Attention to non-speech sounds enhanced auditory cortex activity bilaterally; this effect showed modulation by sound presentation rate. A comparison between fluent and dyslexic readers' brain hemodynamic activity during audiovisual speech perception revealed stronger activation of predominantly motor speech areas in dyslexic readers during a contrast test that allowed exploration of the processing of phonetic features extracted from auditory and visual speech. The results show that visual speech perception modulates hemodynamic activity within auditory cortex areas once considered unimodal, and suggest that the left secondary auditory cortex specifically participates in extracting the linguistic content of seen articulatory gestures. They are strong evidence for the importance of attention as a modulator of auditory cortex function during both sound processing and visual speech perception, and point out the nature of attention as an interactive process (influenced by stimulus-driven effects). Further, they suggest heightened reliance on motor-articulatory and visual speech perception strategies among dyslexic readers, possibly compensating for their auditory speech perception difficulties.

Lapset, media ja symbolinen vuorovaikutus : Suomalaisten, englantilaisten ja saksalaisten lasten mediasuhteen tarkastelua

Tämän hetken mediaympäristölle on ominaista intensiivisyys ja jatkuva läsnäolo. Medialla on merkittävä rooli myös pienten lasten jokapäiväisessä elämässä, sillä he aloittavat median säännöllisen seuraamisen keskimäärin kolmen vuoden iässä. Mediasisällöt, mediavälineet ja mediaan liittyvät sosiaaliset suhteet muodostavatkin lapsille mediaympäristön, jossa lapset rakentavat identiteettejään, oppivat sosiaalista kanssakäymistä ja kehittävät näkemyksiään yhteiskunnasta ja kulttuurista. Tutkimuksessa on selvitetty 4-6-vuotiaitten suomalaisten, englantilaisten ja saksalaisten lasten audiovisuaalisen median tulkintaa ja median roolia heidän elämässään. Tutkimuksen tavoitteena on ollut syventää tutkimuksellista tietoa median sosiaalisesta ja kulttuurisesta merkityksestä pienten lasten elämässä ja sitä, miten he tulkitsevat mediasisältöä. Tutkimuksessa lasten mediasuhdetta on tarkasteltu välineellisenä, sosiaalisena, symbolisena ja kulttuurisena tulkintaympäristönä. Edellisten lisäksi tutkimuksessa on arvioitu harvemmin viestinnän tutkimuksessa käytetyn symbolisen interaktionismin teorian tarjoamia mahdollisuuksia lasten mediasuhteen tarkasteluun. Suomessa, Englannissa ja Saksassa kootun kansainvälisen aineiston pohjalta on tarkasteltu myös vertailuryhmien välillä olevia mediaan liittyviä kulttuurisia eroja. Eri vertailumaiden melko samankaltaisesta mediaympäristöstä huolimatta tutkimus antaa viitteitä mediatulkinnoissa olevista kulttuurisista eroista. Media mahdollistaa lapsen erilaistan taitojensa kehittymistä ja voi siten muodostaa heille sosiaalisia, symbolisia ja kulttuurisia resursseja, joilla on merkitystä lapsen kehittymisen kannalta. Lapsen ja median suhde on kaksisuuntainen vuorovaikutussuhde ja mediainformaation tulkinnassa ovat mukana lapsen aiemmat tiedolliset ja sosiaaliset kokemukset. Aktiivisessa mediatulkintasuhteessaan lapsi kehittää sanavarastoaan, havainnointiaan, ajatteluaan ja tunne-elämäänsä. Median käyttö sosiaalisena tapahtumana kehittää osaltaan lapsen sosiaalisia valmiuksia. Siten esimerkiksi perheen median käyttöön liittyvät säännöt ja ohjeet ohjaavat perheen sisäistä toimintaa ja määrittävät lapsen asemaa perheessä. Median sisällöt ja niihin liittyvät erilaiset oheistuotteet toimivat osaltaan lapsen kulttuuristen koodistojen ja luokittelujen muodostajana. Tutkimus osoittaa myös symbolisen interaktionismin teorian tarjoavan varsin poikkitieteellisen tutkimuksellisen viitekehyksen lapsia ja mediaa koskevalle tutkimukselle ja mahdollistaa lasten mediasuhteen tutkimisen ja ymmärtämisen useiden, erilaisten tekijöiden suhteena.

Linguistic and perceptual processing of communicative cues in Asperger Syndrome

Asperger Syndrome (AS) belongs to autism spectrum disorders where both verbal and non-verbal communication difficulties are at the core of the impairment. Social communication requires a complex use of affective, linguistic-cognitive and perceptual processes. In the four studies included in the current thesis, some of the linguistic and perceptual factors that are important for face-to-face communication were studied using behavioural methods. In all four studies the results obtained from individuals with AS were compared with typically developed age, gender and IQ matched controls. First, the language skills of school-aged children were characterized in detail with standardized tests that measured different aspects of receptive and expressive language (Study I). The children with AS were found to be worse than the controls in following complex verbal instructions. Next, the visual perception of facial expressions of emotion with varying degrees of visual detail was examined (Study II). Adults with AS were found to have impaired recognition of facial expressions on the basis of very low spatial frequencies which are important for processing global information. Following that, multisensory perception was investigated by looking at audiovisual speech perception (Studies III and IV). Adults with AS were found to perceive audiovisual speech qualitatively differently from typically developed adults, although both groups were equally accurate in recognizing auditory and visual speech presented alone. Finally, the effect of attention on audiovisual speech perception was studied by registering eye gaze behaviour (Study III) and by studying the voluntary control of visual attention (Study IV). The groups did not differ in eye gaze behaviour or in the voluntary control of visual attention. The results of the study series demonstrate that many factors underpinning face-to-face social communication are atypical in AS. In contrast with previous assumptions about intact language abilities, the current results show that children with AS have difficulties in understanding complex verbal instructions. Furthermore, the study makes clear that deviations in the perception of global features in faces expressing emotions as well as in the multisensory perception of speech are likely to harm face-to-face social communication.