Seeing and hearing speech, sounds, and signs: functional magnetic resonance studies on fluent and dyslexic readers

Speech has both auditory and visual components (heard speech sounds and seen articulatory gestures). During all perception, selective attention facilitates efficient information processing and enables concentration on high-priority stimuli. Auditory and visual sensory systems interact at multiple processing levels during speech perception and, further, the classical motor speech regions seem also to participate in speech perception. Auditory, visual, and motor-articulatory processes may thus work in parallel during speech perception, their use possibly depending on the information available and the individual characteristics of the observer. Because of their subtle speech perception difficulties possibly stemming from disturbances at elemental levels of sensory processing, dyslexic readers may rely more on motor-articulatory speech perception strategies than do fluent readers. This thesis aimed to investigate the neural mechanisms of speech perception and selective attention in fluent and dyslexic readers. We conducted four functional magnetic resonance imaging experiments, during which subjects perceived articulatory gestures, speech sounds, and other auditory and visual stimuli. Gradient echo-planar images depicting blood oxygenation level-dependent contrast were acquired during stimulus presentation to indirectly measure brain hemodynamic activation. Lip-reading activated the primary auditory cortex, and selective attention to visual speech gestures enhanced activity within the left secondary auditory cortex. Attention to non-speech sounds enhanced auditory cortex activity bilaterally; this effect showed modulation by sound presentation rate. A comparison between fluent and dyslexic readers' brain hemodynamic activity during audiovisual speech perception revealed stronger activation of predominantly motor speech areas in dyslexic readers during a contrast test that allowed exploration of the processing of phonetic features extracted from auditory and visual speech. The results show that visual speech perception modulates hemodynamic activity within auditory cortex areas once considered unimodal, and suggest that the left secondary auditory cortex specifically participates in extracting the linguistic content of seen articulatory gestures. They are strong evidence for the importance of attention as a modulator of auditory cortex function during both sound processing and visual speech perception, and point out the nature of attention as an interactive process (influenced by stimulus-driven effects). Further, they suggest heightened reliance on motor-articulatory and visual speech perception strategies among dyslexic readers, possibly compensating for their auditory speech perception difficulties.

Liikkumisen ja kokemusten yhteys virtuaaliympäristöissä

The aim of this study was to build a model and analyze how users move in a virtual environment and to explore the experiential dimensions connected with different ways of moving. Due to the lack of previous research on this subject, this was an explorative study. This study also aimed to identify different ways how users move in virtual environments and the background variables connected to them. It was hypothesized that fluent movement in virtual environments is connected to high presence, skill and challenge assessments. Test participants (n = 68) were mostly highly educated young adults. A virtual environment was built using a CAVE -type virtual reality interface. The task was to search for objects that do not belong into a normal house. The participants movement in the virtual house was recorded on a computer. Movement was modelled using a cluster analysis of information entropy based movement measurements, acceleration, amount of stops and time spent being stationary. The experiential dimensions were measured using the EVEQ -questionnaire. We were able to identify four different ways of moving in virtual environments. In respect of background variables, the four groups differed only in the amount of weekly computer usage. However, fluent movement in virtual environments was connected to a high sense of presence. Furthermore, participants who moved fluently in the environment assessed their skills as being high and regarded the use of virtual environment as challenging. The results indicate that different ways of moving affects how people experience virtual environments. Consequently the participants assessment of their skills and level of challenge have an impact on the affective evaluation of the situation at hand. Entropy measures have not been previously applied when studying movement, and in addition the role of movement on the experiential dimensions of virtual environments is an unexplored subject. The movement analysis method introduced here is applicable to other research problems. Finally, this study expands on our knowledge of the special characteristics connected with the experiential dimensions of virtual environments.

"Sitte se menee koulus" : Eri kieli- ja kulttuuritaustaisen lapsen suomen kielen taito esiopetuksen päättövaiheessa

A child learns new things, creates social relationships and participates in play with the help of language. How can a child overcome these challenges if the surrounding language is not his mother tongue? The objective of learning a new language in the Pre-school education is an active bilingualism in all fields of the language. Theoretical context of the research rises from bilingualism, learning a language, language skills and evaluating them. Object of the research was to understand language skills of a child from a different linguistic and cultural background in the final stage of Pre-school education and to clarify how learning Finnish was supported during the Pre-school year. Answers to the research issues will be searched with the following questions: 1) What kind of language skills does a child from a different linguistic and cultural backgrounds have at the final stage of Pre-school education?, 1.1) What kind of listening comprehension skills?, 1.2) What kind of speech and vocabulary skills?, 1.3) What kind of structural skills?, 2) What kind of individual differences are there in language skills of children from different linguistic and cultural backgrounds?, and 3) How has a child from a different linguistic and cultural background been supported in learning Finnish during the Pre-school education? The view of language skills in this research is holistic even though it will be analysed in separate fields. The aim of this research is to form an overall impression of Finnish skills of the children participating in the research. Eight Pre-school-aged children with different linguistic and cultural backgrounds and their kindergarten teachers participated in this research. The children had taken part in Finnish activities for about three years. The research material consists of the test series (KITA), which evaluate children’s language skills – and of the questionnaire to the kindergarten teachers. The purpose of the questionnaire was to provide additional information on children’s language skills in Pre-school teaching situations and on supporting Finnish in Pre-school education. This research is qualitative and processing of the material is based on content analysis. According to the kindergarten teachers, the children’s social language skills were sufficient to cope in everyday life but children needed assistance with longer instructions. The same phenomenon could also be seen with the KITA tests – in which long and abstract instructions turned out to be difficult. Individual differences of the children were perceived in productivity skills, which were realised in fluent or influent speech. The children were supported in learning Finnish individually, in small-groups and in the activities of a whole group. ‘Finnish as the second language’ small-groups were the most common form of support in learning the language. The support at understanding activities was emphasized in whole group situations as well as in individual situations while assisting the child’s language skills. Generally, the children’s language skills were in the same level with developing basic language skills. The data of this research help to understand children’s language skills after three years of adopting Finnish. The results can be utilised in planning and evaluation of teaching another language.

Oikein, nurin - miten Suomessa kudin : Tutkimus neulonnan työotteista.

The aim of this work was to study what kind of working grips people use to knit in Finland and decide if one grip is superior to others. I investigated how knitters have adopted their grips and how they experience their knitting. I also explored whether it is possible to change one's grip. To provide a theoretical basis for the research I observed knitting in terms of culture, skill and ergonomics. The first part of the study material comprised video recordings of the grips of 95 knitters together with background information collected via a questionnaire during the education of craft teachers at the University of Helsinki in spring 2004, 2005 and 2006. Using the data obtained I focused on three knitters, whose grip of the knitting needles clearly differed from the ergonomically good grip. In addition to them I interviewed one student, who had changed over to more ergonomic way of knitting after participating in the first part of this study. In this respect my study is a several events' case study. In order to analyse my data I used both qualitative and quantitative content analysis methods to complement each other. Most of my research participants had learned to knit in first years of elementary school or comprehensive school. Almost everyone had adopted the basics of knitting by imitating, and many of them had corrected "incorrect" positions from verbal instructions. Through practice the imitated position had gradually become the style unique to each knitter. The findings showed that students' background in knitting is quite varied due to the diverse level of craft teaching. This is reflected in their knitting grips and their interest in knitting. Students do not think that there is one right working grip. The most important thing is that working seems as fluent and relaxed as possible, at which point knitting is easy and flows freely. They often consider their own style so pleasing and well-functioning that they do not think there could be any room for improvement. This study pointed out that, while it is possible to change a knitter's working grip, there is a bigger challenge in acknowledging weaknesses in one's know how. According to the results of my research, the most common working grip among Finnish knitters' corresponds with the grip that has been described as ergonomically good. Over one third of all participants knitted this way. Hands keep the knitting firmly but without tension. The forefinger that guides the yarn from the ball rests gently against the knitting needle, and the yarn goes in front of the first joint of the forefinger. The position of the hands and loops is the same as in the ergonomically good grip, i.e. the fingertips of both hands and the loops are near the tips of the knitting needles, so that the fingers only have to move small distances. When knitters purl and plain, they commonly pick up the yarn from the back of the knitting needle in the same way as when knitting. While researching the common features of working grips I have learned what abnormal grips are like. Although I recognized many different ways to knit, all the peculiar grips were modifications of the continental way of knitting. The results of this study give a clear picture of those points knitters should focus their attention on in order to gain a good hold of the needles.