Visual search and eye movements: Studies of perceptual span

In visual search one tries to find the currently relevant item among other, irrelevant items. In the present study, visual search performance for complex objects (characters, faces, computer icons and words) was investigated, and the contribution of different stimulus properties, such as luminance contrast between characters and background, set size, stimulus size, colour contrast, spatial frequency, and stimulus layout were investigated. Subjects were required to search for a target object among distracter objects in two-dimensional stimulus arrays. The outcome measure was threshold search time, that is, the presentation duration of the stimulus array required by the subject to find the target with a certain probability. It reflects the time used for visual processing separated from the time used for decision making and manual reactions. The duration of stimulus presentation was controlled by an adaptive staircase method. The number and duration of eye fixations, saccade amplitude, and perceptual span, i.e., the number of items that can be processed during a single fixation, were measured. It was found that search performance was correlated with the number of fixations needed to find the target. Search time and the number of fixations increased with increasing stimulus set size. On the other hand, several complex objects could be processed during a single fixation, i.e., within the perceptual span. Search time and the number of fixations depended on object type as well as luminance contrast. The size of the perceptual span was smaller for more complex objects, and decreased with decreasing luminance contrast within object type, especially for very low contrasts. In addition, the size and shape of perceptual span explained the changes in search performance for different stimulus layouts in word search. Perceptual span was scale invariant for a 16-fold range of stimulus sizes, i.e., the number of items processed during a single fixation was independent of retinal stimulus size or viewing distance. It is suggested that saccadic visual search consists of both serial (eye movements) and parallel (processing within perceptual span) components, and that the size of the perceptual span may explain the effectiveness of saccadic search in different stimulus conditions. Further, low-level visual factors, such as the anatomical structure of the retina, peripheral stimulus visibility and resolution requirements for the identification of different object types are proposed to constrain the size of the perceptual span, and thus, limit visual search performance. Similar methods were used in a clinical study to characterise the visual search performance and eye movements of neurological patients with chronic solvent-induced encephalopathy (CSE). In addition, the data about the effects of different stimulus properties on visual search in normal subjects were presented as simple practical guidelines, so that the limits of human visual perception could be taken into account in the design of user interfaces.

Automatic Lameness Detection in a Milking Robot : Instrumentation, measurement software, algorithms for data analysis and a neural network model

The aim of this thesis is to develop a fully automatic lameness detection system that operates in a milking robot. The instrumentation, measurement software, algorithms for data analysis and a neural network model for lameness detection were developed. Automatic milking has become a common practice in dairy husbandry, and in the year 2006 about 4000 farms worldwide used over 6000 milking robots. There is a worldwide movement with the objective of fully automating every process from feeding to milking. Increase in automation is a consequence of increasing farm sizes, the demand for more efficient production and the growth of labour costs. As the level of automation increases, the time that the cattle keeper uses for monitoring animals often decreases. This has created a need for systems for automatically monitoring the health of farm animals. The popularity of milking robots also offers a new and unique possibility to monitor animals in a single confined space up to four times daily. Lameness is a crucial welfare issue in the modern dairy industry. Limb disorders cause serious welfare, health and economic problems especially in loose housing of cattle. Lameness causes losses in milk production and leads to early culling of animals. These costs could be reduced with early identification and treatment. At present, only a few methods for automatically detecting lameness have been developed, and the most common methods used for lameness detection and assessment are various visual locomotion scoring systems. The problem with locomotion scoring is that it needs experience to be conducted properly, it is labour intensive as an on-farm method and the results are subjective. A four balance system for measuring the leg load distribution of dairy cows during milking in order to detect lameness was developed and set up in the University of Helsinki Research farm Suitia. The leg weights of 73 cows were successfully recorded during almost 10,000 robotic milkings over a period of 5 months. The cows were locomotion scored weekly, and the lame cows were inspected clinically for hoof lesions. Unsuccessful measurements, caused by cows standing outside the balances, were removed from the data with a special algorithm, and the mean leg loads and the number of kicks during milking was calculated. In order to develop an expert system to automatically detect lameness cases, a model was needed. A probabilistic neural network (PNN) classifier model was chosen for the task. The data was divided in two parts and 5,074 measurements from 37 cows were used to train the model. The operation of the model was evaluated for its ability to detect lameness in the validating dataset, which had 4,868 measurements from 36 cows. The model was able to classify 96% of the measurements correctly as sound or lame cows, and 100% of the lameness cases in the validation data were identified. The number of measurements causing false alarms was 1.1%. The developed model has the potential to be used for on-farm decision support and can be used in a real-time lameness monitoring system.

Word Sense Discovery and Disambiguation

The work is based on the assumption that words with similar syntactic usage have similar meaning, which was proposed by Zellig S. Harris (1954,1968). We study his assumption from two aspects: Firstly, different meanings (word senses) of a word should manifest themselves in different usages (contexts), and secondly, similar usages (contexts) should lead to similar meanings (word senses). If we start with the different meanings of a word, we should be able to find distinct contexts for the meanings in text corpora. We separate the meanings by grouping and labeling contexts in an unsupervised or weakly supervised manner (Publication 1, 2 and 3). We are confronted with the question of how best to represent contexts in order to induce effective classifiers of contexts, because differences in context are the only means we have to separate word senses. If we start with words in similar contexts, we should be able to discover similarities in meaning. We can do this monolingually or multilingually. In the monolingual material, we find synonyms and other related words in an unsupervised way (Publication 4). In the multilingual material, we ?nd translations by supervised learning of transliterations (Publication 5). In both the monolingual and multilingual case, we first discover words with similar contexts, i.e., synonym or translation lists. In the monolingual case we also aim at finding structure in the lists by discovering groups of similar words, e.g., synonym sets. In this introduction to the publications of the thesis, we consider the larger background issues of how meaning arises, how it is quantized into word senses, and how it is modeled. We also consider how to define, collect and represent contexts. We discuss how to evaluate the trained context classi?ers and discovered word sense classifications, and ?nally we present the word sense discovery and disambiguation methods of the publications. This work supports Harris' hypothesis by implementing three new methods modeled on his hypothesis. The methods have practical consequences for creating thesauruses and translation dictionaries, e.g., for information retrieval and machine translation purposes. Keywords: Word senses, Context, Evaluation, Word sense disambiguation, Word sense discovery.

Testa din inlärningsstil : En utredning om VAK i undervisning av det andra inhemska språket

This thesis is an investigation of the significance of VAK, i.e. the visual, auditory and kinaesthetic learning styles, for language education. The research part evaluates the predictive validity of a VAK test commonly used in Finnish education. The results of the test were compared, respectively, with the results of a visual, an auditory and a kinaesthetic word test. 62 dyslexic language leaners participated in the tests. There was no statistically significant link between the results of the VAK test and the word tests. On the grounds of a voluntary questionnaire, most of the students did however consider it important that they are taught according to their personal learning style: visual, auditory or kinaesthetic. One of the goals of the study was to investigate the theoretical background of VAK. VAK does not seem to have a consistent theoretical basis, but combines various elements such as NLP pedagogy and Dunn's and Prashnig's learning style models that have previously been sharply criticized by scholars. The study leaves it open whether individual learning styles do exist, and how they could be diagnosed.

Cortical processing of speech and non-speech sounds in adults and newborns

Comprehension of a complex acoustic signal - speech - is vital for human communication, with numerous brain processes required to convert the acoustics into an intelligible message. In four studies in the present thesis, cortical correlates for different stages of speech processing in a mature linguistic system of adults were investigated. In two further studies, developmental aspects of cortical specialisation and its plasticity in adults were examined. In the present studies, electroencephalographic (EEG) and magnetoencephalographic (MEG) recordings of the mismatch negativity (MMN) response elicited by changes in repetitive unattended auditory events and the phonological mismatch negativity (PMN) response elicited by unexpected speech sounds in attended speech inputs served as the main indicators of cortical processes. Changes in speech sounds elicited the MMNm, the magnetic equivalent of the electric MMN, that differed in generator loci and strength from those elicited by comparable changes in non-speech sounds, suggesting intra- and interhemispheric specialisation in the processing of speech and non-speech sounds at an early automatic processing level. This neuronal specialisation for the mother tongue was also reflected in the more efficient formation of stimulus representations in auditory sensory memory for typical native-language speech sounds compared with those formed for unfamiliar, non-prototype speech sounds and simple tones. Further, adding a speech or non-speech sound context to syllable changes was found to modulate the MMNm strength differently in the left and right hemispheres. Following the acoustic-phonetic processing of speech input, phonological effort related to the selection of possible lexical (word) candidates was linked with distinct left-hemisphere neuronal populations. In summary, the results suggest functional specialisation in the neuronal substrates underlying different levels of speech processing. Subsequently, plasticity of the brain's mature linguistic system was investigated in adults, in whom representations for an aurally-mediated communication system, Morse code, were found to develop within the same hemisphere where representations for the native-language speech sounds were already located. Finally, recording and localization of the MMNm response to changes in speech sounds was successfully accomplished in newborn infants, encouraging future MEG investigations on, for example, the state of neuronal specialisation at birth.

Visual completion in an illusory figure

The visual systems of humans and animals represent physical reality in a modified way, depending on the specific demands that the species in question has for survival. The ability to perceive visual illusions is found in independently evolved visual systems, from honeybees to humans. In humans, the ability emerges early, at the age of four months. Thus the perception of illusion is likely to reflect visual processes of fundamental importance for object perception in natural vision. The experiments reported in this thesis employed various modifications of the Kanizsa triangle, a drawn configuration composed of three black disks with missing sectors on a white background. The sectors appear to form the tips of a triangle. The visual system completes the physically empty area between the disks, generally called inducers, with giving the perception of an illusory triangle. The illusory triangle consists of an illusory surface bounded by illusory contours; the triangle appears brighter than and to lie above the background. If the sectors are coloured, the colour fills the illusory area, a phenomenon known as neon colour spreading . We investigated spatial limitations on the perception of Kanizsa-type illusions and how other stimuli and viewing parameters affected these limitations. We also studied complex configurations thick, bent, mobile and chromatic inducers - to determine whether illusions combining several attributes can be perceived. The results suggest that the visual system is highly effective in completing a percept. The perception of an illusory figure is spatially scale invariant when perceived at threshold. The processing time and the number of fixations modify the percept, making the perception of the illusion more probable in various viewing conditions. Furthermore, the fact that the illusion can be perceived when only one inducer is physically present at any given moment indicates the potential of single inducers. Apparently, modelling illusory figure perception will require a combination of low-level, local processes and higher-level integrative processes. Our studies with stimuli combining several attributes relevant to object perception demonstrate that the perception of an illusory figure is flexible and is maintained also when it contains colour and volume and when shown in movement. All in all, the results confirm the assumed importance of the visual processes related with the perception of illusory figures in everyday viewing. This is indicated by the variety of inducer modifications that can be made without destroying the percept. Furthermore, the illusion can acquire additional attributes from such modifications. Due to individual differences in the perception of illusory figures, universal values for absolute performance are not always meaningful, but stable trends and general relations do exist.

Dynamics of contour, object and face processing in the human visual cortex

The neural basis of visual perception can be understood only when the sequence of cortical activity underlying successful recognition is known. The early steps in this processing chain, from retina to the primary visual cortex, are highly local, and the perception of more complex shapes requires integration of the local information. In Study I of this thesis, the progression from local to global visual analysis was assessed by recording cortical magnetoencephalographic (MEG) responses to arrays of elements that either did or did not form global contours. The results demonstrated two spatially and temporally distinct stages of processing: The first, emerging 70 ms after stimulus onset around the calcarine sulcus, was sensitive to local features only, whereas the second, starting at 130 ms across the occipital and posterior parietal cortices, reflected the global configuration. To explore the links between cortical activity and visual recognition, Studies II III presented subjects with recognition tasks of varying levels of difficulty. The occipito-temporal responses from 150 ms onwards were closely linked to recognition performance, in contrast to the 100-ms mid-occipital responses. The averaged responses increased gradually as a function of recognition performance, and further analysis (Study III) showed the single response strengths to be graded as well. Study IV addressed the attention dependence of the different processing stages: Occipito-temporal responses peaking around 150 ms depended on the content of the visual field (faces vs. houses), whereas the later and more sustained activity was strongly modulated by the observers attention. Hemodynamic responses paralleled the pattern of the more sustained electrophysiological responses. Study V assessed the temporal processing capacity of the human object recognition system. Above sufficient luminance, contrast and size of the object, the processing speed was not limited by such low-level factors. Taken together, these studies demonstrate several distinct stages in the cortical activation sequence underlying the object recognition chain, reflecting the level of feature integration, difficulty of recognition, and direction of attention.

Temporal acuity in developmental dyslexia across the life span : Tactile, auditory, visual, and crossmodal estimations

Taustaa Kehityksellinen dysleksia (lukivaikeus) on erityinen lukemaan oppimisen vaikeus, johon liittyy usein myös vaikeuksia kirjoittamaan oppimisessa. Lukivaikeuden oletetaan useissa tapauksissa johtuvan vaikeudesta käsitellä kielen äännerakenteita (fonologinen prosessointi). Tämä poikkeavuus voi olla joko lukivaikeuden perimmäinen syy tai vaihtoehtoisesti ongelmat äänteiden käsittelyssä voivat heijastaa jotain vielä perustavamman tason vaikeutta. Eräs tällainen ehdotettu perustavan tasoin syy on poikkeavuus aistien toiminnoissa, erityisesti aistien aikatarkkuudessa. Aikatarkkuudella tarkoitetaan kykyä ja rajoja siinä, kuinka nopeasti esitettyä aistitiedon virtaa henkilö kykenee vastaanottamaan ja käsittelemään. Monet arjen toiminnot lukemisen rinnalla edellyttävät aistien erittäin tarkkaa ajallista erottelukykyä (esimerkiksi kuulo puheen ymmärtämisessä, tunto pintamateriaalin tunnistamisessa). Aikatarkkuusvaikeuksien esiintyvyyttä lukivaikeudessa on tutkittu aiemminkin, mutta yksimielisyyteen ei ole päästy siitä, onko kaikilla lukivaikeuksisilla näitä ongelmia tai mihin aisteihin vaikeudet mahdollisesti rajoittuvat. Myöskään ei tiedetä, havaitaanko aikatarkkuuden ongelmia kaiken ikäisillä lukivaikeuksisilla vai vaihteleeko mahdollinen ongelmien kuva iän mukana. Lisäksi on epäselvää, kuinka aikatarkkuuden ongelmat itseasiassa ovat yhteydessä kielen käsittelyn ja varsinaisen lukemisen vaikeuksiin. Tutkimussarjan aihe Tässä tutkimussarjassa aikatarkkuutta tutkittiin kolmessa yksittäisessä aistissa, joita olivat tunto, näkö ja kuulo, sekä kolmessa aistien välisessä yhdistelmässä, joita olivat audiotaktiilinen (kuulo-tunto), visuotaktiilinen (näkö-tunto) ja audiovisuaalinen (näkö-kuulo). Aikatarkkuutta arvioitiin kahdella eri menetelmällä, jotta saataisiin lisää tietoa siitä, missä tietyssä aikatarkkuuden osa-alueessa lukivaikeuksisilla mahdollisesti on vaikeuksia. Ensimmäisessä tehtävässä tutkittavan tuli arvioida, ovatko esitetyt ei-kielelliset ärsykkeet samanaikaisia vai eriaikaisia. Toisessa tehtävässä koehenkilön tuli arvioida esitettyjen ei-kielellisten ärsykkeiden esitysjärjestys. Molemmissa tehtävissä määriteltiin millisekuntitasolla (sekunnin tuhannesosa) se esitysnopeus, jolla koehenkilö kykeni arvioimaan ärsykkeiden ajalliset suhteet oikein. Englanninkielinen demonstraatio aikatarkkuustehtävistä löytyy internetistä (http://www.helsinki.fi/hum/ylpsy/neuropsy). Itse aikatarkkuustehtävien lisäksi tutkimussarjassa arvioitiin tutkimushenkilöiden päättelykykyä, kielellisiä toimintoja ja lukemista. Tutkimushenkilöt Tutkimuksiin osallistui 53 lukivaikeuksista ja 66 sujuvaa lukijaa, jotka oli jaettu kolmeen pääikäryhmään: lapset (8-12 vuotta), nuoret aikuiset (20-36 vuotta) ja ikääntyneemmät aikuiset (20-59 vuotta). Ikääntyneempien aikuisten ryhmä oli edelleen jaettu ikävuosikymmenluokkiin, mikä mahdollisti sen tutkimisen, vaikuttaako lisääntyvä aikuisikä lukivaikeuksisten aikatarkkuuteen (20-29, 30-39, 40-49 ja 50-59 -vuotiaat). Tutkimussarjan tulokset Aikatarkkuuden ongelmat lukivaikeuksisilla olivat yleistyneitä yli iän, aistien ja tehtävien Lukivaikeuksiset kaikissa pääikäryhmissä (lapset, nuoret aikuiset, ikääntyneemmän aikuiset) tarvitsivat samanikäisiä sujuvia lukijoita hitaamman esitystahdin, jotta he kykenivät arvioimaan ei-kielellisten ärsykkeiden ajallisen esitystavan oikein. Tämä aikatarkkuuden ongelma havaittiin lukivaikeuksisilla kaikissa aisteissa (tunto, kuulo, näkö) ja niiden yhdistelmissä (audiotaktiilinen, visuotaktiilinen, audiovisuaalinen). Lukivaikeuksisten aikatarkkuusongelmat ilmenivät edelleen molemmissa tehtävätyypeissä (samanaikaisuuden ja järjestyksen arvioinnissa). Aikatarkkuus ja sen ongelmat olivat yhteydessä äänteiden käsittelyyn Aikatarkkuus oli yhteydessä äänteiden käsittelykykyyn (fonologiseen prosessointiin), niin lapsilla kuin aikuisillakin, kaikissa aisteissa, niiden yhdistelmissä ja tehtävätyypeissä. Yhteys ei-kielellisen aikatarkkuuden ja kielellisten toimintojen välillä oli kuitenkin selkeämpi lukivaikeuksisilla kuin sujuvilla lukijoilla. Tämä tarkoittaa, että etenkin lukivaikeuksisilla ryhmätason huono aikatarkkuus oli yhteydessä huonoon äänteiden käsittelyyn (fonologiseen prosessointiin) ja päinvastoin. Suoraa yhteyttä lukemisen ja aikatarkkuuden välillä ei kuitenkaan havaittu. Lisääntyvä aikuisikä heikensi lukivaikeuksisten aikatarkkuutta suhteettoman paljon Tiedonkäsittelyn nopeuden on toistuvasti osoitettu hidastuvan normaalissa ikääntymisessä. Lisääntyvä aikuisikä (20-59 -vuotiailla) heikensikin sekä sujuvien että lukivaikeuksisten aikatarkkuutta. Toisin sanoen, mitä iäkkäämmästä aikuisesta oli kysymys, sitä hitaammin hänelle tuli esittää ärsykkeet, jotta hän kykeni arvioimaan niiden ajalliset suhteet oikein. Tämä ikään liittyvä tavanomainen hidastuminen oli kuitenkin yllättäen suhteettoman nopeaa lukivaikeuksisilla. Toisin sanoen, jo nuorilla lukivaikeuksisilla havaittu aikatarkkuuden vaikeus (ryhmäero verrattuna sujuviin lukijoihin) ei pysynyt saman suuruisena, vaan ryhmien ero kasvoi aikuisiän lisääntyessä. Tulosten merkitys Lukivaikeuden osoitettiin tässä tutkimussarjassa olevan yhteydessä yleistyneeseen vaikeuteen käsitellä ajassa nopeasti muuttuvaa ei-kielellistä aistitietoa (yli aistien ja niiden yhdistelmien, tehtävätyyppien, tutkittavien iän). Tämä osoittaa, että lukivaikeus ei ole ongelma, joka rajoittuu vain kielellisen materiaalin käsittelyn vaikeuksiin (äänteiden käsittely, lukeminen, kirjoittaminen). Nyt havaitut vaikeudet eivät myöskään rajoittuneet vain niihin aisteihin, jotka selkeimmin liittyvät lukemiseen (näkö) ja puhuttuun kieleen (kuulo); Ongelmia esiintyi myös muissa aisteissa (tunto). Lukivaikeuksisten lukijoiden ryhmätasolla havaittu aikatarkkuuden ongelma ei kuitenkaan heijastunut yksilötasolle; Jokainen lukivaikeuksinen ei ollut huono aikatarkkuustehtävissä. Näin ollen ei siis voida väittää, että kaikkien lukivaikeuksisten äänteiden käsittelyn tai lukemaan oppimisen vaikeudet voisivat selittyä aistien toimintojen poikkeavuudella. Aikatarkkuuden ongelmat eivät olleet yhteydessä varsinaiseen lukemiseen. Sekä lukivaikeuksisilla lapsilla että aikuisilla todettiin kuitenkin selkeä yhteys aikatarkkuuden ongelmien ja lukemaan oppimisen keskeisen ennakkoehdon, fonologisen prosessoinnin, välillä. Saattaa siis olla, että synnynnäinen aistien toimintojen poikkeavuus vaikuttaa yksilön suoriutumiseen jo ennen varsinaista lukemaan oppimista, kun ne taidot kehittyvät (fonologinen prosessointi), joille myöhempi lukemaan oppiminen perustuu. Ikäännyttäessä havaittu lukivaikeuksisten suhteettoman nopea aikatarkkuuden heikkeneminen osoittaa, että lukivaikeus ei voi olla ongelma, joka koskee vain lapsuusikää, tai vaikeus, joka johtuu vain kehityksen viivästymästä joka kurottaisiin iän myötä umpeen. Tulosten ymmärtämiseksi onkin muistettava kaksi seikkaa. Lukivaikeus on ensinnäkin yhdistetty synnynnäisiin, pieniin, poikkeavuuksiin aivojen rakenteissa ja toiminnoissa. Toisaalta tavanomaiseen ikääntymiseen liittyy se, että aivot kykenevät yhä huonommin korjaamaan ja kiertämään (kompensoimaan) pieniä vaurioita. Tämän perusteella tutkimussarjan tuloksista voidaan päätellä, että lukivaikeuksisten jo synnynnäisesti heikentyneet aivojen kompensointimahdollisuudet eivät ole yhtä tehokkaita puskuroimaan ikääntymisen tavanomaisia vaikutuksia kuin sujuvilla lukijoilla. Yllättävää kuitenkin on, että tämä korostunut heikkeneminen havaittiin jo suhteellisen nuorilla, työikäisillä, lukivaikeuksisilla, ennen 60 ikävuotta. Samanlaista ikäännyttäessä korostuvaa vaikeutta ei lukivaikeuksilla kuitenkaan havaittu päättelyssä, kielellisissä toiminnoissa tai itse lukemisessa. Vaikuttaakin siis siltä, että ne toiminnot, joita on harjaannutettu aktiivisesti, eivät heikkene kasvavan aikuisiän myötä yhtä suhteettomasti. Alkuperäiset artikkelit Laasonen M, Tomma-Halme J, Lahti-Nuuttila P, Service E, and Virsu V (2000) Rate of information segregation in developmentally dyslexic children, Brain and Language, 75(1), 66-81. Laasonen M, Service E, and Virsu V (2001) Temporal order and processing acuity of visual, auditory, and tactile perception in developmentally dyslexic young adults, Cognitive, Affective, and Behavioral Neuroscience, 1(4), 394-410. Laasonen M, Service E, and Virsu V (2002) Crossmodal temporal order and processing acuity in developmentally dyslexic young adults, Brain and Language, 80(3), 340-354. Laasonen M, Lahti-Nuuttila P, and Virsu V (2002) Developmentally impaired processing speed decreases more than normally with age, NeuroReport, 13(9), 1111-1113.

Constructing skilled images

When experts construct mental images, they do not rely only on perceptual features; they also access domain-specific knowledge and skills in long-term memory, which enables them to exceed the capacity limitations of the short-term working memory system. The central question of the present dissertation was whether the facilitating effect of long-term memory knowledge on working memory imagery tasks is primarily based on perceptual chunking or whether it relies on higher-level conceptual knowledge. Three domains of expertise were studied: chess, music, and taxi driving. The effects of skill level, stimulus surface features, and the stimulus structure on incremental construction of mental images were investigated. A method was developed to capture the chunking mechanisms that experts use in constructing images: chess pieces, street names, and visual notes were presented in a piecemeal fashion for later recall. Over 150 experts and non-experts participated in a total of 13 experiments, as reported in five publications. The results showed skill effects in all of the studied domains when experts performed memory and problem solving tasks that required mental imagery. Furthermore, only experts' construction of mental images benefited from meaningful stimuli. Manipulation of the stimulus surface features, such as replacing chess pieces with dots, did not significantly affect experts' performance in the imagery tasks. In contrast, the structure of the stimuli had a significant effect on experts' performance in every task domain. For example, taxi drivers recalled more street names from lists that formed a spatially continuous route than from alphabetically organised lists. The results suggest that the mechanisms of conceptual chunking rather than automatic perceptual pattern matching underlie expert performance, even though the tasks of the present studies required perception-like mental representations. The results show that experts are able to construct skilled images that surpass working memory capacity, and that their images are conceptually organised and interpreted rather than merely depictive.

The effect of interrogative function on intonation in spontaneous and read Finnish

Goals This study aims to map the effect of interrogative function on the intonation of spontaneous and read Finnish. Earlier research shows that the most prominent feature in Finnish question intonation is an appeal to the listener. Question word questions typically start with a high peak which is followed by falling intonation. In yes/no questions, F0 remains on a high level until the word carrying sentence stress and then falls. Final rises are mainly found in intonation clichés such as "Ai mitä?" ("What?") These earlier results are based on read speech and enacted dialogues. In this study, questions and statements found in spontaneous dialogues were compared. These utterances were also compared with read versions of the same utterances. Fundamental frequency values were compared using a mixed model. Contours were also grouped using auditory and visual inspection. Thus it was possible to compare frequencies of contour types according to utterance type and speech style. The position of questions in the F0 distribution of the whole material was also investigated in this study. Method The material consisted of four spontaneous dialogues and their read versions. The speakers were young adults from the Helsinki metropolitan area, four females and four males. The whole material was first divided into broad dialogue function categories arising from the material and F0 curves were calculated for each category. After this, 277 questions and 244 statements were selected for closer inspection. Values reflecting F0 distribution and contour shape were measured from the F0 contours of these utterances. A mixed model was used to analyse the differences. Utterance type, question type, speech style and speaker gender were used as fixed effects. The frequencies of F0 contour types were compared using a Chi square test. Additional material in this study came from eight young female speakers in central Finland. Results and conclusions In the mixed model analysis, significant differences were found both between questions and statements and between spontaneous and read speech. Generally, utterance type affected the variables reflecting contour type while speech style affected the variables reflecting F0 distribution. The effect of question type was not clearly visible. In read speech the contours resembled earlier results more closely. Speakers had different strategies in differentiating between questions and statements. In the whole material, F0 was slightly higher in questions than in statements. The effect of dialectal background could be seen in the contour types. The results show that interrogative function affects intonation in both spontaneous and read Finnish.

Integrated semantic processing of complex pictures and spoken sentences - Evidence from event-related potentials

It has been suggested that semantic information processing is modularized according to the input form (e.g., visual, verbal, non-verbal sound). A great deal of research has concentrated on detecting a separate verbal module. Also, it has traditionally been assumed in linguistics that the meaning of a single clause is computed before integration to a wider context. Recent research has called these views into question. The present study explored whether it is reasonable to assume separate verbal and nonverbal semantic systems in the light of the evidence from event-related potentials (ERPs). The study also provided information on whether the context influences processing of a single clause before the local meaning is computed. The focus was on an ERP called N400. Its amplitude is assumed to reflect the effort required to integrate an item to the preceding context. For instance, if a word is anomalous in its context, it will elicit a larger N400. N400 has been observed in experiments using both verbal and nonverbal stimuli. Contents of a single sentence were not hypothesized to influence the N400 amplitude. Only the combined contents of the sentence and the picture were hypothesized to influence the N400. The subjects (n = 17) viewed pictures on a computer screen while hearing sentences through headphones. Their task was to judge the congruency of the picture and the sentence. There were four conditions: 1) the picture and the sentence were congruent and sensible, 2) the sentence and the picture were congruent, but the sentence ended anomalously, 3) the picture and the sentence were incongruent but sensible, 4) the picture and the sentence were incongruent and anomalous. Stimuli from the four conditions were presented in a semi-randomized sequence. Their electroencephalography was simultaneously recorded. ERPs were computed for the four conditions. The amplitude of the N400 effect was largest in the incongruent sentence-picture -pairs. The anomalously ending sentences did not elicit a larger N400 than the sensible sentences. The results suggest that there is no separate verbal semantic system, and that the meaning of a single clause is not processed independent of the context.

Auditory - Visual Matching in Learning Disabilities : Intervention Studies from Finland and Sweden

The present thesis discusses relevant issues in education: 1) learning disabilities including the role of comorbidity in LDs, and 2) the use of research-based interventions. This thesis consists of a series of four studies (three articles), which deepens the knowledge of the field of special education. Intervention studies (N=242) aimed to examine whether training using a nonverbal auditory-visual matching computer program had a remedial effect in different learning disabilities, such as developmental dyslexia, Attention Deficit Disorder (ADD) and Specific Language Impairment (SLI). These studies were conducted in both Finland and Sweden. The intervention’s non-verbal character made an international perspective possible. The results of the intervention studies confirmed, that the auditory-visual matching computer program, called Audilex had positive intervention effects. In Study I of children with developmental dyslexia there were also improvements in reading skills, specifically in reading nonsense words and reading speed. These improvements in tasks, which are thought to rely on phonological processing, suggest that such reading difficulties in dyslexia may stem in part from more basic perceptual difficulties, including those required to manage the visual and auditory components of the decoding task. In Study II the intervention had a positive effect on children with dyslexia; older students with dyslexia and surprisingly, students with ADD also benefited from this intervention. In conclusion, the role of comorbidity was apparent. An intervention effect was evident also in students’ school behavior. Study III showed that children with SLI experience difficulties very similar to those of children with dyslexia in auditory-visual matching. Children with language-based learning disabilities, such as dyslexia and SLI benefited from the auditory-visual matching intervention. Also comorbidity was evident among these children; in addition to formal diagnoses, comorbidity was explored with an assessment inventory, which was developed for this thesis. Interestingly, an overview of the data of this thesis shows positive intervention effects in all studies despite learning disability, language, gender or age. These findings have been described by a concept inter-modal transpose. Self-evidently these issues need further studies. In learning disabilities the aim in the future will also be to identify individuals at risk rather than by deficit; this aim can be achieved by using research-based interventions, intensified support in general education and inclusive special education. Keywords: learning disabilities, developmental dyslexia, attention deficit disorder, specific language impairment, language-based learning disabilities, comorbidity, auditory-visual matching, research-based interventions, inter-modal transpose