Auditory - Visual Matching in Learning Disabilities : Intervention Studies from Finland and Sweden

The present thesis discusses relevant issues in education: 1) learning disabilities including the role of comorbidity in LDs, and 2) the use of research-based interventions. This thesis consists of a series of four studies (three articles), which deepens the knowledge of the field of special education. Intervention studies (N=242) aimed to examine whether training using a nonverbal auditory-visual matching computer program had a remedial effect in different learning disabilities, such as developmental dyslexia, Attention Deficit Disorder (ADD) and Specific Language Impairment (SLI). These studies were conducted in both Finland and Sweden. The intervention’s non-verbal character made an international perspective possible. The results of the intervention studies confirmed, that the auditory-visual matching computer program, called Audilex had positive intervention effects. In Study I of children with developmental dyslexia there were also improvements in reading skills, specifically in reading nonsense words and reading speed. These improvements in tasks, which are thought to rely on phonological processing, suggest that such reading difficulties in dyslexia may stem in part from more basic perceptual difficulties, including those required to manage the visual and auditory components of the decoding task. In Study II the intervention had a positive effect on children with dyslexia; older students with dyslexia and surprisingly, students with ADD also benefited from this intervention. In conclusion, the role of comorbidity was apparent. An intervention effect was evident also in students’ school behavior. Study III showed that children with SLI experience difficulties very similar to those of children with dyslexia in auditory-visual matching. Children with language-based learning disabilities, such as dyslexia and SLI benefited from the auditory-visual matching intervention. Also comorbidity was evident among these children; in addition to formal diagnoses, comorbidity was explored with an assessment inventory, which was developed for this thesis. Interestingly, an overview of the data of this thesis shows positive intervention effects in all studies despite learning disability, language, gender or age. These findings have been described by a concept inter-modal transpose. Self-evidently these issues need further studies. In learning disabilities the aim in the future will also be to identify individuals at risk rather than by deficit; this aim can be achieved by using research-based interventions, intensified support in general education and inclusive special education. Keywords: learning disabilities, developmental dyslexia, attention deficit disorder, specific language impairment, language-based learning disabilities, comorbidity, auditory-visual matching, research-based interventions, inter-modal transpose

Generations and turnout : The generational effect in electoral participation in Finland

The relationship between age and turnout has been curve-linear as electoral participation first increases with age, remains relatively stable throughout middle-age and then gradually declines as certain physical infirmities set in (see e.g. Milbrath 1965). Alongside this life-cycle effect in voting, recent pooled cross-sectional analyses (see e.g. Blais et al. 2004; Lyons and Alexander 2000) have shown that there is also a generational effect, referring to lasting differences in turnout between various age groups. This study firstly examines the extent to which the generational effect applies in the Finnish context. Secondly, it investigates the factors accounting for that effect. The first article, based on individual-level register data from the parliamentary elections of 1999, shows that turnout differences between the different age groups would be even larger if there were no differences in social class and education. The second article examines simultaneously the effects of age, generation and period in the Finnish parliamentary elections of 1975-2003 based on pooled data from Finnish voter barometers (N = 8,634). The results show that there is a clear life cycle, generational and period effect. The third article examines the role of political socialisation in accounting for generational differences in electoral participation. Political socialisation is defined as the learning process in which an individual adopts various values, political attitudes, and patterns of actions from his or her environment. The multivariate analysis, based on the Finnish national election study 2003 (N=1,270), indicated that if there were no differences in socialisation between the youngest and the older generations, the difference in turnout would be much larger than if only sex and socioeconomic factors are controlled for. The fourth article examines other possible factors related to generational effect in voting. The results mainly apply to the Finnish parliamentary elections of 2003 in which we have data available. The results show that the sense of duty by far accounts for the generational effect in voting. Political interest, political knowledge and non-parliamentary participation also narrowed the differences in electoral participation between the youngest and the second youngest generations. The implication of the findings is that the lower turnout among the current youth is not a passing phenomenon that will diminish with age. Considering voting a civic duty and understanding the meaning of collective action are both associated with the process of political socialisation which therefore has an important role concerning the generational effect in turnout.

Prototype learning methods for online handwriting recognition

In this paper, we study different methods for prototype selection for recognizing handwritten characters of Tamil script. In the first method, cumulative pairwise- distances of the training samples of a given class are used to select prototypes. In the second method, cumulative distance to allographs of different orientation is used as a criterion to decide if the sample is representative of the group. The latter method is presumed to offset the possible orientation effect. This method still uses fixed number of prototypes for each of the classes. Finally, a prototype set growing algorithm is proposed, with a view to better model the differences in complexity of different character classes. The proposed algorithms are tested and compared for both writer independent and writer adaptation scenarios.

Dictionary-Learning-Based Post-Filter for HMM-Based Speech Synthesis

Oversmoothing of speech parameter trajectories is one of the causes for quality degradation of HMM-based speech synthesis. Various methods have been proposed to overcome this effect, the most recent ones being global variance (GV) and modulation-spectrum-based post-filter (MSPF). However, there is still a significant quality gap between natural and synthesized speech. In this paper, we propose a two-fold post-filtering technique to alleviate to a certain extent the oversmoothing of spectral and excitation parameter trajectories of HMM-based speech synthesis. For the spectral parameters, we propose a sparse coding-based post-filter to match the trajectories of synthetic speech to that of natural speech, and for the excitation trajectory, we introduce a perceptually motivated post-filter. Experimental evaluations show quality improvement compared with existing methods.

Transfer of dynamic learning across postures.

When learning a difficult motor task, we often decompose the task so that the control of individual body segments is practiced in isolation. But on re-composition, the combined movements can result in novel and possibly complex internal forces between the body segments that were not experienced (or did not need to be compensated for) during isolated practice. Here we investigate whether dynamics learned in isolation by one part of the body can be used by other parts of the body to immediately predict and compensate for novel forces between body segments. Subjects reached to targets while holding the handle of a robotic, force-generating manipulandum. One group of subjects was initially exposed to the novel robot dynamics while seated and was then tested in a standing position. A second group was tested in the reverse order: standing then sitting. Both groups adapted their arm dynamics to the novel environment, and this movement learning transferred between seated and standing postures and vice versa. Both groups also generated anticipatory postural adjustments when standing and exposed to the force field for several trials. In the group that had learned the dynamics while seated, the appropriate postural adjustments were observed on the very first reach on standing. These results suggest that the CNS can immediately anticipate the effect of learned movement dynamics on a novel whole-body posture. The results support the existence of separate mappings for posture and movement, which encode similar dynamics but can be adapted independently.

Various algorithms for optimization and learning in adaptive systems

This thesis discusses various methods for learning and optimization in adaptive systems. Overall, it emphasizes the relationship between optimization, learning, and adaptive systems; and it illustrates the influence of underlying hardware upon the construction of efficient algorithms for learning and optimization. Chapter 1 provides a summary and an overview.

Chapter 2 discusses a method for using feed-forward neural networks to filter the noise out of noise-corrupted signals. The networks use back-propagation learning, but they use it in a way that qualifies as unsupervised learning. The networks adapt based only on the raw input data-there are no external teachers providing information on correct operation during training. The chapter contains an analysis of the learning and develops a simple expression that, based only on the geometry of the network, predicts performance.

Chapter 3 explains a simple model of the piriform cortex, an area in the brain involved in the processing of olfactory information. The model was used to explore the possible effect of acetylcholine on learning and on odor classification. According to the model, the piriform cortex can classify odors better when acetylcholine is present during learning but not present during recall. This is interesting since it suggests that learning and recall might be separate neurochemical modes (corresponding to whether or not acetylcholine is present). When acetylcholine is turned off at all times, even during learning, the model exhibits behavior somewhat similar to Alzheimer's disease, a disease associated with the degeneration of cells that distribute acetylcholine.

Chapters 4, 5, and 6 discuss algorithms appropriate for adaptive systems implemented entirely in analog hardware. The algorithms inject noise into the systems and correlate the noise with the outputs of the systems. This allows them to estimate gradients and to implement noisy versions of gradient descent, without having to calculate gradients explicitly. The methods require only noise generators, adders, multipliers, integrators, and differentiators; and the number of devices needed scales linearly with the number of adjustable parameters in the adaptive systems. With the exception of one global signal, the algorithms require only local information exchange.

Optimal Data Distributions in Machine Learning

In the first part of the thesis we explore three fundamental questions that arise naturally when we conceive a machine learning scenario where the training and test distributions can differ. Contrary to conventional wisdom, we show that in fact mismatched training and test distribution can yield better out-of-sample performance. This optimal performance can be obtained by training with the dual distribution. This optimal training distribution depends on the test distribution set by the problem, but not on the target function that we want to learn. We show how to obtain this distribution in both discrete and continuous input spaces, as well as how to approximate it in a practical scenario. Benefits of using this distribution are exemplified in both synthetic and real data sets.

In order to apply the dual distribution in the supervised learning scenario where the training data set is fixed, it is necessary to use weights to make the sample appear as if it came from the dual distribution. We explore the negative effect that weighting a sample can have. The theoretical decomposition of the use of weights regarding its effect on the out-of-sample error is easy to understand but not actionable in practice, as the quantities involved cannot be computed. Hence, we propose the Targeted Weighting algorithm that determines if, for a given set of weights, the out-of-sample performance will improve or not in a practical setting. This is necessary as the setting assumes there are no labeled points distributed according to the test distribution, only unlabeled samples.

Finally, we propose a new class of matching algorithms that can be used to match the training set to a desired distribution, such as the dual distribution (or the test distribution). These algorithms can be applied to very large datasets, and we show how they lead to improved performance in a large real dataset such as the Netflix dataset. Their computational complexity is the main reason for their advantage over previous algorithms proposed in the covariate shift literature.

In the second part of the thesis we apply Machine Learning to the problem of behavior recognition. We develop a specific behavior classifier to study fly aggression, and we develop a system that allows analyzing behavior in videos of animals, with minimal supervision. The system, which we call CUBA (Caltech Unsupervised Behavior Analysis), allows detecting movemes, actions, and stories from time series describing the position of animals in videos. The method summarizes the data, as well as it provides biologists with a mathematical tool to test new hypotheses. Other benefits of CUBA include finding classifiers for specific behaviors without the need for annotation, as well as providing means to discriminate groups of animals, for example, according to their genetic line.

Perinatal hipoxic ischemic injury in the auditory pathway and the effect of several neuroprotective agents

192 p.

Context-dependent partitioning of motor learning in bimanual movements.

Human subjects easily adapt to single dynamic or visuomotor perturbations. In contrast, when two opposing dynamic or visuomotor perturbations are presented sequentially, interference is often observed. We examined the effect of bimanual movement context on interference between opposing perturbations using pairs of contexts, in which the relative direction of movement between the two arms was different across the pair. When each perturbation direction was associated with a different bimanual context, such as movement of the arms in the same direction versus movement in the opposite direction, interference was dramatically reduced. This occurred over a short period of training and was seen for both dynamic and visuomotor perturbations, suggesting a partitioning of motor learning for the different bimanual contexts. Further support for this was found in a series of transfer experiments. Having learned a single dynamic or visuomotor perturbation in one bimanual context, subjects showed incomplete transfer of this learning when the context changed, even though the perturbation remained the same. In addition, we examined a bimanual context in which one arm was moved passively and show that the reduction in interference requires active movement. The sensory consequences of movement are thus insufficient to allow opposing perturbations to be co-represented. Our results suggest different bimanual movement contexts engage at least partially separate representations of dynamics and kinematics in the motor system.

Effects of the user model on simulation-based learning of dialogue strategies

Over the past decade, a variety of user models have been proposed for user simulation-based reinforcement-learning of dialogue strategies. However, the strategies learned with these models are rarely evaluated in actual user trials and it remains unclear how the choice of user model affects the quality of the learned strategy. In particular, the degree to which strategies learned with a user model generalise to real user populations has not be investigated. This paper presents a series of experiments that qualitatively and quantitatively examine the effect of the user model on the learned strategy. Our results show that the performance and characteristics of the strategy are in fact highly dependent on the user model. Furthermore, a policy trained with a poor user model may appear to perform well when tested with the same model, but fail when tested with a more sophisticated user model. This raises significant doubts about the current practice of learning and evaluating strategies with the same user model. The paper further investigates a new technique for testing and comparing strategies directly on real human-machine dialogues, thereby avoiding any evaluation bias introduced by the user model. © 2005 IEEE.

The stress experience dependent long-term depression disassociated with stress effect on spatial memory task

Behavioral stress can either block or facilitate memory and affect the induction of long-term potentiation (LTP) and long-term depression (LTD). However, the relevance of the stress experience-dependent long-term depression (SLTD) to spatial memory task is unknown. Here we have investigated the effects of acute and sub-acute elevated platform (EP) and foot shock (FS) stress on LTD induction in CA1 region of the hippocampus of anesthetized rats and spatial memory in Morris water maze. We found that LTD was facilitated by acute EP stress, but not by sub-acute EP stress that may be due to the fast adaptation of the animals to this naturalistic mild stress. However, FS stress, an inadaptable strong stress, facilitated LTD induction both in acute and sub-acute treatment. In addition, with the same stress protocols, acute EP stress impaired spatial memory but the sub-acute EP stressed animals performed the spatial memory task as well as the controls, may due to the same reason of adaptation. However, acute FS stress slightly impaired learning but sub-acute FS even enhanced memory retrieval. Our results showed that SLTD was disassociated with the effect of stress on memory task but might be related to stress experience-dependent form of aberrant memory. (C) 2003 Elsevier Science Ireland Ltd. and the Japan Neuroscience Society. All rights reserved.

Effects of Prenatal Exposure to a 50-Hz Magnetic Field on One-Trial Passive Avoidance Learning in 1-Day-Old Chicks

We investigated memory impairment in newly hatched chicks following in ovo exposure to a 50-Hz magnetic field (MF) of 2 mT (60 min/day) on embryonic days 12-18. Isolated and paired chicks were used to test the effect of stress during training, and memory retention was tested at 10, 30, and 120 min, following exposure to a bitter-tasting bead (100% methylanthranilate). Results showed that memory was intact at 10 min in both isolated and paired chicks with or without MF exposure. However, while isolated chicks had good memory retention levels at 30 and 120 min, those exposed to MF did not. The results suggest a potential disruption of memory formation following in ovo exposure to MF, with this effect only evident in the more stressed, isolated chicks. Bioelectromagnetics 31:150-155, 2010. (C) 2009 Wiley-Liss. Inc.

Lead exposure through gestation-only caused long-term learning/memory deficits in young adult offspring

Numerous observations in clinical and preclinical studies indicate that the developing brain is particular sensitive to lead (Pb)'s pernicious effects. However, the effect of gestation-only Pb exposure on cognitive functions at maturation has not been studied. We investigated the potential effects of three levels of Pb exposure (low, middle, and high Pb: 0.03%, 0.09%, and 0.27% of lead acetate-containing diets) at the gestational period on the spatial memory of young adult offspring by Morris water maze spatial learning and fixed location/visible platform tasks. Our results revealed that three levels of Pb exposure significantly impaired memory retrieval in male offspring, but only female offspring at low levels of Pb exposure showed impairment of memory retrieval. These impairments were not due to the gross disturbances in motor performance and in vision because these animals performed the fixed location/visible platform task as well as controls, indicating that the specific aspects of spatial learning/memory were impaired. These results suggest that exposure to Pb during the gestational period is sufficient to cause long-term learning/memory deficits in young adult offspring. (C) 2003 Elsevier Inc. All rights reserved.

The effect of acute stress on LTP and LTD induction in the hippocampal CA1 region of anesthetized rats at three different ages

Not all experiences are memorized equally well. Especially, some types of stress are unavoidable in daily life and the stress experience can be memorized for life. Previous evidence has showed that synaptic plasticity, such as long-term potentiation (LTP) that may be the major cellular model of the mechanism underlying learning and memory, is influenced by behavioral stress. However, the effect of behavioral stress on age-related synaptic plasticity in-vivo was primarily known. Here we found that the LTP induction in the hippocampal CA1 region of anesthetized rats obviously showed inverted-U shape related to ages (4, 10 and 74 weeks old rats), but low-frequency stimulation was unable to induce reliable long-term depression (LTD) in these animals. Furthermore, acute elevated platform (EP) stress enabled reliable LTD significantly and completely blocked LTP induction at these ages. Importantly, LTD after exposure to acute EP stress showed similar magnitude over these ages. The present results that stress enables LTD but impairs LTP induction at these three ages strengthen a view that stress experience-dependent LTD (SLTD) may underlie stress form of aberrant memories. (C) 2004 Elsevier B.V. All rights reserved.

The effect of contextual cues on the encoding of motor memories.

Several studies have shown that sensory contextual cues can reduce the interference observed during learning of opposing force fields. However, because each study examined a small set of cues, often in a unique paradigm, the relative efficacy of different sensory contextual cues is unclear. In the present study we quantify how seven contextual cues, some investigated previously and some novel, affect the formation and recall of motor memories. Subjects made movements in a velocity-dependent curl field, with direction varying randomly from trial to trial but always associated with a unique contextual cue. Linking field direction to the cursor or background color, or to peripheral visual motion cues, did not reduce interference. In contrast, the orientation of a visual object attached to the hand cursor significantly reduced interference, albeit by a small amount. When the fields were associated with movement in different locations in the workspace, a substantial reduction in interference was observed. We tested whether this reduction in interference was due to the different locations of the visual feedback (targets and cursor) or the movements (proprioceptive). When the fields were associated only with changes in visual display location (movements always made centrally) or only with changes in the movement location (visual feedback always displayed centrally), a substantial reduction in interference was observed. These results show that although some visual cues can lead to the formation and recall of distinct representations in motor memory, changes in spatial visual and proprioceptive states of the movement are far more effective than changes in simple visual contextual cues.