Auditory - Visual Matching in Learning Disabilities : Intervention Studies from Finland and Sweden

The present thesis discusses relevant issues in education: 1) learning disabilities including the role of comorbidity in LDs, and 2) the use of research-based interventions. This thesis consists of a series of four studies (three articles), which deepens the knowledge of the field of special education. Intervention studies (N=242) aimed to examine whether training using a nonverbal auditory-visual matching computer program had a remedial effect in different learning disabilities, such as developmental dyslexia, Attention Deficit Disorder (ADD) and Specific Language Impairment (SLI). These studies were conducted in both Finland and Sweden. The intervention’s non-verbal character made an international perspective possible. The results of the intervention studies confirmed, that the auditory-visual matching computer program, called Audilex had positive intervention effects. In Study I of children with developmental dyslexia there were also improvements in reading skills, specifically in reading nonsense words and reading speed. These improvements in tasks, which are thought to rely on phonological processing, suggest that such reading difficulties in dyslexia may stem in part from more basic perceptual difficulties, including those required to manage the visual and auditory components of the decoding task. In Study II the intervention had a positive effect on children with dyslexia; older students with dyslexia and surprisingly, students with ADD also benefited from this intervention. In conclusion, the role of comorbidity was apparent. An intervention effect was evident also in students’ school behavior. Study III showed that children with SLI experience difficulties very similar to those of children with dyslexia in auditory-visual matching. Children with language-based learning disabilities, such as dyslexia and SLI benefited from the auditory-visual matching intervention. Also comorbidity was evident among these children; in addition to formal diagnoses, comorbidity was explored with an assessment inventory, which was developed for this thesis. Interestingly, an overview of the data of this thesis shows positive intervention effects in all studies despite learning disability, language, gender or age. These findings have been described by a concept inter-modal transpose. Self-evidently these issues need further studies. In learning disabilities the aim in the future will also be to identify individuals at risk rather than by deficit; this aim can be achieved by using research-based interventions, intensified support in general education and inclusive special education. Keywords: learning disabilities, developmental dyslexia, attention deficit disorder, specific language impairment, language-based learning disabilities, comorbidity, auditory-visual matching, research-based interventions, inter-modal transpose

Developmental, functional brain imaging and electrophysiological evidence of visual and auditory working memory

Intact function of working memory (WM) is essential for children and adults to cope with every day life. Children with deficits in WM mechanisms have learning difficulties that are often accompanied by behavioral problems. The neural processes subserving WM, and brain structures underlying this system, continue to develop during childhood till adolescence and young adulthood. With functional magnetic resonance imaging (fMRI) it is possible to investigate the organization and development of WM. The present thesis aimed to investigate, using behavioral and neuroimaging methods, whether mnemonic processing of spatial and nonspatial visual information is segregated in the developing and mature human brain. A further aim in this research was to investigate the organization and development of audiospatial and visuospatial information processing in WM. The behavioral results showed that spatial and nonspatial visual WM processing is segregated in the adult brain. The fMRI result in children suggested that memory load related processing of spatial and nonspatial visual information engages common cortical networks, whereas selective attention to either type of stimuli recruits partially segregated areas in the frontal, parietal and occipital cortices. Deactivation mechanisms that are important in the performance of WM tasks in adults are already operational in healthy school-aged children. Electrophysiological evidence suggested segregated mnemonic processing of visual and auditory location information. The results of the development of audiospatial and visuospatial WM demonstrate that WM performance improves with age, suggesting functional maturation of underlying cognitive processes and brain areas. The development of the performance of spatial WM tasks follows a different time course in boys and girls indicating a larger degree of immaturity in the male than female WM systems. Furthermore, the differences in mastering auditory and visual WM tasks may indicate that visual WM reaches functional maturity earlier than the corresponding auditory system. Spatial WM deficits may underlie some learning difficulties and behavioral problems related to impulsivity, difficulties in concentration, and hyperactivity. Alternatively, anxiety or depressive symptoms may affect WM function and the ability to concentrate, being thus the primary cause of poor academic achievement in children.

Sexing Sirenians: Validation of Visual and Molecular Sex Determination in Both Wild Dugongs (Dugong dugon) and Florida Manatees (Trichechus manatus latirostris)

Sexing wild marine mammals that show little to no sexual dimorphism is challenging. For sirenians that are difficult to catch or approach closely, molecular sexing from tissue biopsies offers an alternative method to visual discrimination. This paper reports the results of a field study to validate the use of two sexing methods: (1) visual discrimination of sex vs (2) molecular sexing based on a multiplex PCR assay which amplifies the male-specific SRY gene and differentiates ZFX and ZFY gametologues. Skin samples from 628 dugongs (Dugong dugon) and 100 Florida manatees (Trichechus manatus latirostris) were analysed and assigned as male or female based on molecular sex. These individuals were also assigned a sex based on either direct observation of the genitalia and/or the association of the individual with a calf. Individuals of both species showed 93 to 96% congruence between visual and molecular sexing. For the remaining 4 to 7%, the discrepancies could be explained by human error. To mitigate this error rate, we recommend using both of these robust techniques, with routine inclusion of sex primers into microsatellite panels employed for identity, along with trained field observers and stringent sample handling.

Water bottles from China: Decoding visual grammar

On the ALEA Study Tour to China, Beryl Exley and her roomie Kathryn O’Sullivan pondered over their first night dilemma whilst staying at a hotel in Beijing. They read the room service guide (in English) which advised against drinking the tap water and confirming the supply of one bottle of complementary water per guest per day. The room service guide listed ‘special’ bottled water was the equivalent of $AUS7 per bottle. However the dilemma was this: sitting on the shelf above the fridge were three different kinds of water-like bottles. Each had a different label, written mainly in Chinese characters. Not wanting to mistake the bottles, Beryl and Kathryn set about decoding the text of the three bottles in question.

Fisheries Queensland Long Term Monitoring Program Underwater Visual Census of twenty-four reefs on the Great Barrier Reef between 1999 and 2004.

In 1999, the Department of Employment, Economic Development and Innovation (DEEDI), Fisheries Queensland undertook a new initiative to collect long term monitoring data of various important stocks including reef fish. This data and monitoring manual for the reef fish component of that program which was based on Underwater Visual Census methodology of 24 reefs on the Great Barrier Reef between 1999 and 2004. Data was collected using six 50m x 5m transects at 4 sites on 24 reefs. Benthic cover type was also recorded for 10m of each transect. The attached Access Database contains 5 tables being: SITE DETAILS TABLE Survey year Data entry complete REF survey site ID Site # (1-4) Location (reef name) Site Date (date surveyed) Observer 1 (3 initials to identify who estimated fish lengths and recorded benthic cover) TRANSECT DETAILS Survey ID Transect Number (1-6) Time (the transect was surveyed) Visibility (in metres) Minimum Depth surveyed (m) Maximum Depth surveyed (m) Percent of survey completed (%) Comments SUBSTRATE Survey ID Transect Number (1-6) then % cover of each of eth following categories of benthic cover types Dead Coral Live Coral Soft Coral Rubble Sand Sponge Algae Sea Grass Other COORDINATES (over survey sites) from -14 38.792 to -19 44.233 and from 145 21.507 to 149 55.515 SIGHTINGS ID Survey ID Transect Number (1-6) CAAB Code Scientific Name Reef Fish Length (estimated Fork Length of fish; -1 = unknown or not recorded) Outside Transect (if a fish was observed outside a transect -1 was recorded) Morph Code (F = footballer morph for Plectropomus laevis, S = Spawning colour morph displayed)

Visual no-man’s land

Professor Nathan Efron recounts his experience in ‘visual no-man’s land’ – a particularly stressful phase of his ophthalmic journey of retinopexy, cryopexy, vitrectomy and IOL surgery attributed to extreme surgically-induced anisometropia.

Do small-aperture presbyopic corrections influence the visual field?

Purpose To explore the effect of small-aperture optics, designed to aid presbyopes by increasing ocular depth-of-focus, on measurements of the visual field. Methods Simple theoretical and ray-tracing models were used to predict the impact of different designs of small-aperture contact lenses or corneal inlays on the proportion of light passing through natural pupils of various diameters as a function of the direction in the visual field. The left eyes of five healthy volunteers were tested using three afocal, hand-painted opaque soft contact lenses (www.davidthomas.com). Two were opaque over a 10 mm diameter but had central clear circular apertures of 1.5 and 3.0 mm in diameter. The third had an annular opaque zone with inner and outer diameters of 1.5 and 4.0 mm, approximately simulating the geometry of the KAMRA inlay (www.acufocus.com). A fourth, clear lens was used for comparison purposes. Visual fields along the horizontal meridian were evaluated up to 50° eccentricity with static automated perimetry (Medmont M700, stimulus Goldmann-size III; www.medmont.com). Results According to ray-tracing, the two lenses with the circular apertures were expected to reduce the relative transmittance of the pupil to zero at specific field angles (around 60° for the conditions of the experimental measurements). In contrast, the annular stop had no effect on the absolute field but relative transmittance was reduced over the central area of the field, the exact effects depending upon the natural pupil diameter. Experimental results broadly agreed with these theoretical expectations. With the 1.5 and 3.0 mm pupils, only minor losses in sensitivity (around 2 dB) in comparison with the clear-lens case occurred across the central 10° radius of field. Beyond this angle, sensitivity losses increased, to reach about 7 dB at the edge of the measured field (50°). The field results with the annular stop showed at most only a slight loss in sensitivity (≤3 dB) across the measured field. Conclusion The present theoretical and experimental results support earlier clinical findings that KAMRA-type annular stops, unlike circular artificial pupils, have only minor effects on measurements of the visual field.

MPC controlled multirotor with suspended slung load: System architecture and visual load detection

There is an increased interest in the use of Unmanned Aerial Vehicles for load transportation from environmental remote sensing to construction and parcel delivery. One of the main challenges is accurate control of the load position and trajectory. This paper presents an assessment of real flight trials for the control of an autonomous multi-rotor with a suspended slung load using only visual feedback to determine the load position. This method uses an onboard camera to take advantage of a common visual marker detection algorithm to robustly detect the load location. The load position is calculated using an onboard processor, and transmitted over a wireless network to a ground station integrating MATLAB/SIMULINK and Robotic Operating System (ROS) and a Model Predictive Controller (MPC) to control both the load and the UAV. To evaluate the system performance, the position of the load determined by the visual detection system in real flight is compared with data received by a motion tracking system. The multi-rotor position tracking performance is also analyzed by conducting flight trials using perfect load position data and data obtained only from the visual system. Results show very accurate estimation of the load position (~5% Offset) using only the visual system and demonstrate that the need for an external motion tracking system is not needed for this task.

Evaluation of visual stress symptoms in Age-matched Dyslexic, Meares–Irlen syndrome (MIS) and normal adults

AIM To examine the prevalence of dyslexia and Meares–Irlen syndrome (MIS) among female students and determine their level of visual stress in comparison with normal subjects. METHODS A random sample of 450 female medical students of King Saud University Riyadh (age range, 18 - 30 years) responded to a wide range of questions designed to accomplish the aims of this study. The detailed questionnaire consisted of 54 questions with twelve questions enquiring on ocular history and demography of participants while 42 questions were on visual symptoms. Items were categorized into; critical and non-critical questions (CQ and NCQ) and were rated on four point Likert scale. Based on the responses obtained, the subjects were grouped into normal (control), dyslexic with or without MIS (Group 1) and subjects with MIS only (Group 2). Responses were analysed as averages and mean scores were calculated and compared between-groups using one way analysis of variance to evaluate total (TVSS = NCQ + CQ), critical and non-critical visual stress scores. The relationship between categorical variables such as age, handedness and condition were assessed with Chi- Square test. RESULTS The completion rate was 96.8% and majority of the respondents (92%) were normal readers, 2% dyslexic and 6% had MIS. They were age-matched. More than half of the participants had visited an eye care practitioner in the last 2yrs. About 13% were recommended eye exercises and one participant experienced pattern glare. Hand preference was not associated with any condition but Group 1 subjects (3/9, 33%) were significantly more likely to be diagnosed of lazy eye than Group 2 (2/27, 7%) and control (27/414, 5%) subjects. The mean ± SD of TVSS responses were 63 ± 14 but it was 44 ± 9 for CQ and 19 ± 5 for NCQ. Responses from all three variables were normally distributed but the CQ responses were on the average more positive (82%) in Group 2 and less positive (46%) in Group 1 than control. With NCQ, the responses were equally less positive in Group 1 and 2 than control. Group 2 subjects showed significantly higher TVSS (P = 0.002), NCQ (P = 0.006) and CQ (P = 0.008) visual stress scores than control but no difference between Group 1 and control subjects, was observed for all scores (P > 0.05, for all comparisons). CONCLUSION The prevalence of dyslexia and MIS among Saudi female students was 2 and 6%, respectively. Critical questions performed best for assessing visual stress symptoms in dyslexic and MIS subjects. Generally, students with MIS were more sensitive to visual stress than normal students but dyslexics were more likely to present with a lazy eye than MIS and normal readers.

Relational accountability in Indigenizing visual research for participatory communication

This article argues that an indigenous approach to communication research allows us to re-think academic approaches of engaging in and evaluating participatory communication research. It takes as its case study the Komuniti Tok Piksa project undertaken in the Highlands of Papua New Guinea. The project explores ways in which visual methods when paired with a community action approach embedded within an indigenous framework can be used to facilitate social change through meaningful participation. It involves communities to narrate their experiences in regard to HIV and AIDS and assists them in designing and recording their own messages. Local researchers are trained in using visual tools to facilitate this engagement with the communities.

A model for visual recognition of alphanumerics

In this paper we propose a hypothetical scheme for recognizing the alphanumerics. The scheme is based on the known physiological structure of the visual cortex and the concept of a short Lino extractor nouron (SLEN). We assumo four basic typca of such units for extracting vertical, horizontal, right and left inclined straight line segments. The patterns reconstructed from the scheme show perfect agreement with the test patterns. The model indicates that the recognition of letters T and H requires extraction of the largest number of features.

A Probabilistic Approach to the Primary Visual Cortex

What can the statistical structure of natural images teach us about the human brain? Even though the visual cortex is one of the most studied parts of the brain, surprisingly little is known about how exactly images are processed to leave us with a coherent percept of the world around us, so we can recognize a friend or drive on a crowded street without any effort. By constructing probabilistic models of natural images, the goal of this thesis is to understand the structure of the stimulus that is the raison d etre for the visual system. Following the hypothesis that the optimal processing has to be matched to the structure of that stimulus, we attempt to derive computational principles, features that the visual system should compute, and properties that cells in the visual system should have. Starting from machine learning techniques such as principal component analysis and independent component analysis we construct a variety of sta- tistical models to discover structure in natural images that can be linked to receptive field properties of neurons in primary visual cortex such as simple and complex cells. We show that by representing images with phase invariant, complex cell-like units, a better statistical description of the vi- sual environment is obtained than with linear simple cell units, and that complex cell pooling can be learned by estimating both layers of a two-layer model of natural images. We investigate how a simplified model of the processing in the retina, where adaptation and contrast normalization take place, is connected to the nat- ural stimulus statistics. Analyzing the effect that retinal gain control has on later cortical processing, we propose a novel method to perform gain control in a data-driven way. Finally we show how models like those pre- sented here can be extended to capture whole visual scenes rather than just small image patches. By using a Markov random field approach we can model images of arbitrary size, while still being able to estimate the model parameters from the data.

Learning Nonlinear Visual Processing from Natural Images

The paradigm of computational vision hypothesizes that any visual function -- such as the recognition of your grandparent -- can be replicated by computational processing of the visual input. What are these computations that the brain performs? What should or could they be? Working on the latter question, this dissertation takes the statistical approach, where the suitable computations are attempted to be learned from the natural visual data itself. In particular, we empirically study the computational processing that emerges from the statistical properties of the visual world and the constraints and objectives specified for the learning process. This thesis consists of an introduction and 7 peer-reviewed publications, where the purpose of the introduction is to illustrate the area of study to a reader who is not familiar with computational vision research. In the scope of the introduction, we will briefly overview the primary challenges to visual processing, as well as recall some of the current opinions on visual processing in the early visual systems of animals. Next, we describe the methodology we have used in our research, and discuss the presented results. We have included some additional remarks, speculations and conclusions to this discussion that were not featured in the original publications. We present the following results in the publications of this thesis. First, we empirically demonstrate that luminance and contrast are strongly dependent in natural images, contradicting previous theories suggesting that luminance and contrast were processed separately in natural systems due to their independence in the visual data. Second, we show that simple cell -like receptive fields of the primary visual cortex can be learned in the nonlinear contrast domain by maximization of independence. Further, we provide first-time reports of the emergence of conjunctive (corner-detecting) and subtractive (opponent orientation) processing due to nonlinear projection pursuit with simple objective functions related to sparseness and response energy optimization. Then, we show that attempting to extract independent components of nonlinear histogram statistics of a biologically plausible representation leads to projection directions that appear to differentiate between visual contexts. Such processing might be applicable for priming, \ie the selection and tuning of later visual processing. We continue by showing that a different kind of thresholded low-frequency priming can be learned and used to make object detection faster with little loss in accuracy. Finally, we show that in a computational object detection setting, nonlinearly gain-controlled visual features of medium complexity can be acquired sequentially as images are encountered and discarded. We present two online algorithms to perform this feature selection, and propose the idea that for artificial systems, some processing mechanisms could be selectable from the environment without optimizing the mechanisms themselves. In summary, this thesis explores learning visual processing on several levels. The learning can be understood as interplay of input data, model structures, learning objectives, and estimation algorithms. The presented work adds to the growing body of evidence showing that statistical methods can be used to acquire intuitively meaningful visual processing mechanisms. The work also presents some predictions and ideas regarding biological visual processing.