Visual search and eye movements: Studies of perceptual span

In visual search one tries to find the currently relevant item among other, irrelevant items. In the present study, visual search performance for complex objects (characters, faces, computer icons and words) was investigated, and the contribution of different stimulus properties, such as luminance contrast between characters and background, set size, stimulus size, colour contrast, spatial frequency, and stimulus layout were investigated. Subjects were required to search for a target object among distracter objects in two-dimensional stimulus arrays. The outcome measure was threshold search time, that is, the presentation duration of the stimulus array required by the subject to find the target with a certain probability. It reflects the time used for visual processing separated from the time used for decision making and manual reactions. The duration of stimulus presentation was controlled by an adaptive staircase method. The number and duration of eye fixations, saccade amplitude, and perceptual span, i.e., the number of items that can be processed during a single fixation, were measured. It was found that search performance was correlated with the number of fixations needed to find the target. Search time and the number of fixations increased with increasing stimulus set size. On the other hand, several complex objects could be processed during a single fixation, i.e., within the perceptual span. Search time and the number of fixations depended on object type as well as luminance contrast. The size of the perceptual span was smaller for more complex objects, and decreased with decreasing luminance contrast within object type, especially for very low contrasts. In addition, the size and shape of perceptual span explained the changes in search performance for different stimulus layouts in word search. Perceptual span was scale invariant for a 16-fold range of stimulus sizes, i.e., the number of items processed during a single fixation was independent of retinal stimulus size or viewing distance. It is suggested that saccadic visual search consists of both serial (eye movements) and parallel (processing within perceptual span) components, and that the size of the perceptual span may explain the effectiveness of saccadic search in different stimulus conditions. Further, low-level visual factors, such as the anatomical structure of the retina, peripheral stimulus visibility and resolution requirements for the identification of different object types are proposed to constrain the size of the perceptual span, and thus, limit visual search performance. Similar methods were used in a clinical study to characterise the visual search performance and eye movements of neurological patients with chronic solvent-induced encephalopathy (CSE). In addition, the data about the effects of different stimulus properties on visual search in normal subjects were presented as simple practical guidelines, so that the limits of human visual perception could be taken into account in the design of user interfaces.

Dynamics of contour, object and face processing in the human visual cortex

The neural basis of visual perception can be understood only when the sequence of cortical activity underlying successful recognition is known. The early steps in this processing chain, from retina to the primary visual cortex, are highly local, and the perception of more complex shapes requires integration of the local information. In Study I of this thesis, the progression from local to global visual analysis was assessed by recording cortical magnetoencephalographic (MEG) responses to arrays of elements that either did or did not form global contours. The results demonstrated two spatially and temporally distinct stages of processing: The first, emerging 70 ms after stimulus onset around the calcarine sulcus, was sensitive to local features only, whereas the second, starting at 130 ms across the occipital and posterior parietal cortices, reflected the global configuration. To explore the links between cortical activity and visual recognition, Studies II III presented subjects with recognition tasks of varying levels of difficulty. The occipito-temporal responses from 150 ms onwards were closely linked to recognition performance, in contrast to the 100-ms mid-occipital responses. The averaged responses increased gradually as a function of recognition performance, and further analysis (Study III) showed the single response strengths to be graded as well. Study IV addressed the attention dependence of the different processing stages: Occipito-temporal responses peaking around 150 ms depended on the content of the visual field (faces vs. houses), whereas the later and more sustained activity was strongly modulated by the observers attention. Hemodynamic responses paralleled the pattern of the more sustained electrophysiological responses. Study V assessed the temporal processing capacity of the human object recognition system. Above sufficient luminance, contrast and size of the object, the processing speed was not limited by such low-level factors. Taken together, these studies demonstrate several distinct stages in the cortical activation sequence underlying the object recognition chain, reflecting the level of feature integration, difficulty of recognition, and direction of attention.

Temporal acuity in developmental dyslexia across the life span : Tactile, auditory, visual, and crossmodal estimations

Taustaa Kehityksellinen dysleksia (lukivaikeus) on erityinen lukemaan oppimisen vaikeus, johon liittyy usein myös vaikeuksia kirjoittamaan oppimisessa. Lukivaikeuden oletetaan useissa tapauksissa johtuvan vaikeudesta käsitellä kielen äännerakenteita (fonologinen prosessointi). Tämä poikkeavuus voi olla joko lukivaikeuden perimmäinen syy tai vaihtoehtoisesti ongelmat äänteiden käsittelyssä voivat heijastaa jotain vielä perustavamman tason vaikeutta. Eräs tällainen ehdotettu perustavan tasoin syy on poikkeavuus aistien toiminnoissa, erityisesti aistien aikatarkkuudessa. Aikatarkkuudella tarkoitetaan kykyä ja rajoja siinä, kuinka nopeasti esitettyä aistitiedon virtaa henkilö kykenee vastaanottamaan ja käsittelemään. Monet arjen toiminnot lukemisen rinnalla edellyttävät aistien erittäin tarkkaa ajallista erottelukykyä (esimerkiksi kuulo puheen ymmärtämisessä, tunto pintamateriaalin tunnistamisessa). Aikatarkkuusvaikeuksien esiintyvyyttä lukivaikeudessa on tutkittu aiemminkin, mutta yksimielisyyteen ei ole päästy siitä, onko kaikilla lukivaikeuksisilla näitä ongelmia tai mihin aisteihin vaikeudet mahdollisesti rajoittuvat. Myöskään ei tiedetä, havaitaanko aikatarkkuuden ongelmia kaiken ikäisillä lukivaikeuksisilla vai vaihteleeko mahdollinen ongelmien kuva iän mukana. Lisäksi on epäselvää, kuinka aikatarkkuuden ongelmat itseasiassa ovat yhteydessä kielen käsittelyn ja varsinaisen lukemisen vaikeuksiin. Tutkimussarjan aihe Tässä tutkimussarjassa aikatarkkuutta tutkittiin kolmessa yksittäisessä aistissa, joita olivat tunto, näkö ja kuulo, sekä kolmessa aistien välisessä yhdistelmässä, joita olivat audiotaktiilinen (kuulo-tunto), visuotaktiilinen (näkö-tunto) ja audiovisuaalinen (näkö-kuulo). Aikatarkkuutta arvioitiin kahdella eri menetelmällä, jotta saataisiin lisää tietoa siitä, missä tietyssä aikatarkkuuden osa-alueessa lukivaikeuksisilla mahdollisesti on vaikeuksia. Ensimmäisessä tehtävässä tutkittavan tuli arvioida, ovatko esitetyt ei-kielelliset ärsykkeet samanaikaisia vai eriaikaisia. Toisessa tehtävässä koehenkilön tuli arvioida esitettyjen ei-kielellisten ärsykkeiden esitysjärjestys. Molemmissa tehtävissä määriteltiin millisekuntitasolla (sekunnin tuhannesosa) se esitysnopeus, jolla koehenkilö kykeni arvioimaan ärsykkeiden ajalliset suhteet oikein. Englanninkielinen demonstraatio aikatarkkuustehtävistä löytyy internetistä (http://www.helsinki.fi/hum/ylpsy/neuropsy). Itse aikatarkkuustehtävien lisäksi tutkimussarjassa arvioitiin tutkimushenkilöiden päättelykykyä, kielellisiä toimintoja ja lukemista. Tutkimushenkilöt Tutkimuksiin osallistui 53 lukivaikeuksista ja 66 sujuvaa lukijaa, jotka oli jaettu kolmeen pääikäryhmään: lapset (8-12 vuotta), nuoret aikuiset (20-36 vuotta) ja ikääntyneemmät aikuiset (20-59 vuotta). Ikääntyneempien aikuisten ryhmä oli edelleen jaettu ikävuosikymmenluokkiin, mikä mahdollisti sen tutkimisen, vaikuttaako lisääntyvä aikuisikä lukivaikeuksisten aikatarkkuuteen (20-29, 30-39, 40-49 ja 50-59 -vuotiaat). Tutkimussarjan tulokset Aikatarkkuuden ongelmat lukivaikeuksisilla olivat yleistyneitä yli iän, aistien ja tehtävien Lukivaikeuksiset kaikissa pääikäryhmissä (lapset, nuoret aikuiset, ikääntyneemmän aikuiset) tarvitsivat samanikäisiä sujuvia lukijoita hitaamman esitystahdin, jotta he kykenivät arvioimaan ei-kielellisten ärsykkeiden ajallisen esitystavan oikein. Tämä aikatarkkuuden ongelma havaittiin lukivaikeuksisilla kaikissa aisteissa (tunto, kuulo, näkö) ja niiden yhdistelmissä (audiotaktiilinen, visuotaktiilinen, audiovisuaalinen). Lukivaikeuksisten aikatarkkuusongelmat ilmenivät edelleen molemmissa tehtävätyypeissä (samanaikaisuuden ja järjestyksen arvioinnissa). Aikatarkkuus ja sen ongelmat olivat yhteydessä äänteiden käsittelyyn Aikatarkkuus oli yhteydessä äänteiden käsittelykykyyn (fonologiseen prosessointiin), niin lapsilla kuin aikuisillakin, kaikissa aisteissa, niiden yhdistelmissä ja tehtävätyypeissä. Yhteys ei-kielellisen aikatarkkuuden ja kielellisten toimintojen välillä oli kuitenkin selkeämpi lukivaikeuksisilla kuin sujuvilla lukijoilla. Tämä tarkoittaa, että etenkin lukivaikeuksisilla ryhmätason huono aikatarkkuus oli yhteydessä huonoon äänteiden käsittelyyn (fonologiseen prosessointiin) ja päinvastoin. Suoraa yhteyttä lukemisen ja aikatarkkuuden välillä ei kuitenkaan havaittu. Lisääntyvä aikuisikä heikensi lukivaikeuksisten aikatarkkuutta suhteettoman paljon Tiedonkäsittelyn nopeuden on toistuvasti osoitettu hidastuvan normaalissa ikääntymisessä. Lisääntyvä aikuisikä (20-59 -vuotiailla) heikensikin sekä sujuvien että lukivaikeuksisten aikatarkkuutta. Toisin sanoen, mitä iäkkäämmästä aikuisesta oli kysymys, sitä hitaammin hänelle tuli esittää ärsykkeet, jotta hän kykeni arvioimaan niiden ajalliset suhteet oikein. Tämä ikään liittyvä tavanomainen hidastuminen oli kuitenkin yllättäen suhteettoman nopeaa lukivaikeuksisilla. Toisin sanoen, jo nuorilla lukivaikeuksisilla havaittu aikatarkkuuden vaikeus (ryhmäero verrattuna sujuviin lukijoihin) ei pysynyt saman suuruisena, vaan ryhmien ero kasvoi aikuisiän lisääntyessä. Tulosten merkitys Lukivaikeuden osoitettiin tässä tutkimussarjassa olevan yhteydessä yleistyneeseen vaikeuteen käsitellä ajassa nopeasti muuttuvaa ei-kielellistä aistitietoa (yli aistien ja niiden yhdistelmien, tehtävätyyppien, tutkittavien iän). Tämä osoittaa, että lukivaikeus ei ole ongelma, joka rajoittuu vain kielellisen materiaalin käsittelyn vaikeuksiin (äänteiden käsittely, lukeminen, kirjoittaminen). Nyt havaitut vaikeudet eivät myöskään rajoittuneet vain niihin aisteihin, jotka selkeimmin liittyvät lukemiseen (näkö) ja puhuttuun kieleen (kuulo); Ongelmia esiintyi myös muissa aisteissa (tunto). Lukivaikeuksisten lukijoiden ryhmätasolla havaittu aikatarkkuuden ongelma ei kuitenkaan heijastunut yksilötasolle; Jokainen lukivaikeuksinen ei ollut huono aikatarkkuustehtävissä. Näin ollen ei siis voida väittää, että kaikkien lukivaikeuksisten äänteiden käsittelyn tai lukemaan oppimisen vaikeudet voisivat selittyä aistien toimintojen poikkeavuudella. Aikatarkkuuden ongelmat eivät olleet yhteydessä varsinaiseen lukemiseen. Sekä lukivaikeuksisilla lapsilla että aikuisilla todettiin kuitenkin selkeä yhteys aikatarkkuuden ongelmien ja lukemaan oppimisen keskeisen ennakkoehdon, fonologisen prosessoinnin, välillä. Saattaa siis olla, että synnynnäinen aistien toimintojen poikkeavuus vaikuttaa yksilön suoriutumiseen jo ennen varsinaista lukemaan oppimista, kun ne taidot kehittyvät (fonologinen prosessointi), joille myöhempi lukemaan oppiminen perustuu. Ikäännyttäessä havaittu lukivaikeuksisten suhteettoman nopea aikatarkkuuden heikkeneminen osoittaa, että lukivaikeus ei voi olla ongelma, joka koskee vain lapsuusikää, tai vaikeus, joka johtuu vain kehityksen viivästymästä joka kurottaisiin iän myötä umpeen. Tulosten ymmärtämiseksi onkin muistettava kaksi seikkaa. Lukivaikeus on ensinnäkin yhdistetty synnynnäisiin, pieniin, poikkeavuuksiin aivojen rakenteissa ja toiminnoissa. Toisaalta tavanomaiseen ikääntymiseen liittyy se, että aivot kykenevät yhä huonommin korjaamaan ja kiertämään (kompensoimaan) pieniä vaurioita. Tämän perusteella tutkimussarjan tuloksista voidaan päätellä, että lukivaikeuksisten jo synnynnäisesti heikentyneet aivojen kompensointimahdollisuudet eivät ole yhtä tehokkaita puskuroimaan ikääntymisen tavanomaisia vaikutuksia kuin sujuvilla lukijoilla. Yllättävää kuitenkin on, että tämä korostunut heikkeneminen havaittiin jo suhteellisen nuorilla, työikäisillä, lukivaikeuksisilla, ennen 60 ikävuotta. Samanlaista ikäännyttäessä korostuvaa vaikeutta ei lukivaikeuksilla kuitenkaan havaittu päättelyssä, kielellisissä toiminnoissa tai itse lukemisessa. Vaikuttaakin siis siltä, että ne toiminnot, joita on harjaannutettu aktiivisesti, eivät heikkene kasvavan aikuisiän myötä yhtä suhteettomasti. Alkuperäiset artikkelit Laasonen M, Tomma-Halme J, Lahti-Nuuttila P, Service E, and Virsu V (2000) Rate of information segregation in developmentally dyslexic children, Brain and Language, 75(1), 66-81. Laasonen M, Service E, and Virsu V (2001) Temporal order and processing acuity of visual, auditory, and tactile perception in developmentally dyslexic young adults, Cognitive, Affective, and Behavioral Neuroscience, 1(4), 394-410. Laasonen M, Service E, and Virsu V (2002) Crossmodal temporal order and processing acuity in developmentally dyslexic young adults, Brain and Language, 80(3), 340-354. Laasonen M, Lahti-Nuuttila P, and Virsu V (2002) Developmentally impaired processing speed decreases more than normally with age, NeuroReport, 13(9), 1111-1113.

Auditory - Visual Matching in Learning Disabilities : Intervention Studies from Finland and Sweden

The present thesis discusses relevant issues in education: 1) learning disabilities including the role of comorbidity in LDs, and 2) the use of research-based interventions. This thesis consists of a series of four studies (three articles), which deepens the knowledge of the field of special education. Intervention studies (N=242) aimed to examine whether training using a nonverbal auditory-visual matching computer program had a remedial effect in different learning disabilities, such as developmental dyslexia, Attention Deficit Disorder (ADD) and Specific Language Impairment (SLI). These studies were conducted in both Finland and Sweden. The intervention’s non-verbal character made an international perspective possible. The results of the intervention studies confirmed, that the auditory-visual matching computer program, called Audilex had positive intervention effects. In Study I of children with developmental dyslexia there were also improvements in reading skills, specifically in reading nonsense words and reading speed. These improvements in tasks, which are thought to rely on phonological processing, suggest that such reading difficulties in dyslexia may stem in part from more basic perceptual difficulties, including those required to manage the visual and auditory components of the decoding task. In Study II the intervention had a positive effect on children with dyslexia; older students with dyslexia and surprisingly, students with ADD also benefited from this intervention. In conclusion, the role of comorbidity was apparent. An intervention effect was evident also in students’ school behavior. Study III showed that children with SLI experience difficulties very similar to those of children with dyslexia in auditory-visual matching. Children with language-based learning disabilities, such as dyslexia and SLI benefited from the auditory-visual matching intervention. Also comorbidity was evident among these children; in addition to formal diagnoses, comorbidity was explored with an assessment inventory, which was developed for this thesis. Interestingly, an overview of the data of this thesis shows positive intervention effects in all studies despite learning disability, language, gender or age. These findings have been described by a concept inter-modal transpose. Self-evidently these issues need further studies. In learning disabilities the aim in the future will also be to identify individuals at risk rather than by deficit; this aim can be achieved by using research-based interventions, intensified support in general education and inclusive special education. Keywords: learning disabilities, developmental dyslexia, attention deficit disorder, specific language impairment, language-based learning disabilities, comorbidity, auditory-visual matching, research-based interventions, inter-modal transpose

Recognition and enforcement in cross-border insolvency law: A proposal for judicial gap-filling

This Article analyzes the recognition and enforcement of cross-border insolvency judgments from the United States, United Kingdom, and Australia to determine whether the UNCITRAL Model Law’s goal of modified universalism is currently being practiced, and subjects the Model Law to analysis through the lens of international relations theories to elaborate a way forward. We posit that courts could use the express language of the Model Law text to confer recognition and enforcement of foreign insolvency judgments. The adoption of our proposal will reduce costs, maximize recovery for creditors, and ensure predictability for all parties.

Do small-aperture presbyopic corrections influence the visual field?

Purpose To explore the effect of small-aperture optics, designed to aid presbyopes by increasing ocular depth-of-focus, on measurements of the visual field. Methods Simple theoretical and ray-tracing models were used to predict the impact of different designs of small-aperture contact lenses or corneal inlays on the proportion of light passing through natural pupils of various diameters as a function of the direction in the visual field. The left eyes of five healthy volunteers were tested using three afocal, hand-painted opaque soft contact lenses (www.davidthomas.com). Two were opaque over a 10 mm diameter but had central clear circular apertures of 1.5 and 3.0 mm in diameter. The third had an annular opaque zone with inner and outer diameters of 1.5 and 4.0 mm, approximately simulating the geometry of the KAMRA inlay (www.acufocus.com). A fourth, clear lens was used for comparison purposes. Visual fields along the horizontal meridian were evaluated up to 50° eccentricity with static automated perimetry (Medmont M700, stimulus Goldmann-size III; www.medmont.com). Results According to ray-tracing, the two lenses with the circular apertures were expected to reduce the relative transmittance of the pupil to zero at specific field angles (around 60° for the conditions of the experimental measurements). In contrast, the annular stop had no effect on the absolute field but relative transmittance was reduced over the central area of the field, the exact effects depending upon the natural pupil diameter. Experimental results broadly agreed with these theoretical expectations. With the 1.5 and 3.0 mm pupils, only minor losses in sensitivity (around 2 dB) in comparison with the clear-lens case occurred across the central 10° radius of field. Beyond this angle, sensitivity losses increased, to reach about 7 dB at the edge of the measured field (50°). The field results with the annular stop showed at most only a slight loss in sensitivity (≤3 dB) across the measured field. Conclusion The present theoretical and experimental results support earlier clinical findings that KAMRA-type annular stops, unlike circular artificial pupils, have only minor effects on measurements of the visual field.

Evaluation of visual stress symptoms in Age-matched Dyslexic, Meares–Irlen syndrome (MIS) and normal adults

AIM To examine the prevalence of dyslexia and Meares–Irlen syndrome (MIS) among female students and determine their level of visual stress in comparison with normal subjects. METHODS A random sample of 450 female medical students of King Saud University Riyadh (age range, 18 - 30 years) responded to a wide range of questions designed to accomplish the aims of this study. The detailed questionnaire consisted of 54 questions with twelve questions enquiring on ocular history and demography of participants while 42 questions were on visual symptoms. Items were categorized into; critical and non-critical questions (CQ and NCQ) and were rated on four point Likert scale. Based on the responses obtained, the subjects were grouped into normal (control), dyslexic with or without MIS (Group 1) and subjects with MIS only (Group 2). Responses were analysed as averages and mean scores were calculated and compared between-groups using one way analysis of variance to evaluate total (TVSS = NCQ + CQ), critical and non-critical visual stress scores. The relationship between categorical variables such as age, handedness and condition were assessed with Chi- Square test. RESULTS The completion rate was 96.8% and majority of the respondents (92%) were normal readers, 2% dyslexic and 6% had MIS. They were age-matched. More than half of the participants had visited an eye care practitioner in the last 2yrs. About 13% were recommended eye exercises and one participant experienced pattern glare. Hand preference was not associated with any condition but Group 1 subjects (3/9, 33%) were significantly more likely to be diagnosed of lazy eye than Group 2 (2/27, 7%) and control (27/414, 5%) subjects. The mean ± SD of TVSS responses were 63 ± 14 but it was 44 ± 9 for CQ and 19 ± 5 for NCQ. Responses from all three variables were normally distributed but the CQ responses were on the average more positive (82%) in Group 2 and less positive (46%) in Group 1 than control. With NCQ, the responses were equally less positive in Group 1 and 2 than control. Group 2 subjects showed significantly higher TVSS (P = 0.002), NCQ (P = 0.006) and CQ (P = 0.008) visual stress scores than control but no difference between Group 1 and control subjects, was observed for all scores (P > 0.05, for all comparisons). CONCLUSION The prevalence of dyslexia and MIS among Saudi female students was 2 and 6%, respectively. Critical questions performed best for assessing visual stress symptoms in dyslexic and MIS subjects. Generally, students with MIS were more sensitive to visual stress than normal students but dyslexics were more likely to present with a lazy eye than MIS and normal readers.

Learning Nonlinear Visual Processing from Natural Images

The paradigm of computational vision hypothesizes that any visual function -- such as the recognition of your grandparent -- can be replicated by computational processing of the visual input. What are these computations that the brain performs? What should or could they be? Working on the latter question, this dissertation takes the statistical approach, where the suitable computations are attempted to be learned from the natural visual data itself. In particular, we empirically study the computational processing that emerges from the statistical properties of the visual world and the constraints and objectives specified for the learning process. This thesis consists of an introduction and 7 peer-reviewed publications, where the purpose of the introduction is to illustrate the area of study to a reader who is not familiar with computational vision research. In the scope of the introduction, we will briefly overview the primary challenges to visual processing, as well as recall some of the current opinions on visual processing in the early visual systems of animals. Next, we describe the methodology we have used in our research, and discuss the presented results. We have included some additional remarks, speculations and conclusions to this discussion that were not featured in the original publications. We present the following results in the publications of this thesis. First, we empirically demonstrate that luminance and contrast are strongly dependent in natural images, contradicting previous theories suggesting that luminance and contrast were processed separately in natural systems due to their independence in the visual data. Second, we show that simple cell -like receptive fields of the primary visual cortex can be learned in the nonlinear contrast domain by maximization of independence. Further, we provide first-time reports of the emergence of conjunctive (corner-detecting) and subtractive (opponent orientation) processing due to nonlinear projection pursuit with simple objective functions related to sparseness and response energy optimization. Then, we show that attempting to extract independent components of nonlinear histogram statistics of a biologically plausible representation leads to projection directions that appear to differentiate between visual contexts. Such processing might be applicable for priming, \ie the selection and tuning of later visual processing. We continue by showing that a different kind of thresholded low-frequency priming can be learned and used to make object detection faster with little loss in accuracy. Finally, we show that in a computational object detection setting, nonlinearly gain-controlled visual features of medium complexity can be acquired sequentially as images are encountered and discarded. We present two online algorithms to perform this feature selection, and propose the idea that for artificial systems, some processing mechanisms could be selectable from the environment without optimizing the mechanisms themselves. In summary, this thesis explores learning visual processing on several levels. The learning can be understood as interplay of input data, model structures, learning objectives, and estimation algorithms. The presented work adds to the growing body of evidence showing that statistical methods can be used to acquire intuitively meaningful visual processing mechanisms. The work also presents some predictions and ideas regarding biological visual processing.

Spectral Tuning and Adaptation to Different Light Environments of Mysid Visual Pigments

In the present thesis, questions of spectral tuning, the relation of spectral and thermal properties of visual pigments, and evolutionary adaptation to different light environments were addressed using a group of small crustaceans of the genus Mysis as a model. The study was based on microspectrophotometric measurements of visual pigment absorbance spectra, electrophysiological measurements of spectral sensitivities of dark-adapted eyes, and sequencing of the opsin gene retrieved through PCR. The spectral properties were related to the spectral transmission of the respective light environments, as well as to the phylogentic histories of the species. The photoactivation energy (Ea) was estimated from temperature effects on spectral sensitivity in the long-wavelength range, and calculations were made for optimal quantum catch and optimal signal-to-noise ratio in the different light environments. The opsin amino acid sequences of spectrally characterized individuals were compared to find candidate residues for spectral tuning. The general purpose was to clarify to what extent and on what time scale adaptive evolution has driven the functional properties of (mysid) visual pigments towards optimal performance in different light environments. An ultimate goal was to find the molecular mechanisms underlying the spectral tuning and to understand the balance between evolutionary adaptation and molecular constraints. The totally consistent segregation of absorption maxima (λmax) into (shorter-wavelength) marine and (longer-wavelength) freshwater populations suggests that truly adaptive evolution is involved in tuning the visual pigment for optimal performance, driven by selection for high absolute visual sensitivity. On the other hand, the similarity in λmax and opsin sequence between several populations of freshwater M. relicta in spectrally different lakes highlights the limits to adaptation set by evolutionary history and time. A strong inverse correlation between Ea and λmax was found among all visual pigments studied in these respects, including those of M. relicta and 10 species of vertebrate pigments, and this was used to infer thermal noise. The conceptual signal-to-noise ratios thus calculated for pigments with different λmax in the Baltic Sea and Lake Pääjärvi light environments supported the notion that spectral adaptation works towards maximizing the signal-to-noise ratio rather than quantum catch as such. Judged by the shape of absorbance spectra, the visual pigments of all populations of M. relicta and M. salemaai used exclusively the A2 chromophore (3, 4-dehydroretinal). A comparison of amino acid substitutions between M. relicta and M. salemaai indicated that mysid shrimps have a small number of readily available tuning sites to shift between a shorter - and a longer -wavelength opsin. However, phylogenetic history seems to have prevented marine M. relicta from converting back to the (presumably) ancestral opsin form, and thus the more recent reinvention of marine spectral sensitivity has been accomplished by some other novel mechanism, yet to be found

Joint evaluation of multiple speech patterns for speech recognition and training

We are addressing the novel problem of jointly evaluating multiple speech patterns for automatic speech recognition and training. We propose solutions based on both the non-parametric dynamic time warping (DTW) algorithm, and the parametric hidden Markov model (HMM). We show that a hybrid approach is quite effective for the application of noisy speech recognition. We extend the concept to HMM training wherein some patterns may be noisy or distorted. Utilizing the concept of ``virtual pattern'' developed for joint evaluation, we propose selective iterative training of HMMs. Evaluating these algorithms for burst/transient noisy speech and isolated word recognition, significant improvement in recognition accuracy is obtained using the new algorithms over those which do not utilize the joint evaluation strategy.

Visual detection of occluded crop: For automated harvesting

This paper presents a novel crop detection system applied to the challenging task of field sweet pepper (capsicum) detection. The field-grown sweet pepper crop presents several challenges for robotic systems such as the high degree of occlusion and the fact that the crop can have a similar colour to the background (green on green). To overcome these issues, we propose a two-stage system that performs per-pixel segmentation followed by region detection. The output of the segmentation is used to search for highly probable regions and declares these to be sweet pepper. We propose the novel use of the local binary pattern (LBP) to perform crop segmentation. This feature improves the accuracy of crop segmentation from an AUC of 0.10, for previously proposed features, to 0.56. Using the LBP feature as the basis for our two-stage algorithm, we are able to detect 69.2% of field grown sweet peppers in three sites. This is an impressive result given that the average detection accuracy of people viewing the same colour imagery is 66.8%.

Bombs away: Visual thinking and students’ engagement in design studios contexts

In design studio, sketching or visual thinking is part of processes that assist students to achieve final design solutions. At QUT’s First and Third Year industrial design studio classes we engage in a variety of teaching pedagogies from which we identify ‘Concept Bombs’ as instrumental in the development of students’ visual thinking and reflective design process, and also as a vehicle to foster positive student engagement. In First year studios our Concept Bombs’ consist of 20 minute individual design tasks focusing on rapid development of initial concept designs and free-hand sketching. In Third Year studios we adopt a variety of formats and different timing, combining individual and team based tasks. Our experience and surveys tell us that students value intensive studio activities especially when combined with timely assessment and feedback. While conventional longer-duration design projects are essential for allowing students to engage with the full depth and complexity of the design process, short and intensive design activities introduce variety to the learning experience and enhance student engagement. This paper presents a comparative analysis of First and Third Year students’ Concept Bomb sketches to describe the types of design knowledge embedded in them, a discussion of limitations and opportunities of this pedagogical technique, as well as considerations for future development of studio based tasks of this kind as design pedagogies in the midst of current university education trends.

Language is, language is not

‘Language is, Language is not’ is an installation comprising wall drawings, a fabric drawing prosthetic, performance and digital video. This work investigates ‘redrawing’ as a revisionist feminist strategy, taking as it’s starting point Mel Bochner’s work ‘Language is not Transparent’ (1970). 'Language is, Language is not' functions as both homage and critique, drawing on the legacy of conceptual art and questioning the engendering of language that it implies. This work was developed and presented for Bus Projects, Melbourne in 2012, and subsequent versions exhibited at Screen Space, Melbourne and Metro Arts Galleries, Brisbane.

Reduced visual function and its association with physical functioning in the Finnish adult population : Prevalence, causes, and need for eye care services

The purpose of this study was to estimate the prevalence and distribution of reduced visual acuity, major chronic eye diseases, and subsequent need for eye care services in the Finnish adult population comprising persons aged 30 years and older. In addition, we analyzed the effect of decreased vision on functioning and need for assistance using the World Health Organization’s (WHO) International Classification of Functioning, Disability, and Health (ICF) as a framework. The study was based on the Health 2000 health examination survey, a nationally representative population-based comprehensive survey of health and functional capacity carried out in 2000 to 2001 in Finland. The study sample representing the Finnish population aged 30 years and older was drawn by a two-stage stratified cluster sampling. The Health 2000 survey included a home interview and a comprehensive health examination conducted at a nearby screening center. If the invited participants did not attend, an abridged examination was conducted at home or in an institution. Based on our finding in participants, the great majority (96%) of Finnish adults had at least moderate visual acuity (VA ≥ 0.5) with current refraction correction, if any. However, in the age group 75–84 years the prevalence decreased to 81%, and after 85 years to 46%. In the population aged 30 years and older, the prevalence of habitual visual impairment (VA ≤ 0.25) was 1.6%, and 0.5% were blind (VA < 0.1). The prevalence of visual impairment increased significantly with age (p < 0.001), and after the age of 65 years the increase was sharp. Visual impairment was equally common for both sexes (OR 1.20, 95% CI 0.82 – 1.74). Based on self-reported and/or register-based data, the estimated total prevalences of cataract, glaucoma, age-related maculopathy (ARM), and diabetic retinopathy (DR) in the study population were 10%, 5%, 4%, and 1%, respectively. The prevalence of all of these chronic eye diseases increased with age (p < 0.001). Cataract and glaucoma were more common in women than in men (OR 1.55, 95% CI 1.26 – 1.91 and OR 1.57, 95% CI 1.24 – 1.98, respectively). The most prevalent eye diseases in people with visual impairment (VA ≤ 0.25) were ARM (37%), unoperated cataract (27%), glaucoma (22%), and DR (7%). One-half (58%) of visually impaired people had had a vision examination during the past five years, and 79% had received some vision rehabilitation services, mainly in the form of spectacles (70%). Only one-third (31%) had received formal low vision rehabilitation (i.e., fitting of low vision aids, receiving patient education, training for orientation and mobility, training for activities of daily living (ADL), or consultation with a social worker). People with low vision (VA 0.1 – 0.25) were less likely to have received formal low vision rehabilitation, magnifying glasses, or other low vision aids than blind people (VA < 0.1). Furthermore, low cognitive capacity and living in an institution were associated with limited use of vision rehabilitation services. Of the visually impaired living in the community, 71% reported a need for assistance and 24% had an unmet need for assistance in everyday activities. Prevalence of ADL, instrumental activities of daily living (IADL), and mobility increased with decreasing VA (p < 0.001). Visually impaired persons (VA ≤ 0.25) were four times more likely to have ADL disabilities than those with good VA (VA ≥ 0.8) after adjustment for sociodemographic and behavioral factors and chronic conditions (OR 4.36, 95% CI 2.44 – 7.78). Limitations in IADL and measured mobility were five times as likely (OR 4.82, 95% CI 2.38 – 9.76 and OR 5.37, 95% CI 2.44 – 7.78, respectively) and self-reported mobility limitations were three times as likely (OR 3.07, 95% CI 1.67 – 9.63) as in persons with good VA. The high prevalence of age-related eye diseases and subsequent visual impairment in the fastest growing segment of the population will result in a substantial increase in the demand for eye care services in the future. Many of the visually impaired, especially older persons with decreased cognitive capacity or living in an institution, have not had a recent vision examination and lack adequate low vision rehabilitation. This highlights the need for regular evaluation of visual function in the elderly and an active dissemination of information about rehabilitation services. Decreased VA is strongly associated with functional limitations, and even a slight decrease in VA was found to be associated with limited functioning. Thus, continuous efforts are needed to identify and treat eye diseases to maintain patients’ quality of life and to alleviate the social and economic burden of serious eye diseases.

Language learning in infancy

Although immensely complex, speech is also a very efficient means of communication between humans. Understanding how we acquire the skills necessary for perceiving and producing speech remains an intriguing goal for research. However, while learning is likely to begin as soon as we start hearing speech, the tools for studying the language acquisition strategies in the earliest stages of development remain scarce. One prospective strategy is statistical learning. In order to investigate its role in language development, we designed a new research method. The method was tested in adults using magnetoencephalography (MEG) as a measure of cortical activity. Neonatal brain activity was measured with electroencephalography (EEG). Additionally, we developed a method for assessing the integration of seen and heard syllables in the developing brain as well as a method for assessing the role of visual speech when learning phoneme categories. The MEG study showed that adults learn statistical properties of speech during passive listening of syllables. The amplitude of the N400m component of the event-related magnetic fields (ERFs) reflected the location of syllables within pseudowords. The amplitude was also enhanced for syllables in a statistically unexpected position. The results suggest a role for the N400m component in statistical learning studies in adults. Using the same research design with sleeping newborn infants, the auditory event-related potentials (ERPs) measured with EEG reflected the location of syllables within pseudowords. The results were successfully replicated in another group of infants. The results show that even newborn infants have a powerful mechanism for automatic extraction of statistical characteristics from speech. We also found that 5-month-old infants integrate some auditory and visual syllables into a fused percept, whereas other syllable combinations are not fully integrated. Auditory syllables were paired with visual syllables possessing a different phonetic identity, and the ERPs for these artificial syllable combinations were compared with the ERPs for normal syllables. For congruent auditory-visual syllable combinations, the ERPs did not differ from those for normal syllables. However, for incongruent auditory-visual syllable combinations, we observed a mismatch response in the ERPs. The results show an early ability to perceive speech cross-modally. Finally, we exposed two groups of 6-month-old infants to artificially created auditory syllables located between two stereotypical English syllables in the formant space. The auditory syllables followed, equally for both groups, a unimodal statistical distribution, suggestive of a single phoneme category. The visual syllables combined with the auditory syllables, however, were different for the two groups, one group receiving visual stimuli suggestive of two separate phoneme categories, the other receiving visual stimuli suggestive of only one phoneme category. After a short exposure, we observed different learning outcomes for the two groups of infants. The results thus show that visual speech can influence learning of phoneme categories. Altogether, the results demonstrate that complex language learning skills exist from birth. They also suggest a role for the visual component of speech in the learning of phoneme categories.