The role of the posterior superior temporal sulcus in audiovisual processing

In this study we investigate previous claims that a region in the left posterior superior temporal sulcus (pSTS) is more activated by audiovisual than unimodal processing. First, we compare audiovisual to visual-visual and auditory-auditory conceptual matching using auditory or visual object names that are paired with pictures of objects or their environmental sounds. Second, we compare congruent and incongruent audiovisual trials when presentation is simultaneous or sequential. Third, we compare audiovisual stimuli that are either verbal (auditory and visual words) or nonverbal (pictures of objects and their associated sounds). The results demonstrate that, when task, attention, and stimuli are controlled, pSTS activation for audiovisual conceptual matching is 1) identical to that observed for intramodal conceptual matching, 2) greater for incongruent than congruent trials when auditory and visual stimuli are simultaneously presented, and 3) identical for verbal and nonverbal stimuli. These results are not consistent with previous claims that pSTS activation reflects the active formation of an integrated audiovisual representation. After a discussion of the stimulus and task factors that modulate activation, we conclude that, when stimulus input, task, and attention are controlled, pSTS is part of a distributed set of regions involved in conceptual matching, irrespective of whether the stimuli are audiovisual, auditory-auditory or visual-visual.

A hierarchical model of goal directed navigation selects trajectories in a visual environment

We have developed a Hierarchical Look-Ahead Trajectory Model (HiLAM) that incorporates the firing pattern of medial entorhinal grid cells in a planning circuit that includes interactions with hippocampus and prefrontal cortex. We show the model’s flexibility in representing large real world environments using odometry information obtained from challenging video sequences. We acquire the visual data from a camera mounted on a small tele-operated vehicle. The camera has a panoramic field of view with its focal point approximately 5 cm above the ground level, similar to what would be expected from a rat’s point of view. Using established algorithms for calculating perceptual speed from the apparent rate of visual change over time, we generate raw dead reckoning information which loses spatial fidelity over time due to error accumulation. We rectify the loss of fidelity by exploiting the loop-closure detection ability of a biologically inspired, robot navigation model termed RatSLAM. The rectified motion information serves as a velocity input to the HiLAM to encode the environment in the form of grid cell and place cell maps. Finally, we show goal directed path planning results of HiLAM in two different environments, an indoor square maze used in rodent experiments and an outdoor arena more than two orders of magnitude larger than the indoor maze. Together these results bridge for the first time the gap between higher fidelity bio-inspired navigation models (HiLAM) and more abstracted but highly functional bio-inspired robotic mapping systems (RatSLAM), and move from simulated environments into real-world studies in rodent-sized arenas and beyond.

Visual demands of modern primary classrooms and the impact of refractive anomalies on academic performance

This research investigated the visual demands in modern primary school classrooms and also the impact of common refractive anomalies on a child's ability to perform academic-related tasks. The results showed that relatively high levels of visual acuity, contrast demand and sustained accommodative-convergence are required to perform optimally in the modern classroom environment. It was also demonstrated that relatively low magnitudes of uncorrected refractive error may have a detrimental impact on children's ability to perform academic-related activities at school, with sustained near work further exacerbating this effect. These findings have important implications for both eye care practitioners and education authorities.

No specific role for the manual motor system in processing the meanings of words related to the hand

The present study explored whether semantic and motor systems are functionally interwoven via the use of a dual-task paradigm. According to embodied language accounts that propose an automatic and necessary involvement of the motor system in conceptual processing, concurrent processing of hand-related information should interfere more with hand movements than processing of unrelated body-part (i.e., foot, mouth) information. Across three experiments, 100 right-handed participants performed left- or right-hand tapping movements while repeatedly reading action words related to different body-parts, or different body-part names, in both aloud and silent conditions. Concurrent reading of single words related to specific body-parts, or the same words embedded in sentences differing in syntactic and phonological complexity (to manipulate context-relevant processing), and reading while viewing videos of the actions and body-parts described by the target words (to elicit visuomotor associations) all interfered with right-hand but not left-hand tapping rate. However, this motor interference was not affected differentially by hand-related stimuli. Thus, the results provide no support for proposals that body-part specific resources in cortical motor systems are shared between overt manual movements and meaning-related processing of words related to the hand.

On Visual Detection of Highly-occluded Objects for Harvesting Automation in Horticulture

Developing accurate and reliable crop detection algorithms is an important step for harvesting automation in horticulture. This paper presents a novel approach to visual detection of highly-occluded fruits. We use a conditional random field (CRF) on multi-spectral image data (colour and Near-Infrared Reflectance, NIR) to model two classes: crop and background. To describe these two classes, we explore a range of visual-texture features including local binary pattern, histogram of oriented gradients, and learn auto-encoder features. The pro-posed methods are evaluated using hand-labelled images from a dataset captured on a commercial capsicum farm. Experimental results are presented, and performance is evaluated in terms of the Area Under the Curve (AUC) of the precision-recall curves.Our current results achieve a maximum performance of 0.81AUC when combining all of the texture features in conjunction with colour information.

A visual profile of Queensland Indigenous children

Purpose Little is known about the prevalence of refractive error, binocular vision, and other visual conditions in Australian Indigenous children. This is important given the association of these visual conditions with reduced reading performance in the wider population, which may also contribute to the suboptimal reading performance reported in this population. The aim of this study was to develop a visual profile of Queensland Indigenous children. Methods Vision testing was performed on 595 primary schoolchildren in Queensland, Australia. Vision parameters measured included visual acuity, refractive error, color vision, nearpoint of convergence, horizontal heterophoria, fusional vergence range, accommodative facility, AC/A ratio, visual motor integration, and rapid automatized naming. Near heterophoria, nearpoint of convergence, and near fusional vergence range were used to classify convergence insufficiency (CI). Results Although refractive error (Indigenous, 10%; non-Indigenous, 16%; p = 0.04) and strabismus (Indigenous, 0%; non-Indigenous, 3%; p = 0.03) were significantly less common in Indigenous children, CI was twice as prevalent (Indigenous, 10%; non-Indigenous, 5%; p = 0.04). Reduced visual information processing skills were more common in Indigenous children (reduced visual motor integration [Indigenous, 28%; non-Indigenous, 16%; p < 0.01] and slower rapid automatized naming [Indigenous, 67%; non-Indigenous, 59%; p = 0.04]). The prevalence of visual impairment (reduced visual acuity) and color vision deficiency was similar between groups. Conclusions Indigenous children have less refractive error and strabismus than their non-Indigenous peers. However, CI and reduced visual information processing skills were more common in this group. Given that vision screenings primarily target visual acuity assessment and strabismus detection, this is an important finding as many Indigenous children with CI and reduced visual information processing may be missed. Emphasis should be placed on identifying children with CI and reduced visual information processing given the potential effect of these conditions on school performance

Towards automated content analysis of discussion transcripts: A cognitive presence case

In this paper, we present the results of an exploratory study that examined the problem of automating content analysis of student online discussion transcripts. We looked at the problem of coding discussion transcripts for the levels of cognitive presence, one of the three main constructs in the Community of Inquiry (CoI) model of distance education. Using Coh-Metrix and LIWC features, together with a set of custom features developed to capture discussion context, we developed a random forest classification system that achieved 70.3% classification accuracy and 0.63 Cohen's kappa, which is significantly higher than values reported in the previous studies. Besides improvement in classification accuracy, the developed system is also less sensitive to overfitting as it uses only 205 classification features, which is around 100 times less features than in similar systems based on bag-of-words features. We also provide an overview of the classification features most indicative of the different phases of cognitive presence that gives an additional insights into the nature of cognitive presence learning cycle. Overall, our results show great potential of the proposed approach, with an added benefit of providing further characterization of the cognitive presence coding scheme.

Seeing is understanding : the effect of visualisation in understanding programming concepts

How and why visualisations support learning was the subject of this qualitative instrumental collective case study. Five computer programming languages (PHP, Visual Basic, Alice, GameMaker, and RoboLab) supporting differing degrees of visualisation were used as cases to explore the effectiveness of software visualisation to develop fundamental computer programming concepts (sequence, iteration, selection, and modularity). Cognitive theories of visual and auditory processing, cognitive load, and mental models provided a framework in which student cognitive development was tracked and measured by thirty-one 15-17 year old students drawn from a Queensland metropolitan secondary private girls’ school, as active participants in the research. Seventeen findings in three sections increase our understanding of the effects of visualisation on the learning process. The study extended the use of mental model theory to track the learning process, and demonstrated application of student research based metacognitive analysis on individual and peer cognitive development as a means to support research and as an approach to teaching. The findings also forward an explanation for failures in previous software visualisation studies, in particular the study has demonstrated that for the cases examined, where complex concepts are being developed, the mixing of auditory (or text) and visual elements can result in excessive cognitive load and impede learning. This finding provides a framework for selecting the most appropriate instructional programming language based on the cognitive complexity of the concepts under study.

Structural health monitoring of bridges using acoustic emission technology and signal processing techniques

Structural health monitoring (SHM) is the term applied to the procedure of monitoring a structure’s performance, assessing its condition and carrying out appropriate retrofitting so that it performs reliably, safely and efficiently. Bridges form an important part of a nation’s infrastructure. They deteriorate due to age and changing load patterns and hence early detection of damage helps in prolonging the lives and preventing catastrophic failures. Monitoring of bridges has been traditionally done by means of visual inspection. With recent developments in sensor technology and availability of advanced computing resources, newer techniques have emerged for SHM. Acoustic emission (AE) is one such technology that is attracting attention of engineers and researchers all around the world. This paper discusses the use of AE technology in health monitoring of bridge structures, with a special focus on analysis of recorded data. AE waves are stress waves generated by mechanical deformation of material and can be recorded by means of sensors attached to the surface of the structure. Analysis of the AE signals provides vital information regarding the nature of the source of emission. Signal processing of the AE waveform data can be carried out in several ways and is predominantly based on time and frequency domains. Short time Fourier transform and wavelet analysis have proved to be superior alternatives to traditional frequency based analysis in extracting information from recorded waveform. Some of the preliminary results of the application of these analysis tools in signal processing of recorded AE data will be presented in this paper.

Interaction between visual status, driver age and distracters on daytime driving performance

This study investigated the effects of visual status, driver age and the presence of secondary distracter tasks on driving performance. Twenty young (M = 26.8 years) and 19 old (M = 70.2 years) participants drove around a closed-road circuit under three visual (normal, simulated cataracts, blur) and three distracter conditions (none, visual, auditory). Simulated visual impairment, increased driver age and the presence of a distracter task detrimentally affected all measures of driving performance except gap judgments and lane keeping. Significant interaction effects were evident between visual status, age and distracters; simulated cataracts had the most negative impact on performance in the presence of visual distracters and a more negative impact for older drivers. The implications of these findings for driving behaviour and acquisition of driving-related information for people with common visual impairments are discussed

An effective approach to verbose queries using a limited dependencies language model

Intuitively, any `bag of words' approach in IR should benefit from taking term dependencies into account. Unfortunately, for years the results of exploiting such dependencies have been mixed or inconclusive. To improve the situation, this paper shows how the natural language properties of the target documents can be used to transform and enrich the term dependencies to more useful statistics. This is done in three steps. The term co-occurrence statistics of queries and documents are each represented by a Markov chain. The paper proves that such a chain is ergodic, and therefore its asymptotic behavior is unique, stationary, and independent of the initial state. Next, the stationary distribution is taken to model queries and documents, rather than their initial distri- butions. Finally, ranking is achieved following the customary language modeling paradigm. The main contribution of this paper is to argue why the asymptotic behavior of the document model is a better representation then just the document's initial distribution. A secondary contribution is to investigate the practical application of this representation in case the queries become increasingly verbose. In the experiments (based on Lemur's search engine substrate) the default query model was replaced by the stable distribution of the query. Just modeling the query this way already resulted in significant improvements over a standard language model baseline. The results were on a par or better than more sophisticated algorithms that use fine-tuned parameters or extensive training. Moreover, the more verbose the query, the more effective the approach seems to become.

Measuring Visual Consistency in 3D Rendering Systems

One of the major challenges facing a present day game development company is the removal of bugs from such complex virtual environments. This work presents an approach for measuring the correctness of synthetic scenes generated by a rendering system of a 3D application, such as a computer game. Our approach builds a database of labelled point clouds representing the spatiotemporal colour distribution for the objects present in a sequence of bug-free frames. This is done by converting the position that the pixels take over time into the 3D equivalent points with associated colours. Once the space of labelled points is built, each new image produced from the same game by any rendering system can be analysed by measuring its visual inconsistency in terms of distance from the database. Objects within the scene can be relocated (manually or by the application engine); yet the algorithm is able to perform the image analysis in terms of the 3D structure and colour distribution of samples on the surface of the object. We applied our framework to the publicly available game RacingGame developed for Microsoft(R) Xna(R). Preliminary results show how this approach can be used to detect a variety of visual artifacts generated by the rendering system in a professional quality game engine.

Seeing pedestrians at night : visual clutter does not mask biological motion

Although placing reflective markers on pedestrians’ major joints can make pedestrians more conspicuous to drivers at night, it has been suggested that this “biological motion” effect may be reduced when visual clutter is present. We tested whether extraneous points of light affected the ability of 12 younger and 12 older drivers to see pedestrians as they drove on a closed road at night. Pedestrians wore black clothing alone or with retroreflective markings in four different configurations. One pedestrian walked in place and was surrounded by clutter on half of the trials. Another was always surrounded by visual clutter but either walked in place or stood still. Clothing configuration, pedestrian motion, and driver age influenced conspicuity but clutter did not. The results confirm that even in the presence of visual clutter pedestrians wearing biological motion configurations are recognized more often and at greater distances than when they wear a reflective vest.

Effect of amblyopia on the developmental eye movement test in children

Purpose. To investigate the functional impact of amblyopia in children, the performance of amblyopic and age-matched control children on a clinical test of eye movements was compared. The influence of visual factors on test outcome measures was explored. Methods. Eye movements were assessed with the Developmental Eye Movement (DEM) test, in a group of children with amblyopia (n = 39; age, 9.1 ± 0.9 years) of different causes (infantile esotropia, n = 7; acquired strabismus, n = 10; anisometropia, n = 8; mixed, n = 8; deprivation, n = 6) and in an age-matched control group (n = 42; age, 9.3 ± 0.4 years). LogMAR visual acuity (VA), stereoacuity, and refractive error were also recorded in both groups. Results. No significant difference was found between the amblyopic and age-matched control group for any of the outcome measures of the DEM (vertical time, horizontal time, number of errors and ratio(horizontal time/vertical time)). The DEM measures were not significantly related to VA in either eye, level of binocular function (stereoacuity), history of strabismus, or refractive error. Conclusions. The performance of amblyopic children on the DEM, a commonly used clinical measure of eye movements, has not previously been reported. Under habitual binocular viewing conditions, amblyopia has no effect on DEM outcome scores despite significant impairment of binocular vision and decreased VA in both the better and worse eye.

The effect of Amblyopia on motor and psychosocial skills in children

Background/Aims: In an investigation of the functional impact of amblyopia on children, the fine motor skills, perceived self-esteem and eye movements of amblyopic children were compared with that of age-matched controls. The influence of amblyogenic condition or treatment factors that might predict any decrement in outcome measures was investigated. The relationship between indirect measures of eye movements that are used clinically and eye movement characteristics recorded during reading was examined and the relevance of proficiency in fine motor skills to performance on standardised educational tests was explored in a sub-group of the control children. Methods: Children with amblyopia (n=82; age 8.2 ± 1.3 years) from differing causes (infantile esotropia n=17, acquired strabismus n=28, anisometropia n=15, mixed n=13 and deprivation n=9), and a control group of children (n=106; age 9.5 ± 1.2 years) participated in this study. Measures of visual function included monocular logMAR visual acuity (VA) and stereopsis assessed with the Randot Preschool Stereoacuity test, while fine motor skills were measured using the Visual-Motor Control (VMC) and Upper Limb Speed and Dexterity (ULSD) subtests of the Brunicks-Oseretsky Test of Motor Proficiency. Perceived self esteem was assessed for those children from grade 3 school level with the Harter Self Perception Profile for Children and for those in younger grades (preschool to grade 2) with the Pictorial Scale of Perceived Competence and Acceptance for Young Children. A clinical measure of eye movements was made with the Developmental Eye Movement (DEM) test for those children aged eight years and above. For appropriate case-control comparison of data, the results from amblyopic children were compared with age-matched sub-samples drawn from the group of children with normal vision who completed the tests. Eye movements during reading for comprehension were recorded by the Visagraph infra-red recording system and results of standardised tests of educational performance were also obtained for a sub-set of the control group. Results Amblyopic children (n=82; age 8.2 ± 1.7 years) performed significantly poorer than age-matched control children (n=37; age 8.3 ± 1.3 years) on 9 of 16 fine motor skills sub-items and for the overall age-standardised scores for both VMC and ULSD items (p<0.05); differences were most evident on timed manual dexterity tasks. The underlying aetiology of amblyopia and level of stereoacuity significantly affected fine motor skill performance on both items. However, when examined in a multiple regression model that took into account the inter-correlation between visual characteristics, poorer fine motor skills performance was only associated with strabismus (F1,75 = 5.428; p =0. 022), and not with the level of stereoacuity, refractive error or visual acuity in either eye. Amblyopic children from grade 3 school level and above (n=47; age 9.2 ± 1.3 years), particularly those with acquired strabismus, had significantly lower social acceptance scores than age-matched control children (n=52; age 9.4 ± 0.5 years) (F(5,93) = 3.14; p = 0.012). However, the scores of the amblyopic children were not significantly different to controls for other areas related to self-esteem, including scholastic competence, physical appearance, athletic competence, behavioural conduct and global self worth. A lower social acceptance score was independently associated with a history of treatment with patching but not with a history of strabismus or wearing glasses. Amblyopic children from pre-school to grade 2 school level (n=29; age = 6.6 ± 0.6 years) had similar self-perception scores to their age-matched peers (n=20; age = 6.4 ± 0.5 years). There were no significant differences between the amblyopic (n=39; age 9.1 ± 0.9 years) and age-matched control (n = 42; age = 9.3 ± 0.38 years) groups for any of the DEM outcome measures (Vertical Time, Horizontal Time, Number of Errors and Ratio (Horizontal time/Vertical time)). Performance on the DEM did not significantly relate to measures of VA in either eye, level of binocular function, history of strabismus or refractive error. Developmental Eye Movement test outcome measures Horizontal Time and Vertical Time were significantly correlated with reading rates measured by the Visagraph for both reading for comprehension and naming numbers (r>0.5). Some moderate correlations were also seen between the DEM Ratio and word reading rates as recorded by Visagraph (r=0.37). In children with normal vision, academic scores in mathematics, spelling and reading were associated with measures of fine motor skills. Strongest effect sizes were seen with the timed manual dexterity domain, Upper Limb Speed and Dexterity. Conclusions Amblyopia may have a negative impact on a child’s fine motor skills and an older child’s sense of acceptance by their peers may be influenced by treatment that includes eye patching. Clinical measures of eye movements were not affected in amblyopic children. A number of the outcome measures of the DEM are associated with objective recordings of reading rates, supporting its clinical use for identification of children with slower reading rates. In children with normal vision, proficiency on clinical measures of fine motor skill are associated with outcomes on standardised measures of educational performance. Scores on timed manual dexterity tasks had the strongest association with educational performance. Collectively, the results of this study indicate that, in addition to the reduction in visual acuity and binocular function that define the condition, amblyopes have functional impairment in childhood development skills that underlie proficiency in everyday activities. The study provides support for strategies aimed at early identification and remediation of amblyopia and the co-morbidities that arise from abnormal visual neurodevelopment.