The relative contributions of colour and luminance signals towards the visuomotor localisation of targets in human peripheral vision

We sought to determine the extent to which colour (and luminance) signals contribute towards the visuomotor localization of targets. To do so we exploited the movement-related illusory displacement a small stationary window undergoes when it has a continuously moving carrier grating behind it. We used drifting (1.0-4.2 Hz) red/green-modulated isoluminant gratings or yellow/black luminance-modulated gratings as carriers, each curtailed in space by a stationary, two-dimensional window. After each trial, the perceived location of the window was recorded with reference to an on-screen ruler (perceptual task) or the on-screen touch of a ballistic pointing movement made without visual feedback (visuomotor task). Our results showed that the perceptual displacement measures were similar for each stimulus type and weakly dependent on stimulus drift rate. However, while the visuomotor displacement measures were similar for each stimulus type at low drift rates (<4 Hz), they were significantly larger for luminance than colour stimuli at high drift rates (>4 Hz). We show that the latter cannot be attributed to differences in perceived speed between stimulus types. We assume, therefore, that our visuomotor localization judgements were more susceptible to the (carrier) motion of luminance patterns than colour patterns. We suggest that, far from being detrimental, this susceptibility may indicate the operation of mechanisms designed to counter the temporal asynchrony between perceptual experiences and the physical changes in the environment that give rise to them. We propose that perceptual localisation is equally supported by both colour and luminance signals but that visuomotor localisation is predominantly supported by luminance signals. We discuss the neural pathways that may be involved with visuomotor localization. © 2007 Springer-Verlag.

Design and implementation of graphical user interfaces for complex simulations

The development of increasingly powerful computers, which has enabled the use of windowing software, has also opened the way for the computer study, via simulation, of very complex physical systems. In this study, the main issues related to the implementation of interactive simulations of complex systems are identified and discussed. Most existing simulators are closed in the sense that there is no access to the source code and, even if it were available, adaptation to interaction with other systems would require extensive code re-writing. This work aims to increase the flexibility of such software by developing a set of object-oriented simulation classes, which can be extended, by subclassing, at any level, i.e., at the problem domain, presentation or interaction levels. A strategy, which involves the use of an object-oriented framework, concurrent execution of several simulation modules, use of a networked windowing system and the re-use of existing software written in procedural languages, is proposed. A prototype tool which combines these techniques has been implemented and is presented. It allows the on-line definition of the configuration of the physical system and generates the appropriate graphical user interface. Simulation routines have been developed for the chemical recovery cycle of a paper pulp mill. The application, by creation of new classes, of the prototype to the interactive simulation of this physical system is described. Besides providing visual feedback, the resulting graphical user interface greatly simplifies the interaction with this set of simulation modules. This study shows that considerable benefits can be obtained by application of computer science concepts to the engineering domain, by helping domain experts to tailor interactive tools to suit their needs.

A speech analysis system for use in educational research

This thesis describes work undertaken in order to fulfil a need experienced in the Department of Educational Enquiry at the University of Aston in Birmingham for speech analysis facilities suitable for use in teaching and research work within the Department. The hardware and software developed during the research project provides displays of speech fundamental frequency and intensity in real time. The system is suitable for the provision of visual feedback of these parameters of a subject's speech in a learning situation, and overcomes the inadequacies of equipment currently used for this task in that it provides a clear indication of fundamental frequency contours as the subject is speaking. The thesis considers the use of such equipment in several related fields, and the approaches that have been reported to one of the major problems of speech analysis, namely pitch-period estimation. A number of different systems are described, and their suitability for the present purposes is discussed. Finally, a novel method of pitch-period estimation is developed, and a speech analysis system incorporating this method is described. Comparison is made between the results produced by this system and those produced by a conventional speech spectrograph.

Stimulus Integration and Parsing in the Primate Auditory Midbrain

Integrating information from multiple sources is a crucial function of the brain. Examples of such integration include multiple stimuli of different modalties, such as visual and auditory, multiple stimuli of the same modality, such as auditory and auditory, and integrating stimuli from the sensory organs (i.e. ears) with stimuli delivered from brain-machine interfaces.

The overall aim of this body of work is to empirically examine stimulus integration in these three domains to inform our broader understanding of how and when the brain combines information from multiple sources.

First, I examine visually-guided auditory, a problem with implications for the general problem in learning of how the brain determines what lesson to learn (and what lessons not to learn). For example, sound localization is a behavior that is partially learned with the aid of vision. This process requires correctly matching a visual location to that of a sound. This is an intrinsically circular problem when sound location is itself uncertain and the visual scene is rife with possible visual matches. Here, we develop a simple paradigm using visual guidance of sound localization to gain insight into how the brain confronts this type of circularity. We tested two competing hypotheses. 1: The brain guides sound location learning based on the synchrony or simultaneity of auditory-visual stimuli, potentially involving a Hebbian associative mechanism. 2: The brain uses a ‘guess and check’ heuristic in which visual feedback that is obtained after an eye movement to a sound alters future performance, perhaps by recruiting the brain’s reward-related circuitry. We assessed the effects of exposure to visual stimuli spatially mismatched from sounds on performance of an interleaved auditory-only saccade task. We found that when humans and monkeys were provided the visual stimulus asynchronously with the sound but as feedback to an auditory-guided saccade, they shifted their subsequent auditory-only performance toward the direction of the visual cue by 1.3-1.7 degrees, or 22-28% of the original 6 degree visual-auditory mismatch. In contrast when the visual stimulus was presented synchronously with the sound but extinguished too quickly to provide this feedback, there was little change in subsequent auditory-only performance. Our results suggest that the outcome of our own actions is vital to localizing sounds correctly. Contrary to previous expectations, visual calibration of auditory space does not appear to require visual-auditory associations based on synchrony/simultaneity.

My next line of research examines how electrical stimulation of the inferior colliculus influences perception of sounds in a nonhuman primate. The central nucleus of the inferior colliculus is the major ascending relay of auditory information before it reaches the forebrain, and thus an ideal target for understanding low-level information processing prior to the forebrain, as almost all auditory signals pass through the central nucleus of the inferior colliculus before reaching the forebrain. Thus, the inferior colliculus is the ideal structure to examine to understand the format of the inputs into the forebrain and, by extension, the processing of auditory scenes that occurs in the brainstem. Therefore, the inferior colliculus was an attractive target for understanding stimulus integration in the ascending auditory pathway.

Moreover, understanding the relationship between the auditory selectivity of neurons and their contribution to perception is critical to the design of effective auditory brain prosthetics. These prosthetics seek to mimic natural activity patterns to achieve desired perceptual outcomes. We measured the contribution of inferior colliculus (IC) sites to perception using combined recording and electrical stimulation. Monkeys performed a frequency-based discrimination task, reporting whether a probe sound was higher or lower in frequency than a reference sound. Stimulation pulses were paired with the probe sound on 50% of trials (0.5-80 µA, 100-300 Hz, n=172 IC locations in 3 rhesus monkeys). Electrical stimulation tended to bias the animals’ judgments in a fashion that was coarsely but significantly correlated with the best frequency of the stimulation site in comparison to the reference frequency employed in the task. Although there was considerable variability in the effects of stimulation (including impairments in performance and shifts in performance away from the direction predicted based on the site’s response properties), the results indicate that stimulation of the IC can evoke percepts correlated with the frequency tuning properties of the IC. Consistent with the implications of recent human studies, the main avenue for improvement for the auditory midbrain implant suggested by our findings is to increase the number and spatial extent of electrodes, to increase the size of the region that can be electrically activated and provide a greater range of evoked percepts.

My next line of research employs a frequency-tagging approach to examine the extent to which multiple sound sources are combined (or segregated) in the nonhuman primate inferior colliculus. In the single-sound case, most inferior colliculus neurons respond and entrain to sounds in a very broad region of space, and many are entirely spatially insensitive, so it is unknown how the neurons will respond to a situation with more than one sound. I use multiple AM stimuli of different frequencies, which the inferior colliculus represents using a spike timing code. This allows me to measure spike timing in the inferior colliculus to determine which sound source is responsible for neural activity in an auditory scene containing multiple sounds. Using this approach, I find that the same neurons that are tuned to broad regions of space in the single sound condition become dramatically more selective in the dual sound condition, preferentially entraining spikes to stimuli from a smaller region of space. I will examine the possibility that there may be a conceptual linkage between this finding and the finding of receptive field shifts in the visual system.

In chapter 5, I will comment on these findings more generally, compare them to existing theoretical models, and discuss what these results tell us about processing in the central nervous system in a multi-stimulus situation. My results suggest that the brain is flexible in its processing and can adapt its integration schema to fit the available cues and the demands of the task.

The potential contributions of concept maps for learning website to assessment for learning practices

The purpose of this paper is to examine the promising contributions of the Concept Maps for Learning (CMfL) website to assessment for learning practices. The CMfL website generates concept maps from relatedness degree of concepts pairs through the Pathfinder Scaling Algorithm. This website also confirms the established principles of effective assessment for learning, for it is capable of automatically assessing students' higher order knowledge, simultaneously identifying strengths and weaknesses, immediately providing useful feedback and being user-friendly. According to the default assessment plan, students first create concept maps on a particular subject and then they are given individualized visual feedback followed by associated instructional material (e.g., videos, website links, examples, problems, etc.) based on a comparison of their concept map and a subject matter expert's map. After studying the feedback and instructional material, teachers can monitor their students' progress by having them create revised concept maps. Therefore, we claim that the CMfL website may reduce the workload of teachers as well as provide immediate and delayed feedback on the weaknesses of students in different forms such as graphical and multimedia. For the following study, we will examine whether these promising contributions to assessment for learning are valid in a variety of subjects.

Functional heterogeneity of medial posterior parietal cortex of macaque monkey

The posterior parietal cortex (PPC) of primates represents a remarkable platform that has evolved over time to solve some of the computational challenges that we face in the everyday life, such as sensorimotor integration, spatial attention, and motor planning. With the aim of further investigating the multifaceted functional characteristics of medial PPC, we conducted three studies to explore the visuomotor, somatic, visual, and attention-related properties of two PPC areas: V6A, a visuomotor area part of the dorsomedial visual stream, and PE, an area strongly dominated by somatomotor input, residing mainly on the exposed surface of the superior parietal lobule. In the first study, we tested the impact of visual feedback on V6A grasp-related activity during arm movements towards objects of different shapes. Our results demonstrate that V6A is modulated by both grip type and visual information during grasping preparation and execution, with a predominance of cells influenced by grip type. In the second study, we explored the influence of depth and direction information on reach-related activity of neurons in the so far largely neglected medial part of area PE. We observed a remarkable trend in medial PPC, going from the joint coding of depth and direction signals caudally, in area V6A, to a largely segregated processing of the two signals rostrally, in area PE. In the third study, we used a combined fMRI-electrophysiology experiment to investigate the neuronal mechanisms underlying covert shift of attention processes in area V6A. Our preliminary results reveal that half of the cells showed shift-selective activity when the monkey covertly shifted its attention towards the receptive field. All together these findings highlight the role of the medial PPC in integrating information coming from different sources (vision, somatosensory and motor) and emphasize the involvement of action-related regions of the dorsomedial visual stream in higher level cognitive functions.

Dynamic gamma frequency feedback coupling between higher and lower order visual cortices underlies perceptual completion in humans

To perceive a coherent environment, incomplete or overlapping visual forms must be integrated into meaningful coherent percepts, a process referred to as ?Gestalt? formation or perceptual completion. Increasing evidence suggests that this process engages oscillatory neuronal activity in a distributed neuronal assembly. A separate line of evidence suggests that Gestalt formation requires top-down feedback from higher order brain regions to early visual cortex. Here we combine magnetoencephalography (MEG) and effective connectivity analysis in the frequency domain to specifically address the effective coupling between sources of oscillatory brain activity during Gestalt formation. We demonstrate that perceptual completion of two-tone ?Mooney? faces induces increased gamma frequency band power (55?71 Hz) in human early visual, fusiform and parietal cortices. Within this distributed neuronal assembly fusiform and parietal gamma oscillators are coupled by forward and backward connectivity during Mooney face perception, indicating reciprocal influences of gamma activity between these higher order visual brain regions. Critically, gamma band oscillations in early visual cortex are modulated by top-down feedback connectivity from both fusiform and parietal cortices. Thus, we provide a mechanistic account of Gestalt perception in which gamma oscillations in feature sensitive and spatial attention-relevant brain regions reciprocally drive one another and convey global stimulus aspects to local processing units at low levels of the sensory hierarchy by top-down feedback. Our data therefore support the notion of inverse hierarchical processing within the visual system underlying awareness of coherent percepts.

Control framework for dexterous manipulation using dynamic visual servoing and tactile sensors’ feedback

Tactile sensors play an important role in robotics manipulation to perform dexterous and complex tasks. This paper presents a novel control framework to perform dexterous manipulation with multi-fingered robotic hands using feedback data from tactile and visual sensors. This control framework permits the definition of new visual controllers which allow the path tracking of the object motion taking into account both the dynamics model of the robot hand and the grasping force of the fingertips under a hybrid control scheme. In addition, the proposed general method employs optimal control to obtain the desired behaviour in the joint space of the fingers based on an indicated cost function which determines how the control effort is distributed over the joints of the robotic hand. Finally, authors show experimental verifications on a real robotic manipulation system for some of the controllers derived from the control framework.

Does the neurodegeneration of Alzheimer’s disease spread between visual cortical regions B17 and B18 via the feedforward or feedback short cortico-cortical projections?

The laminar distribution of senile plaques (SP) and neurofibrillary tangles (NFT) was studied in areas B17 and B18 of the visual cortex in 18 cases of Alzheimer’s disease which varied in disease onset and duration. The objective was to test the hypothesis that SP and NFT could spread via either the feedforward or feedback short cortico-cortical projections. In area B17, the mean density of SP and NFT reached a maximum in lamina III and in laminae II and III respectively. In B18, mean SP density was maximal in laminae III and IV and NFT density in laminae II and III. No significant correlations were observed in any cortical lamina between the density of SP and patient age. However, the density of NFT in laminae III, IV and VI in B18 was negatively correlated with patient age. In addition, in B18, the density of SP in lamina II and lamina V was negatively correlated with disease duration and disease onset respectively. Although these results suggest that SP and NFT might spread between B17 and B18 via the feedforward short cortico-cortical projections, it is also possible that the longer cortico-cortical and cortico-subcortical connections may be involved.

Exploring the rate-limiting steps in visual phototransduction recovery by bottom-up kinetic modeling

Phototransduction in vertebrate photoreceptor cells represents a paradigm of signaling pathways mediated by G-protein-coupled receptors (GPCRs), which share common modules linking the initiation of the cascade to the final response of the cell. In this work, we focused on the recovery phase of the visual photoresponse, which is comprised of several interacting mechanisms. We employed current biochemical knowledge to investigate the response mechanisms of a comprehensive model of the visual phototransduction pathway. In particular, we have improved the model by implementing a more detailed representation of the recoverin (Rec)-mediated calcium feedback on rhodopsin kinase and including a dynamic arrestin (Arr) oligomerization mechanism. The model was successfully employed to investigate the rate limiting steps in the recovery of the rod photoreceptor cell after illumination. Simulation of experimental conditions in which the expression levels of rhodospin kinase (RK), of the regulator of the G-protein signaling (RGS), of Arr and of Rec were altered individually or in combination revealed severe kinetic constraints to the dynamics of the overall network. Our simulations confirm that RGS-mediated effector shutdown is the rate-limiting step in the recovery of the photoreceptor and show that the dynamic formation and dissociation of Arr homodimers and homotetramers at different light intensities significantly affect the timing of rhodopsin shutdown. The transition of Arr from its oligomeric storage forms to its monomeric form serves to temper its availability in the functional state. Our results may explain the puzzling evidence that overexpressing RK does not influence the saturation time of rod cells at bright light stimuli. The approach presented here could be extended to the study of other GPCR signaling pathways.

Electrostimulation mapping of comprehension of auditory and visual words.

In order to spare functional areas during the removal of brain tumours, electrical stimulation mapping was used in 90 patients (77 in the left hemisphere and 13 in the right; 2754 cortical sites tested). Language functions were studied with a special focus on comprehension of auditory and visual words and the semantic system. In addition to naming, patients were asked to perform pointing tasks from auditory and visual stimuli (using sets of 4 different images controlled for familiarity), and also auditory object (sound recognition) and Token test tasks. Ninety-two auditory comprehension interference sites were observed. We found that the process of auditory comprehension involved a few, fine-grained, sub-centimetre cortical territories. Early stages of speech comprehension seem to relate to two posterior regions in the left superior temporal gyrus. Downstream lexical-semantic speech processing and sound analysis involved 2 pathways, along the anterior part of the left superior temporal gyrus, and posteriorly around the supramarginal and middle temporal gyri. Electrostimulation experimentally dissociated perceptual consciousness attached to speech comprehension. The initial word discrimination process can be considered as an "automatic" stage, the attention feedback not being impaired by stimulation as would be the case at the lexical-semantic stage. Multimodal organization of the superior temporal gyrus was also detected since some neurones could be involved in comprehension of visual material and naming. These findings demonstrate a fine graded, sub-centimetre, cortical representation of speech comprehension processing mainly in the left superior temporal gyrus and are in line with those described in dual stream models of language comprehension processing.

Imagery or video feedback : which is the "route" to strategic improvement?

The implementation of imagery and video feedback programs has become an important tool for aiding athletes in achieving peak performance (Halliwell, 1990). The purpose of the study was to determine the effect of strategic imagery training and video feedback on immediate performance. Participants were two university goaltenders. An alternating treatment design (ATD; Barlow & Hayes, 1979; Tawney & Gast, 1984) was employed. The strategies were investigated using three plays originating from the right side by a right-handed shooting defenceman from the blueline. The baseline condition consisted of six practices and was used to establish a stable and "ideal" measure of performance. The intervention conditions included alternating the use of strategic imagery (Cognitive general; Paivio, 1985) and video feedback. Both participants demonstrated an increase in the frequency of Cognitive general use. Specific and global performance measures were assessed to determine the relative effectiveness of the interventions. Poor inter-rater reliability resulted in the elimination of specific performance measures. Consequently, only the global measure (i.e., save percentage) was used in subsequent analyses. Visual inspection of participant save percentage was conducted to determine the benefits of the intervention. Strategic imagery training resulted in performance improvements for both participants. Video feedback facilitated performance for Participant 2, but not Participant 1. Results are discussed with respect to imagery and video interventions and the challenges associated with applied research. KEYWORDS: imagery, video, goaltenders, alternating treatment design.

Alteraciones perceptivas y dificultades en el aprendizaje : alcance, validez y eficacia de un modelo de intervención psicopedagógica rehabilitadora mediante el empleo de feedback informativo.

Se intenta aislar algún componente diagnóstico de la dislexia y poner a prueba las hipótesis explicativas más actuales. A) 12 sujetos con trastornos de lectura, 12 con trastornos conductuales y 12 normales (9-13 años). Sexo balanceado. B) 20 sujetos disléxicos, 20 deficientes y 20 normales. Se consideró la inteligencia y se descartaron aquellos que en la exploración neurológica mostraron algún tipo de trastorno. A) Diseño mixto con medidas repetidas. VI.: 1) Tiempo de exposición de los estímulos, 2) Grupo experimental. VD.: 1) Tiempo de lectura, 2) Errores, 3) Ausencia de respuesta. Procedimiento: leer estímulos visuales presentados en un taquistoscopio. B) Diseño mixto. VI.: 1) Grupo experimental, 2) Tiempo de exposición del estímulo, 3) Orden de presentación de las listas de palabras, 4) Tipo de listas de palabras. VD.: 1) Errores de lectura, 2) Palabras leídas y palabras leídas correctamente, 3) Errores en la reproducción de estímulos visuales. Variables controladas: ajuste social y status social. Procedimiento: prueba de lectura de textos y de lectura de listas de palabras presentadas en un taquistoscopio. Cada lista era presentada, en orden balanceado, para cada tiempo de exposición. Después, se presentaron estímulos visuales procedentes del test de Retención Visual de Benton, pidiéndose al sujeto que los reproduzca. A) Tarjetas. B) Pruebas de lectura y de comprensión lectora. Para controlar factores individuales se aplicó la Escala de Adaptación de Achenbach. A) Kruskall-Wallis y 'U' de Mann-Withney. B) Anova y Ancova. Análisis de correlación. Intercomparaciones (Scheffe). A) Se observan diferencias significativas en el 'N' de errores cometidos por el grupo de disléxicos frente al de control, en especial a partir de palabras bisilábicas y trisilábicas. La variable 'N' de fracasos es la más discriminativa. B) Comparando sujetos disléxicos y normales se observan diferencias significativas en el 'N' de errores en las pruebas de lectura (además, los tipos de errores muestran configuraciones diferenciales significativas) y en las pruebas de comprensión lectora. En las pruebas de taquistoscopio hay diferencias debidas al grupo pero no al tiempo de exposición, aunque esta variable tiene efecto en otras medidas dependientes. Estímulos visuales: no hay diferencias significativas globales, aunque determinados ítems resultan discriminativos. Grupo de deficientes: se observa clara influencia del tiempo de exposición en determinados errores de lectura. No hay diferencias en la ejecución lectora ni en la reproducción de dibujos. Los resultados indican un patrón diferencial claro entre disléxicos y normales. El rendimiento de los primeros en tareas verbales es inferior. Sin embargo, no se confirma la hipótesis de igual rendimiento en las tareas gráficas no lingüísticas. En los sujetos deficientes, las diferencias más notables radican en que no usan estrategias mnemotécnicas, aunque son susceptibles de entrenamiento.

Feasibility of using eye tracking to increase resolution for visual telepresence

Visual telepresence seeks to extend existing teleoperative capability by supplying the operator with a 3D interactive view of the remote environment. This is achieved through the use of a stereo camera platform which, through appropriate 3D display devices, provides a distinct image to each eye of the operator, and which is slaved directly from the operator's head and eye movements. However, the resolution within current head mounted displays remains poor, thereby reducing the operator's visual acuity. This paper reports on the feasibility of incorporation of eye tracking to increase resolution and investigates the stability and control issues for such a system. Continuous domain and discrete simulations are presented which indicates that eye tracking provides a stable feedback loop for tracking applications, though some empirical testing (currently being initiated) of such a system will be required to overcome indicated stability problems associated with micro saccades of the human operator.

Potential role of vegetation feedback in the climate sensitivity of high-latitude regions: a case study at 6000 years B.P.

Previous climate model simulations have shown that the configuration of the Earth's orbit during the early to mid-Holocene (approximately 10–5 kyr) can account for the generally warmer-than-present conditions experienced by the high latitudes of the northern hemisphere. New simulations for 6 kyr with two atmospheric/mixed-layer ocean models (Community Climate Model, version 1, CCMl, and Global ENvironmental and Ecological Simulation of Interactive Systems, version 2, GENESIS 2) are presented here and compared with results from two previous simulations with GENESIS 1 that were obtained with and without the albedo feedback due to climate-induced poleward expansion of the boreal forest. The climate model results are summarized in the form of potential vegetation maps obtained with the global BIOME model, which facilitates visual comparisons both among models and with pollen and plant macrofossil data recording shifts of the forest-tundra boundary. A preliminary synthesis shows that the forest limit was shifted 100–200 km north in most sectors. Both CCMl and GENESIS 2 produced a shift of this magnitude. GENESIS 1 however produced too small a shift, except when the boreal forest albedo feedback was included. The feedback in this case was estimated to have amplified forest expansion by approximately 50%. The forest limit changes also show meridional patterns (greatest expansion in central Siberia and little or none in Alaska and Labrador) which have yet to be reproduced by models. Further progress in understanding of the processes involved in the response of climate and vegetation to orbital forcing will require both the deployment of coupled atmosphere-biosphere-ocean models and the development of more comprehensive observational data sets