Visual perception of movement kinematics and the acquisition of "action prototypes"

Recognizing a class of movements as belonging to a "nominal" action category, such as walking, running, or throwing, is a fundamental human ability. Three experiments were undertaken to test the hypothesis that common ("prototypical") features of moving displays could be learned by observation. Participants viewed moving stick-figure displays resembling forearm flexion movements in the saggital plane. Four displays (presentation displays) were first presented in which one or more movement dimensions were combined with 2 respective cues: direction (up, down), speed (fast, slow), and extent (long, short). Eight test displays were then shown, and the observer indicated whether each test display was like or unlike those previously seen. The results showed that without corrective feedback, a single cue (e.g., up or down) could be correctly recognized, on average, with the proportion correct between .66 and .87. When two cues were manipulated (e.g., up and slow), recognition accuracy remained high, ranging between .72 and .89. Three-cue displays were also easily identified. These results provide the first empirical demonstration of action-prototype learning for categories of human action and show how apparently complex kinematic patterns can be categorized in terms of common features or cues. It was also shown that probability of correct recognition of kinematic properties was reduced when the set of 4 presentation displays were more variable with respect to their shared kinematic property, such as speed or amplitude. Finally, while not conclusive, the results (from 2 of the 3 experiments) did suggest that similarity (or "likeness") with respect to a common kinematic property (or properties) is more easily recognized than dissimilarity.

User-centered design and evaluation of an interactive visual-haptic-auditory interface : a user study on assembly

Utilizing user-centred system design and evaluation method has become an increasingly important tool to foster better usability in the field of virtual environments (VEs). In recent years, although it is still the norm that designers and developers are concerning the technological advancement and striving for designing impressive multimodal multisensory interfaces, more and more awareness are aroused among the development team that in order to produce usable and useful interfaces, it is essential to have users in mind during design and validate a new design from users' perspective. In this paper, we describe a user study carried out to validate a newly developed haptically enabled virtual training system. By taking consideration of the complexity of individual differences on human performance, adoption and acceptance of haptic and audio-visual I/O devices, we address how well users learn, perform, adapt to and perceive object assembly training. We also explore user experience and interaction with the system, and discuss how multisensory feedback affects user performance, perception and acceptance. At last, we discuss how to better design VEs that enhance users perception, their interaction and motor activity.

The influence of visual inter-hemispheric connections on spiking, assembly and LFP activities, and their phase relationship during figure-ground stimulation

Desde os descobrimentos pioneiros de Hubel e Wiesel acumulou-se uma vasta literatura descrevendo as respostas neuronais do córtex visual primário (V1) a diferentes estímulos visuais. Estes estímulos consistem principalmente em barras em movimento, pontos ou grades, que são úteis para explorar as respostas dentro do campo receptivo clássico (CRF do inglês classical receptive field) a características básicas dos estímulos visuais como a orientação, direção de movimento, contraste, entre outras. Entretanto, nas últimas duas décadas, tornou-se cada vez mais evidente que a atividade de neurônios em V1 pode ser modulada por estímulos fora do CRF. Desta forma, áreas visuais primárias poderiam estar envolvidas em funções visuais mais complexas como, por exemplo, a separação de um objeto ou figura do seu fundo (segregação figura-fundo) e assume-se que as conexões intrínsecas de longo alcance em V1, assim como as conexões de áreas visuais superiores, estão ativamente envolvidas neste processo. Sua possível função foi inferida a partir da análise das variações das respostas induzidas por um estímulo localizado fora do CRF de neurônios individuais. Mesmo sendo muito provável que estas conexões tenham também um impacto tanto na atividade conjunta de neurônios envolvidos no processamento da figura quanto no potencial de campo, estas questões permanecem pouco estudadas. Visando examinar a modulação do contexto visual nessas atividades, coletamos potenciais de ação e potenciais de campo em paralelo de até 48 eletrodos implantados na área visual primária de gatos anestesiados. Estimulamos com grades compostas e cenas naturais, focando-nos na atividade de neurônios cujo CRF estava situado na figura. Da mesma forma, visando examinar a influência das conexões laterais, o sinal proveniente da área visual isotópica e contralateral foi removido através da desativação reversível por resfriamento. Fizemos isso devido a: i) as conexões laterais intrínsecas não podem ser facilmente manipuladas sem afetar diretamente os sinais que estão sendo medidos, ii) as conexões inter-hemisféricas compartilham as principais características anatômicas com a rede lateral intrínseca e podem ser vistas como uma continuação funcional das mesmas entre os dois hemisférios e iii) o resfriamento desativa as conexões de forma causal e reversível, silenciando temporariamente seu sinal, permitindo conclusões diretas a respeito da sua contribuição. Nossos resultados demonstram que o mecanismo de segmentação figurafundo se reflete nas taxas de disparo de neurônios individuais, assim como na potência do potencial de campo e na relação entre sua fase e os padrões de disparo produzidos pela população. Além disso, as conexões laterais inter-hemisféricas modulam estas variáveis dependendo da estimulação feita fora do CRF. Observamos também uma influência deste circuito lateral na coerência entre potenciais de campo entre eletrodos distantes. Em conclusão, nossos resultados dão suporte à ideia de um mecanismo complexo de segmentação figura-fundo atuando desde as áreas visuais primárias em diferentes escalas de frequência. Esse mecanismo parece envolver grupos de neurônios ativos sincronicamente e dependentes da fase do potencial de campo. Nossos resultados também são compatíveis com a hipótese que conexões laterais de longo alcance também fazem parte deste mecanismo

Grip and load force coordination in cyclical isometric manipulation task is not affected by the feedback type

Background: The relationship between normal and tangential force components (grip force - GF and load force - LF, respectively) acting on the digits-object interface during object manipulation reveals neural mechanisms involved in movement control. Here, we examined whether the feedback type provided to the participants during exertion of LF would influence GF-LF coordination and task performance. Methods. Sixteen young (24.7 ±3.8 years-old) volunteers isometrically exerted continuously sinusoidal FZ (vertical component of LF) by pulling a fixed instrumented handle up and relaxing under two feedback conditions: targeting and tracking. In targeting condition, FZ exertion range was determined by horizontal lines representing the upper (10 N) and lower (1 N) targets, with frequency (0.77 or 1.53 Hz) dictated by a metronome. In tracking condition, a sinusoidal template set at similar frequencies and range was presented and should be superposed by the participants' exerted FZ. Task performance was assessed by absolute errors at peaks (AEPeak) and valleys (AEValley) and GF-LF coordination by GF-LF ratios, maximum cross-correlation coefficients (r max), and time lags. Results: The results revealed no effect of feedback and no feedback by frequency interaction on any variable. AE Peak and GF-LF ratio were higher and rmax lower at 1.53 Hz than at 0.77 Hz. Conclusion: These findings indicate that the type of feedback does not influence task performance and GF-LF coordination. Therefore, we recommend the use of tracking tasks when assessing GF-LF coordination during isometric LF exertion in externally fixed instrumented handles because they are easier to understand and provide additional indices (e.g., RMSE) of voluntary force control. © 2013 Pedão et al.; licensee BioMed Central Ltd.

Semi-supervised learning for relevance feedback on image retrieval tasks

Relevance feedback approaches have been established as an important tool for interactive search, enabling users to express their needs. However, in view of the growth of multimedia collections available, the user efforts required by these methods tend to increase as well, demanding approaches for reducing the need of user interactions. In this context, this paper proposes a semi-supervised learning algorithm for relevance feedback to be used in image retrieval tasks. The proposed semi-supervised algorithm aims at using both supervised and unsupervised approaches simultaneously. While a supervised step is performed using the information collected from the user feedback, an unsupervised step exploits the intrinsic dataset structure, which is represented in terms of ranked lists of images. Several experiments were conducted for different image retrieval tasks involving shape, color, and texture descriptors and different datasets. The proposed approach was also evaluated on multimodal retrieval tasks, considering visual and textual descriptors. Experimental results demonstrate the effectiveness of the proposed approach.

Path planning for image based visual servoing

This thesis deals with Visual Servoing and its strictly connected disciplines like projective geometry, image processing, robotics and non-linear control. More specifically the work addresses the problem to control a robotic manipulator through one of the largely used Visual Servoing techniques: the Image Based Visual Servoing (IBVS). In Image Based Visual Servoing the robot is driven by on-line performing a feedback control loop that is closed directly in the 2D space of the camera sensor. The work considers the case of a monocular system with the only camera mounted on the robot end effector (eye in hand configuration). Through IBVS the system can be positioned with respect to a 3D fixed target by minimizing the differences between its initial view and its goal view, corresponding respectively to the initial and the goal system configurations: the robot Cartesian Motion is thus generated only by means of visual informations. However, the execution of a positioning control task by IBVS is not straightforward because singularity problems may occur and local minima may be reached where the reached image is very close to the target one but the 3D positioning task is far from being fulfilled: this happens in particular for large camera displacements, when the the initial and the goal target views are noticeably different. To overcame singularity and local minima drawbacks, maintaining the good properties of IBVS robustness with respect to modeling and camera calibration errors, an opportune image path planning can be exploited. This work deals with the problem of generating opportune image plane trajectories for tracked points of the servoing control scheme (a trajectory is made of a path plus a time law). The generated image plane paths must be feasible i.e. they must be compliant with rigid body motion of the camera with respect to the object so as to avoid image jacobian singularities and local minima problems. In addition, the image planned trajectories must generate camera velocity screws which are smooth and within the allowed bounds of the robot. We will show that a scaled 3D motion planning algorithm can be devised in order to generate feasible image plane trajectories. Since the paths in the image are off-line generated it is also possible to tune the planning parameters so as to maintain the target inside the camera field of view even if, in some unfortunate cases, the feature target points would leave the camera images due to 3D robot motions. To test the validity of the proposed approach some both experiments and simulations results have been reported taking also into account the influence of noise in the path planning strategy. The experiments have been realized with a 6DOF anthropomorphic manipulator with a fire-wire camera installed on its end effector: the results demonstrate the good performances and the feasibility of the proposed approach.

A Simple Visual Demonstration of Phase Diagram Concepts for an Introductory Materials Science Course Using Colored Solvents

A simple and effective demonstration to help students comprehend phase diagrams and understand phase equilibria and transformations is created using common chemical solvents available in the laboratory. Common misconceptions surrounding phase diagram operations, such as components versus phases, reversibility of phase transformations, and the lever rule are addressed. Three different binary liquid mixtures of varying compatibility create contrastive phase equilibrium cases, where colorful dyes selectively dissolved in each of corresponding phases allow for quick and unambiguous perceptions of solubility limit and phase transformations. Direct feedback and test scores from a group of students show evidence of the effectiveness of the visual and active teaching tool.

VISUAL-INERTIAL INTEGRATION FOR HUMAN MOTION TRACKING AND NAVIGATION IN FREE-LIVING ENVIRONMENTS

The aging population has become a burning issue for all modern societies around the world recently. There are two important issues existing now to be solved. One is how to continuously monitor the movements of those people having suffered a stroke in natural living environment for providing more valuable feedback to guide clinical interventions. The other one is how to guide those old people effectively when they are at home or inside other buildings and to make their life easier and convenient. Therefore, human motion tracking and navigation have been active research fields with the increasing number of elderly people. However, motion capture has been extremely challenging to go beyond laboratory environments and obtain accurate measurements of human physical activity especially in free-living environments, and navigation in free-living environments also poses some problems such as the denied GPS signal and the moving objects commonly presented in free-living environments. This thesis seeks to develop new technologies to enable accurate motion tracking and positioning in free-living environments. This thesis comprises three specific goals using our developed IMU board and the camera from the imaging source company: (1) to develop a robust and real-time orientation algorithm using only the measurements from IMU; (2) to develop a robust distance estimation in static free-living environments to estimate people’s position and navigate people in static free-living environments and simultaneously the scale ambiguity problem, usually appearing in the monocular camera tracking, is solved by integrating the data from the visual and inertial sensors; (3) in case of moving objects viewed by the camera existing in free-living environments, to firstly design a robust scene segmentation algorithm and then respectively estimate the motion of the vIMU system and moving objects. To achieve real-time orientation tracking, an Adaptive-Gain Orientation Filter (AGOF) is proposed in this thesis based on the basic theory of deterministic approach and frequency-based approach using only measurements from the newly developed MARG (Magnet, Angular Rate, and Gravity) sensors. To further obtain robust positioning, an adaptive frame-rate vision-aided IMU system is proposed to develop and implement fast vIMU ego-motion estimation algorithms, where the orientation is estimated in real time from MARG sensors in the first step and then used to estimate the position based on the data from visual and inertial sensors. In case of the moving objects viewed by the camera existing in free-living environments, a robust scene segmentation algorithm is firstly proposed to obtain position estimation and simultaneously the 3D motion of moving objects. Finally, corresponding simulations and experiments have been carried out.

Effects of anxiety on decision making and visual search behaviour in complex sport situations

Introduction Current empirical findings indicate that the efficiency of decision making (both for experts and near-experts) in simple situations is reduced under increased stress (Wilson, 2008). Explaining the phenomenon, the Attentional Control Theory (ACT, Eysenck et al., 2007) postulates an impairment of attentional processes resulting in a less efficient processing of visual information. From a practitioner’s perspective, it would be highly relevant to know whether this phenomenon can also be found in complex sport situations like in the game of football. Consequently, in the present study, decision making of football players was examined under regular vs. increased anxiety conditions. Methods 22 participants (11 experts and 11 near-experts) viewed 24 complex football situations (counterbalanced) in two anxiety conditions from the perspective of the last defender. They had to decide as fast and accurate as possible on the next action of the player in possession (options: shot on goal, dribble or pass to a designated team member) for equal numbers of trials in a near and far distance condition (based on the position of the player in possession). Anxiety was manipulated via a competitive environment, false feedback as well as ego threats. Decision time and accuracy, gaze behaviour (e.g., fixation duration on different locations) as well as state anxiety and mental effort were used as dependent variables and analysed with 2 (expertise) x 2 (distance) x 2 (anxiety) ANOVAs with repeated measures on the last two factors. Besides expertise differences, it was hypothesised that, based on ACT, increased anxiety reduces performance efficiency and impairs gaze behaviour. Results and Discussion Anxiety was manipulated successfully, indicated by higher ratings of state anxiety, F(1, 20) = 13.13, p < .01, ηp2 = .40. Besides expertise differences in decision making – experts responded faster, F(1, 20) = 11.32, p < .01, ηp2 = .36, and more accurate, F(1,20) = 23.93, p < .01, ηp2 = .55, than near-experts – decision time, F(1, 20) = 9.29, p < .01, ηp2 = .32, and mental effort, F(1, 20) = 7.33, p = .01, ηp2 = .27, increased for both groups in the high anxiety condition. This result confirms the ACT assumption that processing efficiency is reduced when being anxious. Replicating earlier findings, a significant expertise by distance interaction could be observed, F(1, 18) = 18.53, p < .01, ηp2 = .51), with experts fixating longer on the player in possession or the ball in the near distance and longer on other opponents, teammates and free space in the far distance condition. This shows that experts are able to adjust their gaze behaviour to affordances of displayed playing patterns. Additionally, a three way interaction was found, F(1, 18) = 7.37 p = .01, ηp2 = .29, revealing that experts utilised a reduced number of fixations in the far distance condition when being anxious indicating a reduced ability to pick up visual information. Since especially the visual search behaviour of experts was impaired, the ACT prediction that particularly top-down processes are affected by anxiety could be confirmed. Taken together, the results show that sports performance is negatively influenced by anxiety since longer response times, higher mental effort and inefficient visual search behaviour were observed. From a practitioner’s perspective, this finding might suggest preferring (implicit) perceptual cognitive training; however, this recommendation needs to be empirically supported in intervention studies. References: Eysenck, M. W., Derakshan, N., Santos, R., & Calvo, M. G. (2007). Anxiety and cognitive performance: Attentional control theory. Emotion, 7, 336-353. Wilson, M. (2008). From processing efficiency to attentional control: A mechanistic account of the anxiety-performance relationship. Int. Review of Sport and Exercise Psychology, 1, 184-201.

Neural mechanisms for visual memory and their role in attention

Recent studies show that neuronal mechanisms for learning and memory both dynamically modulate and permanently alter the representations of visual stimuli in the adult monkey cortex. Three commonly observed neuronal effects in memory-demanding tasks are repetition suppression, enhancement, and delay activity. In repetition suppression, repeated experience with the same visual stimulus leads to both short- and long-term suppression of neuronal responses in subpopulations of visual neurons. Enhancement works in an opposite fashion, in that neuronal responses are enhanced for objects with learned behavioral relevance. Delay activity is found in tasks in which animals are required to actively hold specific information “on-line” for short periods. Repetition suppression appears to be an intrinsic property of visual cortical areas such as inferior temporal cortex and is thought to be important for perceptual learning and priming. By contrast, enhancement and delay activity may depend on feedback to temporal cortex from prefrontal cortex and are thought to be important for working memory. All of these mnemonic effects on neuronal responses bias the competitive interactions that take place between stimulus representations in the cortex when there is more than one stimulus in the visual field. As a result, memory will often determine the winner of these competitions and, thus, will determine which stimulus is attended.

Attentional blink modulation in a reaction time task: performance feedback, warning stimulus modality, and task difficulty

The present research investigated the effect of performance feedback on the modulation of the acoustic startle reflex in a Go/NoGo reaction time task. Experiment 1 (n = 120) crossed warning stimulus modality (acoustic, visual, and tactile) with the provision of feedback in a between subject design. Provision of performance feedback increased the number of errors committed and reduced reaction time, but did not affect blink modulation significantly. Attentional blink latency and magnitude modulation was larger during acoustic than during visual and larger during visual than during tactile warning stimuli. In comparison to control blinks, latency shortening was significant in all modality conditions whereas magnitude facilitation was not significant during tactile warning stimuli. Experiment 2 (n = 80) employed visual warning stimuli only and crossed the provision of feedback with task difficulty. Feedback and difficulty affected accuracy and reaction time. Whereas blink latency shortening was not affected, blink magnitude modulation was smallest in the Easy/No Feedback and the Difficult/Feedback conditions. (C) 2002 Elsevier Science B.V. All rights reserved.

Effects of visual occlusion and fatigue on motor performance in water

The purpose of this study was to test the effects of visual occlusion and fatigue on the motor performance of vertical skills in synchronized swimming. Experienced synchronized swimmers (n = 12) were randomly assigned to either an exercise or nonexercise (control) activity group. Subjective ratings of fatigue were obtained from the swimmers who then each performed four vertical skills under alternating conditions of vision and visual occlusion before and after either a swimming (designed to induce fatigue) or nonphysical activity. A main effect of activity (p < .03) was found for two measures of performance accuracy (lateral and anterior total distance traveled) but not for lateral and anterior maximum deviation from vertical, indicating that fatigue played a role in executing the skills. The data also indicate that the maintenance of a stationary position is a skill of greater difficulty than maintaining a true vertical. In contrast with previous research findings on synchronized swimmers, a significant effect of vision in all conditions was found, with performance decrements in the conditions of visual occlusion showing that vision provided important sensory input for the swimmers.

Category learning induces position invariance of pattern recognition across the visual field

Human object recognition is considered to be largely invariant to translation across the visual field. However, the origin of this invariance to positional changes has remained elusive, since numerous studies found that the ability to discriminate between visual patterns develops in a largely location-specific manner, with only a limited transfer to novel visual field positions. In order to reconcile these contradicting observations, we traced the acquisition of categories of unfamiliar grey-level patterns within an interleaved learning and testing paradigm that involved either the same or different retinal locations. Our results show that position invariance is an emergent property of category learning. Pattern categories acquired over several hours at a fixed location in either the peripheral or central visual field gradually become accessible at new locations without any position-specific feedback. Furthermore, categories of novel patterns presented in the left hemifield are distinctly faster learnt and better generalized to other locations than those learnt in the right hemifield. Our results suggest that during learning initially position-specific representations of categories based on spatial pattern structure become encoded in a relational, position-invariant format. Such representational shifts may provide a generic mechanism to achieve perceptual invariance in object recognition.

A visual interactive modelling system as a learning tool

This paper presents a case study of the use of a visual interactive modelling system to investigate issues involved in the management of a hospital ward. Visual Interactive Modelling systems are seen to offer the learner the opportunity to explore operational management issues from a varied perspective and to provide an interactive system in which the learner receives feedback on the consequences of their actions. However to maximise the potential learning experience for a student requires the recognition that they require task structure which helps them to understand the concepts involved. These factors can be incorporated into the visual interactive model by providing an interface customised to guide the student through the experimentation. Recent developments of VIM systems in terms of their connectivity with the programming language Visual Basic facilitates this customisation.

A novel actuated digit with tactile feedback for clinical applications

This thesis describes the work carried out on the development of a novel digit actuator system with tactile perception feedback to a user and demonstrated as a master-slave system. For the tactile surface of the digit, contrasting sensor elements of resistive strain gauges and optical fibre Bragg grating sensors were evaluated. A distributive tactile sensing system consisting of optimised neural networking schemes was developed, resulting in taxonomy of artificial touch. The device is suitable for use in minimal invasive surgical (MIS) procedures as a steerable tip and a digit constructed wholly from polymers makes it suitable for use in Magnetic Resonance Imaging (MRI) environments enabling active monitoring of the patient during a procedure. To provide a realistic template of the work the research responded to the needs of two contrasting procedures: palpation of the prostate and endotracheal intubation in anaesthesia where the application of touch sense can significantly assist navigation. The performance of the approach was demonstrated with an experimental digit constructed for use in the laboratory in phantom trials. The phantom unit was developed to resemble facets of the clinical applications and digit system is able to evaluate reactive force distributions acting over the surface of the digit as well as different descriptions of contact and motion relative to the surface of the lumen. Completing control of the digit is via an instrumented glove, such that the digit actuates in sympathy with finger gesture and tactile information feedback is achieved by a combination of the tactile and visual means.