Effects of anxiety on decision making and visual search behaviour in complex sport situations

Based on the Attentional Control Theory (ACT; Eysenck et al., 2007), performance efficiency is decreased in high-anxiety situations because worrying thoughts compete for attentional resources. A repeated-measures design (high/low state anxiety and high/low perceptual task demands) was used to test ACT explanations. Complex football situations were displayed to expert and non-expert football players in a decision making task in a controlled laboratory setting. Ratings of state anxiety and pupil diameter measures were used to check anxiety manipulations. Dependent variables were verbal response time and accuracy, mental effort ratings and visual search behavior (e.g., visual search rate). Results confirmed that an anxiety increase, indicated by higher state-anxiety ratings and larger pupil diameters, reduced processing efficiency for both groups (higher response times and mental effort ratings). Moreover, high task demands reduced the ability to shift attention between different locations for the expert group in the high anxiety condition only. Since particularly experts, who were expected to use more top-down strategies to guide visual attention under high perceptual task demands, showed less attentional shifts in the high compared to the low anxiety condition, as predicted by ACT, anxiety seems to impair the shifting function by interrupting the balance between top-down and bottom-up processes.

Effects of anxiety on decision making and visual search Behaviour in dynamic, time-constrained situations

Einleitung Aktuelle empirische Befunde deuten darauf hin, dass Sportler/innen durch Stress und erhöhte Angst eine reduzierte Effizienz bei der Entscheidungsfindung aufweisen (Wilson, 2008). Erklärt werden kann dieser Befund durch die Attentional-Control-Theory (ACT, Eysenck et al., 2007), die postuliert, dass aufmerksamkeitslenkende Prozesse unter Angst gestört werden. Um diese Annahme für komplexe Situationen im Sport zu prüfen, wurden Fußballspieler unter erhöhten und regulären Druckbedingungen verglichen. Methode Je 11 Experten und Nicht-Experten hatten aus der Perspektive des Abwehrspielers die Aufgabe, in zwei mal 24 Spielsituationen so schnell und korrekt wie möglich verbal anzugeben, welche Aktion der ballführende Spieler (in naher vs. ferner Spielsituation) nach Ausblendung der Szene ausführen wird. Während im ersten Block der Druck nicht erhöht wurde, wurden Druckbedingungen im zweiten Block u.a. durch eine Wettkampfsituation und „falscher“ Ergebnisrückmeldung gesteigert. Entscheidungs- und Blickverhalten (u.a. Anzahl Fixationen), Pupillengröße, Zustandsangst und „Mental Effort“ (Wilson, 2008) wurden erfasst. Neben Expertiseunterschieden wurde erwartet, dass erhöhte Angst die Entscheidungseffizienz sowie das Blickverhalten stört (ACT-Annahme), was mit 2 (Experten/Nicht-Experten) x 2 (nahe/ferne Spielsituation) x 2 (hohe/reguläre Druckbedingung) ANOVAs (? = .05) mit Messwiederholungen auf den letzten beiden Faktoren geprüft wurde. Ergebnisse Druckmanipulationen führten zu höherer Zustandsangst und größeren Pupillendurchmessern. Neben Expertiseunterschieden – Experten antworteten schneller, korrekter und zeigten ein situationsangepasstes visuelles Suchverhalten – wiesen beide Gruppen in Drucksituationen längere Antwortzeiten und höheren Mental Effort auf. Erhöhter Druck führte bei Experten zur Reduktion der Fixationsortwechsel für ferne Spielsituationen. Nicht-Experten differenzierten ihr Suchverhalten weder zwischen Bedingungen noch für Spielsituationen. Diskussion Die Resultate bestätigen die ACT-Annahme, dass Angst und Stress die sportliche Leistung durch längere Reaktionszeiten, höhere kognitive Anstrengung und ein teilweise ineffizientes visuelles Suchverhalten negativ beeinflusst. Eine gestörte Balance zwischen Top-Down und Bottom-Up-Prozessen könnte die Ursache sein (Eysenck et al., 2007). Literatur Eysenck, M. W., Derakshan, N., Santos, R., & Calvo, M. G. (2007). Anxiety and cognitive performance: Attentional control theory. Emotion, 7, 336–353. Wilson, M. (2008). From processing efficiency to attentional control: A mechanistic account of the anxiety-performance relationship. International Review of Sport and Exercise Psychology, 1, 184– 201. 2 Vorträge und Poster

Perception of co-speech gestures in aphasic patients: A visual exploration study during the observation of dyadic conversations.

BACKGROUND Co-speech gestures are part of nonverbal communication during conversations. They either support the verbal message or provide the interlocutor with additional information. Furthermore, they prompt as nonverbal cues the cooperative process of turn taking. In the present study, we investigated the influence of co-speech gestures on the perception of dyadic dialogue in aphasic patients. In particular, we analysed the impact of co-speech gestures on gaze direction (towards speaker or listener) and fixation of body parts. We hypothesized that aphasic patients, who are restricted in verbal comprehension, adapt their visual exploration strategies. METHODS Sixteen aphasic patients and 23 healthy control subjects participated in the study. Visual exploration behaviour was measured by means of a contact-free infrared eye-tracker while subjects were watching videos depicting spontaneous dialogues between two individuals. Cumulative fixation duration and mean fixation duration were calculated for the factors co-speech gesture (present and absent), gaze direction (to the speaker or to the listener), and region of interest (ROI), including hands, face, and body. RESULTS Both aphasic patients and healthy controls mainly fixated the speaker's face. We found a significant co-speech gesture × ROI interaction, indicating that the presence of a co-speech gesture encouraged subjects to look at the speaker. Further, there was a significant gaze direction × ROI × group interaction revealing that aphasic patients showed reduced cumulative fixation duration on the speaker's face compared to healthy controls. CONCLUSION Co-speech gestures guide the observer's attention towards the speaker, the source of semantic input. It is discussed whether an underlying semantic processing deficit or a deficit to integrate audio-visual information may cause aphasic patients to explore less the speaker's face.

The role of the right frontal eye field in overt visual attention deployment as assessed by free visual exploration

The frontal eye field (FEF) is known to be involved in saccade generation and visual attention control. Studies applying covert attentional orienting paradigms have shown that the right FEF is involved in attentional shifts to both the left and the right hemifield. In the current study, we aimed at examining the effects of inhibitory continuous theta burst (cTBS) transcranial magnetic stimulation over the right FEF on overt attentional orienting, as measured by a free visual exploration paradigm. In forty-two healthy subjects, free visual exploration of naturalistic pictures was tested in three conditions: (1) after cTBS over the right FEF; (2) after cTBS over a control site (vertex); and, (3) without any stimulation. The results showed that cTBS over the right FEF-but not cTBS over the vertex-triggered significant changes in the spatial distribution of the cumulative fixation duration. Compared to the group without stimulation and the group with cTBS over the vertex, cTBS over the right FEF decreased cumulative fixation duration in the left and in the right peripheral regions, and increased cumulative fixation duration in the central region. The present study supports the view that the right FEF is involved in the bilateral control of not only covert, but also of overt, peripheral visual attention.

Different visual exploration of tool-related gestures in left hemisphere brain damaged patients is associated with poor gestural imitation.

According to the direct matching hypothesis, perceived movements automatically activate existing motor components through matching of the perceived gesture and its execution. The aim of the present study was to test the direct matching hypothesis by assessing whether visual exploration behavior correlate with deficits in gestural imitation in left hemisphere damaged (LHD) patients. Eighteen LHD patients and twenty healthy control subjects took part in the study. Gesture imitation performance was measured by the test for upper limb apraxia (TULIA). Visual exploration behavior was measured by an infrared eye-tracking system. Short videos including forty gestures (20 meaningless and 20 communicative gestures) were presented. Cumulative fixation duration was measured in different regions of interest (ROIs), namely the face, the gesturing hand, the body, and the surrounding environment. Compared to healthy subjects, patients fixated significantly less the ROIs comprising the face and the gesturing hand during the exploration of emblematic and tool-related gestures. Moreover, visual exploration of tool-related gestures significantly correlated with tool-related imitation as measured by TULIA in LHD patients. Patients and controls did not differ in the visual exploration of meaningless gestures, and no significant relationships were found between visual exploration behavior and the imitation of emblematic and meaningless gestures in TULIA. The present study thus suggests that altered visual exploration may lead to disturbed imitation of tool related gestures, however not of emblematic and meaningless gestures. Consequently, our findings partially support the direct matching hypothesis.

Visual avoidance in phobia: particularities in neural activity, autonomic responding, and cognitive risk evaluations.

We investigated the neural mechanisms and the autonomic and cognitive responses associated with visual avoidance behavior in spider phobia. Spider phobic and control participants imagined visiting different forest locations with the possibility of encountering spiders, snakes, or birds (neutral reference category). In each experimental trial, participants saw a picture of a forest location followed by a picture of a spider, snake, or bird, and then rated their personal risk of encountering these animals in this context, as well as their fear. The greater the visual avoidance of spiders that a phobic participant demonstrated (as measured by eye tracking), the higher were her autonomic arousal and neural activity in the amygdala, orbitofrontal cortex (OFC), anterior cingulate cortex (ACC), and precuneus at picture onset. Visual avoidance of spiders in phobics also went hand in hand with subsequently reduced cognitive risk of encounters. Control participants, in contrast, displayed a positive relationship between gaze duration toward spiders, on the one hand, and autonomic responding, as well as OFC, ACC, and precuneus activity, on the other hand. In addition, they showed reduced encounter risk estimates when they looked longer at the animal pictures. Our data are consistent with the idea that one reason for phobics to avoid phobic information may be grounded in heightened activity in the fear circuit, which signals potential threat. Because of the absence of alternative efficient regulation strategies, visual avoidance may then function to down-regulate cognitive risk evaluations for threatening information about the phobic stimuli. Control participants, in contrast, may be characterized by a different coping style, whereby paying visual attention to potentially threatening information may help them to actively down-regulate cognitive evaluations of risk.

Effects of (un)predictable whole body vibrations on visual performance

Over recent years, it has repeatedly been shown that optimal gaze strategies enhance motor control (e.g., Foulsham, 2015). However, little is known, whether, vice versa, visual performance can be improved by optimized motor control. Consequently, in two studies, we investigated visual performance as a function of motor control strategies and task parameters, respectively. In Experiment 1, 72 participants were tested on visual acuity (Landolt) and contrast sensitivity (Grating), while standing in two different postures (upright vs. squat) on a ZEPTOR-platform that vibrated at four different frequencies (0, 4, 8, 12 Hz). After each test, perceived exertion (Borg) was assessed. Significant interactions were revealed for both tests, Landolt: F(3,213)=13.25, p<.01, ηp2=.16, Grating: F(3,213)=4.27, p<.01, ηp2=.06, elucidating a larger loss of acuity/contrast sensitivity with increasing frequencies for the upright compared with the squat posture. For perceived exertion, however, a diametrical interaction for frequency was found for acuity, F(3,213)=7.45, p<.01, ηp2=.09, and contrast sensitivity, F(3,213)=7.08, p < .01, ηp2=.09, substantiating that the impaired visual performance cannot be attributed to exertion. Consequently, the squat posture could permit better head and, hence, gaze stabilization. In Experiment 2, 64 participants performed the same tests while standing in a squat position on a ski-simulator, which vibrated with two different frequencies (2.4, 3.6 Hz) and amplitudes (50, 100 mm) in a predictable or unpredictable manner. Control strategies were identified by tracking segmental motion, which allows to derive damping characteristics. Considerable main effects were found for frequency, all F’s(1,52)>10.31, all p’s<.01, all ηp2’s>.16, as well as, in the acuity test, for predictability, F(1,52)=10.31, p<.01, ηp2=.17, and by tendency for amplitude, F(1,52)=3.53, p=.06, ηp2=.06. A significant correlation between the damping amplitude in the knee joint and the performance drop in visual acuity, r=-.97, p<.001, again points towards the importance of motor control strategies to maintain optimal visual performance.

Effects of Anxiety on Anticipation and Visual Search in Dynamic, Time-Constrained Situations

We tested the predictions of Attentional Control Theory (ACT) by examining how anxiety affects visual search strategies, performance efficiency, and performance effectiveness using a dynamic, temporal-constrained anticipation task. Higher and lower skilled players viewed soccer situations under 2 task constraints (near vs. far situation) and were tested under high (HA) and low (LA) anxiety conditions. Response accuracy (effectiveness) and response time, perceived mental effort, and eye-movements (all efficiency) were recorded. A significant increase in anxiety was evidenced by higher state anxiety ratings on the MRF-L scale. Increased anxiety led to decreased performance efficiency because response times and mental effort increased for both skill groups whereas response accuracy did not differ. Anxiety influenced search strategies, with higher skilled players showing a decrease in number of fixation locations for far situations under HA compared with LA condition when compared with lower skilled players. Findings provide support for ACT with anxiety impairing processing efficiency and, potentially, top-down attentional control across different task constraints.

Perception of co-speech gestures in aphasic patients: A visual exploration study during the observation of dyadic conversations

Background: Co-speech gestures are part of nonverbal communication during conversations. They either support the verbal message or provide the interlocutor with additional information. Furthermore, they prompt as nonverbal cues the cooperative process of turn taking. In the present study, we investigated the influence of co-speech gestures on the perception of dyadic dialogue in aphasic patients. In particular, we analysed the impact of co-speech gestures on gaze direction (towards speaker or listener) and fixation of body parts. We hypothesized that aphasic patients, who are restricted in verbal comprehension, adapt their visual exploration strategies. Methods: Sixteen aphasic patients and 23 healthy control subjects participated in the study. Visual exploration behaviour was measured by means of a contact-free infrared eye-tracker while subjects were watching videos depicting spontaneous dialogues between two individuals. Cumulative fixation duration and mean fixation duration were calculated for the factors co-speech gesture (present and absent), gaze direction (to the speaker or to the listener), and region of interest (ROI), including hands, face, and body. Results: Both aphasic patients and healthy controls mainly fixated the speaker’s face. We found a significant co-speech gesture x ROI interaction, indicating that the presence of a co-speech gesture encouraged subjects to look at the speaker. Further, there was a significant gaze direction x ROI x group interaction revealing that aphasic patients showed reduced cumulative fixation duration on the speaker’s face compared to healthy controls. Conclusion: Co-speech gestures guide the observer’s attention towards the speaker, the source of semantic input. It is discussed whether an underlying semantic processing deficit or a deficit to integrate audio-visual information may cause aphasic patients to explore less the speaker’s face. Keywords: Gestures, visual exploration, dialogue, aphasia, apraxia, eye movements

Effects of early and late lesion of orbital frontal cortex on visual processing of faces in rhesus macaques (Macaca mulatta)

Many mental disorders disrupt social skills, yet few studies have examined how the brain processes social information. Functional neuroimaging, neuroconnectivity and electrophysiological studies suggest that orbital frontal cortex plays important roles in social cognition, including the analysis of information from faces, which are important cues in social interactions. Studies in humans and non-human primates show that damage to orbital frontal cortex produces social behavior impairments, including abnormal aggression, but these studies have failed to determine whether damage to this area impairs face processing. In addition, it is not known whether damage early in life is more detrimental than damage in adulthood. This study examined whether orbital frontal cortex is necessary for the discrimination of face identity and facial expressions, and for appropriate behavioral responses to aggressive (threatening) facial expressions. Rhesus monkeys (Macaca mulatta) received selective lesions of orbital frontal cortex as newborns or adults. As adults, these animals were compared with sham-operated controls on their ability to discriminate between faces of individual monkeys and between different facial expressions of emotion. A passive visual paired-comparison task with standardized rhesus monkey face stimuli was designed and used to assess discrimination. In addition, looking behavior toward aggressive expressions was assessed and compared with that of normal control animals. The results showed that lesion of orbital frontal cortex (1) may impair discrimination between faces of individual monkeys, (2) does not impair facial expression discrimination, and (3) changes the amount of time spent looking at aggressive (threatening) facial expressions depending on the context. The effects of early and late lesions did not differ. Thus, orbital frontal cortex appears to be part of the neural circuitry for recognizing individuals and for modulating the response to aggression in faces, and the plasticity of the immature brain does not allow for recovery of these functions when the damage occurs early in life. This study opens new avenues for the assessment of rhesus monkey face processing and the neural basis of social cognition, and allows a better understanding of the nature of the neuropathology in patients with mental disorders that disrupt social behavior, such as autism. ^

Effects of ocean acidification on visual risk assessment in coral reef fishes

1. With the global increase in CO2 emissions, there is a pressing need for studies aimed at understanding the effects of ocean acidification on marine ecosystems. Several studies have reported that exposure to CO2 impairs chemosensory responses of juvenile coral reef fishes to predators. Moreover, one recent study pointed to impaired responses of reef fish to auditory cues that indicate risky locations. These studies suggest that altered behaviour following exposure to elevated CO2 is caused by a systemic effect at the neural level. 2. The goal of our experiment was to test whether juvenile damselfish Pomacentrus amboinensis exposed to different levels of CO2 would respond differently to a potential threat, the sight of a large novel coral reef fish, a spiny chromis, Acanthochromis polyancanthus, placed in a watertight bag. 3. Juvenile damselfish exposed to 440 (current day control), 550 or 700 µatm CO2 did not differ in their response to the chromis. However, fish exposed to 850 µatm showed reduced antipredator responses; they failed to show the same reduction in foraging, activity and area use in response to the chromis. Moreover, they moved closer to the chromis and lacked any bobbing behaviour typically displayed by juvenile damselfishes in threatening situations. 4. Our results are the first to suggest that response to visual cues of risk may be impaired by CO2 and provide strong evidence that the multi-sensory effects of CO2 may stem from systematic effects at the neural level.

3D Object following based on visual information for Unmanned Aerial Vehicles

This article presents a novel system and a control strategy for visual following of a 3D moving object by an Unmanned Aerial Vehicle UAV. The presented strategy is based only on the visual information given by an adaptive tracking method based on the color information, which jointly with the dynamics of a camera fixed to a rotary wind UAV are used to develop an Image-based visual servoing IBVS system. This system is focused on continuously following a 3D moving target object, maintaining it with a fixed distance and centered on the image plane. The algorithm is validated on real flights on outdoors scenarios, showing the robustness of the proposed systems against winds perturbations, illumination and weather changes among others. The obtained results indicate that the proposed algorithms is suitable for complex controls task, such object following and pursuit, flying in formation, as well as their use for indoor navigation

Aerial Object Following Using Visual Fuzzy Servoing

This article presents a visual servoing system to follow a 3D moving object by a Micro Unmanned Aerial Vehicle (MUAV). The presented control strategy is based only on the visual information given by an adaptive tracking method based on the colour information. A visual fuzzy system has been developed for servoing the camera situated on a rotary wing MAUV, that also considers its own dynamics. This system is focused on continuously following of an aerial moving target object, maintaining it with a fixed safe distance and centred on the image plane. The algorithm is validated on real flights on outdoors scenarios, showing the robustness of the proposed systems against winds perturbations, illumination and weather changes among others. The obtained results indicate that the proposed algorithms is suitable for complex controls task, such object following and pursuit, flying in formation, as well as their use for indoor navigation

See-and-avoid quadcopter using fuzzy control optimized by cross-entropy

In this work we present an optimized fuzzy visual servoing system for obstacle avoidance using an unmanned aerial vehicle. The cross-entropy theory is used to optimise the gains of our controllers. The optimization process was made using the ROS-Gazebo 3D simulation with purposeful extensions developed for our experiments. Visual servoing is achieved through an image processing front-end that uses the Camshift algorithm to detect and track objects in the scene. Experimental flight trials using a small quadrotor were performed to validate the parameters estimated from simulation. The integration of crossentropy methods is a straightforward way to estimate optimal gains achieving excellent results when tested in real flights.

Design and control of multi-finger haptic devices for dexterous manipulation

En la interacción con el entorno que nos rodea durante nuestra vida diaria (utilizar un cepillo de dientes, abrir puertas, utilizar el teléfono móvil, etc.) y en situaciones profesionales (intervenciones médicas, procesos de producción, etc.), típicamente realizamos manipulaciones avanzadas que incluyen la utilización de los dedos de ambas manos. De esta forma el desarrollo de métodos de interacción háptica multi-dedo dan lugar a interfaces hombre-máquina más naturales y realistas. No obstante, la mayoría de interfaces hápticas disponibles en el mercado están basadas en interacciones con un solo punto de contacto; esto puede ser suficiente para la exploración o palpación del entorno pero no permite la realización de tareas más avanzadas como agarres. En esta tesis, se investiga el diseño mecánico, control y aplicaciones de dispositivos hápticos modulares con capacidad de reflexión de fuerzas en los dedos índice, corazón y pulgar del usuario. El diseño mecánico de la interfaz diseñada, ha sido optimizado con funciones multi-objetivo para conseguir una baja inercia, un amplio espacio de trabajo, alta manipulabilidad y reflexión de fuerzas superiores a 3 N en el espacio de trabajo. El ancho de banda y la rigidez del dispositivo se han evaluado mediante simulación y experimentación real. Una de las áreas más importantes en el diseño de estos dispositivos es el efector final, ya que es la parte que está en contacto con el usuario. Durante este trabajo se ha diseñado un dedal de bajo peso, adaptable a diferentes usuarios que, mediante la incorporación de sensores de contacto, permite estimar fuerzas normales y tangenciales durante la interacción con entornos reales y virtuales. Para el diseño de la arquitectura de control, se estudiaron los principales requisitos para estos dispositivos. Entre estos, cabe destacar la adquisición, procesado e intercambio a través de internet de numerosas señales de control e instrumentación; la computación de equaciones matemáticas incluyendo la cinemática directa e inversa, jacobiana, algoritmos de detección de agarres, etc. Todos estos componentes deben calcularse en tiempo real garantizando una frecuencia mínima de 1 KHz. Además, se describen sistemas para manipulación de precisión virtual y remota; así como el diseño de un método denominado "desacoplo cinemático iterativo" para computar la cinemática inversa de robots y la comparación con otros métodos actuales. Para entender la importancia de la interacción multimodal, se ha llevado a cabo un estudio para comprobar qué estímulos sensoriales se correlacionan con tiempos de respuesta más rápidos y de mayor precisión. Estos experimentos se desarrollaron en colaboración con neurocientíficos del instituto Technion Israel Institute of Technology. Comparando los tiempos de respuesta en la interacción unimodal (auditiva, visual y háptica) con combinaciones bimodales y trimodales de los mismos, se demuestra que el movimiento sincronizado de los dedos para generar respuestas de agarre se basa principalmente en la percepción háptica. La ventaja en el tiempo de procesamiento de los estímulos hápticos, sugiere que los entornos virtuales que incluyen esta componente sensorial generan mejores contingencias motoras y mejoran la credibilidad de los eventos. Se concluye que, los sistemas que incluyen percepción háptica dotan a los usuarios de más tiempo en las etapas cognitivas para rellenar información de forma creativa y formar una experiencia más rica. Una aplicación interesante de los dispositivos hápticos es el diseño de nuevos simuladores que permitan entrenar habilidades manuales en el sector médico. En colaboración con fisioterapeutas de Griffith University en Australia, se desarrolló un simulador que permite realizar ejercicios de rehabilitación de la mano. Las propiedades de rigidez no lineales de la articulación metacarpofalange del dedo índice se estimaron mediante la utilización del efector final diseñado. Estos parámetros, se han implementado en un escenario que simula el comportamiento de la mano humana y que permite la interacción háptica a través de esta interfaz. Las aplicaciones potenciales de este simulador están relacionadas con entrenamiento y educación de estudiantes de fisioterapia. En esta tesis, se han desarrollado nuevos métodos que permiten el control simultáneo de robots y manos robóticas en la interacción con entornos reales. El espacio de trabajo alcanzable por el dispositivo háptico, se extiende mediante el cambio de modo de control automático entre posición y velocidad. Además, estos métodos permiten reconocer el gesto del usuario durante las primeras etapas de aproximación al objeto para su agarre. Mediante experimentos de manipulación avanzada de objetos con un manipulador y diferentes manos robóticas, se muestra que el tiempo en realizar una tarea se reduce y que el sistema permite la realización de la tarea con precisión. Este trabajo, es el resultado de una colaboración con investigadores de Harvard BioRobotics Laboratory. ABSTRACT When we interact with the environment in our daily life (using a toothbrush, opening doors, using cell-phones, etc.), or in professional situations (medical interventions, manufacturing processes, etc.) we typically perform dexterous manipulations that involve multiple fingers and palm for both hands. Therefore, multi-Finger haptic methods can provide a realistic and natural human-machine interface to enhance immersion when interacting with simulated or remote environments. Most commercial devices allow haptic interaction with only one contact point, which may be sufficient for some exploration or palpation tasks but are not enough to perform advanced object manipulations such as grasping. In this thesis, I investigate the mechanical design, control and applications of a modular haptic device that can provide force feedback to the index, thumb and middle fingers of the user. The designed mechanical device is optimized with a multi-objective design function to achieve a low inertia, a large workspace, manipulability, and force-feedback of up to 3 N within the workspace; the bandwidth and rigidity for the device is assessed through simulation and real experimentation. One of the most important areas when designing haptic devices is the end-effector, since it is in contact with the user. In this thesis the design and evaluation of a thimble-like, lightweight, user-adaptable, and cost-effective device that incorporates four contact force sensors is described. This design allows estimation of the forces applied by a user during manipulation of virtual and real objects. The design of a real-time, modular control architecture for multi-finger haptic interaction is described. Requirements for control of multi-finger haptic devices are explored. Moreover, a large number of signals have to be acquired, processed, sent over the network and mathematical computations such as device direct and inverse kinematics, jacobian, grasp detection algorithms, etc. have to be calculated in Real Time to assure the required high fidelity for the haptic interaction. The Hardware control architecture has different modules and consists of an FPGA for the low-level controller and a RT controller for managing all the complex calculations (jacobian, kinematics, etc.); this provides a compact and scalable solution for the required high computation capabilities assuring a correct frequency rate for the control loop of 1 kHz. A set-up for dexterous virtual and real manipulation is described. Moreover, a new algorithm named the iterative kinematic decoupling method was implemented to solve the inverse kinematics of a robotic manipulator. In order to understand the importance of multi-modal interaction including haptics, a subject study was carried out to look for sensory stimuli that correlate with fast response time and enhanced accuracy. This experiment was carried out in collaboration with neuro-scientists from Technion Israel Institute of Technology. By comparing the grasping response times in unimodal (auditory, visual, and haptic) events with the response times in events with bimodal and trimodal combinations. It is concluded that in grasping tasks the synchronized motion of the fingers to generate the grasping response relies on haptic cues. This processing-speed advantage of haptic cues suggests that multimodalhaptic virtual environments are superior in generating motor contingencies, enhancing the plausibility of events. Applications that include haptics provide users with more time at the cognitive stages to fill in missing information creatively and form a richer experience. A major application of haptic devices is the design of new simulators to train manual skills for the medical sector. In collaboration with physical therapists from Griffith University in Australia, we developed a simulator to allow hand rehabilitation manipulations. First, the non-linear stiffness properties of the metacarpophalangeal joint of the index finger were estimated by using the designed end-effector; these parameters are implemented in a scenario that simulates the behavior of the human hand and that allows haptic interaction through the designed haptic device. The potential application of this work is related to educational and medical training purposes. In this thesis, new methods to simultaneously control the position and orientation of a robotic manipulator and the grasp of a robotic hand when interacting with large real environments are studied. The reachable workspace is extended by automatically switching between rate and position control modes. Moreover, the human hand gesture is recognized by reading the relative movements of the index, thumb and middle fingers of the user during the early stages of the approximation-to-the-object phase and then mapped to the robotic hand actuators. These methods are validated to perform dexterous manipulation of objects with a robotic manipulator, and different robotic hands. This work is the result of a research collaboration with researchers from the Harvard BioRobotics Laboratory. The developed experiments show that the overall task time is reduced and that the developed methods allow for full dexterity and correct completion of dexterous manipulations.