ARMin: a robot for patient-cooperative arm therapy

Task-oriented, repetitive and intensive arm training can enhance arm rehabilitation in patients with paralyzed upper extremities due to lesions of the central nervous system. There is evidence that the training duration is a key factor for the therapy progress. Robot-supported therapy can improve the rehabilitation allowing more intensive training. This paper presents the kinematics, the control and the therapy modes of the arm therapy robot ARMin. It is a haptic display with semi-exoskeleton kinematics with four active and two passive degrees of freedom. Equipped with position, force and torque sensors the device can deliver patient-cooperative arm therapy taking into account the activity of the patient and supporting him/her only as much as needed. The haptic display is combined with an audiovisual display that is used to present the movement and the movement task to the patient. It is assumed that the patient-cooperative therapy approach combined with a multimodal display can increase the patient's motivation and activity and, therefore, the therapeutic progress.

A novel paradigm for patient-cooperative control of upper-limb rehabilitation robots

Early intervention and intensive therapy improve the outcome of neuromuscular rehabilitation. There are indications that where a patient is motivated and premeditates their movement, the recovery is more effective. Therefore, a strategy for patient-cooperative control of rehabilitation devices for upper extremities is proposed and evaluated. The strategy is based on the minimal intervention principle allowing an efficient exploitation of task space redundancies and resulting in user-driven movement trajectories. The patient's effort is taken into consideration by enabling the machine to comply with forces exerted by the user. The interaction is enhanced through a multimodal display and a virtually generated environment that includes haptic, visual and sound modalities.

ARMin - robot for rehabilitation of the upper extremities

Task-oriented repetitive movements can improve motor recovery in patients with neurological or orthopaedic lesions. The application of robotics can serve to assist, enhance, evaluate, and document neurological and orthopaedic rehabilitation. ARMin is a new robot for arm therapy applicable to the training of activities of daily living in clinics. ARMin has a semiexoskeletal structure with six degrees of freedom, and is equipped with position and force sensors. The mechanical structure, the actuators and the sensors of the robot are optimized for patient-cooperative control strategies based on impedance and admittance architectures. This paper describes the mechanical structure, the control system, the sensors and actuators, safety aspects and results of a first pilot study with hemiplegic and spinal cord injured subjects.

The Effect Of Misleading Prior Information On The Subjective Visual Vertical

When tilted sideways participants misperceive the visual vertical assessed by means of a luminous line in otherwise complete dark- ness. A recent modeling approach (De Vrijer et al., 2009) claimed that these typical patterns of errors (known as A- and E-effects) could be explained by as- suming that participants behave in a Bayes optimal manner. In this study, we experimentally manipulate participants’ prior information about body-in-space orientation and measure the effect of this manipulation on the subjective visual vertical (SVV). Specifically, we explore the effects of veridical and misleading instructions about body tilt orientations on the SVV. We used a psychophys- ical 2AFC SVV task at roll tilt angles of 0 degrees, 16 degrees and 4 degrees CW and CCW. Participants were tilted to 4 degrees under different instruction conditions: in one condition, participants received veridical instructions as to their tilt angle, whereas in another condition, participants received the mis- leading instruction that their body position was perfectly upright. Our results indicate systematic differences between the instruction conditions at 4 degrees CW and CCW. Participants did not simply use an ego-centric reference frame in the misleading condition; instead, participants’ estimates of the SVV seem to lie between their head’s Z-axis and the estimate of the SVV as measured in the veridical condition. All participants displayed A-effects at roll tilt an- gles of 16 degrees CW and CCW. We discuss our results in the context of the Bayesian model by De Vrijer et al. (2009), and claim that this pattern of re- sults is consistent with a manipulation of precision of a prior distribution over body-in-space orientations. Furthermore, we introduce a Bayesian Generalized Linear Model for estimating parameters of participants’ psychometric function, which allows us to jointly estimate group level and individual level parameters under all experimental conditions simultaneously, rather than relying on the traditional two-step approach to obtaining group level parameter estimates.

Effects of anxiety on decision making and visual search behaviour in complex sport situations

Introduction Current empirical findings indicate that the efficiency of decision making (both for experts and near-experts) in simple situations is reduced under increased stress (Wilson, 2008). Explaining the phenomenon, the Attentional Control Theory (ACT, Eysenck et al., 2007) postulates an impairment of attentional processes resulting in a less efficient processing of visual information. From a practitioner’s perspective, it would be highly relevant to know whether this phenomenon can also be found in complex sport situations like in the game of football. Consequently, in the present study, decision making of football players was examined under regular vs. increased anxiety conditions. Methods 22 participants (11 experts and 11 near-experts) viewed 24 complex football situations (counterbalanced) in two anxiety conditions from the perspective of the last defender. They had to decide as fast and accurate as possible on the next action of the player in possession (options: shot on goal, dribble or pass to a designated team member) for equal numbers of trials in a near and far distance condition (based on the position of the player in possession). Anxiety was manipulated via a competitive environment, false feedback as well as ego threats. Decision time and accuracy, gaze behaviour (e.g., fixation duration on different locations) as well as state anxiety and mental effort were used as dependent variables and analysed with 2 (expertise) x 2 (distance) x 2 (anxiety) ANOVAs with repeated measures on the last two factors. Besides expertise differences, it was hypothesised that, based on ACT, increased anxiety reduces performance efficiency and impairs gaze behaviour. Results and Discussion Anxiety was manipulated successfully, indicated by higher ratings of state anxiety, F(1, 20) = 13.13, p < .01, ηp2 = .40. Besides expertise differences in decision making – experts responded faster, F(1, 20) = 11.32, p < .01, ηp2 = .36, and more accurate, F(1,20) = 23.93, p < .01, ηp2 = .55, than near-experts – decision time, F(1, 20) = 9.29, p < .01, ηp2 = .32, and mental effort, F(1, 20) = 7.33, p = .01, ηp2 = .27, increased for both groups in the high anxiety condition. This result confirms the ACT assumption that processing efficiency is reduced when being anxious. Replicating earlier findings, a significant expertise by distance interaction could be observed, F(1, 18) = 18.53, p < .01, ηp2 = .51), with experts fixating longer on the player in possession or the ball in the near distance and longer on other opponents, teammates and free space in the far distance condition. This shows that experts are able to adjust their gaze behaviour to affordances of displayed playing patterns. Additionally, a three way interaction was found, F(1, 18) = 7.37 p = .01, ηp2 = .29, revealing that experts utilised a reduced number of fixations in the far distance condition when being anxious indicating a reduced ability to pick up visual information. Since especially the visual search behaviour of experts was impaired, the ACT prediction that particularly top-down processes are affected by anxiety could be confirmed. Taken together, the results show that sports performance is negatively influenced by anxiety since longer response times, higher mental effort and inefficient visual search behaviour were observed. From a practitioner’s perspective, this finding might suggest preferring (implicit) perceptual cognitive training; however, this recommendation needs to be empirically supported in intervention studies. References: Eysenck, M. W., Derakshan, N., Santos, R., & Calvo, M. G. (2007). Anxiety and cognitive performance: Attentional control theory. Emotion, 7, 336-353. Wilson, M. (2008). From processing efficiency to attentional control: A mechanistic account of the anxiety-performance relationship. Int. Review of Sport and Exercise Psychology, 1, 184-201.

Effects of anxiety on decision making and visual search behaviour in complex sport situations

Based on the Attentional Control Theory (ACT; Eysenck et al., 2007), performance efficiency is decreased in high-anxiety situations because worrying thoughts compete for attentional resources. A repeated-measures design (high/low state anxiety and high/low perceptual task demands) was used to test ACT explanations. Complex football situations were displayed to expert and non-expert football players in a decision making task in a controlled laboratory setting. Ratings of state anxiety and pupil diameter measures were used to check anxiety manipulations. Dependent variables were verbal response time and accuracy, mental effort ratings and visual search behavior (e.g., visual search rate). Results confirmed that an anxiety increase, indicated by higher state-anxiety ratings and larger pupil diameters, reduced processing efficiency for both groups (higher response times and mental effort ratings). Moreover, high task demands reduced the ability to shift attention between different locations for the expert group in the high anxiety condition only. Since particularly experts, who were expected to use more top-down strategies to guide visual attention under high perceptual task demands, showed less attentional shifts in the high compared to the low anxiety condition, as predicted by ACT, anxiety seems to impair the shifting function by interrupting the balance between top-down and bottom-up processes.

Effects of anxiety on decision making and visual search Behaviour in dynamic, time-constrained situations

Einleitung Aktuelle empirische Befunde deuten darauf hin, dass Sportler/innen durch Stress und erhöhte Angst eine reduzierte Effizienz bei der Entscheidungsfindung aufweisen (Wilson, 2008). Erklärt werden kann dieser Befund durch die Attentional-Control-Theory (ACT, Eysenck et al., 2007), die postuliert, dass aufmerksamkeitslenkende Prozesse unter Angst gestört werden. Um diese Annahme für komplexe Situationen im Sport zu prüfen, wurden Fußballspieler unter erhöhten und regulären Druckbedingungen verglichen. Methode Je 11 Experten und Nicht-Experten hatten aus der Perspektive des Abwehrspielers die Aufgabe, in zwei mal 24 Spielsituationen so schnell und korrekt wie möglich verbal anzugeben, welche Aktion der ballführende Spieler (in naher vs. ferner Spielsituation) nach Ausblendung der Szene ausführen wird. Während im ersten Block der Druck nicht erhöht wurde, wurden Druckbedingungen im zweiten Block u.a. durch eine Wettkampfsituation und „falscher“ Ergebnisrückmeldung gesteigert. Entscheidungs- und Blickverhalten (u.a. Anzahl Fixationen), Pupillengröße, Zustandsangst und „Mental Effort“ (Wilson, 2008) wurden erfasst. Neben Expertiseunterschieden wurde erwartet, dass erhöhte Angst die Entscheidungseffizienz sowie das Blickverhalten stört (ACT-Annahme), was mit 2 (Experten/Nicht-Experten) x 2 (nahe/ferne Spielsituation) x 2 (hohe/reguläre Druckbedingung) ANOVAs (? = .05) mit Messwiederholungen auf den letzten beiden Faktoren geprüft wurde. Ergebnisse Druckmanipulationen führten zu höherer Zustandsangst und größeren Pupillendurchmessern. Neben Expertiseunterschieden – Experten antworteten schneller, korrekter und zeigten ein situationsangepasstes visuelles Suchverhalten – wiesen beide Gruppen in Drucksituationen längere Antwortzeiten und höheren Mental Effort auf. Erhöhter Druck führte bei Experten zur Reduktion der Fixationsortwechsel für ferne Spielsituationen. Nicht-Experten differenzierten ihr Suchverhalten weder zwischen Bedingungen noch für Spielsituationen. Diskussion Die Resultate bestätigen die ACT-Annahme, dass Angst und Stress die sportliche Leistung durch längere Reaktionszeiten, höhere kognitive Anstrengung und ein teilweise ineffizientes visuelles Suchverhalten negativ beeinflusst. Eine gestörte Balance zwischen Top-Down und Bottom-Up-Prozessen könnte die Ursache sein (Eysenck et al., 2007). Literatur Eysenck, M. W., Derakshan, N., Santos, R., & Calvo, M. G. (2007). Anxiety and cognitive performance: Attentional control theory. Emotion, 7, 336–353. Wilson, M. (2008). From processing efficiency to attentional control: A mechanistic account of the anxiety-performance relationship. International Review of Sport and Exercise Psychology, 1, 184– 201. 2 Vorträge und Poster

Perception of co-speech gestures in aphasic patients: A visual exploration study during the observation of dyadic conversations.

BACKGROUND Co-speech gestures are part of nonverbal communication during conversations. They either support the verbal message or provide the interlocutor with additional information. Furthermore, they prompt as nonverbal cues the cooperative process of turn taking. In the present study, we investigated the influence of co-speech gestures on the perception of dyadic dialogue in aphasic patients. In particular, we analysed the impact of co-speech gestures on gaze direction (towards speaker or listener) and fixation of body parts. We hypothesized that aphasic patients, who are restricted in verbal comprehension, adapt their visual exploration strategies. METHODS Sixteen aphasic patients and 23 healthy control subjects participated in the study. Visual exploration behaviour was measured by means of a contact-free infrared eye-tracker while subjects were watching videos depicting spontaneous dialogues between two individuals. Cumulative fixation duration and mean fixation duration were calculated for the factors co-speech gesture (present and absent), gaze direction (to the speaker or to the listener), and region of interest (ROI), including hands, face, and body. RESULTS Both aphasic patients and healthy controls mainly fixated the speaker's face. We found a significant co-speech gesture × ROI interaction, indicating that the presence of a co-speech gesture encouraged subjects to look at the speaker. Further, there was a significant gaze direction × ROI × group interaction revealing that aphasic patients showed reduced cumulative fixation duration on the speaker's face compared to healthy controls. CONCLUSION Co-speech gestures guide the observer's attention towards the speaker, the source of semantic input. It is discussed whether an underlying semantic processing deficit or a deficit to integrate audio-visual information may cause aphasic patients to explore less the speaker's face.

Different visual exploration of tool-related gestures in left hemisphere brain damaged patients is associated with poor gestural imitation.

According to the direct matching hypothesis, perceived movements automatically activate existing motor components through matching of the perceived gesture and its execution. The aim of the present study was to test the direct matching hypothesis by assessing whether visual exploration behavior correlate with deficits in gestural imitation in left hemisphere damaged (LHD) patients. Eighteen LHD patients and twenty healthy control subjects took part in the study. Gesture imitation performance was measured by the test for upper limb apraxia (TULIA). Visual exploration behavior was measured by an infrared eye-tracking system. Short videos including forty gestures (20 meaningless and 20 communicative gestures) were presented. Cumulative fixation duration was measured in different regions of interest (ROIs), namely the face, the gesturing hand, the body, and the surrounding environment. Compared to healthy subjects, patients fixated significantly less the ROIs comprising the face and the gesturing hand during the exploration of emblematic and tool-related gestures. Moreover, visual exploration of tool-related gestures significantly correlated with tool-related imitation as measured by TULIA in LHD patients. Patients and controls did not differ in the visual exploration of meaningless gestures, and no significant relationships were found between visual exploration behavior and the imitation of emblematic and meaningless gestures in TULIA. The present study thus suggests that altered visual exploration may lead to disturbed imitation of tool related gestures, however not of emblematic and meaningless gestures. Consequently, our findings partially support the direct matching hypothesis.

Visual avoidance in phobia: particularities in neural activity, autonomic responding, and cognitive risk evaluations.

We investigated the neural mechanisms and the autonomic and cognitive responses associated with visual avoidance behavior in spider phobia. Spider phobic and control participants imagined visiting different forest locations with the possibility of encountering spiders, snakes, or birds (neutral reference category). In each experimental trial, participants saw a picture of a forest location followed by a picture of a spider, snake, or bird, and then rated their personal risk of encountering these animals in this context, as well as their fear. The greater the visual avoidance of spiders that a phobic participant demonstrated (as measured by eye tracking), the higher were her autonomic arousal and neural activity in the amygdala, orbitofrontal cortex (OFC), anterior cingulate cortex (ACC), and precuneus at picture onset. Visual avoidance of spiders in phobics also went hand in hand with subsequently reduced cognitive risk of encounters. Control participants, in contrast, displayed a positive relationship between gaze duration toward spiders, on the one hand, and autonomic responding, as well as OFC, ACC, and precuneus activity, on the other hand. In addition, they showed reduced encounter risk estimates when they looked longer at the animal pictures. Our data are consistent with the idea that one reason for phobics to avoid phobic information may be grounded in heightened activity in the fear circuit, which signals potential threat. Because of the absence of alternative efficient regulation strategies, visual avoidance may then function to down-regulate cognitive risk evaluations for threatening information about the phobic stimuli. Control participants, in contrast, may be characterized by a different coping style, whereby paying visual attention to potentially threatening information may help them to actively down-regulate cognitive evaluations of risk.

Effects of (un)predictable whole body vibrations on visual performance

Over recent years, it has repeatedly been shown that optimal gaze strategies enhance motor control (e.g., Foulsham, 2015). However, little is known, whether, vice versa, visual performance can be improved by optimized motor control. Consequently, in two studies, we investigated visual performance as a function of motor control strategies and task parameters, respectively. In Experiment 1, 72 participants were tested on visual acuity (Landolt) and contrast sensitivity (Grating), while standing in two different postures (upright vs. squat) on a ZEPTOR-platform that vibrated at four different frequencies (0, 4, 8, 12 Hz). After each test, perceived exertion (Borg) was assessed. Significant interactions were revealed for both tests, Landolt: F(3,213)=13.25, p<.01, ηp2=.16, Grating: F(3,213)=4.27, p<.01, ηp2=.06, elucidating a larger loss of acuity/contrast sensitivity with increasing frequencies for the upright compared with the squat posture. For perceived exertion, however, a diametrical interaction for frequency was found for acuity, F(3,213)=7.45, p<.01, ηp2=.09, and contrast sensitivity, F(3,213)=7.08, p < .01, ηp2=.09, substantiating that the impaired visual performance cannot be attributed to exertion. Consequently, the squat posture could permit better head and, hence, gaze stabilization. In Experiment 2, 64 participants performed the same tests while standing in a squat position on a ski-simulator, which vibrated with two different frequencies (2.4, 3.6 Hz) and amplitudes (50, 100 mm) in a predictable or unpredictable manner. Control strategies were identified by tracking segmental motion, which allows to derive damping characteristics. Considerable main effects were found for frequency, all F’s(1,52)>10.31, all p’s<.01, all ηp2’s>.16, as well as, in the acuity test, for predictability, F(1,52)=10.31, p<.01, ηp2=.17, and by tendency for amplitude, F(1,52)=3.53, p=.06, ηp2=.06. A significant correlation between the damping amplitude in the knee joint and the performance drop in visual acuity, r=-.97, p<.001, again points towards the importance of motor control strategies to maintain optimal visual performance.

Effects of Anxiety on Anticipation and Visual Search in Dynamic, Time-Constrained Situations

We tested the predictions of Attentional Control Theory (ACT) by examining how anxiety affects visual search strategies, performance efficiency, and performance effectiveness using a dynamic, temporal-constrained anticipation task. Higher and lower skilled players viewed soccer situations under 2 task constraints (near vs. far situation) and were tested under high (HA) and low (LA) anxiety conditions. Response accuracy (effectiveness) and response time, perceived mental effort, and eye-movements (all efficiency) were recorded. A significant increase in anxiety was evidenced by higher state anxiety ratings on the MRF-L scale. Increased anxiety led to decreased performance efficiency because response times and mental effort increased for both skill groups whereas response accuracy did not differ. Anxiety influenced search strategies, with higher skilled players showing a decrease in number of fixation locations for far situations under HA compared with LA condition when compared with lower skilled players. Findings provide support for ACT with anxiety impairing processing efficiency and, potentially, top-down attentional control across different task constraints.

Perception of co-speech gestures in aphasic patients: A visual exploration study during the observation of dyadic conversations

Background: Co-speech gestures are part of nonverbal communication during conversations. They either support the verbal message or provide the interlocutor with additional information. Furthermore, they prompt as nonverbal cues the cooperative process of turn taking. In the present study, we investigated the influence of co-speech gestures on the perception of dyadic dialogue in aphasic patients. In particular, we analysed the impact of co-speech gestures on gaze direction (towards speaker or listener) and fixation of body parts. We hypothesized that aphasic patients, who are restricted in verbal comprehension, adapt their visual exploration strategies. Methods: Sixteen aphasic patients and 23 healthy control subjects participated in the study. Visual exploration behaviour was measured by means of a contact-free infrared eye-tracker while subjects were watching videos depicting spontaneous dialogues between two individuals. Cumulative fixation duration and mean fixation duration were calculated for the factors co-speech gesture (present and absent), gaze direction (to the speaker or to the listener), and region of interest (ROI), including hands, face, and body. Results: Both aphasic patients and healthy controls mainly fixated the speaker’s face. We found a significant co-speech gesture x ROI interaction, indicating that the presence of a co-speech gesture encouraged subjects to look at the speaker. Further, there was a significant gaze direction x ROI x group interaction revealing that aphasic patients showed reduced cumulative fixation duration on the speaker’s face compared to healthy controls. Conclusion: Co-speech gestures guide the observer’s attention towards the speaker, the source of semantic input. It is discussed whether an underlying semantic processing deficit or a deficit to integrate audio-visual information may cause aphasic patients to explore less the speaker’s face. Keywords: Gestures, visual exploration, dialogue, aphasia, apraxia, eye movements

Effects of early and late lesion of orbital frontal cortex on visual processing of faces in rhesus macaques (Macaca mulatta)

Many mental disorders disrupt social skills, yet few studies have examined how the brain processes social information. Functional neuroimaging, neuroconnectivity and electrophysiological studies suggest that orbital frontal cortex plays important roles in social cognition, including the analysis of information from faces, which are important cues in social interactions. Studies in humans and non-human primates show that damage to orbital frontal cortex produces social behavior impairments, including abnormal aggression, but these studies have failed to determine whether damage to this area impairs face processing. In addition, it is not known whether damage early in life is more detrimental than damage in adulthood. This study examined whether orbital frontal cortex is necessary for the discrimination of face identity and facial expressions, and for appropriate behavioral responses to aggressive (threatening) facial expressions. Rhesus monkeys (Macaca mulatta) received selective lesions of orbital frontal cortex as newborns or adults. As adults, these animals were compared with sham-operated controls on their ability to discriminate between faces of individual monkeys and between different facial expressions of emotion. A passive visual paired-comparison task with standardized rhesus monkey face stimuli was designed and used to assess discrimination. In addition, looking behavior toward aggressive expressions was assessed and compared with that of normal control animals. The results showed that lesion of orbital frontal cortex (1) may impair discrimination between faces of individual monkeys, (2) does not impair facial expression discrimination, and (3) changes the amount of time spent looking at aggressive (threatening) facial expressions depending on the context. The effects of early and late lesions did not differ. Thus, orbital frontal cortex appears to be part of the neural circuitry for recognizing individuals and for modulating the response to aggression in faces, and the plasticity of the immature brain does not allow for recovery of these functions when the damage occurs early in life. This study opens new avenues for the assessment of rhesus monkey face processing and the neural basis of social cognition, and allows a better understanding of the nature of the neuropathology in patients with mental disorders that disrupt social behavior, such as autism. ^

Effects of ocean acidification on visual risk assessment in coral reef fishes

1. With the global increase in CO2 emissions, there is a pressing need for studies aimed at understanding the effects of ocean acidification on marine ecosystems. Several studies have reported that exposure to CO2 impairs chemosensory responses of juvenile coral reef fishes to predators. Moreover, one recent study pointed to impaired responses of reef fish to auditory cues that indicate risky locations. These studies suggest that altered behaviour following exposure to elevated CO2 is caused by a systemic effect at the neural level. 2. The goal of our experiment was to test whether juvenile damselfish Pomacentrus amboinensis exposed to different levels of CO2 would respond differently to a potential threat, the sight of a large novel coral reef fish, a spiny chromis, Acanthochromis polyancanthus, placed in a watertight bag. 3. Juvenile damselfish exposed to 440 (current day control), 550 or 700 µatm CO2 did not differ in their response to the chromis. However, fish exposed to 850 µatm showed reduced antipredator responses; they failed to show the same reduction in foraging, activity and area use in response to the chromis. Moreover, they moved closer to the chromis and lacked any bobbing behaviour typically displayed by juvenile damselfishes in threatening situations. 4. Our results are the first to suggest that response to visual cues of risk may be impaired by CO2 and provide strong evidence that the multi-sensory effects of CO2 may stem from systematic effects at the neural level.