Towards Human-like Bimanual Movements in Anthropomorphic Robots: A Nonlinear Optimization Approach

Previously we have presented a model for generating human-like arm and hand movements on an unimanual anthropomorphic robot involved in human-robot collaboration tasks. The present paper aims to extend our model in order to address the generation of human-like bimanual movement sequences which are challenged by scenarios cluttered with obstacles. Movement planning involves large scale nonlinear constrained optimization problems which are solved using the IPOPT solver. Simulation studies show that the model generates feasible and realistic hand trajectories for action sequences involving the two hands. The computational costs involved in the planning allow for real-time human robot-interaction. A qualitative analysis reveals that the movements of the robot exhibit basic characteristics of human movements.

Towards human-like bimanual movements in anthropomorphic robots: a nonlinear optimization approach

Previously we have presented a model for generating human-like arm and hand movements on an unimanual anthropomorphic robot involved in human-robot collaboration tasks. The present paper aims to extend our model in order to address the generation of human-like bimanual movement sequences which are challenged by scenarios cluttered with obstacles. Movement planning involves large scale nonlinear constrained optimization problems which are solved using the IPOPT solver. Simulation studies show that the model generates feasible and realistic hand trajectories for action sequences involving the two hands. The computational costs involved in the planning allow for real-time human robot-interaction. A qualitative analysis reveals that the movements of the robot exhibit basic characteristics of human movements.

Activation and inhibition of bimanual movements in school-aged children

The development of motor activation and inhibition was compared in 6-to-12 year-olds. Children had to initiate or stop the externally paced movements of one hand, while maintaining that of the other hand. The time needed to perform the switching task (RT) and the spatio-temporal variables show different agerelated evolutions depending on the coordination pattern (inor anti-phase) and the type of transition (activation, selective inhibition, non selective inhibition) required. In the anti-phase mode, activation perturbs the younger subjects' responses while temporal and spatial stabilities transiently decrease around 9 years when activating in the in-phase mode. Aged-related changes differed between inhibition and activation in the antiphase mode, suggesting either the involvement of distinct neural networks or the existence of a single network that is reorganized. In contrast, stopping or adding one hand in the in-phase mode shows similar aged-related improvement. We suggest that selectively stopping or activating one arm during symmetrical coordination rely on the two faces of a common processing in which activation could be the release of inhibition

Bimanual co-ordination in Parkinson's disease

The basal ganglia may be involved in bimanual co-ordination. Parkinson's disease (which impairs basal ganglia output) is clinically reported to cause difficulties in the performance of co-ordinated bimanual movements. Nevertheless, any bimanual co-ordination difficulties may be task specific, as experimental observations are equivocal. To infer the role of the basal ganglia in co-ordinating the two arms, this study investigated the bimanual co-ordination of patients with Parkinson's disease. Sixteen Parkinson's disease patients and matched control subjects performed a bimanual cranking task, at different speeds (1 and 2 Hz) and phase relationships. All subjects performed the required bimanual in-phase movement on a pair of cranks, at fast (2 Hz) and slow (1 Hz) speeds. However the Parkinson's disease patients were unable to perform the asymmetrical anti-phase movement, in which rotation of the cranks differed by 180 degrees, at either speed; but instead reverted to the in-phase symmetrical movement. For Parkinson's disease patients, performance of the in-phase movement was more accurate and stable when an external timing cue was used; however for anti-phase movement, the external cue accentuated the tendency for patients to revert to more symmetrical, in-phase movements.

The acquisition of movement skills: Practice enhances the dynamic stability of bimanual coordination

During bimanual movements, two relatively stable inherent patterns of coordination (in-phase and anti-phase) are displayed (e.g., Kelso, Am. J. Physiol. 246 (1984) R1000). Recent research has shown that new patterns of coordination can be learned. For example, following practice a 90 degrees out-of-phase pattern can emerge as an additional, relatively stable, state (e.g., Zanone & Kelso, J. Exp. Psychol.: Human Performance and Perception 18 (1992) 403). On this basis, it has been concluded that practice leads to the evolution and stabilisation of the newly learned pattern and that this process of learning changes the entire attractor layout of the dynamic system. A general feature of such research has been to observe the changes of the targeted pattern's stability characteristics during training at a single movement frequency. The present study was designed to examine how practice affects the maintenance of a coordinated pattern as the movement frequency is scaled. Eleven volunteers were asked to perform a bimanual forearm pronation-supination task. Time to transition onset was used as an index of the subjects' ability to maintain two symmetrically opposite coordinated patterns (target task - 90 degrees out-of-phase - transfer task - 270 degrees out-of-phase). Their ability to maintain the target task and the transfer task were examined again after five practice sessions each consisting of 15 trials of only the 90 degrees out-of-phase pattern. Concurrent performance feedback (a Lissajous figure) was available to the participants during each practice trial. A comparison of the time to transition onset showed that the target task was more stable after practice (p = 0.025). These changes were still observed one week (p = 0.05) and two months (p = 0.075) after the practice period. Changes in the stability of the transfer task were not observed until two months after practice (p = 0.025). Notably, following practice, transitions from the 90 degrees pattern were generally to the anti-phase (180 degrees) pattern, whereas, transitions from the 270 degrees pattern were to the 90 degrees pattern. These results suggest that practice does improve the stability of a 90 degrees pattern, and that such improvements are transferable to the performance of the unpractised 270 degrees pattern. In addition, the anti-phase pattern remained more stable than the practised 90 degrees pattern throughout. (C) 2001 Elsevier Science B.V. All rights reserved.

Nonlinear optimization for human-like synchronous movements of a dual arm-hand robotic system

In previous work we have presented a model capable of generating human-like movements for a dual arm-hand robot involved in human-robot cooperative tasks. However, the focus was on the generation of reach-to-grasp and reach-to-regrasp bimanual movements and no synchrony in timing was taken into account. In this paper we extend the previous model in order to accomplish bimanual manipulation tasks by synchronously moving both arms and hands of an anthropomorphic robotic system. Specifically, the new extended model has been designed for two different tasks with different degrees of difficulty. Numerical results were obtained by the implementation of the IPOPT solver embedded in our MATLAB simulator.

Electro-cortical modulations and fronto-parietal activity during motor transitions in the elderly

With aging, bimanual movements are performed with increased cerebral activity in frontal and parietal areas. In contrast, motor switching is poorly documented and is expected to engage increasing resources in the elderly. In this study, spontaneous electroencephalographic activity (EEG) was recorded while 39 young participants (YP) and 37 elderly (EP) performed motor transitions from unimanual tapping to symmetric bimanual tapping (= Activation), and opposite (= Inhibition). We measured the delay of switching using the mean and standard deviation of transition time (meanTT and sdTT). Task-related power (TRPow) in alpha frequency band (8-12Hz) was used to measure electro-cortical changes, negative values corresponding to increased cerebral activity. A balance index (BI) was computed between frontal and parietal regions, values non-significantly different from "zero" representing a comparable level of cerebral activity in these regions. The results reveal higher sdTT 1) in EP compared to YP in both transitions, 2) in Activation compared to Inhibition in both groups. TRPow tends to reach greater negative values (p=0.052) in EP compared to YP in both tapping modes and both motor transitions. Furthermore, the results show more negative TRPow 1) in both motor transitions compared to the tapping movements and 2) in frontal region for YP compared to EP during Inhibition only. BI values differ significantly from "zero" for YP in Inhibition only. In conclusion, motor transitions are more variable and tend to be resource-consuming in the elderly. Moreover, the cerebral activity spreading in EP characterized by similar level of activity between frontal and parietal regions suggest reduced capacity to recruit specialized neural mechanisms during motor inhibition.

Movement control of manipulative tasks in patients with Gilles de la Tourette syndrome

When a hand-held object is moved, grip and load force are accurately coordinated for establishing grasp stability. In the present work, the question was raised whether patients with Gilles de la Tourette syndrome (TS), who show tic-like movements, are impaired in grip-load force control when executing a manipulative task. To this end, we assessed force regulation during action patterns that required rhythmical unimanual or bimanual (iso-directional/anti-directional) movements. Results showed that the profile of grip-load force ratio was characterized by maxima and minima that were realized at upward and downward hand positions, respectively. TS patients showed increased force ratios during unimanual and bimanual movements, compared with control subjects, indicative of an inaccurate specification of the precision grip. Functional imaging data complemented the behavioural results and revealed that secondary motor areas showed no (or greatly reduced) activation in TS patients when executing the movement tasks as compared with baseline conditions. This indicates that the metabolic level in the secondary motor areas was equal during rest and task performance. At the neuronal level, this observation suggests that these cortical areas were continuously involved in movement preparation. Based on these data, we conclude that the ongoing activation of secondary motor areas may be explained by the TS patients' involuntary urges to move. Accordingly, interference will prevent an accurate planning of voluntary behaviour. Together, these findings reveal modulations in movement organization in patients with TS and exemplify degrading consequences for manual function.

Development of a magnetic resonance compatible wrist device for the analysis of movement encoding in the brain

Tese de mestrado integrado em Engenharia Biomédica e Biofísica, apresentada à Universidade de Lisboa, através da Faculdade de Ciências, 2016

Coordination dynamics and attentional costs of continuous and discontinuous bimanual circle drawing movements

It has been suggested that the temporal control of rhythmic unimianual movements is different between tasks requiring continuous (e.g., circle drawing) and discontinuous movements (e.g., finger tapping). Specifically, for continuous movements temporal regularities are ail emergent property, whereas for tasks that involve discontinuities timing is ail explicit part of the action goal. The present experiment further investigated the control of continuous and discontinuous movements by comparing the coordination dynamics and attentional demands of bimanual continuous circle drawing with bimanual intermittent circle drawing. The intermittent task required participants to insert a 400 ms pause between each cycle while circling. Using dual-task methodology, 15 right-handed participants performed the two circle drawing tasks, while vocally responding to randomly presented auditory probes. The circle drawing tasks were performed in symmetrical and asymmetrical coordination modes and at movement frequencies of 1 Hz and 1.7 Hz. Intermittent circle drawing exhibited superior spatial and temporal accuracy and stability than continuous circle drawing supporting the hypothesis that the two tasks have different underlying control processes. In terms of attentional cost, probe RT was significantly slower during the intermittent circle drawing task than the continuous circle drawing task across both coordination modes and movement frequencies. Of interest was the finding that in the intermittent circling task reaction time (RT) to probes presented during the pause between cycles did not differ from the RT to probes occurring during the circling movement. The differences in attentional demands between the intermittent and continuous circle drawing tasks may reflect the operation of explicit event timing and implicit emergent timing processes, respectively. (C) 2008 Elsevier B.V. All rights reserved.

Age-related changes in the bimanual advantage and in brain oscillatory activity during tapping movements suggest a decline in processing sensory reafference

Deficits in the processing of sensory reafferences have been suggested as accounting for age-related decline in motor coordination. Whether sensory reafferences are accurately processed can be assessed based on the bimanual advantage in tapping: because of tapping with an additional hand increases kinesthetic reafferences, bimanual tapping is characterized by a reduced inter-tap interval variability than unimanual tapping. A suppression of the bimanual advantage would thus indicate a deficit in sensory reafference. We tested whether elderly indeed show a reduced bimanual advantage by measuring unimanual (UM) and bimanual (BM) self-paced tapping performance in groups of young (n = 29) and old (n = 27) healthy adults. Electroencephalogram was recorded to assess the underlying patterns of oscillatory activity, a neurophysiological mechanism advanced to support the integration of sensory reafferences. Behaviorally, there was a significant interaction between the factors tapping condition and age group at the level of the inter-tap interval variability, driven by a lower variability in BM than UM tapping in the young, but not in the elderly group. This result indicates that in self-paced tapping, the bimanual advantage is absent in elderly. Electrophysiological results revealed an interaction between tapping condition and age group on low beta band (14âeuro"20 Hz) activity. Beta activity varied depending on the tapping condition in the elderly but not in the young group. Source estimations localized this effect within left superior parietal and left occipital areas. We interpret our results in terms of engagement of different mechanisms in the elderly depending on the tapping mode: a âeuro~kinestheticâeuro? mechanism for UM and a âeuro~visual imageryâeuro? mechanism for BM tapping movement.

Bimanual aiming and overt attention: one law for two hands

Reaching to interact with an object requires a compromise between the speed of the limb movement and the required end-point accuracy. The time it takes one hand to move to a target in a simple aiming task can be predicted reliably from Fitts' law, which states that movement time is a function of a combined measure of amplitude and accuracy constraints (the index of difficulty, ID). It has been assumed previously that Fitts' law is violated in bimanual aiming movements to targets of unequal ID. We present data from two experiments to show that this assumption is incorrect: if the attention demands of a bimanual aiming task are constant then the movements are well described by a Fitts' law relationship. Movement time therefore depends not only on ID but on other task conditions, which is a basic feature of Fitts' law. In a third experiment we show that eye movements are an important determinant of the attention demands in a bimanual aiming task. The results from the third experiment extend the findings of the first two experiments and show that bimanual aiming often relies on the strategic co-ordination of separate actions into a seamless behaviour. A number of the task specific strategies employed by the adult human nervous system were elucidated in the third experiment. The general strategic pattern observed in the hand trajectories was reflected by the pattern of eye movements recorded during the experiment. The results from all three experiments demonstrate that eye movements must be considered as an important constraint in bimanual aiming tasks.

Neuromuscular-skeletal constraints upon the dynamics of unimanual and bimanual coordination

In the first of three experiments, 11 participants generated pronation and supination movements of the forearm, in time with an auditory metronome. The metronome frequency was increased in eight steps (0.25 Hz) from a base frequency of 1.75 Hz. On alternating trials, participants were required to coordinate either maximum pronation or maximum supination with each beat of the metronome. In each block of trials, the axis of rotation was either coincident with the long axis of the forearm, above this axis, or below this axis. The stability of the pronate-on-the-beat pattern, as indexed by the number of pattern changes, and the time of onset of pattern change, was greatest when the axis of rotation of the movement was below the long axis of the forearm. In contrast, the stability of the supinate-on-the-beat pattern was greatest when the axis of rotation of the movement was above the long axis of the forearm. In a second experiment, we examined how changes in the position of the axis of rotation alter the activation patterns of muscles that contribute to pronation and supination of the forearm. Variations in the relative dominance of the pronation and supination phases of the movement cycle across conditions were accounted for primarily by changes in the activation profile of flexor carpi radialis (FCR) and extensor carpi radialis longus (ECR). In the Final experiment we examined how these constraints impact upon the stability of bimanual coordination. Thirty-two participants were assigned at random to one of four conditions, each of which combined an axis of rotation configuration (bottom or top) for each limb. The participants generated both inphase (both limbs pronating simultaneously, and supinating simultaneously) and antiphase (left limb pronating and right limb supinating simultaneously, and vice versa) patterns of coordination. When the position of the axis of rotation was equivalent for the left and the right limb, transitions from antiphase to inphase patterns of coordination were Frequently observed. In marked contrast, when the position of the axis of rotation for the left and right limb was contradistinct, transitions From inphase to antiphase patterns of coordination occurred. The results demonstrated that when movements are performed in an appropriate mechanical context, inphase patterns of coordination are less stable than antiphase patterns.