Physiological modules for generating discrete and rhythmic movements: action identification by a dynamic recurrent neural network

In this study we employed a dynamic recurrent neural network (DRNN) in a novel fashion to reveal characteristics of control modules underlying the generation of muscle activations when drawing figures with the outstretched arm. We asked healthy human subjects to perform four different figure-eight movements in each of two workspaces (frontal plane and sagittal plane). We then trained a DRNN to predict the movement of the wrist from information in the EMG signals from seven different muscles. We trained different instances of the same network on a single movement direction, on all four movement directions in a single movement plane, or on all eight possible movement patterns and looked at the ability of the DRNN to generalize and predict movements for trials that were not included in the training set. Within a single movement plane, a DRNN trained on one movement direction was not able to predict movements of the hand for trials in the other three directions, but a DRNN trained simultaneously on all four movement directions could generalize across movement directions within the same plane. Similarly, the DRNN was able to reproduce the kinematics of the hand for both movement planes, but only if it was trained on examples performed in each one. As we will discuss, these results indicate that there are important dynamical constraints on the mapping of EMG to hand movement that depend on both the time sequence of the movement and on the anatomical constraints of the musculoskeletal system. In a second step, we injected EMG signals constructed from different synergies derived by the PCA in order to identify the mechanical significance of each of these components. From these results, one can surmise that discrete-rhythmic movements may be constructed from three different fundamental modules, one regulating the co-activation of all muscles over the time span of the movement and two others elliciting patterns of reciprocal activation operating in orthogonal directions.

Physiological modules for generating discrete and rhythmic movements: Component analysis of EMG signals

A central question in Neuroscience is that of how the nervous system generates the spatiotemporal commands needed to realize complex gestures, such as handwriting. A key postulate is that the central nervous system (CNS) builds up complex movements from a set of simpler motor primitives or control modules. In this study we examined the control modules underlying the generation of muscle activations when performing different types of movement: discrete, point-to-point movements in eight different directions and continuous figure-eight movements in both the normal, upright orientation and rotated 90 degrees. To test for the effects of biomechanical constraints, movements were performed in the frontal-parallel or sagittal planes, corresponding to two different nominal flexion/abduction postures of the shoulder. In all cases we measured limb kinematics and surface electromyographic activity (EMB) signals for seven different muscles acting around the shoulder. We first performed principal component analysis (PCA) of the EMG signals on a movement-by-movement basis. We found a surprisingly consistent pattern of muscle groupings across movement types and movement planes, although we could detect systematic differences between the PCs derived from movements performed in each sholder posture and between the principal components associated with the different orientations of the figure. Unexpectedly we found no systematic differences between the figute eights and the point-to-point movements. The first three principal components could be associated with a general co-contraction of all seven muscles plus two patterns of reciprocal activatoin. From these results, we surmise that both "discrete-rhythmic movements" such as the figure eight, and discrete point-to-point movement may be constructed from three different fundamental modules, one regulating the impedance of the limb over the time span of the movement and two others operating to generate movement, one aligned with the vertical and the other aligned with the horizontal.

Experimental arts practice incorporating motion capture

My practice-led research explores and maps workflows for generating experimental creative work involving inertia based motion capture technology. Motion capture has often been used as a way to bridge animation and dance resulting in abstracted visuals outcomes. In early works this process was largely done by rotoscoping, reference footage and mechanical forms of motion capture. With the evolution of technology, optical and inertial forms of motion capture are now more accessible and able to accurately capture a larger range of complex movements. Made by Motion is a collaboration between digital artist Paul Van Opdenbosch and performer and choreographer Elise May; a series of studies on captured motion data used to generate experimental visual forms that reverberate in space and time. The project investigates the invisible forces generated by and influencing the movement of a dancer. Along with how the forces can be captured and applied to generating visual outcomes that surpass simple data visualisation, projecting the intent of the performer’s movements. The source or ‘seed’ comes from using an Xsens MVN – Inertial Motion Capture system to capture spontaneous dance movements, with the visual generation conducted through a customised dynamics simulation. In my presentation I will be displaying and discussing a selected creative works from the project along with the process and considerations behind the work.

Contours in Motion

My practice-led research explores and maps workflows for generating experimental creative work involving inertia based motion capture technology. Motion capture has often been used as a way to bridge animation and dance resulting in abstracted visuals outcomes. In early works this process was largely done by rotoscoping, reference footage and mechanical forms of motion capture. With the evolution of technology, optical and inertial forms of motion capture are now more accessible and able to accurately capture a larger range of complex movements. The creative work titled “Contours in Motion” was the first in a series of studies on captured motion data used to generating experimental visual forms that reverberate in space and time. With the source or ‘seed’ comes from using an Xsens MVN - Inertial Motion Capture system to capture spontaneous dance movements, with the visual generation conducted through a customised dynamics simulation. The aim of the creative work was to diverge way from a standard practice of using particle system and/or a simple re-targeting of the motion data to drive a 3d character as a means to produce abstracted visual forms. To facilitate this divergence a virtual dynamic object was tether to a selection of data points from a captured performance. The proprieties of the dynamic object were then adjusted to balance the influences from the human movement data with the influence of computer based randomization. The resulting outcome was a visual form that surpassed simple data visualization to project the intent of the performer’s movements into a visual shape itself. The reported outcomes from this investigation have contributed to a larger study on the use of motion capture in the generative arts, furthering the understanding of and generating theories on practice.

A STUDY ON THE EFFECT OF LESIONS OF AREA-7 OF THE PARIETAL CORTEX ON THE SHORT-TERM VISUAL SPATIAL MEMORY OF RHESUS-MONKEYS (MACACA-MULATTA)

This research is focused on the contribution of area 7 to the short-term visual spatial memory. Three rhesus monkeys (Macaca mulatta) were trained in the direct delayed response task in which 5 delay intervals were used in each session. When each monkey reached the criterion of 90% correct responses in 5 successive sessions, two monkeys underwent a surgery while the other one received a sham operation as a control. In the first stage of the surgery, bilateral areas 7a, 7b and 7ip of the parietal cortex of two monkeys were precisely lesioned. After 7 days of recuperation, the monkeys were required to do the same task. The average percentage of correct responses in the lesioned animals decreased from 94.7% to 89.3% and 93.3% to 82.0% respectively (no significance, P > 0.05, n = 2). In addition, the monkeys' complex movements were mildly impaired. The lesioned monkeys were found to have difficulty picking up food from the wells. In the second stage, bilateral area 7m was lesioned. In the 5 postoperative sessions, the average percentage of correct responses in one monkey, with a relatively precise 7m lesion, decreased from 94.7% to 92.2% (no significance, P > 0.05), while the other monkey, with widely spread necrosis of lateral parietal cortex, showed an. obvious decline in performance, but still over the chance level. After 240 trials this monkey reattained the normal criterion. The results of this research suggest that the lesions of area 7 of the parietal cortex did not significantly affect the short-term visual spatial memory, which has been shown to be sensitive to lesions of the prefrontal cortex; they also support the notion of dissociation of spatial functions in the prefrontal and parietal cortices.

A Quantitative Evaluation of the AVITEWRITE Model of Handwriting Learning

Much sensory-motor behavior develops through imitation, as during the learning of handwriting by children. Such complex sequential acts are broken down into distinct motor control synergies, or muscle groups, whose activities overlap in time to generate continuous, curved movements that obey an intense relation between curvature and speed. The Adaptive Vector Integration to Endpoint (AVITEWRITE) model of Grossberg and Paine (2000) proposed how such complex movements may be learned through attentive imitation. The model suggest how frontal, parietal, and motor cortical mechanisms, such as difference vector encoding, under volitional control from the basal ganglia, interact with adaptively-timed, predictive cerebellar learning during movement imitation and predictive performance. Key psycophysical and neural data about learning to make curved movements were simulated, including a decrease in writing time as learning progresses; generation of unimodal, bell-shaped velocity profiles for each movement synergy; size scaling with isochrony, and speed scaling with preservation of the letter shape and the shapes of the velocity profiles; an inverse relation between curvature and tangential velocity; and a Two-Thirds Power Law relation between angular velocity and curvature. However, the model learned from letter trajectories of only one subject, and only qualitative kinematic comparisons were made with previously published human data. The present work describes a quantitative test of AVITEWRITE through direct comparison of a corpus of human handwriting data with the model's performance when it learns by tracing human trajectories. The results show that model performance was variable across subjects, with an average correlation between the model and human data of 89+/-10%. The present data from simulations using the AVITEWRITE model highlight some of its strengths while focusing attention on areas, such as novel shape learning in children, where all models of handwriting and learning of other complex sensory-motor skills would benefit from further research.

Biologically Plausible Neural Model for the Recognition of Biological Motion and Actions

The visual recognition of complex movements and actions is crucial for communication and survival in many species. Remarkable sensitivity and robustness of biological motion perception have been demonstrated in psychophysical experiments. In recent years, neurons and cortical areas involved in action recognition have been identified in neurophysiological and imaging studies. However, the detailed neural mechanisms that underlie the recognition of such complex movement patterns remain largely unknown. This paper reviews the experimental results and summarizes them in terms of a biologically plausible neural model. The model is based on the key assumption that action recognition is based on learned prototypical patterns and exploits information from the ventral and the dorsal pathway. The model makes specific predictions that motivate new experiments.

Investigation of language and motor skills in Serbian speaking children with specific language impairment and in typically developing children

Specific language impairment (SLI) is usually defined as a developmental language disorder which does not result from a hearing loss, autism, neurological and emotional difficulties, severe social deprivation, low non-verbal abilities. Children affected with SLI typically have difficulties with the acquisition of different aspects of language and by definition, their impairment is specific to language and no other skills are affected. However, there has been a growing body of literature to suggest that children with SLI also have non-linguistic deficits, including impaired motor abilities. The aim of the current study is to investigate language and motor abilities of a group of thirty children with SLI (aged between 4 and 7) in comparison to a group of 30 typically developing children matched for chronological age. The results showed that the group of children with SLI had significantly more difficulties on the language and motor assessments compared to the control group. The SLI group also showed delayed onset in the development of all motor skills under investigation in comparison to the typically developing group. More interestingly, the two groups differed with respect to which language abilities were correlated with motor abilities, however Imitation of Complex Movements was the unique skill which reliably predicted expressive vocabulary in both typically developing children and in children with SLI.

High activity and Levy searches : jellyfish can search the water column like fish

Over-fishing may lead to a decrease in fish abundance and a proliferation of jellyfish. Active movements and prey search might be thought to provide a competitive advantage for fish, but here we use data-loggers to show that the frequently occurring coastal jellyfish (Rhizostoma octopus) does not simply passively drift to encounter prey. Jellyfish (327 days of data from 25 jellyfish with depth collected every 1 min) showed very dynamic vertical movements, with their integrated vertical movement averaging 619.2 m d−1, more than 60 times the water depth where they were tagged. The majority of movement patterns were best approximated by exponential models describing normal random walks. However, jellyfish also showed switching behaviour from exponential patterns to patterns best fitted by a truncated Lévy distribution with exponents (mean μ = 1.96, range 1.2–2.9) close to the theoretical optimum for searching for sparse prey (μopt ≈ 2.0). Complex movements in these ‘simple’ animals may help jellyfish to compete effectively with fish for plankton prey, which may enhance their ability to increase in dominance in perturbed ocean systems.

Combinação de dispositivos de baixo custo para rastreamento de gestos

Pós-graduação em Ciência da Computação - IBILCE

Imagem corporal e ginastas: pesquisas e publicações no Brasil. -

The present study emerged from discussions of the Grupo de Estudos e Pesquisas Pedagógicos em Ginástica (GEPPEGIN), from UNESP/RC, and had the intention to understand and analyze the existence and discussions on Body Image and Gymnasts in researches and publications over the last decade (2003-2013) in Brazil. Body image refers to the mental representation of the body, structured according to the world. It is known that cultural and social pressures have been imposing an ideal body model and generating consequences as body dissatisfaction. Therefore, this study aims discuss the body image of Artistic and Rhythmic gymnastics' athletes. The choice of these modalities is justified by the fact that they are directly related to body image, especially the issue of the necessity of low body weight, beyond the relationship of complex movements and the need of good body awareness (BERRY; HOWE, 2000; KERR et al., 2006). For the development of this qualitative research, a documentary survey were conducted over the last decade (2003-2013) on Body Image and Gymnasts, focusing on researches of strictosensu postgraduate programs, recognized by CAPES, and scientific papers published in journals indexed in Brazil and classified in Physical Education Qualis. For categorization of information related to the theme, was used the organization by the units of analysis proposed by Laville and Dionne (1999). Based on the studies analyzed, perceive a dissatisfaction with body image to most participants from all studies, being athlete or nonathlete. Vieira and colleagues (2009) assume that the body pattern required for performance on competitive Gymnastics is close to the aesthetics of slim body served as body pattern for girls/teenager

Indicadores biomecânicos do karate de alto nível

Pós-graduação em Desenvolvimento Humano e Tecnologias - IBRC

From inverted pendulum to N-link chain: inertial sensors-based assessment of movement kinematics and dynamics for functional evaluation and rehabilitation

Despite several clinical tests that have been developed to qualitatively describe complex motor tasks by functional testing, these methods often depend on clinicians' interpretation, experience and training, which make the assessment results inconsistent, without the precision required to objectively assess the effect of the rehabilitative intervention. A more detailed characterization is required to fully capture the various aspects of motor control and performance during complex movements of lower and upper limbs. The need for cost-effective and clinically applicable instrumented tests would enable quantitative assessment of performance on a subject-specific basis, overcoming the limitations due to the lack of objectiveness related to individual judgment, and possibly disclosing subtle alterations that are not clearly visible to the observer. Postural motion measurements at additional locations, such as lower and upper limbs and trunk, may be necessary in order to obtain information about the inter-segmental coordination during different functional tests involved in clinical practice. With these considerations in mind, this Thesis aims: i) to suggest a novel quantitative assessment tool for the kinematics and dynamics evaluation of a multi-link kinematic chain during several functional motor tasks (i.e. squat, sit-to-stand, postural sway), using one single-axis accelerometer per segment, ii) to present a novel quantitative technique for the upper limb joint kinematics estimation, considering a 3-link kinematic chain during the Fugl-Meyer Motor Assessment and using one inertial measurement unit per segment. The suggested methods could have several positive feedbacks from clinical practice. The use of objective biomechanical measurements, provided by inertial sensor-based technique, may help clinicians to: i) objectively track changes in motor ability, ii) provide timely feedback about the effectiveness of administered rehabilitation interventions, iii) enable intervention strategies to be modified or changed if found to be ineffective, and iv) speed up the experimental sessions when several subjects are asked to perform different functional tests.

Untersuchung der Auswirkungen verschiedener Variationsbereiche des differenziellen Lernens und Lehrens im weiten Sinn auf ausgewählte technische Grundfertigkeiten im Hallenhockey

Die Frage wie großmotorische Bewegungen gelernt werden beschäftigt nicht nur Sportler, Trainer und Sportlehrer sondern auch Ärzte und Physiotherapeuten. Die sportwissenschaftlichen Teildisziplinen Bewegungs- und Trainingswissenschaft versuchen diese Frage sowohl im Sinne der Grundlagenforschung (Wie funktioniert Bewegungslernen?) als auch hinsichtlich der praktischen Konsequenzen (Wie lehrt man Bewegungen?) zu beantworten. Innerhalb dieser Themenfelder existieren Modelle, die Bewegungslernen als gezielte und extern unterstützte Ausbildung zentralnervöser Bewegungsprogramme verstehen und solche, die Lernen als Selbstorganisationsprozess interpretieren. Letzteren ist das Differenzielle Lernen und Lehren (Schöllhorn, 1999) zuzuordnen, das die Notwendigkeit betont, Bewegungen durch die Steigerung der Variationen während der Aneignungsphase zu lernen und zu lehren. Durch eine Vielzahl an Variationen, so die Modellannahme, findet der Lernende ohne externe Vorgaben selbstorganisiert ein individuelles situatives Optimum. Die vorliegende Arbeit untersucht, welchen Einfluss Variationen verschiedener Art und Größe auf die Lern- und Aneignungsleistung großmotorischer Bewegungen haben und in wie fern personenübergreifende Optima existieren. In zwei Experimenten wird der Einfluss von räumlichen (Bewegungsausführung, Bewegungsergebnis) und zeitlichen Variationen (zeitliche Verteilung der Trainingsreize) auf die Aneignungs- und Lernleistung großmotorischer sportlicher Bewegungen am Beispiel zweier technischer Grundfertigkeiten des Hallenhockeys untersucht. Die Ergebnisse der Experimente stützen die bisherige Befundlage zum Differenziellen Lernen und Lehren, wonach eine Zunahme an Variation in der Aneignungsphase zu größeren Aneignungs- und Lernleistungen führt. Zusätzlich wird die Annahme bestätigt, dass ein Zusammenhang von Variationsbereich und Lernrate in Form eines Optimaltrends vorliegt. Neu sind die Hinweise auf die Dynamik von motorischen Lernprozessen (Experiment 1). Hier scheinen individuelle Faktoren (z. B. die Lernbiografie) als auch die Phase im Lernprozess (Aneignung, Lernen) Einfluss zu haben auf den Umfang und die Struktur eines für die optimale Adaptation notwendigen Variationsbereichs. Darüber hinaus weisen die Befunde auf verschiedene Aneignungs- und Lerneffekte aufgrund alleiniger Variation der zeitlichen Verteilung bei ansonsten gleichen Trainingsreizen hin (Experiment 2). Für zukünftige Forschungsarbeiten zum Erlernen großmotorischer Bewegungen und für die sportliche Praxis dürfte es daher erkenntnisreich sein, die Historie der intrinsischen Dynamik der lernenden Systeme stärker zu berücksichtigen. Neben Fragestellungen für die Grundlagenforschung zum (Bewegungs-)Lernen ließen sich hieraus unmittelbar praxisrelevante Erkenntnisse darüber ableiten, wie Bewegungslernprozesse mittels verschiedener Variationsbereiche strukturiert und gesteuert werden könnten.

Concentration-dependent isoflurane effects on withdrawal reflexes in pigs and the role of the stimulation paradigm

In this prospective two-phase experimental trial, 10 pigs were anaesthetized twice with isoflurane only. In the first phase, the individual minimum alveolar concentration (MAC) was determined and in the second phase the effects on withdrawal reflexes of increasing end-tidal isoflurane concentrations (from 1.6% to 2.8%) were assessed. Single, 10 and 60 repeated electrical stimulations were used to evoke withdrawal reflexes which were recorded and quantified by electromyography. Recruitment curves for reflex amplitude for increasing stimulation intensities and isoflurane concentrations were constructed. Isoflurane MAC was 1.9+/-0.3%. Reflexes evoked by repeated stimulation were suppressed at isoflurane concentrations significantly higher than those which suppressed complex movements during MAC determination (P=0.014 and P=0.006 for 10 and 60 repeated stimuli respectively). Isoflurane up to 2.8% was still not able to abolish reflex activity evoked by repeated stimulations in all pigs. Single stimulation reflexes were suppressed at significantly lower concentrations than repeated stimulation reflexes (P=0.008 and P=0.004 for 10 and 60 repeated stimuli, respectively). Reflex amplitude was significantly correlated with isoflurane concentration (P<0.001, r=-0.85) independent of the individual MAC. The findings indicate that the level at which isoflurane suppresses withdrawal reflexes is dependent on the stimulation paradigm (single vs. repeated electrical stimulation), and there is limited value in expressing reflex withdrawal suppression in terms of MAC as purposeful and reflex movements are independently affected by isoflurane in individual animals.