Teleoperation of a 7 DOF humanoid robot arm using human arm accelerations and EMG signals

We present our work on tele-operating a complex humanoid robot with the help of bio-signals collected from the operator. The frameworks (for robot vision, collision avoidance and machine learning), developed in our lab, allow for a safe interaction with the environment, when combined. This even works with noisy control signals, such as, the operator’s hand acceleration and their electromyography (EMG) signals. These bio-signals are used to execute equivalent actions (such as, reaching and grasping of objects) on the 7 DOF arm.

Physiological modules for generating discrete and rhythmic movements: Component analysis of EMG signals

A central question in Neuroscience is that of how the nervous system generates the spatiotemporal commands needed to realize complex gestures, such as handwriting. A key postulate is that the central nervous system (CNS) builds up complex movements from a set of simpler motor primitives or control modules. In this study we examined the control modules underlying the generation of muscle activations when performing different types of movement: discrete, point-to-point movements in eight different directions and continuous figure-eight movements in both the normal, upright orientation and rotated 90 degrees. To test for the effects of biomechanical constraints, movements were performed in the frontal-parallel or sagittal planes, corresponding to two different nominal flexion/abduction postures of the shoulder. In all cases we measured limb kinematics and surface electromyographic activity (EMB) signals for seven different muscles acting around the shoulder. We first performed principal component analysis (PCA) of the EMG signals on a movement-by-movement basis. We found a surprisingly consistent pattern of muscle groupings across movement types and movement planes, although we could detect systematic differences between the PCs derived from movements performed in each sholder posture and between the principal components associated with the different orientations of the figure. Unexpectedly we found no systematic differences between the figute eights and the point-to-point movements. The first three principal components could be associated with a general co-contraction of all seven muscles plus two patterns of reciprocal activatoin. From these results, we surmise that both "discrete-rhythmic movements" such as the figure eight, and discrete point-to-point movement may be constructed from three different fundamental modules, one regulating the impedance of the limb over the time span of the movement and two others operating to generate movement, one aligned with the vertical and the other aligned with the horizontal.

EMG Biofeedback Videogame System for the Gait Rehabilitation of Hemiparetic Individuals

Gemstone Team CHIP

The application of the Hilbert spectrum to the analysis of electromyographic signals

This paper investigates the application of the Hilbert spectrum (HS), which is a recent tool for the analysis of nonlinear and nonstationary time-series, to the study of electromyographic (EMG) signals. The HS allows for the visualization of the energy of signals through a joint time-frequency representation. In this work we illustrate the use of the HS in two distinct applications. The first is for feature extraction from EMG signals. Our results showed that the instantaneous mean frequency (IMNF) estimated from the HS is a relevant feature to clinical practice. We found that the median of the IMNF reduces when the force level of the muscle contraction increases. In the second application we investigated the use of the HS for detection of motor unit action potentials (MUAPs). The detection of MUAPs is a basic step in EMG decomposition tools, which provide relevant information about the neuromuscular system through the morphology and firing time of MUAPs. We compared, visually, how MUAP activity is perceived on the HS with visualizations provided by some traditional (e.g. scalogram, spectrogram, Wigner-Ville) time-frequency distributions. Furthermore, an alternative visualization to the HS, for detection of MUAPs, is proposed and compared to a similar approach based on the continuous wavelet transform (CWT). Our results showed that both the proposed technique and the CWT allowed for a clear visualization of MUAP activity on the time-frequency distributions, whereas results obtained with the HS were the most difficult to interpret as they were extremely affected by spurious energy activity. (c) 2008 Elsevier Inc. All rights reserved.

EMG signal filtering based on Empirical Mode Decomposition

This paper introduces a procedure for filtering electromyographic (EMG) signals. Its key element is the Empirical Mode Decomposition, a novel digital signal processing technique that can decompose my time-series into a set of functions designated as intrinsic mode functions. The procedure for EMG signal filtering is compared to a related approach based on the wavelet transform. Results obtained from the analysis of synthetic and experimental EMG signals show that Our method can be Successfully and easily applied in practice to attenuation of background activity in EMG signals. (c) 2006 Elsevier Ltd. All rights reserved.

Diagnostic accuracy of the EMG parameters associated with anterior knee pain in the diagnosis of patellofemoral pain syndrome

Objective To assess the diagnostic accuracy of the surface electromyography (sEMG) parameters associated with referred anterior knee pain in diagnosing patellofemoral pain syndrome (PFPS). Design Sensitivity and specificity analysis. Setting Physical rehabilitation center and laboratory of biomechanics and motor control. Participants Pain-free subjects (n=29) and participants with PFPS (n=22) selected by convenience. Interventions Not applicable. Main Outcome Measure The diagnostic accuracy was calculated for sEMG parameters’ reliability, precision, and ability to differentiate participants with and without PFPS. The selected sEMG parameter associated with anterior knee pain was considered as an index test and was compared with the reference standard for the diagnosis of PFPS. Intraclass correlation coefficient, SEM, independent t tests, sensitivity, specificity, negative and positive likelihood ratios, and negative and positive predictive values were used for the statistical analysis. Results The medium-frequency band (B2) parameter was reliable (intraclass correlation coefficient=.80–.90), precise (SEM=2.71–3.87 normalized unit), and able to differentiate participants with and without PFPS (P<.05). The association of B2 with anterior knee pain showed positive diagnostic accuracy values (specificity, .87; sensitivity, .70; negative likelihood ratio, .33; positive likelihood ratio, 5.63; negative predictive value, .72; and positive predictive value, .86). Conclusions The results provide evidence to support the use of EMG signals (B2 – frequency band of 45–96Hz) of the vastus lateralis and vastus medialis muscles with referred anterior knee pain in the diagnosis of PFPS.

The effect of hip abduction on the EMG activity of vastus medialis obliquus, vastus lateralis longus and vastus lateralis obliquus in healthy subjects

Abstract Study design Controlled laboratory study. Objectives The purposes of this paper were to investigate (d) whether vastus medialis obliquus (VMO), vastus lateralis longus (VLL) and vastus lateralis obliquus (VLO) EMG activity can be influenced by hip abduction performed by healthy subjects. Background Some clinicians contraindicate hip abduction for patellofemoral patients (with) based on the premise that hip abduction could facilitate the VLL muscle activation leading to a VLL and VMO imbalance Methods and measures Twenty-one clinically healthy subjects were involved in the study, 10 women and 11 men (aged X = 23.3 ± 2.9). The EMG signals were collected using a computerized EMG VIKING II, with 8 channels and three pairs of surface electrodes. EMG activity was obtained from MVIC knee extension at 90° of flexion in a seated position and MVIC hip abduction at 0° and 30° with patients in side-lying position with the knee in full extension. The data were normalized in the MVIC knee extension at 50° of flexion in a seated position, and were submitted to ANOVA test with subsequent application of the Bonferroni multiple comparisons analysis test. The level of significance was defined as p ≤ 0.05. Results The VLO muscle demonstrated a similar pattern to the VMO muscle showing higher EMG activity in MVIC knee extension at 90° of flexion compared with MVIC hip abduction at 0° and 30° of abduction for male (p < 0.0007) and MVIC hip abduction at 0° of abduction for female subjects (p < 0.02196). There were no statistically significant differences in the VLL EMG activity among the three sets of exercises tested. Conclusion The results showed that no selective EMG activation was observed when comparison was made between the VMO, VLL and VLO muscles while performing MVIC hip abduction at 0° and 30° of abduction and MVIC knee extension at 90° of flexion in both male and female subjects. Our findings demonstrate that hip abduction do not facilitated VLL and VLO activity in relation to the VMO, however, this study included only healthy subjects performing maximum voluntary isometric contraction contractions, therefore much remains to be discovered by future research

Feasibility of Using EMG for Early Detection of the Facial Nerve During Robotic Direct Cochlear Access

HYPOTHESIS Facial nerve monitoring can be used synchronous with a high-precision robotic tool as a functional warning to prevent of a collision of the drill bit with the facial nerve during direct cochlear access (DCA). BACKGROUND Minimally invasive direct cochlear access (DCA) aims to eliminate the need for a mastoidectomy by drilling a small tunnel through the facial recess to the cochlea with the aid of stereotactic tool guidance. Because the procedure is performed in a blind manner, structures such as the facial nerve are at risk. Neuromonitoring is a commonly used tool to help surgeons identify the facial nerve (FN) during routine surgical procedures in the mastoid. Recently, neuromonitoring technology was integrated into a commercially available drill system enabling real-time monitoring of the FN. The objective of this study was to determine if this drilling system could be used to warn of an impending collision with the FN during robot-assisted DCA. MATERIALS AND METHODS The sheep was chosen as a suitable model for this study because of its similarity to the human ear anatomy. The same surgical workflow applicable to human patients was performed in the animal model. Bone screws, serving as reference fiducials, were placed in the skull near the ear canal. The sheep head was imaged using a computed tomographic scanner and segmentation of FN, mastoid, and other relevant structures as well as planning of drilling trajectories was carried out using a dedicated software tool. During the actual procedure, a surgical drill system was connected to a nerve monitor and guided by a custom built robot system. As the planned trajectories were drilled, stimulation and EMG response signals were recorded. A postoperative analysis was achieved after each surgery to determine the actual drilled positions. RESULTS Using the calibrated pose synchronized with the EMG signals, the precise relationship between distance to FN and EMG with 3 different stimulation intensities could be determined for 11 different tunnels drilled in 3 different subjects. CONCLUSION From the results, it was determined that the current implementation of the neuromonitoring system lacks sensitivity and repeatability necessary to be used as a warning device in robotic DCA. We hypothesize that this is primarily because of the stimulation pattern achieved using a noninsulated drill as a stimulating probe. Further work is necessary to determine whether specific changes to the design can improve the sensitivity and specificity.

Determination of muscle fatigue in clinical practices using dynamically embedded signals

This paper explores a new method of analysing muscle fatigue within the muscles predominantly used during microsurgery. The captured electromyographic (EMG) data retrieved from these muscles are analysed for any defining patterns relating to muscle fatigue. The analysis consists of dynamically embedding the EMG signals from a single muscle channel into an embedded matrix. The muscle fatigue is determined by defining its entropy characterized by the singular values of the dynamically embedded (DE) matrix. The paper compares this new method with the traditional method of using mean frequency shifts in the EMG signal's power spectral density. Linear regressions are fitted to the results from both methods, and the coefficients of variation of both their slope and point of intercept are determined. It is shown that the complexity method is slightly more robust in that the coefficient of variation for the DE method has lower variability than the conventional method of mean frequency analysis.

A practical system for hands-off computer interaction based on electromyogram (EMG)/eye gaze tracking (EGT)

Effective interaction with personal computers is a basic requirement for many of the functions that are performed in our daily lives. With the rapid emergence of the Internet and the World Wide Web, computers have become one of the premier means of communication in our society. Unfortunately, these advances have not become equally accessible to physically handicapped individuals. In reality, a significant number of individuals with severe motor disabilities, due to a variety of causes such as Spinal Cord Injury (SCI), Amyothrophic Lateral Sclerosis (ALS), etc., may not be able to utilize the computer mouse as a vital input device for computer interaction. The purpose of this research was to further develop and improve an existing alternative input device for computer cursor control to be used by individuals with severe motor disabilities. This thesis describes the development and the underlying principle for a practical hands-off human-computer interface based on Electromyogram (EMG) signals and Eye Gaze Tracking (EGT) technology compatible with the Microsoft Windows operating system (OS). Results of the software developed in this thesis show a significant improvement in the performance and usability of the EMG/EGT cursor control HCI.

Physiological modules for generating discrete and rhythmic movements: action identification by a dynamic recurrent neural network

In this study we employed a dynamic recurrent neural network (DRNN) in a novel fashion to reveal characteristics of control modules underlying the generation of muscle activations when drawing figures with the outstretched arm. We asked healthy human subjects to perform four different figure-eight movements in each of two workspaces (frontal plane and sagittal plane). We then trained a DRNN to predict the movement of the wrist from information in the EMG signals from seven different muscles. We trained different instances of the same network on a single movement direction, on all four movement directions in a single movement plane, or on all eight possible movement patterns and looked at the ability of the DRNN to generalize and predict movements for trials that were not included in the training set. Within a single movement plane, a DRNN trained on one movement direction was not able to predict movements of the hand for trials in the other three directions, but a DRNN trained simultaneously on all four movement directions could generalize across movement directions within the same plane. Similarly, the DRNN was able to reproduce the kinematics of the hand for both movement planes, but only if it was trained on examples performed in each one. As we will discuss, these results indicate that there are important dynamical constraints on the mapping of EMG to hand movement that depend on both the time sequence of the movement and on the anatomical constraints of the musculoskeletal system. In a second step, we injected EMG signals constructed from different synergies derived by the PCA in order to identify the mechanical significance of each of these components. From these results, one can surmise that discrete-rhythmic movements may be constructed from three different fundamental modules, one regulating the co-activation of all muscles over the time span of the movement and two others elliciting patterns of reciprocal activation operating in orthogonal directions.

A biosignal embedded system for physiological computing

Thesis submitted in the fulfilment of the requirements for the Degree of Master in Electronic and Telecomunications Engineering

Study on the activation of the biceps brachii compartments in normal subjects

Les prothèses myoélectriques modernes peuvent être dotées de plusieurs degrés de liberté ce qui nécessite plusieurs signaux musculaires pour en exploiter pleinement les capacités. Pour obtenir plus de signaux, il nous a semblé prometteur d'expérimenter si les 6 compartiments du biceps brachial pouvaient être mis sous tension de façon volontaire et obtenir ainsi 6 signaux de contrôle au lieu d'un seul comme actuellement. Des expériences ont donc été réalisées avec 10 sujets normaux. Des matrices d'électrodes ont été placées en surface au-dessus du chef court et long du biceps pour recueillir les signaux électromyographiques (EMG) générés par le muscle lors de contractions effectuées alors que les sujets étaient soit assis, le coude droit fléchi ~ 100 ° ou debout avec le bras droit tendu à l'horizontale dans le plan coronal (sur le côté). Dans ces deux positions, la main était soit en supination, soit en position neutre, soit en pronation. L'amplitude des signaux captés au-dessus du chef court du muscle a été comparée à ceux obtenus à partir du chef long. Pour visualiser la forme du biceps sous les électrodes l'imagerie ultrasonore a été utilisée. En fonction de la tâche à accomplir, l'activité EMG a était plus importante soit dans un chef ou dans l'autre. Le fait de pouvoir activer préférentiellement l'un des 2 chefs du biceps, même si ce n'est pas encore de façon complètement indépendante, suggère que l'utilisation sélective des compartiments pourrait être une avenue possible pour faciliter le contrôle des prothèses myoélectriques du membre supérieur.

Back muscles activity and scoliosis in ataxic and dystrophic patients

To investigate the role of muscles in the development of adolescent idiopathic scoliosis (AIS), our group was initially interested in Duchenne muscular dystrophy (DMD) diseases where a muscular degeneration often leads to scoliosis. Few years ago the studies with those patients provided interesting results but were obtained only from few patients. To increase that number, the present project was initiated but recruitment of new DMD patients from Marie-Enfant hospital was found impossible. As an alternative, patients with Friedreich’s ataxia (FA) were recruited since they also suffer from a muscular deficiency which often induces a scoliosis. So, 4 FA patients and 4 healthy controls have been chosen to closely match the age, weight and body mass indexes (BMI) of the patients were enrolled in our experiments. As in the previous study, electromyography (EMG) activity of paraspinal muscles were recorded on each side of the spine during three types of contraction at 2 different maximum voluntary contractions (MVC). Moreover, the volume and skinfold thickness of these muscles were determined from ultrasound images (US) in order to facilitate the interpretation of EMG signals recorded on the skin surface. For the 3 FA right scoliotic patients, EMG activity was most of the time larger on the concave side of the deviation. The opposite was found for the 4th one (P4, left scoliosis, 32°) for whom EMG activity was larger on the convex side; it should however be noted that all his signals were of small amplitude. This was associated to a muscle weakness and a large skinfold thickness (12 mm) vs 7 mm for the 3 others. As for the paraspinal muscle volume, it was present on the convex side of P1, P3 and P4 and on the concave side for P2. As for skinfold thickness over this muscle, it was larger on the concave side for P1 and P2 and the opposite for P3 and P4. At the apex of each curve, the volume and skinfold thickness differences were the largest. Although the study covers only a small number of FA patients, the presence of larger EMG signals on the concave side of a spinal deformation is similar to pre-scoliotic DMD patients for whom the deformation is in its initial stage. It thus seems that our FA patients with more EMG activity on their concave side could see progression of their spinal deformation in the coming months in spite of their already important Cobb angle.

Proposition de combinaisons optimales de contractions volontaires maximales isométriques pour la normalisation de 12 muscles de l'épaule

Afin d’être représentatif d’un niveau d’effort musculaire, le signal électromyographique (EMG) est exprimé par rapport à une valeur d’activation maximale. Comme l’épaule est une structure articulaire et musculaire complexe, aucune contraction volontaire isométrique (CVMi) proposée dans la littérature ne permet d’activer maximalement un même muscle de l’épaule pour un groupe d’individus. L’objectif de ce mémoire est de développer une approche statistique permettant de déterminer les CVMi optimales afin de maximiser les niveaux d’activation d’un ensemble de muscles de l’épaule. L’amplitude du signal EMG de 12 muscles de l’épaule a été enregistrée chez 16 sujets alors qu’ils effectuaient 15 CVMi. Une première approche systématique a permis de déterminer les 4 CVMi parmi les 15 qui ensemble maximisent les niveaux d’activation pour les 12 muscles simultanément. Ces 4 contractions ont donné des niveaux d’activation supérieurs aux recommandations antérieures pour 4 muscles de l’épaule. Une seconde approche a permis de déterminer le nombre minimal de CVMi qui sont nécessaires afin de produire un niveau d’activation qui n’est pas significativement différent des valeurs d’activation maximales pour les 16 sujets. Pour 12 muscles de l’épaule, un total de 9 CVMi sont requises afin de produire des valeurs d’activation qui sont représentatives de l’effort maximal de tous les sujets. Ce mémoire a proposé deux approches originales, dont la première a maximisé les niveaux d’activation qui peuvent être produits à partir d’un nombre fixe de CVMi tandis que la deuxième a permis d’identifier le nombre minimal de CVMi nécessaire afin de produire des niveaux d’activation qui ne sont pas significativement différentes des valeurs d’activation maximales. Ces deux approches ont permis d’émettre des recommandations concernant les CVMi nécessaires à la normalisation de l’EMG afin de réduire les risques de sous-estimer l’effort maximal d’un ensemble d’individus.