Human gait recognition using extraction and fusion of global motion features

This paper proposes a novel computer vision approach that processes video sequences of people walking and then recognises those people by their gait. Human motion carries different information that can be analysed in various ways. The skeleton carries motion information about human joints, and the silhouette carries information about boundary motion of the human body. Moreover, binary and gray-level images contain different information about human movements. This work proposes to recover these different kinds of information to interpret the global motion of the human body based on four different segmented image models, using a fusion model to improve classification. Our proposed method considers the set of the segmented frames of each individual as a distinct class and each frame as an object of this class. The methodology applies background extraction using the Gaussian Mixture Model (GMM), a scale reduction based on the Wavelet Transform (WT) and feature extraction by Principal Component Analysis (PCA). We propose four new schemas for motion information capture: the Silhouette-Gray-Wavelet model (SGW) captures motion based on grey level variations; the Silhouette-Binary-Wavelet model (SBW) captures motion based on binary information; the Silhouette-Edge-Binary model (SEW) captures motion based on edge information and the Silhouette Skeleton Wavelet model (SSW) captures motion based on skeleton movement. The classification rates obtained separately from these four different models are then merged using a new proposed fusion technique. The results suggest excellent performance in terms of recognising people by their gait.

Three-dimensional kinematic analysis of upper and lower limb motion during gait of post-stroke patients

The aim of this study was to analyze the alterations of arm and leg movements of patients during stroke gait. Joint angles of upper and lower limbs and spatiotemporal variables were evaluated in two groups: hemiparetic group (HG, 14 hemiparetic men, 53 ± 10 years) and control group (CG, 7 able-bodied men, 50 ± 4 years). The statistical analysis was based on the following comparisons (P ≤ 0.05): 1) right versus left sides of CG; 2) affected (AF) versus unaffected (UF) sides of HG; 3) CG versus both the affected and unaffected sides of HG, and 4) an intracycle comparison of the kinematic continuous angular variables between HG and CG. This study showed that the affected upper limb motion in stroke gait was characterized by a decreased range of motion of the glenohumeral (HG: 6.3 ± 4.5, CG: 20.1 ± 8.2) and elbow joints (AF: 8.4 ± 4.4, UF: 15.6 ± 7.6) on the sagittal plane and elbow joint flexion throughout the cycle (AF: 68.2 ± 0.4, CG: 46.8 ± 2.7). The glenohumeral joint presented a higher abduction angle (AF: 14.2 ± 1.6, CG: 11.5 ± 4.0) and a lower external rotation throughout the cycle (AF: 4.6 ± 1.2, CG: 22.0 ± 3.0). The lower limbs showed typical alterations of the stroke gait patterns. Thus, the changes in upper and lower limb motion of stroke gait were identified. The description of upper limb motion in stroke gait is new and complements gait analysis.

Gait Analysis for Classification

This thesis describes a representation of gait appearance for the purpose of person identification and classification. This gait representation is based on simple localized image features such as moments extracted from orthogonal view video silhouettes of human walking motion. A suite of time-integration methods, spanning a range of coarseness of time aggregation and modeling of feature distributions, are applied to these image features to create a suite of gait sequence representations. Despite their simplicity, the resulting feature vectors contain enough information to perform well on human identification and gender classification tasks. We demonstrate the accuracy of recognition on gait video sequences collected over different days and times and under varying lighting environments. Each of the integration methods are investigated for their advantages and disadvantages. An improved gait representation is built based on our experiences with the initial set of gait representations. In addition, we show gender classification results using our gait appearance features, the effect of our heuristic feature selection method, and the significance of individual features.

Tools and methods for the quality assurance of force platforms in human movement analysis

The human movement analysis (HMA) aims to measure the abilities of a subject to stand or to walk. In the field of HMA, tests are daily performed in research laboratories, hospitals and clinics, aiming to diagnose a disease, distinguish between disease entities, monitor the progress of a treatment and predict the outcome of an intervention [Brand and Crowninshield, 1981; Brand, 1987; Baker, 2006]. To achieve these purposes, clinicians and researchers use measurement devices, like force platforms, stereophotogrammetric systems, accelerometers, baropodometric insoles, etc. This thesis focus on the force platform (FP) and in particular on the quality assessment of the FP data. The principal objective of our work was the design and the experimental validation of a portable system for the in situ calibration of FPs. The thesis is structured as follows: Chapter 1. Description of the physical principles used for the functioning of a FP: how these principles are used to create force transducers, such as strain gauges and piezoelectrics transducers. Then, description of the two category of FPs, three- and six-component, the signals acquisition (hardware structure), and the signals calibration. Finally, a brief description of the use of FPs in HMA, for balance or gait analysis. Chapter 2. Description of the inverse dynamics, the most common method used in the field of HMA. This method uses the signals measured by a FP to estimate kinetic quantities, such as joint forces and moments. The measures of these variables can not be taken directly, unless very invasive techniques; consequently these variables can only be estimated using indirect techniques, as the inverse dynamics. Finally, a brief description of the sources of error, present in the gait analysis. Chapter 3. State of the art in the FP calibration. The selected literature is divided in sections, each section describes: systems for the periodic control of the FP accuracy; systems for the error reduction in the FP signals; systems and procedures for the construction of a FP. In particular is detailed described a calibration system designed by our group, based on the theoretical method proposed by ?. This system was the “starting point” for the new system presented in this thesis. Chapter 4. Description of the new system, divided in its parts: 1) the algorithm; 2) the device; and 3) the calibration procedure, for the correct performing of the calibration process. The algorithm characteristics were optimized by a simulation approach, the results are here presented. In addiction, the different versions of the device are described. Chapter 5. Experimental validation of the new system, achieved by testing it on 4 commercial FPs. The effectiveness of the calibration was verified by measuring, before and after calibration, the accuracy of the FPs in measuring the center of pressure of an applied force. The new system can estimate local and global calibration matrices; by local and global calibration matrices, the non–linearity of the FPs was quantified and locally compensated. Further, a non–linear calibration is proposed. This calibration compensates the non– linear effect in the FP functioning, due to the bending of its upper plate. The experimental results are presented. Chapter 6. Influence of the FP calibration on the estimation of kinetic quantities, with the inverse dynamics approach. Chapter 7. The conclusions of this thesis are presented: need of a calibration of FPs and consequential enhancement in the kinetic data quality. Appendix: Calibration of the LC used in the presented system. Different calibration set–up of a 3D force transducer are presented, and is proposed the optimal set–up, with particular attention to the compensation of non–linearities. The optimal set–up is verified by experimental results.

Gait analysis using a single wearable inertial measurement unit

Procedures for quantitative walking analysis include the assessment of body segment movements within defined gait cycles. Recently, methods to track human body motion using inertial measurement units have been suggested. It is not known if these techniques can be readily transferred to clinical measurement situations. This work investigates the aspects necessary for one inertial measurement unit mounted on the lower back to track orientation, and determine spatio-temporal features of gait outside the confines of a conventional gait laboratory. Apparent limitations of different inertial sensors can be overcome by fusing data using methods such as a Kalman filter. The benefits of optimizing such a filter for the type of motion are unknown. 3D accelerations and 3D angular velocities were collected for 18 healthy subjects while treadmill walking. Optimization of Kalman filter parameters improved pitch and roll angle estimates when compared to angles derived using stereophotogrammetry. A Weighted Fourier Linear Combiner method for estimating 3D orientation angles by constructing an analytical representation of angular velocities and allowing drift free integration is also presented. When tested this method provided accurate estimates of 3D orientation when compared to stereophotogrammetry. Methods to determine spatio-temporal features from lower trunk accelerations generally require knowledge of sensor alignment. A method was developed to estimate the instants of initial and final ground contact from accelerations measured by a waist mounted inertial device without rigorous alignment. A continuous wavelet transform method was used to filter and differentiate the signal and derive estimates of initial and final contact times. The technique was tested with data recorded for both healthy and pathologic (hemiplegia and Parkinson’s disease) subjects and validated using an instrumented mat. The results show that a single inertial measurement unit can assist whole body gait assessment however further investigation is required to understand altered gait timing in some pathological subjects.

Human Motion Analysis Based on Sequential Modeling of Radar Signal and Stereo Image Features

Falls are one of the greatest threats to elderly health in their daily living routines and activities. Therefore, it is very important to detect falls of an elderly in a timely and accurate manner, so that immediate response and proper care can be provided, by sending fall alarms to caregivers. Radar is an effective non-intrusive sensing modality which is well suited for this purpose, which can detect human motions in all types of environments, penetrate walls and fabrics, preserve privacy, and is insensitive to lighting conditions. Micro-Doppler features are utilized in radar signal corresponding to human body motions and gait to detect falls using a narrowband pulse-Doppler radar. Human motions cause time-varying Doppler signatures, which are analyzed using time-frequency representations and matching pursuit decomposition (MPD) for feature extraction and fall detection. The extracted features include MPD features and the principal components of the time-frequency signal representations. To analyze the sequential characteristics of typical falls, the extracted features are used for training and testing hidden Markov models (HMM) in different falling scenarios. Experimental results demonstrate that the proposed algorithm and method achieve fast and accurate fall detections. The risk of falls increases sharply when the elderly or patients try to exit beds. Thus, if a bed exit can be detected at an early stage of this motion, the related injuries can be prevented with a high probability. To detect bed exit for fall prevention, the trajectory of head movements is used for recognize such human motion. A head detector is trained using the histogram of oriented gradient (HOG) features of the head and shoulder areas from recorded bed exit images. A data association algorithm is applied on the head detection results to eliminate head detection false alarms. Then the three dimensional (3D) head trajectories are constructed by matching scale-invariant feature transform (SIFT) keypoints in the detected head areas from both the left and right stereo images. The extracted 3D head trajectories are used for training and testing an HMM based classifier for recognizing bed exit activities. The results of the classifier are presented and discussed in the thesis, which demonstrates the effectiveness of the proposed stereo vision based bed exit detection approach.

Gait analysis of the hind limb in Labrador Retrievers with and without cranial cruciate ligament disease

Cranial cruciate ligament (CCL) deficiency is the leading cause of lameness affecting the stifle joints of large breed dogs, especially Labrador Retrievers. Although CCL disease has been studied extensively, its exact pathogenesis and the primary cause leading to CCL rupture remain controversial. However, weakening secondary to repetitive microtrauma is currently believed to cause the majority of CCL instabilities diagnosed in dogs. Techniques of gait analysis have become the most productive tools to investigate normal and pathological gait in human and veterinary subjects. The inverse dynamics analysis approach models the limb as a series of connected linkages and integrates morphometric data to yield information about the net joint moment, patterns of muscle power and joint reaction forces. The results of these studies have greatly advanced our understanding of the pathogenesis of joint diseases in humans. A muscular imbalance between the hamstring and quadriceps muscles has been suggested as a cause for anterior cruciate ligament rupture in female athletes. Based on these findings, neuromuscular training programs leading to a relative risk reduction of up to 80% has been designed. In spite of the cost and morbidity associated with CCL disease and its management, very few studies have focused on the inverse dynamics gait analysis of this condition in dogs. The general goals of this research were (1) to further define gait mechanism in Labrador Retrievers with and without CCL-deficiency, (2) to identify individual dogs that are susceptible to CCL disease, and (3) to characterize their gait. The mass, location of the center of mass (COM), and mass moment of inertia of hind limb segments were calculated using a noninvasive method based on computerized tomography of normal and CCL-deficient Labrador Retrievers. Regression models were developed to determine predictive equations to estimate body segment parameters on the basis of simple morphometric measurements, providing a basis for nonterminal studies of inverse dynamics of the hind limbs in Labrador Retrievers. Kinematic, ground reaction forces (GRF) and morphometric data were combined in an inverse dynamics approach to compute hock, stifle and hip net moments, powers and joint reaction forces (JRF) while trotting in normal, CCL-deficient or sound contralateral limbs. Reductions in joint moment, power, and loads observed in CCL-deficient limbs were interpreted as modifications adopted to reduce or avoid painful mobilization of the injured stifle joint. Lameness resulting from CCL disease affected predominantly reaction forces during the braking phase and the extension during push-off. Kinetics also identified a greater joint moment and power of the contralateral limbs compared with normal, particularly of the stifle extensor muscles group, which may correlate with the lameness observed, but also with the predisposition of contralateral limbs to CCL deficiency in dogs. For the first time, surface EMG patterns of major hind limb muscles during trotting gait of healthy Labrador Retrievers were characterized and compared with kinetic and kinematic data of the stifle joint. The use of surface EMG highlighted the co-contraction patterns of the muscles around the stifle joint, which were documented during transition periods between flexion and extension of the joint, but also during the flexion observed in the weight bearing phase. Identification of possible differences in EMG activation characteristics between healthy patients and dogs with or predisposed to orthopedic and neurological disease may help understanding the neuromuscular abnormality and gait mechanics of such disorders in the future. Conformation parameters, obtained from femoral and tibial radiographs, hind limb CT images, and dual-energy X-ray absorptiometry, of hind limbs predisposed to CCL deficiency were compared with the conformation parameters from hind limbs at low risk. A combination of tibial plateau angle and femoral anteversion angle measured on radiographs was determined optimal for discriminating predisposed and non-predisposed limbs for CCL disease in Labrador Retrievers using a receiver operating characteristic curve analysis method. In the future, the tibial plateau angle (TPA) and femoral anteversion angle (FAA) may be used to screen dogs suspected of being susceptible to CCL disease. Last, kinematics and kinetics across the hock, stifle and hip joints in Labrador Retrievers presumed to be at low risk based on their radiographic TPA and FAA were compared to gait data from dogs presumed to be predisposed to CCL disease for overground and treadmill trotting gait. For overground trials, extensor moment at the hock and energy generated around the hock and stifle joints were increased in predisposed limbs compared to non predisposed limbs. For treadmill trials, dogs qualified as predisposed to CCL disease held their stifle at a greater degree of flexion, extended their hock less, and generated more energy around the stifle joints while trotting on a treadmill compared with dogs at low risk. This characterization of the gait mechanics of Labrador Retrievers at low risk or predisposed to CCL disease may help developing and monitoring preventive exercise programs to decrease gastrocnemius dominance and strengthened the hamstring muscle group.

Gait analysis following treadmill training with body weight support versus conventional physical therapy: a prospective randomized controlled single blind study

Study design: Single-blind randomized, controlled clinical study. Objectives: To evaluate, using kinematic gait analysis, the results obtained from gait training on a treadmill with body weight support versus those obtained with conventional gait training and physiotherapy. Setting: Thirty patients with sequelae from traumatic incomplete spinal cord injuries at least 12 months earlier; patients were able to walk and were classified according to motor function as ASIA (American Spinal Injury Association) impairment scale C or D. Methods: Patients were divided randomly into two groups of 15 patients by the drawing of opaque envelopes: group A (weight support) and group B (conventional). After an initial assessment, both groups underwent 30 sessions of gait training. Sessions occurred twice a week, lasted for 30min each and continued for four months. All of the patients were evaluated by a single blinded examiner using movement analysis to measure angular and linear kinematic gait parameters. Six patients (three from group A and three from group B) were excluded because they attended fewer than 85% of the training sessions. Results: There were no statistically significant differences in intra-group comparisons among the spatial-temporal variables in group B. In group A, the following significant differences in the studied spatial-temporal variables were observed: increases in velocity, distance, cadence, step length, swing phase and gait cycle duration, in addition to a reduction in stance phase. There were also no significant differences in intra-group comparisons among the angular variables in group B. However, group A achieved significant improvements in maximum hip extension and plantar flexion during stance. Conclusion: Gait training with body weight support was more effective than conventional physiotherapy for improving the spatial-temporal and kinematic gait parameters among patients with incomplete spinal cord injuries. Spinal Cord (2011) 49, 1001-1007; doi:10.1038/sc.2011.37; published online 3 May 2011

Are the recommendations from three-dimensional gait analysis associated with better postoperative outcomes in patients with cerebral palsy?

This study was performed to check if recommendations based on three-dimensional gait analysis (3DGA) are associated with better postoperative outcomes in patients with cerebral palsy (CP). Thirty-eight patients who underwent orthopedic surgery and assessment at the Gait Analysis Laboratory were evaluated retrospectively. The patients were divided in four groups according to the agreement between the recommendations from gait analysis and the procedures actually carried out. Fifteen patients with diplegic spastic cerebral palsy and indication for orthopedic surgery to improve walking - and whose surgical intervention was postponed - were also included in the study as a control group. Fourteen gait parameters recorded before and after treatment, were included in the statistical analysis. No gait improvement was noted in the control group or inh patients on whom no procedures recommended by the gait exam were performed (agreement of 0%). In the other groups, agreements averaged 46.71%, 72.2%, and 100%, respectively. Improvement of gait parameters after treatment was observed in these groups, with more significant values directly related to increased agreement percentage. Therefore, in this study the patients whose treatment matched the recommendations from three-dimensional gait analysis showed a more significant improvement in walking. (c) 2008 Elsevier B.V. All rights reserved.

Are transitions in human gait determined by mechanical, kinetic or energetic factors?

It is currently unclear whether it is the need to maintain metabolic efficiency, the need to keep skeletal loading below critical force levels, or simple mechanical factors that drive the walk-to-run (W R) and run-to-walk (R-W) transitions in human gait. Eighteen adults (9 males and 9 females) locomoted on an instrumented treadmill using their preferred gait. Each completed 2 ascending (W-R) and 2 descending (R-W) series of trials under three levels of loading (0%, 15% and 30% body weight). For each trial, participants locomoted for 60 s at each of 9 different speeds -4 speeds both above and below their preferred transition speed (PTS) plus their PTS. Evidence was sought for critical levels of key kinetic (maximum vertical force, impulse, first peak force, time to first peak force and maximum loading rate), energetic (oxygen consumption, transport cost) and mechanical variables (limb lengths, strength) predictive of the gait transition. Analyses suggested the kinetic variables of time to first peak force and loading rate as the most likely determinants of the W-R and R-W transitions. (C) 2003 Elsevier Science B.V. All rights reserved.

Gait Analysis of Natural and Artificial Walking Systems

This paper studies periodic gaits of multi-legged locomotion systems based on dynamic models. The purpose is to determine the system performance during walking and the best set of locomotion variables. For that objective the prescribed motion of the robot is completely characterized in terms of several locomotion variables such as gait, duty factor, body height, step length, stroke pitch, foot clearance, legs link lengths, foot-hip offset, body and legs mass and cycle time. In this perspective, we formulate three performance measures of the walking robot namely, the mean absolute energy, the mean power dispersion and the mean power lost in the joint actuators per walking distance. A set of model-based experiments reveals the influence of the locomotion variables in the proposed indices.

Influence of the hip joint modeling approaches on the kinematics of human gait

The influence of the hip joint formulation on the kinematic response of the model of human gait is investigated throughout this work. To accomplish this goal, the fundamental issues of the modeling process of a planar hip joint under the framework of multibody systems are revisited. In particular, the formulations for the ideal, dry, and lubricated revolute joints are described and utilized for the interaction of femur head inside acetabulum or the hip bone. In this process, the main kinematic and dynamic aspects of hip joints are analyzed. In a simple manner, the forces that are generated during human gait, for both dry and lubricated hip joint models, are computed in terms of the system’s state variables and subsequently introduced into the dynamics equations of motion of the multibody system as external generalized forces. Moreover, a human multibody model is considered, which incorporates the different approaches for the hip articulation, namely ideal joint, dry, and lubricated models. Finally, several computational simulations based on different approaches are performed, and the main results presented and compared to identify differences among the methodologies and procedures adopted in this work. The input conditions to the models correspond to the experimental data capture from an adult male during normal gait. In general, the obtained results in terms of positions do not differ significantly when the different hip joint models are considered. In sharp contrast, the velocity and acceleration plotted vary significantly. The effect of the hip joint modeling approach is clearly measurable and visible in terms of peaks and oscillations of the velocities and accelerations. In general, with the dry hip model, intra-joint force peaks can be observed, which can be associated with the multiple impacts between the femur head and the cup. In turn, when the lubricant is present, the system’s response tends to be smoother due to the damping effects of the synovial fluid.

Spatio-temporal gait analysis in children with cerebral palsy using, foot-worn inertial sensors.

A child's natural gait pattern may be affected by the gait laboratory environment. Wearable devices using body-worn sensors have been developed for gait analysis. The purpose of this study was to validate and explore the use of foot-worn inertial sensors for the measurement of selected spatio-temporal parameters, based on the 3D foot trajectory, in independently walking children with cerebral palsy (CP). We performed a case control study with 14 children with CP aged 6-15 years old and 15 age-matched controls. Accuracy and precision of the foot-worn device were measured using an optical motion capture system as the reference system. Mean accuracy±precision for both groups was 3.4±4.6cm for stride length, 4.3±4.2cm/s for speed and 0.5±2.9° for strike angle. Longer stance and shorter swing phases with an increase in double support were observed in children with CP (p=0.001). Stride length, speed and peak angular velocity during swing were decreased in paretic limbs, with significant differences in strike and lift-off angles. Children with cerebral palsy showed significantly higher inter-stride variability (measured by their coefficient of variation) for speed, stride length, swing and stance. During turning trajectories speed and stride length decreased significantly (p<0.01) for both groups, whereas stance increased significantly (p<0.01) in CP children only. Foot-worn inertial sensors allowed us to analyze gait spatiotemporal data outside a laboratory environment with good accuracy and precision and congruent results with what is known of gait variations during linear walking in children with CP.

Ambulatory gait analysis results after total knee arthroplasty : arguments for mobile or fixed bearing?

Background: Mobile-bearing knee replacements have some theoretical advantages over fixed-bearing devices. However, very few randomized controlled clinical trials have been published to date, and studies showed little clinical and subjective advantages for the mobile-bearing using traditional systems of scoring. The choice of the ideal outcome measure to assess total joint replacement remains a complex issue. However, gait analysis provides objective and quantifying evidences of treatment evaluation. Significant methodological advances are currently made in gait analysis laboratories and ambulatory gait devices are now available. The goal of this study was to provide gait parameters as a new objective method to assess total knee arthroplasty outcome between patients with fixed- and mobile-bearing, using an ambulatory device with minimal sensor configuration. Methods: This randomized controlled double-blind study included to date 31 patients: the gait signatures of 12 patients with mobile-bearing were compared to the gait signatures of 19 patients with fixed-bearing pre-operatively and post-operatively at 6 weeks, 3 months and 6 months. Each participant was asked to perform two walking trials of 30m long at his/her preferred speed and to complete a EQ-5D questionnaire, a WOMAC and Knee Society Score (KSS). Lower limbs rotations were measured by four miniature angular rate sensors mounted respectively, on each shank and thigh. Results: Better relative differences between pre-operative and post-operative 3 months and 6 months KSS (122% vs 34% at 3 months, 138% vs 36% at 6 months) and KSS function (154% vs 8% at 3 months, 183% vs 42% at 6 months) scores were observed for the fixed-bearing compared to the mobile-bearing. The same better improvements for fixed-bearing were also found with the range of knee angles (Affected side: 31% vs -5% at 3 months, 47% vs 5% at 6 months), (Unaffected side: 16% vs 5% at 3 months, 15% vs 6% at 6 months) and peak swing speeds of shank (Affected side: 18% vs -2% at 3 months, 30% vs 4% at 6 months), (Unaffected side: 8% vs -3% at 3 months, 7% vs 4% at 6 months). Conclusions: A new method for a portable system for gait analysis has been developed with very encouraging results regarding the objective outcome of total knee arthroplasty using mobile- and fixed-bearings.