Gait energy volumes and frontal gait recognition using depth images

Gait energy images (GEIs) and its variants form the basis of many recent appearance-based gait recognition systems. The GEI combines good recognition performance with a simple implementation, though it suffers problems inherent to appearance-based approaches, such as being highly view dependent. In this paper, we extend the concept of the GEI to 3D, to create what we call the gait energy volume, or GEV. A basic GEV implementation is tested on the CMU MoBo database, showing improvements over both the GEI baseline and a fused multi-view GEI approach. We also demonstrate the efficacy of this approach on partial volume reconstructions created from frontal depth images, which can be more practically acquired, for example, in biometric portals implemented with stereo cameras, or other depth acquisition systems. Experiments on frontal depth images are evaluated on an in-house developed database captured using the Microsoft Kinect, and demonstrate the validity of the proposed approach.

Compressive sensing for gait recognition

Compressive Sensing (CS) is a popular signal processing technique, that can exactly reconstruct a signal given a small number of random projections of the original signal, provided that the signal is sufficiently sparse. We demonstrate the applicability of CS in the field of gait recognition as a very effective dimensionality reduction technique, using the gait energy image (GEI) as the feature extraction process. We compare the CS based approach to the principal component analysis (PCA) and show that the proposed method outperforms this baseline, particularly under situations where there are appearance changes in the subject. Applying CS to the gait features also avoids the need to train the models, by using a generalised random projection.

The backfilled GEI : a cross-capture modality gait feature for frontal and side-view gait recognition

In this paper, we propose a novel direction for gait recognition research by proposing a new capture-modality independent, appearance-based feature which we call the Back-filled Gait Energy Image (BGEI). It can can be constructed from both frontal depth images, as well as the more commonly used side-view silhouettes, allowing the feature to be applied across these two differing capturing systems using the same enrolled database. To evaluate this new feature, a frontally captured depth-based gait dataset was created containing 37 unique subjects, a subset of which also contained sequences captured from the side. The results demonstrate that the BGEI can effectively be used to identify subjects through their gait across these two differing input devices, achieving rank-1 match rate of 100%, in our experiments. We also compare the BGEI against the GEI and GEV in their respective domains, using the CASIA dataset and our depth dataset, showing that it compares favourably against them. The experiments conducted were performed using a sparse representation based classifier with a locally discriminating input feature space, which show significant improvement in performance over other classifiers used in gait recognition literature, achieving state of the art results with the GEI on the CASIA dataset.

Histogram of weighted local directions for gait recognition

In this paper, we explore the effectiveness of patch-based gradient feature extraction methods when applied to appearance-based gait recognition. Extending existing popular feature extraction methods such as HOG and LDP, we propose a novel technique which we term the Histogram of Weighted Local Directions (HWLD). These 3 methods are applied to gait recognition using the GEI feature, with classification performed using SRC. Evaluations on the CASIA and OULP datasets show significant improvements using these patch-based methods over existing implementations, with the proposed method achieving the highest recognition rate for the respective datasets. In addition, the HWLD can easily be extended to 3D, which we demonstrate using the GEV feature on the DGD dataset, observing improvements in performance.

Human identification from video using advanced gait recognition techniques

The solutions proposed in this thesis contribute to improve gait recognition performance in practical scenarios that further enable the adoption of gait recognition into real world security and forensic applications that require identifying humans at a distance. Pioneering work has been conducted on frontal gait recognition using depth images to allow gait to be integrated with biometric walkthrough portals. The effects of gait challenging conditions including clothing, carrying goods, and viewpoint have been explored. Enhanced approaches are proposed on segmentation, feature extraction, feature optimisation and classification elements, and state-of-the-art recognition performance has been achieved. A frontal depth gait database has been developed and made available to the research community for further investigation. Solutions are explored in 2D and 3D domains using multiple images sources, and both domain-specific and independent modality gait features are proposed.

A frontal view gait recognition based on 3D imaging using a time of flight camera

Studies have been carried out to recognize individuals from a frontal view using their gait patterns. In previous work, gait sequences were captured using either single or stereo RGB camera systems or the Kinect 1.0 camera system. In this research, we used a new frontal view gait recognition method using a laser based Time of Flight (ToF) camera. In addition to the new gait data set, other contributions include enhancement of the silhouette segmentation, gait cycle estimation and gait image representations. We propose four new gait image representations namely Gait Depth Energy Image (GDE), Partial GDE (PGDE), Discrete Cosine Transform GDE (DGDE) and Partial DGDE (PDGDE). The experimental results show that all the proposed gait image representations produce better accuracy than the previous methods. In addition, we have also developed Fusion GDEs (FGDEs) which achieve better overall accuracy and outperform the previous methods.

Sparse representation based action and gesture recognition

In this paper we present a solution to the problem of action and gesture recognition using sparse representations. The dictionary is modelled as a simple concatenation of features computed for each action or gesture class from the training data, and test data is classified by finding sparse representation of the test video features over this dictionary. Our method does not impose any explicit training procedure on the dictionary. We experiment our model with two kinds of features, by projecting (i) Gait Energy Images (GEIs) and (ii) Motion-descriptors, to a lower dimension using Random projection. Experiments have shown 100% recognition rate on standard datasets and are compared to the results obtained with widely used SVM classifier.

Fusion of fingerprint recognition methods for robust human identification

Biometrics is one of the biggest tendencies in human identification. The fingerprint is the most widely used biometric. However considering the automatic fingerprint recognition a completely solved problem is a common mistake. The most popular and extensively used methods, the minutiae-based, do not perform well on poor-quality images and when just a small area of overlap between the template and the query images exists. The use of multibiometrics is considered one of the keys to overcome the weakness and improve the accuracy of biometrics systems. This paper presents the fusion of a minutiae-based and a ridge-based fingerprint recognition method at rank, decision and score level. The fusion techniques implemented leaded to a reduction of the Equal Error Rate by 31.78% (from 4.09% to 2.79%) and a decreasing of 6 positions in the rank to reach a Correct Retrieval (from rank 8 to 2) when assessed in the FVC2002-DB1A database. © 2008 IEEE.

Energy efficiency in gait, activity, participation, and health status in children with cerebral palsy

The aim of the study was to establish if a relationship exists between the energy efficiency of gait, and measures of activity limitation, participation restriction, and health status in a representative sample of children with cerebral palsy (CP). Secondary aims were to investigate potential differences between clinical subtypes and gross motor classification, and to explore other relationships between the measures under investigation. A longitudinal study of a representative sample of 184 children with ambulant CP was conducted (112 males, 72 females; 94 had unilateral spastic C P, 84 had bilateral spastic C P, and six had non-spastic forms; age range 4-17y; Gross Motor Function Classification System Level I, n=57; Level II, n=91; Level III, n=22; and Level IV, n=14); energy efficiency (oxygen cost) during gait, activity limitation, participation restriction, and health status were recorded. Energy efficiency during gait was shown to correlate significantly with activity limitations; no relationship between energy efficiency during gait was found with either participation restriction or health status. With the exception of psychosocial health, all other measures showed significant differences by clinical subtype and gross motor classification. The energy efficiency of walking is not reflective of participation restriction or health status. Thus, therapies leading to improved energy efficiency may not necessarily lead to improved participation or general health.

Age-related changes in energy efficiency of gait, activity, and participation in children with cerebral palsy

Aim
The aim of this study was to use a prospective longitudinal study to describe age-related trends in energy efficiency during gait, activity, and participation in ambulatory children with cerebral palsy (CP).

Method
Gross Motor Function Measure (GMFM), Paediatric Evaluation of Disability Inventory (PEDI), and Lifestyle Assessment Questionnaire-Cerebral Palsy (LAQ-CP) scores, and energy efficiency (oxygen cost) during gait were assessed in representative sample of 184 children (112 male; 72 female; mean age 10y 9mo; range 4–16y) with CP. Ninety-four children had unilateral spastic CP, 84 bilateral spastic CP, and six had other forms of CP. Fifty-seven were classified as Gross Motor Function Classification System (GMFCS) level I, 91 as level II, 22 as level III, and 14 as level IV). Assessments were carried out on two occasions (visit 1 and visit 2) separated by an interval of 2 years and 7 months. A total of 157 participants returned for reassessment.

Results
Significant improvements in mean raw scores for GMFM, PEDI, and LAQ-CP were recorded; however, mean raw oxygen cost deteriorated over time. Age-related trends revealed gait to be most inefficient at the age of 12 years, but GMFM scores continued to improve until the age of 13 years, and two PEDI subscales to age 14 years, before deteriorating (p<0.05). Baseline score was consistently the single greatest predictor of visit 2 score. Substantial agreement in GMFCS ratings over time was achieved (?lw=0.74–0.76).

Interpretation
These findings have implications in terms of optimal provision and delivery of services for young people with CP to maximize physical capabilities and maintain functional skills into adulthood.

Calibration of BAS-TR image plate response to high energy (3-300 MeV) carbon ions

The paper presents the calibration of Fuji BAS-TR image plate (IP) response to high energy carbon ions of different charge states by employing an intense laser-driven ion source, which allowed access to carbon energies up to 270 MeV. The calibration method consists of employing a Thomson parabola spectrometer to separate and spectrally resolve different ion species, and a slotted CR-39 solid state detector overlayed onto an image plate for an absolute calibration of the IP signal. An empirical response function was obtained which can be reasonably extrapolated to higher ion energies. The experimental data also show that the IP response is independent of ion charge states.