Simultaneous Localization and Recognition of Dynamic Hand Gestures

A framework for the simultaneous localization and recognition of dynamic hand gestures is proposed. At the core of this framework is a dynamic space-time warping (DSTW) algorithm, that aligns a pair of query and model gestures in both space and time. For every frame of the query sequence, feature detectors generate multiple hand region candidates. Dynamic programming is then used to compute both a global matching cost, which is used to recognize the query gesture, and a warping path, which aligns the query and model sequences in time, and also finds the best hand candidate region in every query frame. The proposed framework includes translation invariant recognition of gestures, a desirable property for many HCI systems. The performance of the approach is evaluated on a dataset of hand signed digits gestured by people wearing short sleeve shirts, in front of a background containing other non-hand skin-colored objects. The algorithm simultaneously localizes the gesturing hand and recognizes the hand-signed digit. Although DSTW is illustrated in a gesture recognition setting, the proposed algorithm is a general method for matching time series, that allows for multiple candidate feature vectors to be extracted at each time step.

The Use of Electrospray Mass Spectrometry to Determine Speciation in a Dynamic Combinatorial Library for Anion Recognition

The composition of a dynamic mixture of similar 2,2'-bipyridine complexes of iron(II) bearing either an amide (5-benzylamido-2,2'-bipyridine and 5-(2-methoxyethane)amido-2,2'-bipyridine) or an ester (2,2'-bipyridine-5-carboxylic acid benzylester and 2,2'-bipyridine-5-carboxylic acid 2-methoxyethane ester) side chain have been evaluated by electrospray mass spectroscopy in acetonitrile. The time taken for the complexes to come to equilibrium appears to be dependent on the counteranion, with chloride causing a rapid redistribution of two preformed heteroleptic complexes (of the order of 1 hour), whereas the time it takes in the presence of tetrafluoroborate salts is in excess of 24^^h. Similarly the final distribution of products is dependent on the anion present, with the presence of chloride, and to a lesser extent bromide, preferring three amide-functionalized ligands, and a slight preference for an appended benzyl over a methoxyethyl group. Furthermore, for the first time, this study shows that the distribution of a dynamic library of metal complexes monitored by ESI-MS can adapt following the introduction of a different anion, in this case tetrabutylammonium chloride to give the most favoured heteroleptic complex despite the increasing ionic strength of the solution. 

Recognition of static and dynamic facial expressions: Influences of sex, type and intensity of emotion

Ecological validity of static and intense facial expressions in emotional recognition has been questioned. Recent studies have recommended the use of facial stimuli more compatible to the natural conditions of social interaction, which involves motion and variations in emotional intensity. In this study, we compared the recognition of static and dynamic facial expressions of happiness, fear, anger and sadness, presented in four emotional intensities (25 %, 50 %, 75 % and 100 %). Twenty volunteers (9 women and 11 men), aged between 19 and 31 years, took part in the study. The experiment consisted of two sessions in which participants had to identify the emotion of static (photographs) and dynamic (videos) displays of facial expressions on the computer screen. The mean accuracy was submitted to an Anova for repeated measures of model: 2 sexes x [2 conditions x 4 expressions x 4 intensities]. We observed an advantage for the recognition of dynamic expressions of happiness and fear compared to the static stimuli (p < .05). Analysis of interactions showed that expressions with intensity of 25 % were better recognized in the dynamic condition (p < .05). The addition of motion contributes to improve recognition especially in male participants (p < .05). We concluded that the effect of the motion varies as a function of the type of emotion, intensity of the expression and sex of the participant. These results support the hypothesis that dynamic stimuli have more ecological validity and are more appropriate to the research with emotions.

Dynamic Changes in the Mental Rotation Network Revealed by Pattern Recognition Analysis of fMRI Data

We investigated the temporal dynamics and changes in connectivity in the mental rotation network through the application of spatio-temporal support vector machines (SVMs). The spatio-temporal SVM [Mourao-Miranda, J., Friston, K. J., et al. (2007). Dynamic discrimination analysis: A spatial-temporal SVM. Neuroimage, 36, 88-99] is a pattern recognition approach that is suitable for investigating dynamic changes in the brain network during a complex mental task. It does not require a model describing each component of the task and the precise shape of the BOLD impulse response. By defining a time window including a cognitive event, one can use spatio-temporal fMRI observations from two cognitive states to train the SVM. During the training, the SVM finds the discriminating pattern between the two states and produces a discriminating weight vector encompassing both voxels and time (i.e., spatio-temporal maps). We showed that by applying spatio-temporal SVM to an event-related mental rotation experiment, it is possible to discriminate between different degrees of angular disparity (0 degrees vs. 20 degrees, 0 degrees vs. 60 degrees, and 0 degrees vs. 100 degrees), and the discrimination accuracy is correlated with the difference in angular disparity between the conditions. For the comparison with highest accuracy (08 vs. 1008), we evaluated how the most discriminating areas (visual regions, parietal regions, supplementary, and premotor areas) change their behavior over time. The frontal premotor regions became highly discriminating earlier than the superior parietal cortex. There seems to be a parcellation of the parietal regions with an earlier discrimination of the inferior parietal lobe in the mental rotation in relation to the superior parietal. The SVM also identified a network of regions that had a decrease in BOLD responses during the 100 degrees condition in relation to the 0 degrees condition (posterior cingulate, frontal, and superior temporal gyrus). This network was also highly discriminating between the two conditions. In addition, we investigated changes in functional connectivity between the most discriminating areas identified by the spatio-temporal SVM. We observed an increase in functional connectivity between almost all areas activated during the 100 degrees condition (bilateral inferior and superior parietal lobe, bilateral premotor area, and SMA) but not between the areas that showed a decrease in BOLD response during the 100 degrees condition.

Dynamic biometrics fusion at feature level for video-based human recognition

This paper proposes a novel human recognition method in video, which combines human face and gait traits
using a dynamic multi-modal biometrics fusion scheme. The Fisherface approach is adopted to extract face
features, while for gait features, Locality Preserving Projection (LPP) is used to achieve low-dimensional
manifold embedding of the temporal silhouette data derived from image sequences. Face and gait features are
fused dynamically at feature level based on a distance-driven fusion method. Encouraging experimental results
are achieved on the video sequences containing 20 people, which show that dynamically fused features produce
a more discriminating power than any individual biometric as well as integrated features built on common static
fusion schemes.

Dynamic recrystallization of austenite in Ni-30 Pct Fe model alloy : microstructure and texture evolution

The microstructure and crystallographic texture development in an austenitic Ni-30 pct Fe model alloy was investigated within the dynamic recrystallization (DRX) regime using hot torsion testing. The prominent DRX nucleation mechanism was strain-induced grain boundary migration accompanied by the formation of large-angle sub-boundaries and annealing twins. The increase in DRX volume fraction occurred through the formation of multiple twinning chains. With increasing strain, the pre-existing Σ3 twin boundaries became gradually converted to general boundaries capable of acting as potent DRX nucleation sites. The texture characteristics of deformed grains resulted from the preferred consumption of high Taylor factor components by new recrystallized grains. Similarly, the texture of DRX grains was dominated by low Taylor factor components as a result of their lower consumption rate during the DRX process. The substructure of deformed grains was characterized by “organized,” banded subgrain arrangements, while that of the DRX grains displayed “random,” more equiaxed subgrain/cell configurations.

Texture and substructure development during dynamic recrystallization in Ni-30Fe austenite

An austenitic Ni-30%Fe model alloy was employed to investigate the texture and substructure development within the deformed matrix and dynamically recrystallized (DRX) grains during hot torsion deformation. Both the deformed matrix and DRX grains predominantly displayed the crystallographic texture components expected for simple shear deformation. The characteristics of the deformed matrix texture evolution during deformation largely resulted from the preferred consumption of high Taylor factor components by new recrystallized grains. Likewise, the comparatively weaker crystallographic texture of DRX grains became increasingly dominated by low Taylor factor components as a result of their easier nucleation and lower consumption rate during DRX. There was a significant difference in the substructure formation mechanism between the deformed matrix and DRX grains for a given texture component. The deformed matrix substructure was largely characterized by “organized”, banded subgrain arrangements with alternating misorientations, while the substructure of DRX grains was more “random” in character and displayed complex, more equiaxed subgrain/cell arrangements characterized by a local accumulation of misorientations. Substructure characteristics of individual orientation components were principally consistent with the corresponding Taylor factor values.

Texture and substructure characteristics of dynamic recrystallization in a Ni–30%Fe austenitic model alloy

The substructure and texture development during dynamic recrystallization (DRX) of an austenitic Ni–30%Fe model alloy was investigated using hot torsion testing. The current results revealed that the DRX texture was dominated by grains with a low Taylor factor component. This was related to the preferred nucleation and lower consumption rates of these grains during DRX. The substructure of DRX grains was ‘‘random” in character and displayed complex subgrain/cell arrangements that largely depended on grain orientation.

Texture and substructure development during post-dynamic softening in Ni-30%Fe austenite

The texture and substructure development during post-dynamic annealing of an austenitic Ni-30%Fe model alloy after complete dynamic recrystallization was investigated using electron back-scattered diffraction (EBSD) and transmission electron microscopy (TEM). A novel mechanism of metadynamic softening is proposed based on the experimental investigation of the grain structure, crystallographic texture and dislocation substructure evolution. The initial softening stage involved rapid growth of the dynamically formed nuclei and migration of the mobile boundaries. The subboundaries within DRX grains progressively disintegrated through dislocation climb and dislocation annihilation, which ultimately led to the formation of dislocation-free grains, while the grain boundary migration gradually became slower. As a result, the DRX texture was largely preserved throughout the annealing process.

Threshold dynamic time warping for spatial activity recognition

Non-invasive spatial activity recognition is a difficult task, complicated by variation in how the same activities are conducted and furthermore by noise introduced by video tracking procedures. In this paper we propose an algorithm based on dynamic time warping (DTW) as a viable method with which to quantify segmented spatial activity sequences from a video tracking system. DTW is a widely used technique for optimally aligning or warping temporal sequences through minimisation of the distance between their components. The proposed algorithm threshold DTW (TDTW) is capable of accurate spatial sequence distance quantification and is shown using a three class spatial data set to be more robust and accurate than DTW and the discrete hidden markov model (HMM). We also evaluate the application of a band dynamic programming (DP) constraint to TDTW in order to reduce extraneous warping between sequences and to reduce the computation complexity of the approach. Results show that application of a band DP constraint to TDTW improves runtime performance significantly, whilst still maintaining a high precision and recall.

On the incremental learning and recognition of the pattern of movement of multiple labelled objects in dynamic scenes

In this paper we discuss combining incremental learning and incremental recognition to classify patterns consisting of multiple objects, each represented by multiple spatio-temporal features. Importantly the technique allows for ambiguity in terms of the positions of the start and finish of the pattern. This involves a progressive classification which considers the data at each time instance in the query and thus provides a probable answer before all the query information becomes available. We present two methods that combine incremental learning and incremental recognition: a time instance method and an overall best match method.

Online context recognition in multisensor systems using Dynamic Time Warping

In this paper, we present our system for online context recognition of multimodal sequences acquired from multiple sensors. The system uses Dynamic Time Warping (DTW) to recognize multimodal sequences of different lengths, embedded in continuous data streams. We evaluate the performance of our system on two real world datasets: 1) accelerometer data acquired from performing two hand gestures and 2) NOKIA's benchmark dataset for context recognition. The results from both datasets demonstrate that the system can perform online context recognition efficiently and achieve high recognition accuracy.