Sparse representation based action and gesture recognition

In this paper we present a solution to the problem of action and gesture recognition using sparse representations. The dictionary is modelled as a simple concatenation of features computed for each action or gesture class from the training data, and test data is classified by finding sparse representation of the test video features over this dictionary. Our method does not impose any explicit training procedure on the dictionary. We experiment our model with two kinds of features, by projecting (i) Gait Energy Images (GEIs) and (ii) Motion-descriptors, to a lower dimension using Random projection. Experiments have shown 100% recognition rate on standard datasets and are compared to the results obtained with widely used SVM classifier.

Impaired gesture performance in schizophrenia: particular vulnerability of meaningless pantomimes

Schizophrenia patients frequently present with subtle motor impairments, including higher order motor function such as hand gesture performance. Using cut off scores from a standardized gesture test, we previously reported gesture deficits in 40% of schizophrenia patients irrespective of the gesture content. However, these findings were based on normative data from an older control group. Hence, we now aimed at determining cut-off scores in an age and gender matched control group. Furthermore, we wanted to explore whether gesture categories are differentially affected in Schizophrenia. Gesture performance data of 30 schizophrenia patients and data from 30 matched controls were compared. Categories included meaningless, intransitive (communicative) and transitive (object related) hand gestures, which were either imitated or pantomimed, i.e. produced on verbal command. Cut-off scores of the age matched control group were higher than the previous cut-off scores in an older control group. An ANOVA tested effects of group, domain (imitation or pantomime), and semantic category (meaningless, transitive or intransitive), as well as their interaction. According to the new cut-off scores, 67% of the schizophrenia patients demonstrated gestural deficits. Patients performed worse in all gesture categories, however meaningless gestures on verbal command were particularly impaired (p = 0.008). This category correlated with poor frontal lobe function (p < 0.001). In conclusion, gestural deficits in schizophrenia are even more frequent than previously reported. Gesture categories that pose higher demands on planning and selection such as pantomime of meaningless gestures are predominantly affected and associated with the well-known frontal lobe dysfunction.

Nonverbal social communication and gesture control in schizophrenia

Schizophrenia patients are severely impaired in nonverbal communication, including social perception and gesture production. However, the impact of nonverbal social perception on gestural behavior remains unknown, as is the contribution of negative symptoms, working memory, and abnormal motor behavior. Thus, the study tested whether poor nonverbal social perception was related to impaired gesture performance, gestural knowledge, or motor abnormalities. Forty-six patients with schizophrenia (80%), schizophreniform (15%), or schizoaffective disorder (5%) and 44 healthy controls matched for age, gender, and education were included. Participants completed 4 tasks on nonverbal communication including nonverbal social perception, gesture performance, gesture recognition, and tool use. In addition, they underwent comprehensive clinical and motor assessments. Patients presented impaired nonverbal communication in all tasks compared with controls. Furthermore, in contrast to controls, performance in patients was highly correlated between tasks, not explained by supramodal cognitive deficits such as working memory. Schizophrenia patients with impaired gesture performance also demonstrated poor nonverbal social perception, gestural knowledge, and tool use. Importantly, motor/frontal abnormalities negatively mediated the strong association between nonverbal social perception and gesture performance. The factors negative symptoms and antipsychotic dosage were unrelated to the nonverbal tasks. The study confirmed a generalized nonverbal communication deficit in schizophrenia. Specifically, the findings suggested that nonverbal social perception in schizophrenia has a relevant impact on gestural impairment beyond the negative influence of motor/frontal abnormalities.

Interference with gesture production by theta burst stimulation over left inferior frontal cortex

The traditional view of a predominant inferior parietal representation of gestures has been recently challenged by neuroimaging studies demonstrating that gesture production and discrimination may critically depend on inferior frontal lobe function. The aim of the present work was therefore to investigate the effect of transient disruption of these brain sites by continuous theta burst stimulation (cTBS) on gesture production and recognition.

Disorganization and timing of motor behavior : insight from gesture impairments and movement patterns in schizophrenia

Background: Motor symptoms are frequent phenomena across the entire course of schizophrenia1. Some have argued that disorganized behavior was associated with aberrant motor behavior. We have studied the association of motor disturbances and disorganization in two projects focusing on the timing of movements. Method: In two studies, we assessed motor behavior and psychopathology. The first study applied a validated test of upper limb apraxia in 30 schizophrenia patients2,3. We used standardized video assessments of hand gestures by a blinded rater. The second study tested the stability of movement patterns using time series analysis in actigraphy data of 100 schizophrenia patients4. Both stability of movement patterns and the overall amount of movement were calculated from data of two hours with high degrees of social interaction comparable across the 100 subjects. Results: In total, 67% of the patients had gesture performance deficits3. Most frequently, they made spatial, temporal and body-part-as-object errors. Gesture performance relied on frontal lobe function2. Poor gesture performance was associated with increased disorganization scores. In the second study, we found disorganization to be predicted only by more irregular movement patterns irrespective of the overall amount of movement4. Conclusion : Both studies provide evidence for a link between aberrant timing of motor behavior and disorganization. Disturbed movement control seems critical for disorganized behavior in schizophrenia.