Computer vision tools for the non-invasive assessment of autism-related behavioral markers

The early detection of developmental disorders is key to child outcome, allowing interventions to be initiated that promote development and improve prognosis. Research on autism spectrum disorder (ASD) suggests behavioral markers can be observed late in the first year of life. Many of these studies involved extensive frame-by-frame video observation and analysis of a child's natural behavior. Although non-intrusive, these methods are extremely time-intensive and require a high level of observer training; thus, they are impractical for clinical and large population research purposes. Diagnostic measures for ASD are available for infants but are only accurate when used by specialists experienced in early diagnosis. This work is a first milestone in a long-term multidisciplinary project that aims at helping clinicians and general practitioners accomplish this early detection/measurement task automatically. We focus on providing computer vision tools to measure and identify ASD behavioral markers based on components of the Autism Observation Scale for Infants (AOSI). In particular, we develop algorithms to measure three critical AOSI activities that assess visual attention. We augment these AOSI activities with an additional test that analyzes asymmetrical patterns in unsupported gait. The first set of algorithms involves assessing head motion by tracking facial features, while the gait analysis relies on joint foreground segmentation and 2D body pose estimation in video. We show results that provide insightful knowledge to augment the clinician's behavioral observations obtained from real in-clinic assessments.

A Mechanical Analysis of Suspensory Locomotion in Primates and Other Mammals

For primates, and other arboreal mammals, adopting suspensory locomotion represents one of the strategies an animal can use to prevent toppling off a thin support during arboreal movement and foraging. While numerous studies have reported the incidence of suspensory locomotion in a broad phylogenetic sample of mammals, little research has explored what mechanical transitions must occur in order for an animal to successfully adopt suspensory locomotion. Additionally, many primate species are capable of adopting a highly specialized form of suspensory locomotion referred to as arm-swinging, but few scenarios have been posited to explain how arm-swinging initially evolved. This study takes a comparative experimental approach to explore the mechanics of below branch quadrupedal locomotion in primates and other mammals to determine whether above and below branch quadrupedal locomotion represent neuromuscular mirrors of each other, and whether the patterns below branch quadrupedal locomotion are similar across taxa. Also, this study explores whether the nature of the flexible coupling between the forelimb and hindlimb observed in primates is a uniquely primate feature, and investigates the possibility that this mechanism could be responsible for the evolution of arm-swinging.

To address these research goals, kinetic, kinematic, and spatiotemporal gait variables were collected from five species of primate (Cebus capucinus, Daubentonia madagascariensis, Lemur catta, Propithecus coquereli, and Varecia variegata) walking quadrupedally above and below branches. Data from these primate species were compared to data collected from three species of non-primate mammals (Choloepus didactylus, Pteropus vampyrus, and Desmodus rotundus) and to three species of arm-swinging primate (Hylobates moloch, Ateles fusciceps, and Pygathrix nemaeus) to determine how varying forms of suspensory locomotion relate to each other and across taxa.

From the data collected in this study it is evident the specialized gait characteristics present during above branch quadrupedal locomotion in primates are not observed when walking below branches. Instead, gait mechanics closely replicate the characteristic walking patterns of non-primate mammals, with the exception that primates demonstrate an altered limb loading pattern during below branch quadrupedal locomotion, in which the forelimb becomes the primary propulsive and weight-bearing limb; a pattern similar to what is observed during arm-swinging. It is likely that below branch quadrupedal locomotion represents a “mechanical release” from the challenges of moving on top of thin arboreal supports. Additionally, it is possible, that arm-swinging could have evolved from an anatomically-generalized arboreal primate that began to forage and locomote below branches. During these suspensory bouts, weight would have been shifted away from the hindlimbs towards forelimbs, and as the frequency of these boats increased the reliance of the forelimb as the sole form of weight support would have also increased. This form of functional decoupling may have released the hindlimbs from their weight-bearing role during suspensory locomotion, and eventually arm-swinging would have replaced below branch quadrupedal locomotion as the primary mode of suspensory locomotion observed in some primate species. This study provides the first experimental evidence supporting the hypothetical link between below branch quadrupedal locomotion and arm-swinging in primates.