Context Models for Understanding Images and Videos

A computer vision system that has to interact in natural language needs to understand the visual appearance of interactions between objects along with the appearance of objects themselves. Relationships between objects are frequently mentioned in queries of tasks like semantic image retrieval, image captioning, visual question answering and natural language object detection. Hence, it is essential to model context between objects for solving these tasks. In the first part of this thesis, we present a technique for detecting an object mentioned in a natural language query. Specifically, we work with referring expressions which are sentences that identify a particular object instance in an image. In many referring expressions, an object is described in relation to another object using prepositions, comparative adjectives, action verbs etc. Our proposed technique can identify both the referred object and the context object mentioned in such expressions. Context is also useful for incrementally understanding scenes and videos. In the second part of this thesis, we propose techniques for searching for objects in an image and events in a video. Our proposed incremental algorithms use the context from previously explored regions to prioritize the regions to explore next. The advantage of incremental understanding is restricting the amount of computation time and/or resources spent for various detection tasks. Our first proposed technique shows how to learn context in indoor scenes in an implicit manner and use it for searching for objects. The second technique shows how explicitly written context rules of one-on-one basketball can be used to sequentially detect events in a game.

INTERGENERATIONAL SUPPORT AND WELL-BEING OF OLDER ADULTS IN CHANGING FAMILY CONTEXTS

This dissertation consists of three papers that examine the complexities in upward intergenerational support and adult children’s influence on older adults’ health in changing family contexts of America and China. The prevalence of “gray divorce/repartnering ” in later life after age 55 is on the rise in the United States, yet little is known about its effect on intergenerational support. The first paper uses the life course perspective to examine whether gray divorce and repartnering affect support from biological and stepchildren differently than early divorce and repartnering, and how patterns differ by parents’ gender. Massive internal migration in China has led to increased geographic distance between adult children and aging parents, which may have consequences for old age support received by parents. This topic has yet to be thoroughly explored in China, as most studies of intergenerational support to older parents have focused on the role of coresident children or have not considered the interdependence of multiple parent-child dyads in the family. The second paper adopts the within-family differences approach to assess the influence of non-coresident children’s relative living proximity to parents compared to that of their siblings on their provision of support to parents in rural and urban Chinese families. The study also examines how patterns of the impact are moderated by parents’ living arrangement, non-coresident children’s gender, and parents’ provision of support to children. Taking a multigenerational network perspective, the third paper questions if and how adult children’s socioeconomic status (SES) influences older parents’ health in China. It further examines whether health benefits brought by adult children’s socioeconomic attainment are larger for older adults with lower SES and whether one of the mechanisms through which adult children’s SES affects older parents’ health is by changing their health behaviors. These questions are highly relevant in contemporary China, where adult children have experienced substantial gains in SES and play a central role in old age support for parents. In sum, these three papers take the life course, the within-family differences, and the multigenerational network perspective to address the complexities in intergenerational support and older adults’ health in diverse family contexts.