Leveraging Multiple Features for Image Retrieval and Matching

The goal of image retrieval and matching is to find and locate object instances in images from a large-scale image database. While visual features are abundant, how to combine them to improve performance by individual features remains a challenging task. In this work, we focus on leveraging multiple features for accurate and efficient image retrieval and matching. We first propose two graph-based approaches to rerank initially retrieved images for generic image retrieval. In the graph, vertices are images while edges are similarities between image pairs. Our first approach employs a mixture Markov model based on a random walk model on multiple graphs to fuse graphs. We introduce a probabilistic model to compute the importance of each feature for graph fusion under a naive Bayesian formulation, which requires statistics of similarities from a manually labeled dataset containing irrelevant images. To reduce human labeling, we further propose a fully unsupervised reranking algorithm based on a submodular objective function that can be efficiently optimized by greedy algorithm. By maximizing an information gain term over the graph, our submodular function favors a subset of database images that are similar to query images and resemble each other. The function also exploits the rank relationships of images from multiple ranked lists obtained by different features. We then study a more well-defined application, person re-identification, where the database contains labeled images of human bodies captured by multiple cameras. Re-identifications from multiple cameras are regarded as related tasks to exploit shared information. We apply a novel multi-task learning algorithm using both low level features and attributes. A low rank attribute embedding is joint learned within the multi-task learning formulation to embed original binary attributes to a continuous attribute space, where incorrect and incomplete attributes are rectified and recovered. To locate objects in images, we design an object detector based on object proposals and deep convolutional neural networks (CNN) in view of the emergence of deep networks. We improve a Fast RCNN framework and investigate two new strategies to detect objects accurately and efficiently: scale-dependent pooling (SDP) and cascaded rejection classifiers (CRC). The SDP improves detection accuracy by exploiting appropriate convolutional features depending on the scale of input object proposals. The CRC effectively utilizes convolutional features and greatly eliminates negative proposals in a cascaded manner, while maintaining a high recall for true objects. The two strategies together improve the detection accuracy and reduce the computational cost.

INFORMATION PRACTICES DURING LIFE TRANSITION: KOREAN IMMIGRANT WOMEN’S EVERYDAY LIFE INFORMATION SEEKING AND ACCULTURATION

In this dissertation, I explore information practices during life transition in the context of immigration. This study aims to understand how their unique personal, social, and life contexts shape immigration experiences, and how these diverse contexts are related to various information practices that they engage in to resolve daily information needs and achieve immigration goals. In my study I examined daily information needs and acquisition of Korean immigrant women. Data were collected through two interview sessions, diary entries on everyday information seeking up to three weeks, post-diary debriefing interviews to reveal contexts surrounding information practices, and observation sessions. My study shows that one’s accumulated experiences with information-related situations shape the person’s attitudes toward diverse information resources and habitual information practices. Both personal and social contexts surrounding immigrant women change during life transition and shape how they interpret their immigration experiences, what information they need to deal with both daily and long-term goals, and how they modify their information practices to obtain the relevant information in an unfamiliar information environment. Also, life transition of immigration entails changes in immigrant women’s social roles, which engender their daily responsibilities in the new society. These daily responsibilities motivate immigrant women’s everyday interactions with a variety of communities in order to exchange information and conduct their social roles in the new sociocultural environment. While immigrant women had common information needs around culture learning, social roles and associated responsibilities explain differences in their differing information needs and tend to direct daily information practices. The advancement of ICTs allows immigrant women to conduct their social roles in a remote city as well as to maintain multiple connections with both the heritage and host society. Limited cultural knowledge influences immigrant women’s evaluation and use of the obtained information as well as their acquisition of relevant information. This study provides understandings on the role of information during life transition as well as Korean immigrant women’s information practices.

Flooded with Information from Social Media: Effects of Disaster Information Source and Visuals on Viewers' Cognitive, Affective, and Behavioral Responses

While a variety of crisis types loom as real risks for organizations and communities, and the media landscape continues to evolve, research is needed to help explain and predict how people respond to various kinds of crisis and disaster information. For example, despite the rising prevalence of digital and mobile media centered on still and moving visuals, and stark increases in Americans’ use of visual-based platforms for seeking and sharing disaster information, relatively little is known about how the presence or absence of disaster visuals online might prompt or deter resilience-related feelings, thoughts, and/or behaviors. Yet, with such insights, governmental and other organizational entities as well as communities themselves may best help individuals and communities prepare for, cope with, and recover from adverse events. Thus, this work uses the theoretical lens of the social-mediated crisis communication model (SMCC) coupled with the limited capacity model of motivated mediated message processing (LC4MP) to explore effects of disaster information source and visuals on viewers’ resilience-related responses to an extreme flooding scenario. Results from two experiments are reported. First a preliminary 2 (disaster information source: organization/US National Weather Service vs. news media/USA Today) x 2 (disaster visuals: no visual podcast vs. moving visual video) factorial between-subjects online experiment with a convenience sample of university students probes effects of crisis source and visuals on a variety of cognitive, affective, and behavioral outcomes. A second between-subjects online experiment manipulating still and moving visual pace in online videos (no visual vs. still, slow-pace visual vs. still, medium-pace visual vs. still, fast-pace visual vs. moving, slow-pace visual vs. moving, medium-pace visual vs. moving, fast-pace visual) with a convenience sample recruited from Amazon’s Mechanical Turk (mTurk) similarly probes a variety of potentially resilience-related cognitive, affective, and behavioral outcomes. The role of biological sex as a quasi-experimental variable is also investigated in both studies. Various implications for community resilience and recommendations for risk and disaster communicators are explored. Implications for theory building and future research are also examined. Resulting modifications of the SMCC model (i.e., removing “message strategy” and adding the new category of “message content elements” under organizational considerations) are proposed.