Automatic Food Intake Assessment Using Camera Phones

Obesity is becoming an epidemic phenomenon in most developed countries. The fundamental cause of obesity and overweight is an energy imbalance between calories consumed and calories expended. It is essential to monitor everyday food intake for obesity prevention and management. Existing dietary assessment methods usually require manually recording and recall of food types and portions. Accuracy of the results largely relies on many uncertain factors such as user's memory, food knowledge, and portion estimations. As a result, the accuracy is often compromised. Accurate and convenient dietary assessment methods are still blank and needed in both population and research societies. In this thesis, an automatic food intake assessment method using cameras, inertial measurement units (IMUs) on smart phones was developed to help people foster a healthy life style. With this method, users use their smart phones before and after a meal to capture images or videos around the meal. The smart phone will recognize food items and calculate the volume of the food consumed and provide the results to users. The technical objective is to explore the feasibility of image based food recognition and image based volume estimation. This thesis comprises five publications that address four specific goals of this work: (1) to develop a prototype system with existing methods to review the literature methods, find their drawbacks and explore the feasibility to develop novel methods; (2) based on the prototype system, to investigate new food classification methods to improve the recognition accuracy to a field application level; (3) to design indexing methods for large-scale image database to facilitate the development of new food image recognition and retrieval algorithms; (4) to develop novel convenient and accurate food volume estimation methods using only smart phones with cameras and IMUs. A prototype system was implemented to review existing methods. Image feature detector and descriptor were developed and a nearest neighbor classifier were implemented to classify food items. A reedit card marker method was introduced for metric scale 3D reconstruction and volume calculation. To increase recognition accuracy, novel multi-view food recognition algorithms were developed to recognize regular shape food items. To further increase the accuracy and make the algorithm applicable to arbitrary food items, new food features, new classifiers were designed. The efficiency of the algorithm was increased by means of developing novel image indexing method in large-scale image database. Finally, the volume calculation was enhanced through reducing the marker and introducing IMUs. Sensor fusion technique to combine measurements from cameras and IMUs were explored to infer the metric scale of the 3D model as well as reduce noises from these sensors.

Adapting health-risk communication to the specific cultural contexts of diverse populations : an assessment of malaria-treatment programs in Liberia

Drawing on theories of technical communication, rhetoric, literacy, language and culture, and medical anthropology, this dissertation explores how local culture and traditions can be incorporated into health-risk-communication-program design and implementation, including the design and dissemination of health-risk messages. In a modern world with increasing global economic partnerships, mounting health and environmental risks, and cross-cultural collaborations, those who interact with people of different cultures have “a moral obligation to take those cultures seriously, including their social organization and values” (Hahn and Inhorn 10). Paradoxically, at the same time as we must carefully adapt health, safety, and environmental-risk messages to diverse cultures and populations, we must also recognize the increasing extent to which we are all becoming part of one, vast, interrelated global village. This, too, has a significant impact on the ways in which healthcare plans should be designed, communicated, and implemented. Because communicating across diverse cultures requires a system for “bridging the gap between individual differences and negotiating individual realities” (Kim and Gudykunst 50), both administrators and beneficiaries of malaria-treatment-and-control programs (MTCPs) in Liberia were targeted to participate in this study. A total of 105 people participated in this study: 21 MTCP administrators (including designers and implementers) completed survey questionnaires on program design, implementation, and outcomes; and 84 MTCP beneficiaries (e.g., traditional leaders and young adults) were interviewed about their knowledge of malaria and methods for communicating health risks in their tribe or culture. All participants showed a tremendous sense of courage, commitment, resilience, and pragmatism, especially in light of the fact that many of them live and work under dire socioeconomic conditions (e.g., no electricity and poor communication networks). Although many MTCP beneficiaries interviewed for this study had bed nets in their homes, a majority (46.34 percent) used a combination of traditional herbal medicine and Western medicine to treat malaria. MTCP administrators who participated in this study rated the impacts of their programs on reducing malaria in Liberia as moderately successful (61.90 percent) or greatly successful (38.10 percent), and they offered a variety of insights on what they might do differently in the future to incorporate local culture and traditions into program design and implementation. Participating MTCP administrators and beneficiaries differed in their understanding of what “cultural incorporation” meant, but they agreed that using local indigenous languages to communicate health-risk messages was essential for effective health-risk communication. They also suggested that understanding the literacy practices and linguistic cultures of the local people is essential to communicating health risks across diverse cultures and populations.