Automatic Food Intake Assessment Using Camera Phones

Obesity is becoming an epidemic phenomenon in most developed countries. The fundamental cause of obesity and overweight is an energy imbalance between calories consumed and calories expended. It is essential to monitor everyday food intake for obesity prevention and management. Existing dietary assessment methods usually require manually recording and recall of food types and portions. Accuracy of the results largely relies on many uncertain factors such as user's memory, food knowledge, and portion estimations. As a result, the accuracy is often compromised. Accurate and convenient dietary assessment methods are still blank and needed in both population and research societies. In this thesis, an automatic food intake assessment method using cameras, inertial measurement units (IMUs) on smart phones was developed to help people foster a healthy life style. With this method, users use their smart phones before and after a meal to capture images or videos around the meal. The smart phone will recognize food items and calculate the volume of the food consumed and provide the results to users. The technical objective is to explore the feasibility of image based food recognition and image based volume estimation. This thesis comprises five publications that address four specific goals of this work: (1) to develop a prototype system with existing methods to review the literature methods, find their drawbacks and explore the feasibility to develop novel methods; (2) based on the prototype system, to investigate new food classification methods to improve the recognition accuracy to a field application level; (3) to design indexing methods for large-scale image database to facilitate the development of new food image recognition and retrieval algorithms; (4) to develop novel convenient and accurate food volume estimation methods using only smart phones with cameras and IMUs. A prototype system was implemented to review existing methods. Image feature detector and descriptor were developed and a nearest neighbor classifier were implemented to classify food items. A reedit card marker method was introduced for metric scale 3D reconstruction and volume calculation. To increase recognition accuracy, novel multi-view food recognition algorithms were developed to recognize regular shape food items. To further increase the accuracy and make the algorithm applicable to arbitrary food items, new food features, new classifiers were designed. The efficiency of the algorithm was increased by means of developing novel image indexing method in large-scale image database. Finally, the volume calculation was enhanced through reducing the marker and introducing IMUs. Sensor fusion technique to combine measurements from cameras and IMUs were explored to infer the metric scale of the 3D model as well as reduce noises from these sensors.

CHANGE FOR GOOD? AN ASSESSMENT OF THE DISCONNECT BETWEEN PERCEIVED BENEFITS BY ENGOS AND USER SATISFACTION OF SOLAR BOTTLE LIGHTS IN INFORMAL SETTLEMENTS OF DHAKA CITY, BANGLADESH

A major challenge for a developing country such as Bangladesh is to supply basic services to its most marginalized populations, which includes both rural and urban dwellers. The government struggles to provide basic necessities such as water and electricity. In marginalized urban communities in Bangladesh, in particular informal settlements, meeting basic needs is even direr. Most informal settlements are built to respond to a rapid immigration to urban centers, and are thought of as ‘temporary structures’, though many structures have been there for decades. In addition, as the settlements are often squatting on private land, access to formalized services such as electricity or water is largely absent. In some cases, electricity and water connections are brought in - but through informal and non-government sanctioned ways -- these hookups are deemed ‘illegal’ by the state. My research will focus on recent efforts to help ameliorate issues associated with lack of basic services in informal settlements in Bangladesh – in this case lack of light. When the government fails to meet the needs of the general population, different non-government organizations tend to step in to intervene. A new emphasis on solar bottle systems in informal urban settlement areas to help address some energy needs (specifically day-time lighting). One such example is the solar bottle light in Bangladesh, a project introduced by the organization ‘Change’. There has been mixed reactions on this technology among the users. This is where my research intervenes. I have used quantitative method to investigate user satisfactions for the solar bottle lights among the residents of the informal settlements to address the overarching question, is there a disconnect between the perceived benefits of the ENGO and the user satisfaction of the residents of the informal settlements of Dhaka City? This paper uses survey responses to investigate level of user satisfaction and the contributing factors.