Datasets, features, learning, and models in visual recognition

Visual recognition is a fundamental research topic in computer vision. This dissertation explores datasets, features, learning, and models used for visual recognition. In order to train visual models and evaluate different recognition algorithms, this dissertation develops an approach to collect object image datasets on web pages using an analysis of text around the image and of image appearance. This method exploits established online knowledge resources (Wikipedia pages for text; Flickr and Caltech data sets for images). The resources provide rich text and object appearance information. This dissertation describes results on two datasets. The first is Berg’s collection of 10 animal categories; on this dataset, we significantly outperform previous approaches. On an additional set of 5 categories, experimental results show the effectiveness of the method. Images are represented as features for visual recognition. This dissertation introduces a text-based image feature and demonstrates that it consistently improves performance on hard object classification problems. The feature is built using an auxiliary dataset of images annotated with tags, downloaded from the Internet. Image tags are noisy. The method obtains the text features of an unannotated image from the tags of its k-nearest neighbors in this auxiliary collection. A visual classifier presented with an object viewed under novel circumstances (say, a new viewing direction) must rely on its visual examples. This text feature may not change, because the auxiliary dataset likely contains a similar picture. While the tags associated with images are noisy, they are more stable when appearance changes. The performance of this feature is tested using PASCAL VOC 2006 and 2007 datasets. This feature performs well; it consistently improves the performance of visual object classifiers, and is particularly effective when the training dataset is small. With more and more collected training data, computational cost becomes a bottleneck, especially when training sophisticated classifiers such as kernelized SVM. This dissertation proposes a fast training algorithm called Stochastic Intersection Kernel Machine (SIKMA). This proposed training method will be useful for many vision problems, as it can produce a kernel classifier that is more accurate than a linear classifier, and can be trained on tens of thousands of examples in two minutes. It processes training examples one by one in a sequence, so memory cost is no longer the bottleneck to process large scale datasets. This dissertation applies this approach to train classifiers of Flickr groups with many group training examples. The resulting Flickr group prediction scores can be used to measure image similarity between two images. Experimental results on the Corel dataset and a PASCAL VOC dataset show the learned Flickr features perform better on image matching, retrieval, and classification than conventional visual features. Visual models are usually trained to best separate positive and negative training examples. However, when recognizing a large number of object categories, there may not be enough training examples for most objects, due to the intrinsic long-tailed distribution of objects in the real world. This dissertation proposes an approach to use comparative object similarity. The key insight is that, given a set of object categories which are similar and a set of categories which are dissimilar, a good object model should respond more strongly to examples from similar categories than to examples from dissimilar categories. This dissertation develops a regularized kernel machine algorithm to use this category dependent similarity regularization. Experiments on hundreds of categories show that our method can make significant improvement for categories with few or even no positive examples.

Protein quality and distribution determines anabolic signaling, cellular energetics, and body composition

Building and maintaining muscle is critical to the quality of life for adults and elderly. Physical activity and nutrition are important factors for long-term muscle health. In particular, dietary protein – including protein distribution and quality – are under-appreciated determinants of muscle health for adults. The most unequivocal evidence for the benefit of optimal dietary protein at individual meals is derived from studies of weight management. During the catabolic condition of weight loss, higher protein diets attenuate loss of lean tissue and partition weight loss to body fat when compared with commonly recommended high carbohydrate, low protein diets. Muscle protein turnover is a continuous process in which proteins are degraded, and replaced by newly synthesized proteins. Muscle growth occurs when protein synthesis exceeds protein degradation. Regulation of protein synthesis is complex, with multiple signals influencing this process. The mammalian target of rapamycin (mTORC1) pathway has been identified as a particularly important regulator of protein synthesis, via stimulation of translation initiation. Key regulatory points of translation initiation effected by mTORC1 include assembly of the eukaryotic initiation factor 4F (eIF4F) complex and phosphorylation of the 70 kilodalton ribosomal protein S6 kinase (S6K1). Assembly of the eIF4F initiation complex involves phosphorylation of the inhibitory eIF4E binding protein-1 (4E-BP1), which releases the initiation factor eIF4E and allows it to bind with eIF4G. Binding of eIF4E with eIF4G promotes preparation of the mRNA for binding to the 43S pre-initiation complex. Consumption of the amino acid leucine (Leu) is a key factor determining the anabolic response of muscle protein synthesis (MPS) and mTORC1 signaling to a meal. Research from this dissertation demonstrates that the peak activation of MPS following a complete meal is proportional to the Leu content of a meal and its ability to elevate plasma Leu. Leu has also been implicated as an inhibitor of muscle protein degradation (MPD). In particular, there is evidence suggesting that in muscle wasting conditions Leu supplementation attenuates expression of the ubiquitin-proteosome pathway, which is the primary mode of intracellular protein degradation. However, this is untested in healthy, physiological feeding models. Therefore, an experiment was performed to see if feeding isonitrogenous protein sources with different Leu contents to healthy adult rats would differentially impact ubiquitin-proteosome (protein degradation) outcomes; and if these outcomes are related to the meal responses of plasma Leu. Results showed that higher Leu diets were able to attenuate total proteasome content but had no effect on ubiquitin proteins. This research shows that dietary Leu determines postprandial muscle anabolism. In a parallel line of research, the effects of dietary Leu on changes in muscle mass overtime were investigated. Animals consuming higher Leu diets had larger gastrocnemius muscle weights; furthermore, gastrocnemius muscle weights were correlated with postprandial changes in MPS (r=0.471, P<0.01) and plasma Leu (r=0.400, P=0.01). These results show that the effect of Leu on ubiquitin-proteosome pathways is minimal for healthy adult rats consuming adequate diets. Thus, long-term changes in muscle mass observed in adult rats are likely due to the differences in MPS, rather than MPD. Factors determining the duration of Leu-stimulated MPS were further investigated. Despite continued elevations in plasma Leu and associated translation initiation factors (e.g., S6K1 and 4E-BP1), MPS returned to basal levels ~3 hours after a meal. However, administration of additional nutrients in the form of carbohydrate, Leu, or both ~2 hours after a meal was able to extend the elevation of MPS, in a time and dose dependent manner. This effect led to a novel discovery that decreases in translation elongation activity was associated with increases in activity of AMP kinase, a key cellular energy sensor. This research shows that the Leu density of dietary protein determines anabolic signaling, thereby affecting cellular energetics and body composition.