Probabilistic Models for Scalable Knowledge Graph Construction

In the past decade, systems that extract information from millions of Internet documents have become commonplace. Knowledge graphs -- structured knowledge bases that describe entities, their attributes and the relationships between them -- are a powerful tool for understanding and organizing this vast amount of information. However, a significant obstacle to knowledge graph construction is the unreliability of the extracted information, due to noise and ambiguity in the underlying data or errors made by the extraction system and the complexity of reasoning about the dependencies between these noisy extractions. My dissertation addresses these challenges by exploiting the interdependencies between facts to improve the quality of the knowledge graph in a scalable framework. I introduce a new approach called knowledge graph identification (KGI), which resolves the entities, attributes and relationships in the knowledge graph by incorporating uncertain extractions from multiple sources, entity co-references, and ontological constraints. I define a probability distribution over possible knowledge graphs and infer the most probable knowledge graph using a combination of probabilistic and logical reasoning. Such probabilistic models are frequently dismissed due to scalability concerns, but my implementation of KGI maintains tractable performance on large problems through the use of hinge-loss Markov random fields, which have a convex inference objective. This allows the inference of large knowledge graphs using 4M facts and 20M ground constraints in 2 hours. To further scale the solution, I develop a distributed approach to the KGI problem which runs in parallel across multiple machines, reducing inference time by 90%. Finally, I extend my model to the streaming setting, where a knowledge graph is continuously updated by incorporating newly extracted facts. I devise a general approach for approximately updating inference in convex probabilistic models, and quantify the approximation error by defining and bounding inference regret for online models. Together, my work retains the attractive features of probabilistic models while providing the scalability necessary for large-scale knowledge graph construction. These models have been applied on a number of real-world knowledge graph projects, including the NELL project at Carnegie Mellon and the Google Knowledge Graph.

The relationship of early social, mental, and behavioral experiences with adult obesity and Alcohol Use Disorder

Stressful life events early in life, including symptoms of mental disorders or childhood maltreatment, may increase risk for worse mental and physical health outcomes in adulthood. The purpose of this dissertation was to examine the effects of childhood Attention Deficit Hyperactivity Disorder (ADHD) symptoms and maltreatment experience on two adult outcomes: obesity and alcohol use disorder (AUD). Mediational effects of adolescent characteristics were explored. This dissertation used Waves I, III, and IV of the National Longitudinal Study of Adolescent to Adult Health. In Paper 1 (Chapter 3), we investigated the association between multiple types of child maltreatment and adult objective (body mass index; BMI) and subjective (self-rated) obesity, as well as mediating effects by adolescent characteristics including depressive symptoms and BMI. Results showed that after adjusting for sex, race/ethnicity, and maternal education, physical maltreatment was moderately associated with adulthood obesity as measured by BMI and self-reported obesity, while sexual maltreatment was more strongly associated with the objective measure but not the subjective measure. The indirect effects of mediation of adolescent BMI and depressive symptoms were statistically significant. In Paper 2 (Chapter 4), the objective was to examine mediation by adolescent depressive symptoms, alcohol consumption, peer alcohol consumption, and delinquency in the relationship between ADHD symptoms and adult AUD. The indirect effects of mediation of adolescent delinquency, alcohol consumption, and peer alcohol consumption were statistically significant in single and multiple mediator models. In Paper 3 (Chapter 5), the objective was to assess the joint effects of maltreatment/neglect on adult AUD. After adjusting for sex, race/ethnicity, child maltreatment, and parental AUD, ADHD symptoms were significantly associated with increased odds of AUD. There was no strong evidence of multiplicative interaction by maltreatment. This association was stronger for males than females, although the interaction term was not statistically significant. This dissertation adds to the literature by examining relationships between several major public health problems: ADHD symptoms, childhood maltreatment, AUD, depressive symptoms, and obesity. This project has implications for understanding how early life stress increases risk for later physical and mental health problems, and identifying potential intervention targets for adolescents.