Multilingualism and conceptual modelling

One of the leading motivations behind the multilingual semantic web is to make resources accessible digitally in an online global multilingual context. Consequently, it is fundamental for knowledge bases to find a way to manage multilingualism and thus be equipped with those procedures for its conceptual modelling. In this context, the goal of this paper is to discuss how common-sense knowledge and cultural knowledge are modelled in a multilingual framework. More particularly, multilingualism and conceptual modelling are dealt with from the perspective of FunGramKB, a lexico-conceptual knowledge base for natural language understanding. This project argues for a clear division between the lexical and the conceptual dimensions of knowledge. Moreover, the conceptual layer is organized into three modules, which result from a strong commitment towards capturing semantic knowledge (Ontology), procedural knowledge (Cognicon) and episodic knowledge (Onomasticon). Cultural mismatches are discussed and formally represented at the three conceptual levels of FunGramKB.

Building autonomous sensitive artificial listeners (Extended abstract)

This paper describes a substantial effort to build a real-time interactive multimodal dialogue system with a focus on emotional and non-verbal interaction capabilities. The work is motivated by the aim to provide technology with competences in perceiving and producing the emotional and non-verbal behaviours required to sustain a conversational dialogue. We present the Sensitive Artificial Listener (SAL) scenario as a setting which seems particularly suited for the study of emotional and non-verbal behaviour, since it requires only very limited verbal understanding on the part of the machine. This scenario allows us to concentrate on non-verbal capabilities without having to address at the same time the challenges of spoken language understanding, task modeling etc. We first summarise three prototype versions of the SAL scenario, in which the behaviour of the Sensitive Artificial Listener characters was determined by a human operator. These prototypes served the purpose of verifying the effectiveness of the SAL scenario and allowed us to collect data required for building system components for analysing and synthesising the respective behaviours. We then describe the fully autonomous integrated real-time system we created, which combines incremental analysis of user behaviour, dialogue management, and synthesis of speaker and listener behaviour of a SAL character displayed as a virtual agent. We discuss principles that should underlie the evaluation of SAL-type systems. Since the system is designed for modularity and reuse, and since it is publicly available, the SAL system has potential as a joint research tool in the affective computing research community.

Learning to Interpret and Generate Instructional Recipes

Thesis (Ph.D.)--University of Washington, 2016-08

Learning data-driven models of non-verbal behaviors for building rapport using an intelligent virtual agent

There is a growing societal need to address the increasing prevalence of behavioral health issues, such as obesity, alcohol or drug use, and general lack of treatment adherence for a variety of health problems. The statistics, worldwide and in the USA, are daunting. Excessive alcohol use is the third leading preventable cause of death in the United States (with 79,000 deaths annually), and is responsible for a wide range of health and social problems. On the positive side though, these behavioral health issues (and associated possible diseases) can often be prevented with relatively simple lifestyle changes, such as losing weight with a diet and/or physical exercise, or learning how to reduce alcohol consumption. Medicine has therefore started to move toward finding ways of preventively promoting wellness, rather than solely treating already established illness.^ Evidence-based patient-centered Brief Motivational Interviewing (BMI) interventions have been found particularly effective in helping people find intrinsic motivation to change problem behaviors after short counseling sessions, and to maintain healthy lifestyles over the long-term. Lack of locally available personnel well-trained in BMI, however, often limits access to successful interventions for people in need. To fill this accessibility gap, Computer-Based Interventions (CBIs) have started to emerge. Success of the CBIs, however, critically relies on insuring engagement and retention of CBI users so that they remain motivated to use these systems and come back to use them over the long term as necessary.^ Because of their text-only interfaces, current CBIs can therefore only express limited empathy and rapport, which are the most important factors of health interventions. Fortunately, in the last decade, computer science research has progressed in the design of simulated human characters with anthropomorphic communicative abilities. Virtual characters interact using humans’ innate communication modalities, such as facial expressions, body language, speech, and natural language understanding. By advancing research in Artificial Intelligence (AI), we can improve the ability of artificial agents to help us solve CBI problems.^ To facilitate successful communication and social interaction between artificial agents and human partners, it is essential that aspects of human social behavior, especially empathy and rapport, be considered when designing human-computer interfaces. Hence, the goal of the present dissertation is to provide a computational model of rapport to enhance an artificial agent’s social behavior, and to provide an experimental tool for the psychological theories shaping the model. Parts of this thesis were already published in [LYL+12, AYL12, AL13, ALYR13, LAYR13, YALR13, ALY14].^

Understanding the information literacy experiences of EFL (English as a Foreign Language) students

This thesis investigated the information literacy experiences of EFL (English as a Foreign Language) students in a higher education institution in the United Arab Emirates (UAE). Phenomenography was used to investigate how EFL students' 'used information to learn' (ie. information literacy). The study revealed that EFL students' experienced information literacy across four categories and had varying experiences of information and learning. The research also showed that EFL students' faced a number of challenges and barriers due to language that impacted on their experiences of reading, understanding, accessing and translating information.

Understanding the information literacy experiences of EFL (English as a Foreign Language) students

Purpose – This paper outlines research that explores the information literacy experiences of EFL (English as a Foreign Language) students. The question explored in this research was: how do EFL students experience information literacy. Design/Methodology/Approach – This study used phenomenography, a relational approach to explore the information literacy experiences of EFL students. Phenomenography studies the qualitatively different ways a phenomenon is experienced in the world around us. Findings – This research revealed that EFL students experienced information literacy in four qualitatively different ways. The four categories revealed through the data were: process, quality, language and knowledge. This research found that language impacted on EFL students’ experiences of information literacy and revealed that EFL students applied various techniques and strategies when they read, understood, organised and translated information. Research limitations/implications – This research was conducted in a specific cultural and educational context, therefore the results might not reflect the experiences of EFL students in other cultural or educational contexts. Practical implications – The findings from this research offer an important contribution to information literacy practice by providing important insights about EFL students’ experiences and perceptions of information and learning that can be used to inform curriculum development in second language learning contexts. Originality/Value - There is currently a lack of research using a relational approach to investigate EFL students’ experiences of information literacy. There is also limited research that explores the impact language has on information literary and learning in English as a foreign or second language contexts.

H.M.'s personal crossword puzzles: understanding memory and language.

The amnesic patient H.M. has been solving crossword puzzles nearly all his life. Here, we analysed the linguistic content of 277 of H.M.'s crossword-puzzle solutions. H.M. did not have any unusual difficulties with the orthographic and grammatical components inherent to the puzzles. He exhibited few spelling errors, responded with appropriate parts of speech, and provided answers that were, at times, more convincing to observers than those supplied by the answer keys. These results suggest that H.M.'s lexical word-retrieval skills remain fluid despite his profound anterograde amnesia. Once acquired, the maintenance of written language comprehension and production does not seem to require intact medial temporal lobe structures.

Procedures as a Representation for Data in a Computer Program for Understanding Natural Language

This paper describes a system for the computer understanding of English. The system answers questions, executes commands, and accepts information in normal English dialog. It uses semantic information and context to understand discourse and to disambiguate sentences. It combines a complete syntactic analysis of each sentence with a "heuristic understander" which uses different kinds of information about a sentence, other parts of the discourse, and general information about the world in deciding what the sentence means. It is based on the belief that a computer cannot deal reasonably with language unless it can "understand" the subject it is discussing. The program is given a detailed model of the knowledge needed by a simple robot having only a hand and an eye. We can give it instructions to manipulate toy objects, interrogate it about the scene, and give it information it will use in deduction. In addition to knowing the properties of toy objects, the program has a simple model of its own mentality. It can remember and discuss its plans and actions as well as carry them out. It enters into a dialog with a person, responding to English sentences with actions and English replies, and asking for clarification when its heuristic programs cannot understand a sentence through use of context and physical knowledge.

Understanding communication in second language classrooms.

Esta publicación se centra en la comunicación como elemento central de la enseñanza y el aprendizaje en aulas de segundo idioma. Basándose en las transcripciones reales de aula, el autor construye un marco conceptual a través del cual los docentes pueden reconocer cómo los patrones de comunicación se han establecido y mantenido en la clase. Reconoce la importancia de lo que los profesores y los estudiantes aportan de su propio medio, así como lo que realmente ocurre durante la interacción en la comunicación del aula. En la primera parte del volumen se esboza un marco para la comprensión de la comunicación de la segunda lengua en las aulas, incluyendo el control de patrones de comunicación, las percepciones de los estudiantes de patrones de comunicación en la clase, y el conocimiento y uso del lenguaje en el aula, tanto en general como a efectos del aprendizaje de los alumnos. La segunda parte examina una serie de patrones de la comunicación:la interacción profesor-alumno, la interacción estudiante-estudiante, y las pautas que se relacionan con la comunidad basada en cuestiones tales como inglés como segundo idioma de instrucción y el uso de materiales comerciales. La parte tercera ofrece sugerencias para la ampliación de patrones de comunicación, lo que permite su variabilidad, y establecer y ampliar las competencias comunicativas en el aula. Se incluye bibliografía.

Understanding expertise in teaching : case studies of second language teachers.

Se analiza desde el punto de vista crítico una amplia literatura sobre la cognición docente, para mostrar cómo las teorías de los profesores, sus conocimientos, su experiencia y sus objetivos determinan su práctica docente y su aptitud ante ella, tanto en el profesor principiante como en el experto. A partir de casos prácticos estudiados en las aulas se clarifica en qué consiste la pericia en la enseñanza de la lengua y cuales son los factores que determinan e influyen en su desarrollo y cómo los profesores de lengua la utilizan para la docencia.

The Minimum core for language and literacy : knowledge, understanding and personal skills.

Guía práctica sobre lenguaje y alfabetización para profesores en formación (nivel bachillerato). Les permite identificar y desarrollar sus propias habilidades lingüísticas y de alfabetización y al mismo tiempo apoyar la evolución de los alumnos. Contiene todas las áreas claves de conocimiento, compresión y habilidades personales, además de analizar en un contexto amplio cómo el lenguaje y la alfabetización se adquieren y se desarrollan a nivel personal, social y cultural. El contenido está adaptado para la obtención de los certificados QTLS (Qualified Teacher, Learning and Skills) y ATLS (Associate Teacher, Learning and Skills).

AQA GCSE English Language Unit 3 student workbook: Understanding Spoken and Written Texts and Writing Creatively.

Las dos principales secciones de este cuaderno de ejercicios están diseñadas para ayudar a los estudiantes a adquirir experiencia para el AQA examen de Literatura Inglesa de enseñanza secundaria y así conseguir el GCSE (Certificado General de Educación Secundaria). El cuadernillo contiene material y ejercicios que tienen por objeto mejorar el nivel de habilidades de los estudiantes. Los temas del cuadernillo son: comprensión de textos escritos (escribir ensayos sobre los textos en prosa, caracterización y voz, aspectos de género y forma, muestras: Oliver Twist de Charles Dickens, poemas de Emily Dickinson, el soneto 18 de William Shakespeare), la producción de textos creativos (escritura creativa), el estudio del lenguaje hablado.

The relationship of language development to theory of mind understanding in young deaf children

This paper studies cognitive development in young deaf children, specifically Theory of Mind development and its link to language abilities.

Precise Mathematical Language: Exploring the Relationship Between Student Vocabulary Understanding and Student Achievement

In this action research study of my classroom of fifth grade mathematics, I investigate the relationship between student understanding of precise mathematics vocabulary and student achievement in mathematics. Specifically, I focused on students’ understanding of written mathematics problems and on their ability to use precise mathematical language in their written solutions of critical thinking problems. I discovered that students are resistant to change; they prefer to do what comes naturally to them. Since they have not been previously taught to use precise mathematical language in their communication about math, they have great difficulty in adapting to this new requirement. However, with teaching modeling and ample opportunities to use the language of mathematics, students’ understanding and use of specific mathematical vocabulary is increased.