Advances in scaling deep learning algorithms

Les algorithmes d'apprentissage profond forment un nouvel ensemble de méthodes puissantes pour l'apprentissage automatique. L'idée est de combiner des couches de facteurs latents en hierarchies. Cela requiert souvent un coût computationel plus elevé et augmente aussi le nombre de paramètres du modèle. Ainsi, l'utilisation de ces méthodes sur des problèmes à plus grande échelle demande de réduire leur coût et aussi d'améliorer leur régularisation et leur optimization. Cette thèse adresse cette question sur ces trois perspectives. Nous étudions tout d'abord le problème de réduire le coût de certains algorithmes profonds. Nous proposons deux méthodes pour entrainer des machines de Boltzmann restreintes et des auto-encodeurs débruitants sur des distributions sparses à haute dimension. Ceci est important pour l'application de ces algorithmes pour le traitement de langues naturelles. Ces deux méthodes (Dauphin et al., 2011; Dauphin and Bengio, 2013) utilisent l'échantillonage par importance pour échantilloner l'objectif de ces modèles. Nous observons que cela réduit significativement le temps d'entrainement. L'accéleration atteint 2 ordres de magnitude sur plusieurs bancs d'essai. Deuxièmement, nous introduisont un puissant régularisateur pour les méthodes profondes. Les résultats expérimentaux démontrent qu'un bon régularisateur est crucial pour obtenir de bonnes performances avec des gros réseaux (Hinton et al., 2012). Dans Rifai et al. (2011), nous proposons un nouveau régularisateur qui combine l'apprentissage non-supervisé et la propagation de tangente (Simard et al., 1992). Cette méthode exploite des principes géometriques et permit au moment de la publication d'atteindre des résultats à l'état de l'art. Finalement, nous considérons le problème d'optimiser des surfaces non-convexes à haute dimensionalité comme celle des réseaux de neurones. Tradionellement, l'abondance de minimum locaux était considéré comme la principale difficulté dans ces problèmes. Dans Dauphin et al. (2014a) nous argumentons à partir de résultats en statistique physique, de la théorie des matrices aléatoires, de la théorie des réseaux de neurones et à partir de résultats expérimentaux qu'une difficulté plus profonde provient de la prolifération de points-selle. Dans ce papier nous proposons aussi une nouvelle méthode pour l'optimisation non-convexe.

Bodies, stories, cities : learning to read and write (in) Montréal with Gail Scott

Cette lecture, tant critique, comparative, et théorique que pédagogique, s’ancre dans le constat, premièrement, qu’il advient aux étudiantEs en littérature de se (re)poser la question des coûts et complicités qu’apprendre à lire et à écrire présuppose aujourd’hui; deuxièmement, que nos pratiques littéraires se trament au sein de lieux empreints de différences, que l’on peut nommer, selon le contexte, métaphore, récit, ville; et, troisièmement, que les efforts et investissements requis sont tout autant couteux et interminable qu’un plaisir et une nécessité politique. Ces conclusions tendent vers l’abstrait et le théorique, mais le langage en lequel elles sont articulées, langage corporel et urbain, de la dépendance et de la violence, cherche d’autant plus une qualité matérielle et concrète. Or, l’introduction propose un survol des lectures et comparaisons de Heroine de Gail Scott qui centre ce projet; identifie les contextes institutionnels, historiques, et personnels qui risquent, ensuite, de décentrer celui-ci. Le premier chapitre permet de cerner le matérialisme littéraire qui me sert de méthode par laquelle la littérature, à la fois, sollicite et offre une réponse à ces interrogations théoriques. Inspirée de l’œuvre de Gail Scott et Réjean Ducharme, premièrement, et de Walter Benjamin, Elisabeth Grosz, et Pierre Macherey ensuite, ‘matérialisme’ fait référence à cette collection de figures de pratiques littéraires et urbaines qui proviennent, par exemple, de Georges Perec, Michel DeCerteau, Barbara Johnson, et Patricia Smart, et qui invitent ensuite une réflexions sur les relations entre corporalité et narrativité, entre la nécessité et la contingence du littéraire. De plus, une collection de figures d’un Montréal littéraire et d’une cité pédagogique, acquis des œuvres de Zygmunt Bauman, Partricia Godbout, et Lewis Mumford, constitue en effet un vocabulaire nous permettant de mieux découvrir (et donc enseigner) ce que lire et apprendre requiert. Le deuxième chapitre propose une lecture comparée de Heroine et des romans des auteures québécoises Anne Dandurand, Marie Gagnon, et Tess Fragoulis, dans le contexte, premièrement, les débats entourant l’institutionnalisation de la littérature (anglo)Québécoise et, deuxièmement, des questions pédagogiques et politiques plus larges et plus urgentes que nous pose, encore aujourd’hui, cette violence récurrente qui s’acharna, par exemple, sur la Polytechnique en 1989. Or, cette intersection de la violence meurtrière, la pratique littéraire, et la pédagogie qui en résulte se pose et s’articule, encore, par le biais d’une collection de figures de styles. En fait, à travers le roman de Scott et de l’œuvre critique qui en fait la lecture, une série de craques invite à reconnaître Heroine comme étant, ce que j’appelle, un récit de dépendance, au sein duquel se concrétise une temporalité récursive et une logique d’introjection nous permettant de mieux comprendre la violence et, par conséquent, le pouvoir d’une pratique littéraire sur laquelle, ensuite, j’appuie ma pédagogie en devenir. Jetant, finalement, un regard rétrospectif sur l’oeuvre dans son entier, la conclusion de ce projet se tourne aussi vers l’avant, c’est-à-dire, vers ce que mes lectures dites matérialistes de la littérature canadienne et québécoise contribuent à mon enseignement de la langue anglaise en Corée du Sud. C’est dans ce contexte que les propos de Jacques Rancière occasionnent un dernier questionnement quant à l’historique des débats et des structures pédagogiques en Corée, d’une part, et, de l’autre, les conclusions que cette lecture de la fiction théorique de Gail Scott nous livre.

Design And Development Of A Named Entity Based Question Answering System For Malayalam Language

This is a Named Entity Based Question Answering System for Malayalam Language. Although a vast amount of information is available today in digital form, no effective information access mechanism exists to provide humans with convenient information access. Information Retrieval and Question Answering systems are the two mechanisms available now for information access. Information systems typically return a long list of documents in response to a user’s query which are to be skimmed by the user to determine whether they contain an answer. But a Question Answering System allows the user to state his/her information need as a natural language question and receives most appropriate answer in a word or a sentence or a paragraph. This system is based on Named Entity Tagging and Question Classification. Document tagging extracts useful information from the documents which will be used in finding the answer to the question. Question Classification extracts useful information from the question to determine the type of the question and the way in which the question is to be answered. Various Machine Learning methods are used to tag the documents. Rule-Based Approach is used for Question Classification. Malayalam belongs to the Dravidian family of languages and is one of the four major languages of this family. It is one of the 22 Scheduled Languages of India with official language status in the state of Kerala. It is spoken by 40 million people. Malayalam is a morphologically rich agglutinative language and relatively of free word order. Also Malayalam has a productive morphology that allows the creation of complex words which are often highly ambiguous. Document tagging tools such as Parts-of-Speech Tagger, Phrase Chunker, Named Entity Tagger, and Compound Word Splitter are developed as a part of this research work. No such tools were available for Malayalam language. Finite State Transducer, High Order Conditional Random Field, Artificial Immunity System Principles, and Support Vector Machines are the techniques used for the design of these document preprocessing tools. This research work describes how the Named Entity is used to represent the documents. Single sentence questions are used to test the system. Overall Precision and Recall obtained are 88.5% and 85.9% respectively. This work can be extended in several directions. The coverage of non-factoid questions can be increased and also it can be extended to include open domain applications. Reference Resolution and Word Sense Disambiguation techniques are suggested as the future enhancements

Hybrid coordination of reinforcement learning-based behaviors for AUV control

This paper proposes a hybrid coordination method for behavior-based control architectures. The hybrid method takes advantages of the robustness and modularity in competitive approaches as well as optimized trajectories in cooperative ones. This paper shows the feasibility of applying this hybrid method with a 3D-navigation to an autonomous underwater vehicle (AUV). The behaviors are learnt online by means of reinforcement learning. A continuous Q-learning implemented with a feed-forward neural network is employed. Realistic simulations were carried out. The results obtained show the good performance of the hybrid method on behavior coordination as well as the convergence of the behaviors

A behavior-based scheme using reinforcement learning for autonomous underwater vehicles

This paper presents a hybrid behavior-based scheme using reinforcement learning for high-level control of autonomous underwater vehicles (AUVs). Two main features of the presented approach are hybrid behavior coordination and semi on-line neural-Q_learning (SONQL). Hybrid behavior coordination takes advantages of robustness and modularity in the competitive approach as well as efficient trajectories in the cooperative approach. SONQL, a new continuous approach of the Q_learning algorithm with a multilayer neural network is used to learn behavior state/action mapping online. Experimental results show the feasibility of the presented approach for AUVs

A Self-Scoring Exercise On APA Style, Research Language, and Referencing for Undergraduate Students

Based on examples provided by 27 graduate psychology faculty, this self-test incorporates many of the more common errors in style, language, and referencing found in student papers. Taking this self-test helps students to recognize common errors and encourages them to refer the APA Publication Manual on a regular basis. In addition, students begin to think about how to use correctly the language of psychological research. This self-test should take about 30 minutes to complete and score. It is composed of three parts: a) a mock Discussion section, where students are asked to act as editors and find the errors, p. 2 (10 minutes). b) a corrected Discussion section, where students find the errors they missed, p. 3 (5 minutes) and, c) a full description of each error with illustrations of correct usage, pp. 4-7 (15 minutes). This exercise assumes some knowledge of APA style. Thus, it is best-suited for advanced undergraduates who need to write research reports and all levels of graduate students. It may be taken at home or in class. Although the self-test is designed to be fully self-directed, instructors may wish to use it at the beginning or end of a classroom discussion on APA style. It could also be used in a pre-test-post-test fashion to evaluate students learning over the course of a term.

Self-study Language Modules Using Blackboard - Julie Watson

This is one of a series of short case studies describing how academic tutors at the University of Southampton have made use of learning technologies to support their students.

Actitudes de los directivos en torno a la adopción del e-learning como herramienta de trabajo en las empresas

El desarrollo del presente documento constituye una investigación sobre las actitudes de los directivos frente a la adopción del e-learning como herramienta de trabajo en las organizaciones de Bogotá. Para ello se realizó una encuesta a 101 directivos, tomando como base el tipo de muestreo de conveniencia; esto con el objetivo de identificar sus actitudes frente al uso del e-learning y su influencia dentro de la organización. Como resultado se obtuvo que las actitudes de los directivos influencian en el uso de herramientas e-learning, así como también en las acciones que promueven su uso y en las actitudes de los empleados; por otro lado se identificó que las creencias relacionadas con la apropiación de herramientas e-learning y los factores facilitadores del uso de estas, influencian en las actitudes de los directivos. Lo anterior, corresponde a los análisis llevados a cabo a partir de los resultados contrastados con los estudios empíricos hallados y el marco teórico desarrollado.

The acquisition of expository uses of language

Objective: This study offers a description of the kinds of linguistic aids offered by adults while giving explanations to young children about different issues. During the midst of these conversations children have several opportunities to learn, not only from objects and events, but also from the utterances used to refer to them, learning how realities are named after, and in many cases, how to participate in them. Methodology: Through the analysis of eleven minutes of interaction between young child and his maternal grandparents. Results: Adults offers young child different discursive ways for helping him to add information, organize and clarify the topic that he is talking about. Conclusions: The results allow to identify different ways that the adults use for helping young child to improve his explanations.

Occupational therapy and its relevance in social projects. relationships, learning and opportunities: collection of experiences of University of Alberta Mscot students in Bogotá, Colombia

Occupational therapists are equipped to promote wellbeing through occupation and to enable participation and meaningful engagement of people in their social and physical environments (WFOT, 2012). As such, the role of the occupational therapists is profoundly linked to the social, cultural and environmental characteristics of the contexts in which occupations take place. The central role that context plays in occupational performance creates an interesting dichotomy for the occupational therapist: on one hand, a profound understanding of cultural and social factors is required from the Occupational Therapy (OT) in order to develop a meaningful and successful collaboration with the person; on the other hand, the ability of the occupational therapists to recognize and explore the contextual factor of an occupation-person dyad transcends cultural and spatial barriers. As a result, occupational therapists are equipped to engage in international collaboration and practice, and as such face unique and enriching challenges. International fieldwork experiences have become a tool through which occupational therapists in training can develop the critical skills for understanding the impact of cultural and social factors on occupation. An OT student in an international fieldwork experience faces numerous challenges in leading a process that is both relevant and respectful to the characteristics of the local context: language, cultural perceptions of occupation and personhood, religious backgrounds, health care access, etc. These challenges stand out as ethical considerations that must be considered when navigating an international fieldwork experience (AOTA, 2009). For more than five years now, the Faculty of Rehabilitation Medicine (FRM) of the University of Alberta (UoFA) and the School of Medicine and Health Sciences at the Universidad del Rosario (UR), Bogota, Colombia, have sustained a productive and meaningful international collaboration. This collaboration includes a visit by Dr. Albert Cook, professor of the FRM and former dean, to the UR as the main guest speaker in the International Congress of Technologies for Disability Support (IBERDISCAP) in 2008. Furthermore, Dr. Cook was a speaker in the research seminar of the Assistive Technology Research Group of the Universidad del Rosario. Following Dr. Cook’s visit, Professors Liliana Álvarez and Adriana Ríos travelled to Edmonton and initiated collaboration with the FRM, resulting in the signing of an agreement between the FRM and the UR in 2009, agreement that has been maintained to this day. The main goal of this agreement is to increase academic and cultural cooperation between the UR and the UofA. Other activities have included the cooperation between Dr. Kim Adams (who has largely maintained interest and effort in supporting the capacity building of the UR rehabilitation programs in coordinating the provision of research placement opportunities for UR students at the UofA), an Assistive Technology course for clinicians and students led by Dr. Adams, and a research project that researched the use of basic cell phones to provide social interaction and health information access for people with disabilities in a low-income community in Colombia (led by Tim Barlott, OT, MSc, under the supervision of Dr. Adams). Since the beginning, the occupational therapy programs of the Universidad del Rosario and the University of Alberta have promoted this collaboration and have strived to engage in interactions that provide further development opportunities for students and staff. As part of this process, the international placement experience of UofA OT students was born under the leadership of: Claudia Rozo, OT program director at UR, placement and academic leadership of Elvis Castro and Angélica Monsalve, professors of the occupational therapy program at UR; and Dr. Lili Liu, OT department director at UofA, Cori Schmitz, Academic coordinator of clinical education at the UofA; and Tim Barlott and Liliana Álvarez leading the international and cross-cultural aspect of this collaboration.This publication summarizes and illustrates the process of international placement in community settings in Colombia, undertaken by occupational therapy students of the University of Alberta. It is our hope that this document can provide and document the ethical considerations of international fieldwork experience, the special characteristics of communities and the ways in which cultural and social competences are developed and help international students navigate the international setting. We also hope that this document will stimulate discussion among professional and academic communities about the importance and richness of international placement experiences and encourage staff and students to articulate their daily efforts with the global occupational therapy agenda.

AQA GCSE English language and literature. Foundation.

Recurso aprobado por AQA, ha sido escrito para apoyar a los estudiantes en la preparación del General Certificate of Secondary Education (GCSE) inglés lengua y literatura inglesas. Todas las unidades son totalmente compatibles con recursos digitales. Estructurado en diecisiete unidades: las siete primeras ayudarán con los exámenes, las unidades restantes con evaluaciones controladas. Incluye secciones de gramática, ortografía y puntuación.

AQA GCSE English language and literature. Higuer.

Recurso aprobado por AQA, ha sido escrito para apoyar a los estudiantes en la preparación del General Certificate of Secondary Education (GCSE) inglés lengua y literatura inglesas. Todas las unidades son totalmente compatibles con recursos digitales. Estructurado en diecisiete unidades: las siete primeras ayudarán con los exámenes, las unidades restantes con evaluaciones controladas. Incluye secciones de gramática, ortografía y puntuación.

AQA GCSE English language and literature. Teacher's resource book. Higher and foundation.

Recurso para el profesor con directrices detalladas y consejos prácticos para los estudiantes que preparan el General Certificate of Secondary Education (GCSE) AQA de lengua y literatura inglesas. Estructurado en diecisiete unidades, las siete primeras preparan los exámenes y las restantes incluyen unidades con evaluaciones controladas.