Westminster Serious Games Platform (wmin-SGP) a tool for real-time authoring of roleplay simulations for learning

The use of serious games in education and their pedagogical benefit is being widely recognized. However, effective integration of serious games in education depends on addressing two big challenges: the successful incorporation of motivation and engagement that can lead to learning; and the highly specialised skills associated with customised development to meet the required pedagogical objectives. This paper presents the Westminster Serious Games Platform (wmin-SGP) an authoring tool that allows educators/domain experts without games design and development technical skills to create bespoke roleplay simulations in three dimensional scenes featuring fully embodied virtual humans capable of verbal and non-verbal interaction with users fit for specific educational objectives. The paper presents the wmin-SGP system architecture and it evaluates its effectiveness in fulfilling its purpose via the implementation of two roleplay simulations, one for Politics and one for Law. In addition, it presents the results of two types of evaluation that address how successfully the wmin-SGP combines usability principles and game core drives based on the Octalysis gamification framework that lead to motivating games experiences. The evaluation results shows that the wmin-SGP: provides an intuitive environment and tools that support users without advanced technical skills to create in real-time bespoke roleplay simulations in advanced graphical interfaces; satisfies most of the usability principles; and provides balanced simulations based on the Octalysis framework core drives. The paper concludes with a discussion of future extension of this real time authoring tool and directions for further development of the Octalysis framework to address learning.

Building autonomous sensitive artificial listeners (Extended abstract)

This paper describes a substantial effort to build a real-time interactive multimodal dialogue system with a focus on emotional and non-verbal interaction capabilities. The work is motivated by the aim to provide technology with competences in perceiving and producing the emotional and non-verbal behaviours required to sustain a conversational dialogue. We present the Sensitive Artificial Listener (SAL) scenario as a setting which seems particularly suited for the study of emotional and non-verbal behaviour, since it requires only very limited verbal understanding on the part of the machine. This scenario allows us to concentrate on non-verbal capabilities without having to address at the same time the challenges of spoken language understanding, task modeling etc. We first summarise three prototype versions of the SAL scenario, in which the behaviour of the Sensitive Artificial Listener characters was determined by a human operator. These prototypes served the purpose of verifying the effectiveness of the SAL scenario and allowed us to collect data required for building system components for analysing and synthesising the respective behaviours. We then describe the fully autonomous integrated real-time system we created, which combines incremental analysis of user behaviour, dialogue management, and synthesis of speaker and listener behaviour of a SAL character displayed as a virtual agent. We discuss principles that should underlie the evaluation of SAL-type systems. Since the system is designed for modularity and reuse, and since it is publicly available, the SAL system has potential as a joint research tool in the affective computing research community.

Transformer les pratiques professionnelles vis-à-vis des personnes prestataires de l’aide sociale : développement participatif et évaluation d’une formation continue en cabinet dentaire

L’objectif de la présente thèse est de générer des connaissances sur les contributions possibles d’une formation continue à l’évolution des perspectives et pratiques des professionnels de la santé buccodentaire. Prônant une approche centrée sur le patient, la formation vise à sensibiliser les professionnels à la pauvreté et à encourager des pratiques qui se veulent inclusives et qui tiennent compte du contexte social des patients. L’évaluation de la formation s’inscrit dans le contexte d’une recherche-action participative de développement d’outils éducatifs et de transfert des connaissances sur la pauvreté. Cette recherche-action aspire à contribuer à la lutte contre les iniquités sociales de santé et d’accès aux soins au Québec; elle reflète une préoccupation pour une plus grande justice sociale ainsi qu’une prise de position pour une santé publique critique fondée sur une « science des solutions » (Potvin, 2013). Quatre articles scientifiques, ancrés dans une philosophie constructiviste et dans les concepts et principes de l’apprentissage transformationnel (Mezirow, 1991), constituent le cœur de cette thèse. Le premier article présente une revue critique de la littérature portant sur l’enseignement de l’approche de soins centrés sur le patient. Prenant appui sur le concept d’une « épistémologie partagée », des principes éducatifs porteurs d’une transformation de perspective à l’égard de la relation professionnel-patient ont été identifiés et analysés. Le deuxième article de thèse s’inscrit dans le cadre du développement participatif d’outils de formation sur la pauvreté et illustre le processus de co-construction d’un scénario de court-métrage social réaliste portant sur la pauvreté et l’accès aux soins. L’article décrit et apporte une réflexion, notamment sur la dimension de co-formation entre les différents acteurs des milieux académique, professionnel et citoyen qui ont constitué le collectif À l’écoute les uns des autres. Nous y découvrons la force du croisement des savoirs pour générer des prises de conscience sur soi et sur ses préjugés. Les outils développés par le collectif ont été intégrés à une formation continue axée sur la réflexion critique et l’apprentissage transformationnel, et conçue pour être livrée en cabinet dentaire privé. Les deux derniers articles de thèse présentent les résultats d’une étude de cas instrumentale évaluative centrée sur cette formation continue et visant donc à répondre à l’objectif premier de cette thèse. Le premier consiste en une analyse des transformations de perspectives et d’action au sein d’une équipe de 15 professionnels dentaires ayant participé à la formation continue sur une période de trois mois. L’article décrit, entre autres, une plus grande ouverture, chez certains participants, sur les causes structurelles de la pauvreté et une plus grande sensibilité au vécu au quotidien des personnes prestataires de l’aide sociale. L’article comprend également une exploration des effets paradoxaux dans l’apprentissage, notamment le renforcement, chez certains, de perceptions négatives à l’égard des personnes prestataires de l’aide sociale. Le quatrième article fait état de barrières idéologiques contraignant la transformation des pratiques professionnelles : 1) l’identification à l’idéologie du marché privé comme véhicule d’organisation des soins; 2) l’attachement au concept d’égalité dans les pratiques, au détriment de l’équité; 3) la prédominance du modèle biomédical, contraignant l’adoption de pratiques centrées sur la personne et 4) la catégorisation sociale des personnes prestataires de l’aide sociale. L’analyse des perceptions, mais aussi de l’expérience vécue de ces barrières démontre comment des facteurs systémiques et sociaux influent sur le rapport entre professionnel dentaire et personne prestataire de l’aide sociale. Les conséquences pour la recherche, l’éducation dentaire, le transfert des connaissances, ainsi que pour la régulation professionnelle et les politiques de santé buccodentaire, sont examinées à partir de cette perspective.

Classifying Child Maltreatment by Brain Imaging Data

Thesis (Master's)--University of Washington, 2016-08

Learning to Interpret and Generate Instructional Recipes

Thesis (Ph.D.)--University of Washington, 2016-08

A review of Parkinson’s disease cardinal and dyskinetic motor symptoms assessment methods using sensor systems

This paper is reviewing objective assessments of Parkinson’s disease(PD) motor symptoms, cardinal, and dyskinesia, using sensor systems. It surveys the manifestation of PD symptoms, sensors that were used for their detection, types of signals (measures) as well as their signal processing (data analysis) methods. A summary of this review’s finding is represented in a table including devices (sensors), measures and methods that were used in each reviewed motor symptom assessment study. In the gathered studies among sensors, accelerometers and touch screen devices are the most widely used to detect PD symptoms and among symptoms, bradykinesia and tremor were found to be mostly evaluated. In general, machine learning methods are potentially promising for this. PD is a complex disease that requires continuous monitoring and multidimensional symptom analysis. Combining existing technologies to develop new sensor platforms may assist in assessing the overall symptom profile more accurately to develop useful tools towards supporting better treatment process.

Convex Optimization Algorithms and Statistical Bounds for Learning Structured Models

Thesis (Ph.D.)--University of Washington, 2016-08

Recognition of Activities of Daily Living from Topic Model

Research in ubiquitous and pervasive technologies have made it possible to recognise activities of daily living through non-intrusive sensors. The data captured from these sensors are required to be classified using various machine learning or knowledge driven techniques to infer and recognise activities. The process of discovering the activities and activity-object patterns from the sensors tagged to objects as they are used is critical to recognising the activities. In this paper, we propose a topic model process of discovering activities and activity-object patterns from the interactions of low level state-change sensors. We also develop a recognition and segmentation algorithm to recognise activities and recognise activity boundaries. Experimental results we present validates our framework and shows it is comparable to existing approaches.

IoT Based Pain Management using Physiological Parameters

The continuous technology evaluation is benefiting our lives to a great extent. The evolution of Internet of things and deployment of wireless sensor networks is making it possible to have more connectivity between people and devices used extensively in our daily lives. Almost every discipline of daily life including health sector, transportation, agriculture etc. is benefiting from these technologies. There is a great potential of research and refinement of health sector as the current system is very often dependent on manual evaluations conducted by the clinicians. There is no automatic system for patient health monitoring and assessment which results to incomplete and less reliable heath information. Internet of things has a great potential to benefit health care applications by automated and remote assessment, monitoring and identification of diseases. Acute pain is the main cause of people visiting to hospitals. An automatic pain detection system based on internet of things with wireless devices can make the assessment and redemption significantly more efficient. The contribution of this research work is proposing pain assessment method based on physiological parameters. The physiological parameters chosen for this study are heart rate, electrocardiography, breathing rate and galvanic skin response. As a first step, the relation between these physiological parameters and acute pain experienced by the test persons is evaluated. The electrocardiography data collected from the test persons is analyzed to extract interbeat intervals. This evaluation clearly demonstrates specific patterns and trends in these parameters as a consequence of pain. This parametric behavior is then used to assess and identify the pain intensity by implementing machine learning algorithms. Support vector machines are used for classifying these parameters influenced by different pain intensities and classification results are achieved. The classification results with good accuracy rates between two and three levels of pain intensities shows clear indication of pain and the feasibility of this pain assessment method. An improved approach on the basis of this research work can be implemented by using both physiological parameters and electromyography data of facial muscles for classification.

Towards Proactive Context-aware Computing and Systems

A primary goal of context-aware systems is delivering the right information at the right place and right time to users in order to enable them to make effective decisions and improve their quality of life. There are three key requirements for achieving this goal: determining what information is relevant, personalizing it based on the users’ context (location, preferences, behavioral history etc.), and delivering it to them in a timely manner without an explicit request from them. These requirements create a paradigm that we term as “Proactive Context-aware Computing”. Most of the existing context-aware systems fulfill only a subset of these requirements. Many of these systems focus only on personalization of the requested information based on users’ current context. Moreover, they are often designed for specific domains. In addition, most of the existing systems are reactive - the users request for some information and the system delivers it to them. These systems are not proactive i.e. they cannot anticipate users’ intent and behavior and act proactively without an explicit request from them. In order to overcome these limitations, we need to conduct a deeper analysis and enhance our understanding of context-aware systems that are generic, universal, proactive and applicable to a wide variety of domains. To support this dissertation, we explore several directions. Clearly the most significant sources of information about users today are smartphones. A large amount of users’ context can be acquired through them and they can be used as an effective means to deliver information to users. In addition, social media such as Facebook, Flickr and Foursquare provide a rich and powerful platform to mine users’ interests, preferences and behavioral history. We employ the ubiquity of smartphones and the wealth of information available from social media to address the challenge of building proactive context-aware systems. We have implemented and evaluated a few approaches, including some as part of the Rover framework, to achieve the paradigm of Proactive Context-aware Computing. Rover is a context-aware research platform which has been evolving for the last 6 years. Since location is one of the most important context for users, we have developed ‘Locus’, an indoor localization, tracking and navigation system for multi-story buildings. Other important dimensions of users’ context include the activities that they are engaged in. To this end, we have developed ‘SenseMe’, a system that leverages the smartphone and its multiple sensors in order to perform multidimensional context and activity recognition for users. As part of the ‘SenseMe’ project, we also conducted an exploratory study of privacy, trust, risks and other concerns of users with smart phone based personal sensing systems and applications. To determine what information would be relevant to users’ situations, we have developed ‘TellMe’ - a system that employs a new, flexible and scalable approach based on Natural Language Processing techniques to perform bootstrapped discovery and ranking of relevant information in context-aware systems. In order to personalize the relevant information, we have also developed an algorithm and system for mining a broad range of users’ preferences from their social network profiles and activities. For recommending new information to the users based on their past behavior and context history (such as visited locations, activities and time), we have developed a recommender system and approach for performing multi-dimensional collaborative recommendations using tensor factorization. For timely delivery of personalized and relevant information, it is essential to anticipate and predict users’ behavior. To this end, we have developed a unified infrastructure, within the Rover framework, and implemented several novel approaches and algorithms that employ various contextual features and state of the art machine learning techniques for building diverse behavioral models of users. Examples of generated models include classifying users’ semantic places and mobility states, predicting their availability for accepting calls on smartphones and inferring their device charging behavior. Finally, to enable proactivity in context-aware systems, we have also developed a planning framework based on HTN planning. Together, these works provide a major push in the direction of proactive context-aware computing.

Microblogging Temporal Summarization: Filtering Important Twitter Updates for Breaking News

While news stories are an important traditional medium to broadcast and consume news, microblogging has recently emerged as a place where people can dis- cuss, disseminate, collect or report information about news. However, the massive information in the microblogosphere makes it hard for readers to keep up with these real-time updates. This is especially a problem when it comes to breaking news, where people are more eager to know “what is happening”. Therefore, this dis- sertation is intended as an exploratory effort to investigate computational methods to augment human effort when monitoring the development of breaking news on a given topic from a microblog stream by extractively summarizing the updates in a timely manner. More specifically, given an interest in a topic, either entered as a query or presented as an initial news report, a microblog temporal summarization system is proposed to filter microblog posts from a stream with three primary concerns: topical relevance, novelty, and salience. Considering the relatively high arrival rate of microblog streams, a cascade framework consisting of three stages is proposed to progressively reduce quantity of posts. For each step in the cascade, this dissertation studies methods that improve over current baselines. In the relevance filtering stage, query and document expansion techniques are applied to mitigate sparsity and vocabulary mismatch issues. The use of word embedding as a basis for filtering is also explored, using unsupervised and supervised modeling to characterize lexical and semantic similarity. In the novelty filtering stage, several statistical ways of characterizing novelty are investigated and ensemble learning techniques are used to integrate results from these diverse techniques. These results are compared with a baseline clustering approach using both standard and delay-discounted measures. In the salience filtering stage, because of the real-time prediction requirement a method of learning verb phrase usage from past relevant news reports is used in conjunction with some standard measures for characterizing writing quality. Following a Cranfield-like evaluation paradigm, this dissertation includes a se- ries of experiments to evaluate the proposed methods for each step, and for the end- to-end system. New microblog novelty and salience judgments are created, building on existing relevance judgments from the TREC Microblog track. The results point to future research directions at the intersection of social media, computational jour- nalism, information retrieval, automatic summarization, and machine learning.

Requirement Risk Level Forecast Using Bayesian Networks Classifiers

Requirement engineering is a key issue in the development of a software project. Like any other development activity it is not without risks. This work is about the empirical study of risks of requirements by applying machine learning techniques, specifically Bayesian networks classifiers. We have defined several models to predict the risk level for a given requirement using three dataset that collect metrics taken from the requirement specifications of different projects. The classification accuracy of the Bayesian models obtained is evaluated and compared using several classification performance measures. The results of the experiments show that the Bayesians networks allow obtaining valid predictors. Specifically, a tree augmented network structure shows a competitive experimental performance in all datasets. Besides, the relations established between the variables collected to determine the level of risk in a requirement, match with those set by requirement engineers. We show that Bayesian networks are valid tools for the automation of risks assessment in requirement engineering.

Interação didática em língua estrangeira: contributos de um estudo baseado na dimensão sócio-afetiva da aprendizagem colaborativa

Pretendeu-se com este projecto de investigação estudar a interação didática co-construída por alunos do ensino superior em moldes de aprendizagem colaborativa na aula de Inglês língua estrangeira, com enfoque na dimensão sócio-afetiva da aprendizagem. Na base do quadro teórico encontra-se o pressuposto de que o conhecimento é algo dinâmico e construído colaborativamente, e que é na interação didática que emergem os comportamentos verbais reveladores do Saber―Ser/Estar/Aprender dos sujeitos, nomeadamente através da coconstrução e negociação de sentidos. Subjacente portanto ao estudo está a convicção de que “o trabalho crítico sobre a interação permite entender os modos relacionais entre os sujeitos pedagógicos, as relações interpessoais que se estabelecem e articular o desenvolvimento linguístico-comunicativo com o desenvolvimento pessoal e social dos alunos” (Araújo e Sá & Andrade, 2002, p. 82). Esta investigação centra-se exclusivamente nos aprendentes, na sequência de indicações provenientes da revisão de literatura, as quais apontam para uma lacuna nas investigações efetuadas até à data, referente ao número insuficiente de estudos dedicado à interação didática interpares, já que a grande maioria dos estudos se dirige para a relação professor-aluno (cf. Baker & Clark, 2010; Hellermann, 2008; O'Donnell & King, 2014). Por outro lado, o estado da arte relativo às investigações focalizadas na interacção entre aprendentes permite concluir que a melhor forma de exponenciar esta interação será através da aprendizagem colaborativa (cf. Johnson, Johnson, & Stanne, 2000; Slavin, 2014; Smith, Sheppard, Johnson, & Johnson, 2005). Circunscrevemos o nosso estudo à dimensão sócio-afetiva das estratégias de aprendizagem que ocorrem nessas interações, já que a revisão da literatura fez evidenciar a correlação positiva da aprendizagem colaborativa com as dimensões social e afetiva da interação (cf. Byun et al., 2012): por um lado, a dinâmica de grupo numa aula de língua estrangeira contribui grandemente para uma perceção afetiva favorável do processo de aprendizagem, incrementando igualmente a quantidade e a qualidade da interação (cf. Felder & Brent, 2007); por outro lado, a existência, na aprendizagem colaborativa, dos fenómenos de correção dos pares e de negociação de sentidos estimula a emergência da dimensão sócio-afetiva da aprendizagem de uma língua estrangeira (cf. Campbell & Kryszewska,1992; Hadfield, 1992; Macaro, 2005). É neste enquadramento teórico que se situam as nossas questões e objetivos de investigação. Em primeiro lugar procurámos saber como é que um grupo de aprendentes de Inglês língua estrangeira do ensino superior perceciona as estratégias de aprendizagem sócio-afetivas que utiliza em contexto de sala de aula, no âmbito da aprendizagem colaborativa e nãocolaborativa. Procurámos igualmente indagar quais as estratégias de aprendizagem sócio-afetivas passíveis de serem identificadas neste grupo de aprendentes, em situação de interação didática, em contexto de aprendizagem colaborativa. Finalmente, questionámo-nos sobre a relação entre a perceção que estes alunos possuem das estratégias de aprendizagem sócio-afetivas que empregam nas aulas de Inglês língua estrangeira e as estratégias sócio-afetivas identificadas em situação de interação didática, em contexto de aprendizagem colaborativa. No que respeita à componente empírica do nosso projecto, norteámo-nos pelo paradigma qualitativo, no contexto do qual efetuámos um estudo de caso, a partir de uma abordagem tendencialmente etnográfica, por tal nos parecer mais consentâneo, quer com a nossa problemática, quer com a natureza complexa dos processos interativos em sala de aula. A metodologia quantitativa está igualmente presente, pretendendo-se que tenha adicionado mais dimensionalidade à investigação, contribuindo para a triangulação dos resultados. A investigação, que se desenvolveu ao longo de 18 semanas, teve a sala de aula como local privilegiado para obter grande parte da informação. Os participantes do estudo de caso foram 24 alunos do primeiro ano de uma turma de Inglês Língua Estrangeira de um Instituto Politécnico, sendo a investigadora a docente da disciplina. A informação proveio primordialmente de um corpus de interações didáticas colaborativas audiogravadas e posteriormente transcritas, constituído por 8 sessões com uma duração aproximada de uma hora, e das respostas a um inquérito por questionário − construído a partir da taxonomia de Oxford (1990) − relativo à dimensão sócio-afetiva das estratégias de aprendizagem do Inglês língua estrangeira. O corpus gravado e transcrito foi analisado através da categorização por indicadores, com o objetivo de se detetarem as marcas sócio-afetivas das estratégias de aprendizagem mobilizadas pelos alunos. As respostas ao questionário foram tratadas quantitativamente numa primeira fase, e os resultados foram posteriormente triangulados com os provenientes da análise do corpus de interações. Este estudo permitiu: i) elencar as estratégias de aprendizagem que os aprendentes referem utilizar em situação de aprendizagem colaborativa e não colaborativa, ii) detetar quais destas estratégias são efetivamente utilizadas na aprendizagem colaborativa, iii) e concluir que existe, na maioria dos casos, um desfasamento entre o autoconceito do aluno relativamente ao seu perfil de aprendente de línguas estrangeiras, mais concretamente às dimensões afetiva e social das estratégias de aprendizagem que mobiliza, e a forma como este aprendente recorre a estas mesma estratégias na sala de aula. Concluímos igualmente que, em termos globais, existem diferenças, por vezes significativas, entre as representações que os sujeitos possuem da aprendizagem colaborativa e aquelas que detêm acerca da aprendizagem não colaborativa.

Tile-Based Two-Dimensional Phase Unwrapping for Digital Holography Using a Modular Framework

A variety of physical and biomedical imaging techniques, such as digital holography, interferometric synthetic aperture radar (InSAR), or magnetic resonance imaging (MRI) enable measurement of the phase of a physical quantity additionally to its amplitude. However, the phase can commonly only be measured modulo 2π, as a so called wrapped phase map. Phase unwrapping is the process of obtaining the underlying physical phase map from the wrapped phase. Tile-based phase unwrapping algorithms operate by first tessellating the phase map, then unwrapping individual tiles, and finally merging them to a continuous phase map. They can be implemented computationally efficiently and are robust to noise. However, they are prone to failure in the presence of phase residues or erroneous unwraps of single tiles. We tried to overcome these shortcomings by creating novel tile unwrapping and merging algorithms as well as creating a framework that allows to combine them in modular fashion. To increase the robustness of the tile unwrapping step, we implemented a model-based algorithm that makes efficient use of linear algebra to unwrap individual tiles. Furthermore, we adapted an established pixel-based unwrapping algorithm to create a quality guided tile merger. These original algorithms as well as previously existing ones were implemented in a modular phase unwrapping C++ framework. By examining different combinations of unwrapping and merging algorithms we compared our method to existing approaches. We could show that the appropriate choice of unwrapping and merging algorithms can significantly improve the unwrapped result in the presence of phase residues and noise. Beyond that, our modular framework allows for efficient design and test of new tile-based phase unwrapping algorithms. The software developed in this study is freely available.

Applied web traffic analysis for numerical encoding of SQL Injection attack features.

SQL Injection Attack (SQLIA) remains a technique used by a computer network intruder to pilfer an organisation’s confidential data. This is done by an intruder re-crafting web form’s input and query strings used in web requests with malicious intent to compromise the security of an organisation’s confidential data stored at the back-end database. The database is the most valuable data source, and thus, intruders are unrelenting in constantly evolving new techniques to bypass the signature’s solutions currently provided in Web Application Firewalls (WAF) to mitigate SQLIA. There is therefore a need for an automated scalable methodology in the pre-processing of SQLIA features fit for a supervised learning model. However, obtaining a ready-made scalable dataset that is feature engineered with numerical attributes dataset items to train Artificial Neural Network (ANN) and Machine Leaning (ML) models is a known issue in applying artificial intelligence to effectively address ever evolving novel SQLIA signatures. This proposed approach applies numerical attributes encoding ontology to encode features (both legitimate web requests and SQLIA) to numerical data items as to extract scalable dataset for input to a supervised learning model in moving towards a ML SQLIA detection and prevention model. In numerical attributes encoding of features, the proposed model explores a hybrid of static and dynamic pattern matching by implementing a Non-Deterministic Finite Automaton (NFA). This combined with proxy and SQL parser Application Programming Interface (API) to intercept and parse web requests in transition to the back-end database. In developing a solution to address SQLIA, this model allows processed web requests at the proxy deemed to contain injected query string to be excluded from reaching the target back-end database. This paper is intended for evaluating the performance metrics of a dataset obtained by numerical encoding of features ontology in Microsoft Azure Machine Learning (MAML) studio using Two-Class Support Vector Machines (TCSVM) binary classifier. This methodology then forms the subject of the empirical evaluation.