Content-aware compression for big textual data analysis

A substantial amount of information on the Internet is present in the form of text. The value of this semi-structured and unstructured data has been widely acknowledged, with consequent scientific and commercial exploitation. The ever-increasing data production, however, pushes data analytic platforms to their limit. This thesis proposes techniques for more efficient textual big data analysis suitable for the Hadoop analytic platform. This research explores the direct processing of compressed textual data. The focus is on developing novel compression methods with a number of desirable properties to support text-based big data analysis in distributed environments. The novel contributions of this work include the following. Firstly, a Content-aware Partial Compression (CaPC) scheme is developed. CaPC makes a distinction between informational and functional content in which only the informational content is compressed. Thus, the compressed data is made transparent to existing software libraries which often rely on functional content to work. Secondly, a context-free bit-oriented compression scheme (Approximated Huffman Compression) based on the Huffman algorithm is developed. This uses a hybrid data structure that allows pattern searching in compressed data in linear time. Thirdly, several modern compression schemes have been extended so that the compressed data can be safely split with respect to logical data records in distributed file systems. Furthermore, an innovative two layer compression architecture is used, in which each compression layer is appropriate for the corresponding stage of data processing. Peripheral libraries are developed that seamlessly link the proposed compression schemes to existing analytic platforms and computational frameworks, and also make the use of the compressed data transparent to developers. The compression schemes have been evaluated for a number of standard MapReduce analysis tasks using a collection of real-world datasets. In comparison with existing solutions, they have shown substantial improvement in performance and significant reduction in system resource requirements.

Reviewing mHealth in developing countries: A stakeholder perspective

Infrastructural deficiencies, limited access to medicare, and shortage of health care workers are just a few of the barriers to health care in developing countries. As a consequence, the burden of disease and its impact on the livelihoods and the economic productivity of people are staggering. mHealth has been extolled as one possible solution to overcoming these challenges, yet discussion of mHealth systems is often limited to specific tasks and user groups. To address this, we adopt a stakeholder perspective and analyze existing research on the mHealth process in developing countries. Specifically, we focus on three key stakeholder groups, i.e. healthcare workers, patients, and system developers. We perform an in-depth analysis of 60 peer-reviewed studies to determine the extent to which different mHealth stakeholder interactions are researched, and to identify high-level themes emerging within these interactions. This analysis illustrates two key gaps in existing mHealth research. First, while interactions involving healthcare workers and/or patients have received significant attention, relatively little research has looked at the role of patient-to-patient interactions. Second, the interactions between system developers and the other stakeholder groups are strikingly under-represented. We conclude by calling for more mHealth research that explicitly addresses these stakeholder interactions.

An Exploration of the challenges associated with software logging in large systems

Over the past few years, logging has evolved from from simple printf statements to more complex and widely used logging libraries. Today logging information is used to support various development activities such as fixing bugs, analyzing the results of load tests, monitoring performance and transferring knowledge. Recent research has examined how to improve logging practices by informing developers what to log and where to log. Furthermore, the strong dependence on logging has led to the development of logging libraries that have reduced the intricacies of logging, which has resulted in an abundance of log information. Two recent challenges have emerged as modern software systems start to treat logging as a core aspect of their software. In particular, 1) infrastructural challenges have emerged due to the plethora of logging libraries available today and 2) processing challenges have emerged due to the large number of log processing tools that ingest logs and produce useful information from them. In this thesis, we explore these two challenges. We first explore the infrastructural challenges that arise due to the plethora of logging libraries available today. As systems evolve, their logging infrastructure has to evolve (commonly this is done by migrating to new logging libraries). We explore logging library migrations within Apache Software Foundation (ASF) projects. We i find that close to 14% of the pro jects within the ASF migrate their logging libraries at least once. For processing challenges, we explore the different factors which can affect the likelihood of a logging statement changing in the future in four open source systems namely ActiveMQ, Camel, Cloudstack and Liferay. Such changes are likely to negatively impact the log processing tools that must be updated to accommodate such changes. We find that 20%-45% of the logging statements within the four systems are changed at least once. We construct random forest classifiers and Cox models to determine the likelihood of both just-introduced and long-lived logging statements changing in the future. We find that file ownership, developer experience, log density and SLOC are important factors in determining the stability of logging statements.

A Minor Change?: A Case Study of Carleton Place's Integration of Minor Variance Procedures into Ontario's Development Permit System

The Development Permit System has been introduce with minimal directives for establishing a decision making process. This is in opposition to the long established process for minor variances and suggests that the Development Permit System does not necessarily incorporate all of Ontario’s fundamental planning principles. From this concept, the study aimed to identify how minor variances are incorporated into the Development Permit System. In order to examine this topic, the research was based around the following research questions: • How are ‘minor variance’ applications processed within the DPS? • To what extent do the four tests of a minor variance influence the outcomes of lower level applications in the DPS approval process? A case study approach was used for this research. The single-case design employed both qualitative and quantitative research methods including a review of academic literature, court cases, and official documents, as well as a content analysis of Class 1, 1A, and 2 Development Permit application files from the Town of Carleton Place that were decided between 2011 and 2015. Upon the completion of the content analysis, it was found that minor variance issues were most commonly assigned to Class 1 applications. Planning staff generally met approval timelines and embraced their delegated approval authority, readily attaching conditions to applications in order to mitigate off-site impacts. While staff met the regulatory requirements of the DPS, ‘minor variance’ applications were largely decided on impact alone, demonstrating that the principles established by the four tests, the defining quality of the minor variance approval process, had not transferred to the Development Permit System. Alternatively, there was some evidence that the development community has not fully adjusted to the requirements of the new approvals process, as some applications were supported using a rationale containing the four tests. Subsequently, a set of four recommendations were offered which reflect the main themes established by the findings. The first two recommendations are directed towards the Province, the third to municipalities and the fourth to developers and planning consultants: 1) Amend Ontario Regulation 608/06 so that provisions under Section 4(3)(e) fall under Section 4(2). 2) Change the rhetoric from “combining elements of minor variances” to “replacing minor variances”. 3) Establish clear evaluation criteria. 4) Understand the evaluative criteria of the municipality in which you are working.

Adding Run-Time Monitoring to UML-RT by Modifying the Papyrus-RT Code Generator

In Model-Driven Engineering (MDE), the developer creates a model using a language such as Unified Modeling Language (UML) or UML for Real-Time (UML-RT) and uses tools such as Papyrus or Papyrus-RT that generate code for them based on the model they create. Tracing allows developers to get insights such as which events occur and timing information into their own application as it runs. We try to add monitoring capabilities using Linux Trace Toolkit: next generation (LTTng) to models created in UML-RT using Papyrus-RT. The implementation requires changing the code generator to add tracing statements for the events that the user wants to monitor to the generated code. We also change the makefile to automate the build process and we create an Extensible Markup Language (XML) file that allows developers to view their traces visually using Trace Compass, an Eclipse-based trace viewing tool. Finally, we validate our results using three models we create and trace.

Machine translation quality in an audiovisual context

The volume of Audiovisual Translation (AVT) is increasing to meet the rising demand for data that needs to be accessible around the world. Machine Translation (MT) is one of the most innovative technologies to be deployed in the field of translation, but it is still too early to predict how it can support the creativity and productivity of professional translators in the future. Currently, MT is more widely used in (non-AV) text translation than in AVT. In this article, we discuss MT technology and demonstrate why its use in AVT scenarios is particularly challenging. We also present some potentially useful methods and tools for measuring MT quality that have been developed primarily for text translation. The ultimate objective is to bridge the gap between the tech-savvy AVT community, on the one hand, and researchers and developers in the field of high-quality MT, on the other.

The Psychometric Properties of the Developmental Reading Assessment

ABSTRACT The purpose of this study was to examine the technical adequacy of the Developmental Reading Assessment (Beaver & Carter, 2004). Internal consistency analysis, factor analysis, and linear regression analyses were used to test whether the DRA is a statistically reliable measuring of reading comprehension for Grades 7 and 8 students. Correlational analyses, decision consistency analyses, and a focus group of experienced Intermediate (Grades 7 and 8) teachers examined whether there is evidence that the results from the DRA provide valid interpretations regarding students’ reading skills and comprehension. Results indicated that, as currently scored, internal consistency is low and skewness of distribution is high. Factor analyses did not replicate those cited by the DRA developers to prove construct validity. Two-way contingency analyses determined that decision consistency did not vary greatly between the DRA, EQAO, scores and report card marks. Views expressed during the focus group echoed many of the challenges to validity found in the statistical analysis. The teachers found that the DRA was somewhat useful, as there were limited alternative reading assessments available for the classroom, but did not endorse it strongly. The study found little evidence that the DRA provides valid interpretations regarding Intermediate students’ reading skills. Indicated changes to the structure and administration procedures of the DRA may ameliorate some of these issues.

Extending Science Gateway Frameworks to Support Big Data Applications in the Cloud

Cloud computing offers massive scalability and elasticity required by many scien-tific and commercial applications. Combining the computational and data handling capabilities of clouds with parallel processing also has the potential to tackle Big Data problems efficiently. Science gateway frameworks and workflow systems enable application developers to implement complex applications and make these available for end-users via simple graphical user interfaces. The integration of such frameworks with Big Data processing tools on the cloud opens new oppor-tunities for application developers. This paper investigates how workflow sys-tems and science gateways can be extended with Big Data processing capabilities. A generic approach based on infrastructure aware workflows is suggested and a proof of concept is implemented based on the WS-PGRADE/gUSE science gateway framework and its integration with the Hadoop parallel data processing solution based on the MapReduce paradigm in the cloud. The provided analysis demonstrates that the methods described to integrate Big Data processing with workflows and science gateways work well in different cloud infrastructures and application scenarios, and can be used to create massively parallel applications for scientific analysis of Big Data.

Disability in the Digital Age: Reconfiguring Access, Inclusion and Equality

There is an abundance of research that examines disability and technology in the context of computers and the Internet, however few have examined disability and mobile devices. Also largely absent from existing literature are the voices of disabled people themselves. This dissertation draws upon science and technology studies (STS) and disability studies to address these gaps by conducting in-depth qualitative research that examines disabled people’s experiences using smartphones and tablets. At its core, this dissertation aims to provide insight on the following: 1) an understanding of how disability is perceived in the digital age and the subjective meanings of access, inclusion and equality; 2) the ways in which mobile devices impact the lived experience of disability; and 3) how perspectives in disability studies and STS can be applied to understand the relationship between the body, disability and technology. The empirical contribution of this research draws from participant diaries and interviews with disabled people, as well as from open-ended questionnaires completed by mobile app developers. The concept of ‘subjectivities of disability’ is introduced to refer to the uniquely personal and individual experience of disability. Findings reveal that mobile device use amongst disabled people redefines their subjectivities of disability through socio-technical interactions whereby disabled people use their devices in ways that are integrated into their everyday lives and positively shapes how they view themselves in relation to their experience of disability. The responses from app developers reveal that there is a place for disability in the mobile market and that disabled people play a key role in making apps accessible. The data suggests that mobile devices facilitate access, inclusion and equality by integrating the body in ways that recognize and accommodate diversity. The results furthermore make it clear that the interaction between disabled people and mobile devices takes on an embodied and social characteristic. This research concludes that both on an individual level and collectively, disabled people are engaging with digital artifacts in ways that promote agency and independence as well as reshaping how disability is experienced and perceived in the digital age.

Industrial land development and manufacturing deconcentration in Greater Jakarta

Industrial land development has become a key feature of urbanization in Greater Jakarta, one of the largest metropolitan areas in Southeast Asia. Following Suharto’s marketoriented policy measures in the late 1980s, private developers have dominated the land development projects in Greater Jakarta. The article investigates the extent to which these private industrial centers have effectively reduced the domination of Jakarta in shaping the entire metropolitan structure. The analysis indicates that major suburban industrial centers have captured most of the manufacturing employment that has dispersed from Jakarta. The industrial centers have now increasingly specialized and diversified. It is likely that a polycentric metropolitan structure will emerge in the future.

IMPROVING THE PERFORMANCE OF DATABASE-CENTRIC APPLICATIONS THROUGH PROGRAM ANALYSIS

Modern software applications are becoming more dependent on database management systems (DBMSs). DBMSs are usually used as black boxes by software developers. For example, Object-Relational Mapping (ORM) is one of the most popular database abstraction approaches that developers use nowadays. Using ORM, objects in Object-Oriented languages are mapped to records in the database, and object manipulations are automatically translated to SQL queries. As a result of such conceptual abstraction, developers do not need deep knowledge of databases; however, all too often this abstraction leads to inefficient and incorrect database access code. Thus, this thesis proposes a series of approaches to improve the performance of database-centric software applications that are implemented using ORM. Our approaches focus on troubleshooting and detecting inefficient (i.e., performance problems) database accesses in the source code, and we rank the detected problems based on their severity. We first conduct an empirical study on the maintenance of ORM code in both open source and industrial applications. We find that ORM performance-related configurations are rarely tuned in practice, and there is a need for tools that can help improve/tune the performance of ORM-based applications. Thus, we propose approaches along two dimensions to help developers improve the performance of ORM-based applications: 1) helping developers write more performant ORM code; and 2) helping developers configure ORM configurations. To provide tooling support to developers, we first propose static analysis approaches to detect performance anti-patterns in the source code. We automatically rank the detected anti-pattern instances according to their performance impacts. Our study finds that by resolving the detected anti-patterns, the application performance can be improved by 34% on average. We then discuss our experience and lessons learned when integrating our anti-pattern detection tool into industrial practice. We hope our experience can help improve the industrial adoption of future research tools. However, as static analysis approaches are prone to false positives and lack runtime information, we also propose dynamic analysis approaches to further help developers improve the performance of their database access code. We propose automated approaches to detect redundant data access anti-patterns in the database access code, and our study finds that resolving such redundant data access anti-patterns can improve application performance by an average of 17%. Finally, we propose an automated approach to tune performance-related ORM configurations using both static and dynamic analysis. Our study shows that our approach can help improve application throughput by 27--138%. Through our case studies on real-world applications, we show that all of our proposed approaches can provide valuable support to developers and help improve application performance significantly.

La creación de valor en el museo y la sociomuseología

Los museos tienen normalmente mucha dificultad en justificar su existencia y en demostrar su valor real y su contribución al desarrollo de las comunidades a las que sirven. El coste del mantenimiento de un museo, después de inaugurado, nunca parece estar justificado para las tutelas y financiadores que lo promovieron. El museo, grande o pequeño, puede ser un elemento esencial en el desarrollo cultural del conjunto social, pero necesita tener una actividad que lo justifique y que su labor sea reconocida. Para contribuir con eficacia debe compartir con la comunidad su misión y sus actividades y para probar su valor debe tener sistemas de evaluación que permitan verificar si su labor de investigación y acción sobre el patrimonio, de promoción de la cultura y la ciudadanía y de colaboración con escuelas y asociaciones, reduce el fracaso escolar, aumenta la participación en la vida y cultura o contribuye a la cohesión social y a la formación de ciudadanos más responsables y solidarios. La Sociomuseología estudia estos campos de la actividad del museo, acompaña experiencias y propone soluciones a estas dificultades.

D3.5 – First Storytelling Framework

This document presents the first release of the project’s storytelling framework, which is composed by two assets. The purpose of this framework is to facilitate the use of interactive storytelling for the development of applied games. More precisely, the framework is meant to aid developers in the creation of game scenarios where both players and autonomous characters are playing an active role in a narrative that unfolds according to their actions. The document describes the current state for the assets that are part of this framework, also providing links to the source code of the assets as well as associated demonstrations and documentation. The primary audience for the contents of this deliverable are the game developers that will use the proposed framework in their development process. The information about the specific RAGE use cases that are using the framework is written in Deliverable 4.2.

D3.3 – First Social Gamification Assets

This deliverable is software, as such this document is abridged to be as succinct as possible, the extended descriptions and detailed documentation for the software are online. The document consists of two parts, part one describes the first bundle of social gamification assets developed in WP3, part two presents mock-ups of the RAGE ecosystem gamification. In addition to the software outline, included in part one is a short market analysis of existing gamification solutions, outline rationale for combining the three social gamification assets into one unified asset, and the branding exercise to make the assets more developer friendly.Online links to the source code, binaries, demo and documentation for the assets are provided. The combined assets offer game developers as well as a wide range of software developers the opportunity to readily enhance existing games or digital platforms with multiplayer gamification functionalities, catering for both competitive and cooperative game dynamics. The solution consist of a flexible client-server solution which can run either as a cloud-based service, serving many games or have specific instances for individual games as necessary.

D3.1 – First Bundle of Core Social Agency Assets

This deliverable presents and describes the first delivery of assets that are part of the core social agency bundle. In total, the bundle includes 16 assets, divided into 4 main categories. Each category is related to a type of challenge that developers of applied games are typically faced with and the aim of the included assets is to provide solutions to those challenges. The main goal of this document is to provide the reader with a description for each included asset, accompanied by links to their source code, distributable versions, demonstrations and documentation. A short discussion of what are the future steps for each asset is also given. The primary audience for the contents of this deliverable are the game developers, both inside and outside of the project, which can use this document as an official list of the current social agency assets and their associated resources. Note that the information about which RAGE use cases are using which of these assets is described in Deliverable 4.2.