Data analytics in the cloud with flexible mapreduced workflows

Data analytic applications are characterized by large data sets that are subject to a series of processing phases. Some of these phases are executed sequentially but others can be executed concurrently or in parallel on clusters, grids or clouds. The MapReduce programming model has been applied to process large data sets in cluster and cloud environments. For developing an application using MapReduce there is a need to install/configure/access specific frameworks such as Apache Hadoop or Elastic MapReduce in Amazon Cloud. It would be desirable to provide more flexibility in adjusting such configurations according to the application characteristics. Furthermore the composition of the multiple phases of a data analytic application requires the specification of all the phases and their orchestration. The original MapReduce model and environment lacks flexible support for such configuration and composition. Recognizing that scientific workflows have been successfully applied to modeling complex applications, this paper describes our experiments on implementing MapReduce as subworkflows in the AWARD framework (Autonomic Workflow Activities Reconfigurable and Dynamic). A text mining data analytic application is modeled as a complex workflow with multiple phases, where individual workflow nodes support MapReduce computations. As in typical MapReduce environments, the end user only needs to define the application algorithms for input data processing and for the map and reduce functions. In the paper we present experimental results when using the AWARD framework to execute MapReduce workflows deployed over multiple Amazon EC2 (Elastic Compute Cloud) instances.

Agile modeling data warehouse development

Most of the traditional software and database development approaches tend to be serial, not evolutionary and certainly not agile, especially on data-oriented aspects. Most of the more commonly used methodologies are strict, meaning they’re composed by several stages each with very specific associated tasks. A clear example is the Rational Unified Process (RUP), divided into Business Modeling, Requirements, Analysis & Design, Implementation, Testing and Deployment. But what happens when the needs of a well design and structured plan, meet the reality of a small starting company that aims to build an entire user experience solution. Here resource control and time productivity is vital, requirements are in constant change, and so is the product itself. In order to succeed in this environment a highly collaborative and evolutionary development approach is mandatory. The implications of constant changing requirements imply an iterative development process. Project focus is on Data Warehouse development and business modeling. This area is usually a tricky one. Business knowledge is part of the enterprise, how they work, their goals, what is relevant for analyses are internal business processes. Throughout this document it will be explained why Agile Modeling development was chosen. How an iterative and evolutionary methodology, allowed for reasonable planning and documentation while permitting development flexibility, from idea to product. More importantly how it was applied on the development of a Retail Focused Data Warehouse. A productized Data Warehouse built on the knowledge of not one but several client needs. One that aims not just to store usual business areas but create an innovative sets of business metrics by joining them with store environment analysis, converting Business Intelligence into Actionable Business Intelligence.

Bridging the gap between closed and open data. System proposal for the Portuguese Legislation

Esta dissertação apresenta uma proposta de sistema capaz de preencher a lacuna entre documentos legislativos em formato PDF e documentos legislativos em formato aberto. O objetivo principal é mapear o conhecimento presente nesses documentos de maneira a representar essa coleção como informação interligada. O sistema é composto por vários componentes responsáveis pela execução de três fases propostas: extração de dados, organização de conhecimento, acesso à informação. A primeira fase propõe uma abordagem à extração de estrutura, texto e entidades de documentos PDF de maneira a obter a informação desejada, de acordo com a parametrização do utilizador. Esta abordagem usa dois métodos de extração diferentes, de acordo com as duas fases de processamento de documentos – análise de documento e compreensão de documento. O critério utilizado para agrupar objetos de texto é a fonte usada nos objetos de texto de acordo com a sua definição no código de fonte (Content Stream) do PDF. A abordagem está dividida em três partes: análise de documento, compreensão de documento e conjunção. A primeira parte da abordagem trata da extração de segmentos de texto, adotando uma abordagem geométrica. O resultado é uma lista de linhas do texto do documento; a segunda parte trata de agrupar os objetos de texto de acordo com o critério estipulado, produzindo um documento XML com o resultado dessa extração; a terceira e última fase junta os resultados das duas fases anteriores e aplica regras estruturais e lógicas no sentido de obter o documento XML final. A segunda fase propõe uma ontologia no domínio legal capaz de organizar a informação extraída pelo processo de extração da primeira fase. Também é responsável pelo processo de indexação do texto dos documentos. A ontologia proposta apresenta três características: pequena, interoperável e partilhável. A primeira característica está relacionada com o facto da ontologia não estar focada na descrição pormenorizada dos conceitos presentes, propondo uma descrição mais abstrata das entidades presentes; a segunda característica é incorporada devido à necessidade de interoperabilidade com outras ontologias do domínio legal, mas também com as ontologias padrão que são utilizadas geralmente; a terceira característica é definida no sentido de permitir que o conhecimento traduzido, segundo a ontologia proposta, seja independente de vários fatores, tais como o país, a língua ou a jurisdição. A terceira fase corresponde a uma resposta à questão do acesso e reutilização do conhecimento por utilizadores externos ao sistema através do desenvolvimento dum Web Service. Este componente permite o acesso à informação através da disponibilização de um grupo de recursos disponíveis a atores externos que desejem aceder à informação. O Web Service desenvolvido utiliza a arquitetura REST. Uma aplicação móvel Android também foi desenvolvida de maneira a providenciar visualizações dos pedidos de informação. O resultado final é então o desenvolvimento de um sistema capaz de transformar coleções de documentos em formato PDF para coleções em formato aberto de maneira a permitir o acesso e reutilização por outros utilizadores. Este sistema responde diretamente às questões da comunidade de dados abertos e de Governos, que possuem muitas coleções deste tipo, para as quais não existe a capacidade de raciocinar sobre a informação contida, e transformá-la em dados que os cidadãos e os profissionais possam visualizar e utilizar.

User friendly knowledge acquisition system for medical devices actuation

Dissertação para obtenção do Grau de Mestre em Engenharia Biomédica

User Profiling and Knowledge Extraction For Tourism

O sector do turismo é uma área francamente em crescimento em Portugal e que tem desenvolvido a sua divulgação e estratégia de marketing. Contudo, apenas se prende com indicadores de desempenho e de oferta instalada (número de quartos, hotéis, voos, estadias), deixando os indicadores estatísticos em segundo plano. De acordo com o “ Travel & tourism Competitiveness Report 2013”, do World Economic Forum, classifica Portugal em 72º lugar no que respeita à qualidade e cobertura da informação estatística, disponível para o sector do Turismo. Refira-se que Espanha ocupa o 3º lugar. Uma estratégia de mercado, sem base analítica, que sustente um quadro de orientações específico e objetivo, com relevante conhecimento dos mercados alvo, dificilmente é compreensível ou até mesmo materializável. A implementação de uma estrutura de Business Intelligence que permita a realização de um levantamento e tratamento de dados que possibilite relacionar e sustentar os resultados obtidos no sector do turismo revela-se fundamental e crucial, para que sejam criadas estratégias de mercado. Essas estratégias são realizadas a partir da informação dos turistas que nos visitam, e dos potenciais turistas, para que possam ser cativados no futuro. A análise das características e dos padrões comportamentais dos turistas permite definir perfis distintos e assim detetar as tendências de mercado, de forma a promover a oferta dos produtos e serviços mais adequados. O conhecimento obtido permite, por um lado criar e disponibilizar os produtos mais atrativos para oferecer aos turistas e por outro informá-los, de uma forma direcionada, da existência desses produtos. Assim, a associação de uma recomendação personalizada que, com base no conhecimento de perfis do turista proceda ao aconselhamento dos melhores produtos, revela-se como uma ferramenta essencial na captação e expansão de mercado.

Information flow analysis using data-dependent logical propositions

Dissertação para obtenção do Grau de Mestre em Engenharia Informática

Participatory mapping in the design process of a spatial data infrastructure SDI: a case study in the Biosphere Reserve Rio Platano (Honduras)

Dissertation submitted in partial fulfillment of the requirements for the Degree of Master of Science in Geospatial Technologies.

TSKY: a dependable middleware solution for data privacy using public storage clouds

Dissertação para obtenção do Grau de Mestre em Engenharia Informática

Combining WLAN fingerprint-based localization with sensor data for indoor navigation using mobile devices

This project proposes an approach for supporting Indoor Navigation Systems using Pedestrian Dead Reckoning-based methods and by analyzing motion sensor data available in most modern smartphones. Processes suggested in this investigation are able to calculate the distance traveled by a user while he or she is walking. WLAN fingerprint- based navigation systems benefit from the processes followed in this research and results achieved to reduce its workload and improve its positioning estimations.

A DSL for querying building data streams of energy, eeather and occupation data

The superfluous consumption of energy is faced by the modern society as a Socio-Economical and Environmental problem of the present days. This situation is worsening given that it is becoming clear that the tendency is to increase energy price every year. It is also noticeable that people, not necessarily proficient in technology, are not able to know where savings can be achieved, due to the absence of accessible awareness mechanisms. One of the home user concerns is to balance the need of reducing energy consumption, while producing the same activity with all the comfort and work efficiency. The common techniques to reduce the consumption are to use a less wasteful equipment, altering the equipment program to a more economical one or disconnecting appliances that are not necessary at the moment. However, there is no direct feedback from this performed actions, which leads to the situation where the user is not aware of the influence that these techniques have in the electrical bill. With the intension to give some control over the home consumption, Energy Management Systems (EMS) were developed. These systems allow the access to the consumption information and help understanding the energy waste. However, some studies have proven that these systems have a clear mismatch between the information that is presented and the one the user finds useful for his daily life, leading to demotivation of use. In order to create a solution more oriented towards the user’s demands, a specially tailored language (DSL) was implemented. This solution allows the user to acquire the information he considers useful, through the construction of questions about his energy consumption. The development of this language, following the Model Driven Development (MDD) approach, took into consideration the ideas of facility managers and home users in the phases of design and validation. These opinions were gathered through meetings with experts and a survey, which was conducted to the purpose of collecting statistics about what home users want to know.

Impact of mobile app user acquisition on managerial decisions: Evidence from empirical experiment

In this research we conducted a mixed research, using qualitative and quantitative analysis to study the relationship and impact between mobile advertisement and mobile app user acquisition and the conclusions companies can derive from it. Data was gathered from management of mobile advertisement campaigns of a portfolio of three different mobile apps. We found that a number of implications can be extracted from this intersection, namely to product development, internationalisation and management of marketing budget. We propose further research on alternative app users sources, impact of revenue on apps and exploitation of product segments: wearable technology and Internet of Things.

Who uses NHS saúde 24 hotline? Has the user changed over time?

There has been an increase in the use of telephone-based services and internet throughout the years and, therefore, the Saúde 24 Hotline has become an important service in Portugal. This service aims to screen, counsel and refer the patient in order to avoid unnecessary visits to health institutions and also to indicate the most appropriate resource according to the illness. This work has two different questions: the first one examines the determinants of satisfaction that have more influence on the overall satisfaction of the Saúde 24 Hotline users. The second one aims to analyze if the confidence level of the users is increasing over time, measured by following the recommendation. The first study was conducted on a random sample collected from June to October 2014, which was taken from the User Satisfaction Survey. The second approach includes data from January 2008 to December 2014 from the Clinical Data Base of all users who have called the Hotline. Findings suggest that the majority of users are very satisfied with the service and the variables with more impact on the overall satisfaction are commitment and availability from the nurse, adequacy of call duration and quick identification of the problem. The survey indicates that 94% of respondents follow the recommendation and on average people have called the hotline 3 times in the previous year. The results from the Clinical Database show that people who were recommended to go to the emergency room are more likely to follow the advice than the people who were recommended to book routine appointments

Contribution of Mental Health Service User Groups to Mental Health Services and Policy in Ghana : The Case of Mental Health Society of Ghana

RESUMO: Este estudo procurou documentar a perspectiva (s) dos utentes de saúde mental e das associações de prestadores de cuidados sobre a prestação, o papel e a contribuição de serviços de saúde mental da comunidade tal como foram percebidos por um número de informadores-chave, incluindo os utentes do serviço mentais e os próprios prestadores de cuidados. O caso específico da Sociedade Saúde Mental do Gana (MEHSOG) foi o foco deste estudo. O modelo foi o de um estudo de caso, utilizando discussões de grupo e entrevistas com informadores-chave como instrumentos de recolha de dados. Estas ferramentas de colheita de dados foram complementadas por observações dos participantes e pela revisão de documentos da MEHSOG e dos vários grupos de apoio da comunidade de auto-ajuda que compõem a associação nacional. O estudo revelou que os utentes dos serviços de saúde mental e seus prestadores de cuidados constituem um importante grupo de partes interessadas na prestação de serviços de saúde mental da comunidade e no desenvolvimento de políticas que tenham em conta as necessidades e os direitos das pessoas com doença mental ou epilepsia. O envolvimento da MEHSOG promove a mobilização de membros e famílias relacionadas com a doença mental de beneficiar de serviços de tratamento bem organizados com um impacto significativo na melhoria da saúde e da participação dos utentes dos serviços e seus prestadores de cuidados primários em processos de tomada de decisão da família e na comunidade processos de desenvolvimento. Os utentes dos serviços por beneficiarem de tratamento, e os prestadores de cuidados primários, por se tornarem mais livres e menos sobrecarregados com a responsabilidade de cuidar, podem passar a envolver-se mais em atividades que melhoramo seu estado, o de suas famílias e das comunidades. A advocacia dos membros da MEHSOG para conseguir que a “Mental Health Bill” se transforme numa Lei foi também um desenvolvimento significativo resultante da participação ativa dos utentes do serviço em chamar a atenção para uma nova e inclusiva legislação de saúde mental para o Gana. Entre os fatores e oportunidades que permitiram aos utentes dos serviços de saúde mental e aos prestadores de cuidados primários de pessoas com doença mental apoiar activamente a prestação de serviços de saúde mental comunitária e o desenvolvimento de políticas conta-se a contribuição da sociedade civil do Gana, particularmente o movimento da deficiência, e os esforços anteriores de ONGs em saúde mental e dos profissionais de saúde mental para ter uma nova lei em saúde mental. Observámos um certo número de desafios e barreiras que actuam de forma a limitar a influência dos utentes dos serviços de saúde mental na provisão da saúde mental comunitária e no desenvolvimento de políticas. Entre elas o estigma social contra a doença mental e pessoas com doença mental ou epilepsia e seus cuidadores primaries é um factor chave. O estigma tem alterado a percepção e as análises do público em geral, especialmente dos profissionais de saúde e das autoridades políticas afetando a priorização dos problemas de saúde mental nas políticas e programas. Outro desafio foi a deficiente infra-estrutura disponível para apoiar serviços de saúde mentais que assegurem aos utentes permanecerem em bom estado de saúde e bem-estar para serem advogados de si próprios. A recomendação do presente estudo é que os movimentos de utentes dos serviços de saúde mental são importantes e que eles precisam de ser apoiados e encorajados a desempenhar o seu papel como pessoas com experiência vivida para contribuir para a organização e prestação de serviços de saúde mental, bem como para a implementação, monitorização e avaliação de políticas e programas. ------------------------------------ ABSTRACT: This study sought to document the perspective(s) of mental health users and care-givers associations in community mental health service provision and their role and contribution as it was perceived by a number of key informants including the mental service users and care-givers themselves. The specific case of the Mental Health Society of Ghana (MEHSOG) was the focus of this study. A case study approach was used to with Focus Group Discussions and Key Informants Interviews being the data collection tools that were used. These data collection tools were complemented by participant observations and review of documents of the MEHSOG and the various community self-help peer support groups that make up the national association. The study revealed that mental health service users and their care-givers constitute an important stakeholder group in community mental health service provision and development of policies that factor in the needs and rights of persons with mental illness or epilepsy. MEHSOG’s involvement in mobilising members and education families to come forward with the relations with mental illness to benefit from treatment services were well made a significant impact in improving the health and participation of service users and their primary carers in family decision-making processes and in community development processes. Service users, on benefiting from treatment, and primary care-givers, on becoming freer and less burdened with the responsibility of care, move on to engage in secure livelihoods activities, which enhanced their status in their families and communities. The advocacy MEHSOG members undertook in getting the mental health Bill become Law was also noted as significant development that was realised as a result of active involvement of service users in calling for a new and inclusive mental health legislation for Ghana. Enabling factors and opportunities that enabled mental health service users and primary care-givers of people with mental illness to actively support community mental health service provision and policy development is with the vibrant civil society presence in Ghana, particularly the disability movement, and earlier efforts by NGOs in mental health in Ghana long-side mental health professionals to have a new law in mental health. A number of challenges were also noted which were found to limit the extent to which mental health service users can be influential in community mental health service provision and policy development. Key among them was the social stigma against mental illness and people with mental illness or epilepsy and their primary carers. Stigma has affected perceptions, analyses of the general public, especially health practitioners and policy authorities that it has affected their prioritisation of mental health issues in policies and programmes. Another challenge was the poor infrastructure available to support enhanced mental health care services that ensure mental health service users remain in a good state of health and wellbeing to advocate for themselves. The recommendation from the study is that mental health service user movements are important and need to be supported and encouraged to play their role as persons with lived experience to inform organisation and provision of mental health services as well as design and implementation, monitoring and evaluation of policies and programes.

Interaction paradigms versus age-related user profiles: an evaluation on content selection

Novel input modalities such as touch, tangibles or gestures try to exploit human's innate skills rather than imposing new learning processes. However, despite the recent boom of different natural interaction paradigms, it hasn't been systematically evaluated how these interfaces influence a user's performance or whether each interface could be more or less appropriate when it comes to: 1) different age groups; and 2) different basic operations, as data selection, insertion or manipulation. This work presents the first step of an exploratory evaluation about whether or not the users' performance is indeed influenced by the different interfaces. The key point is to understand how different interaction paradigms affect specific target-audiences (children, adults and older adults) when dealing with a selection task. 60 participants took part in this study to assess how different interfaces may influence the interaction of specific groups of users with regard to their age. Four input modalities were used to perform a selection task and the methodology was based on usability testing (speed, accuracy and user preference). The study suggests a statistically significant difference between mean selection times for each group of users, and also raises new issues regarding the “old” mouse input versus the “new” input modalities.

Big data e data analysis: visualização de informação

Dissertação de mestrado integrado em Engenharia e Gestão de Sistemas de Informação