Interactive acquisition of spatial information from images for multimedia applications

Dissertação para obtenção do Grau de Doutor em Informática

H-N2N : uma arquitetura hierárquica escalável para ambientes de realidade mista de grande porte

In this work, we propose a solution to solve the scalability problem found in collaborative, virtual and mixed reality environments of large scale, that use the hierarchical client-server model. Basically, we use a hierarchy of servers. When the capacity of a server is reached, a new server is created as a sun of the first one, and the system load is distributed between them (father and sun). We propose efficient tools and techniques for solving problems inherent to client-server model, as the definition of clusters of users, distribution and redistribution of users through the servers, and some mixing and filtering operations, that are necessary to reduce flow between servers. The new model was tested, in simulation, emulation and in interactive applications that were implemented. The results of these experimentations show enhancements in the traditional, previous models indicating the usability of the proposed in problems of all-to-all communications. This is the case of interactive games and other applications devoted to Internet (including multi-user environments) and interactive applications of the Brazilian Digital Television System, to be developed by the research group. Keywords: large scale virtual environments, interactive digital tv, distributed

A Research Roadmap for Complementary and Alternative Medicine – What We Need to Know by 2020

Background: The CAMbrella coordination action was funded within the Framework Programme 7. Its aim is to provide a research roadmap for clinical and epidemiological research for complementary and alternative medicine (CAM) that is appropriate for the health needs of European citizens and acceptable to their national research institutes and healthcare providers in both public and private sectors. One major issue in the European research agenda is the demographic change and its impact on health care. Our vision for 2020 is that there is an evidence base that enables European citizens to make informed decisions about CAM, both positive and negative. This roadmap proposes a strategic research agenda for the field of CAM designed to address future European health care challenges. This roadmap is based on the results of CAMbrella’s several work packages, literature reviews and expert discussions including a consensus meeting. Methods: We first conducted a systematic literature review on key issues in clinical and epidemiological research in CAM to identify the general concepts, methods and the strengths and weaknesses of current CAM research. These findings were discussed in a workshop (Castellaro, Italy, September 7–9th 2011) with international CAM experts and strategic and methodological recommendations were defined in order to improve the rigor and relevance of CAM research. These recommendations provide the basis for the research roadmap, which was subsequently discussed in a consensus conference (Järna, Sweden, May 9–11th 2012) with all CAMbrella members and the CAMbrella advisory board. The roadmap was revised after this discussion in CAMbrella Work Package (WP) 7 and finally approved by CAMbrella’s scientific steering committee on September 26th 2012. Results: Our main findings show that CAM is very heterogenous in terms of definitions and legal regulations between the European countries. In addition, citizens’ needs and attitudes towards CAM as well as the use and provision of CAM differ significantly between countries. In terms of research methodology, there was consensus that CAM researchers should make use of all the commonly accepted scientific research methods and employ those with utmost diligence combined in a mixed methods framework. Conclusions: We propose 6 core areas of research that should be investigated to achieve a robust knowledge base and to allow stakeholders to make informed decisions. These are: Research into the prevalence of CAM in Europe: Reviews show that we do not know enough about the circumstances in which CAM is used by Europeans. To enable a common European strategic approach, a clear picture of current use is of the utmost importance. Research into differences regarding citizens’ attitudes and needs towards CAM: Citizens are the driver for CAM utilization. Their needs and views on CAM are a key priority, and their interests must be investigated and addressed in future CAM research. Research into safety of CAM: Safety is a key issue for European citizens. CAM is considered safe, but reliable data is scarce although urgently needed in order to assess the risk and cost-benefit ratio of CAM. Research into the comparative effectiveness of CAM: Everybody needs to know in what situation CAM is a reasonable choice. Therefore, we recommend a clear emphasis on concurrent evaluation of the overall effectiveness of CAM as an additional or alternative treatment strategy in real-world settings. Research into effects of context and meaning: The impact of effects of context and meaning on the outcome of CAM treatments must be investigated; it is likely that they are significant. Research into different models of CAM health care integration: There are different models of CAM being integrated into conventional medicine throughout Europe, each with their respective strengths and limitations. These models should be described and concurrently evaluated; innovative models of CAM provision in health care systems should be one focus for CAM research. We also propose a methodological framework for CAM research. We consider that a framework of mixed methodological approaches is likely to yield the most useful information. In this model, all available research strategies including comparative effectiveness research utilising quantitative and qualitative methods should be considered to enable us to secure the greatest density of knowledge possible. Stakeholders, such as citizens, patients and providers, should be involved in every stage of developing the specific and relevant research questions, study design and the assurance of real-world relevance for the research. Furthermore, structural and sufficient financial support for research into CAM is needed to strengthen CAM research capacity if we wish to understand why it remains so popular within the EU. In order to consider employing CAM as part of the solution to the health care, health creation and self-care challenges we face by 2020, it is vital to obtain a robust picture of CAM use and reliable information about its cost, safety and effectiveness in real-world settings. We need to consider the availability, accessibility and affordability of CAM. We need to engage in research excellence and utilise comparative effectiveness approaches and mixed methods to obtain this data. Our recommendations are both strategic and methodological. They are presented for the consideration of researchers and funders while being designed to answer the important and implicit questions posed by EU citizens currently using CAM in apparently increasing numbers. We propose that the EU actively supports an EUwide strategic approach that facilitates the development of CAM research. This could be achieved in the first instance through funding a European CAM coordinating research office dedicated to foster systematic communication between EU governments, public, charitable and industry funders as well as researchers, citizens and other stakeholders. The aim of this office would be to coordinate research strategy developments and research funding opportunities, as well as to document and disseminate international research activities in this field. With the aim to develop sustainability as second step, a European Centre for CAM should be established that takes over the monitoring and further development of a coordinated research strategy for CAM, as well as it should have funds that can be awarded to foster high quality and robust independent research with a focus on citizens health needs and pan-European collaboration. We wish to establish a solid funding for CAM research to adequately inform health care and health creation decision-making throughout the EU. This centre would ensure that our vision of a common, strategic and scientifically rigorous approach to CAM research becomes our legacy and Europe’s reality. We are confident that our recommendations will serve these essential goals for EU citizens.

A mixed methods investigation of parental factors in non-attendance at general paediatric hospital outpatient appointments

Non-attendance at paediatric outpatient appointments results in delayed diagnosis and treatment, putting children at risk of avoidable ill health, and incurring considerable health service costs. Links between missed appointments and clinical, socio-demographic, and access-related factors have been indicated, but parental cognitions associated with non-attendance have yet to be investigated. The aims of this project were to evaluate the effectiveness and theoretical bases of existing interventions designed to reduce non-attendance; to consider the ways in which missed appointments are managed by healthcare providers; to explore parents’ beliefs and experiences of attending and missing appointments; and to investigate the factors underlying these beliefs. A systematic literature review focusing on non-attendance interventions was conducted Within a mixed methods framework, interviews were conducted with healthcare professionals, subsequent interviews were conducted with parents who had attended or missed a General Paediatric outpatient appointment, and a cross-sectional questionnaire study of parents’ beliefs was implemented. The systematic review revealed that text message appointment reminders are effective at reducing non-attendance rates, but that no interventions have thus far been developed using theories of behaviour. Healthcare professionals recognised both barriers and parents’ beliefs as influences on attendance, but also believed there were ‘types’ of families who miss appointments. Healthcare professionals disagreed somewhat about how non-attendance should best be managed. The parent interview study found six themes. The findings reflect parents’ perceptions about the importance of attending and of their ability to attend. The results of the questionnaire study corroborate this structure of beliefs as the analysis produced two factors, the perceived ‘worth’ of attending and anticipated ‘worry’ when attending. This thesis demonstrates an original approach to investigating non-attendance at children’s outpatient appointments, using mixed methods and adopting a psychological rather than service-use perspective. The findings contribute to Health Psychology theory and offer recommendations for healthcare providers.

Gamification e rilevazione di barriere architettoniche: un caso di studio con applicazioni mobili

Questo volume di tesi descrive lo sviluppo di un'applicazione cross-platform per la raccolta dati sull'accessibilità urbana. E' stato creato un Pervasive GWAP strutturato in modo tale da raccogliere, tramite un gioco in mixed-reality, dati sulla geolocalizzazione delle barriere/facility architettoniche in ambiente urbano, in modo da mappare il territorio. Il gioco è rivolto a bambini accompagnati da insegnanti/genitori e prevede l'utilizzo di dispositivi mobili quali tablet e smartphone con sistema operativo Andoid. E' stata utilizzata la funzione GPS dei dispositivi per la geolocalizzazione dei giocatori e delle barriere/facility segnalate e la CAMERA per lo scan dei Qr-Code utilizzati come incentivo per intrattenere gli utenti. L'applicazione è scritta utilizzando tecnologie web quali HTML, CSS, JavaScript, PHP, JSON e grazie all'utilizzo del framework Apache Cordova è stato possibile lo sviluppo multipiattaforma. Questo strumento permette di utilizzare tecnologie web per lo sviluppo di applicazioni mobile, generando codice nativo supportato da sistemi operativi quali Android, iOS, BlackBerry.

Developing a methodology for co-creation using extended reality technologies.

Amid the remarkable growth of innovative technologies, particularly immersive technologies like Extended Reality (XR) (comprising of Virtual Reality (VR), Augmented Reality (AR) & Mixed Reality (MR)), a transformation is unfolding in the way we collaborate and interact. The current research takes the initiative to explore XR’s potential for co-creation activities and proposes XR as a future co-creation platform. It strives to develop a XR-based co-creation system, actively engage stakeholders in the co-creation process, with the goal of enhancing their creative businesses. The research leverages XR tools to investigate how they can enhance digital co-creation methods and determine if the system facilitates efficient and effective value creation during XR-based co-creation sessions. In specific terms, the research probes into whether the XR-based co-creation method and environment enhances the quality and novelty of ideas, reduce communication challenges by providing better understanding of the product, problem or process and optimize the process in terms of reduction in time and costs. The research introduces a multi-user, multi-sensory collaborative and interactive XR platform that adapts to various use-case scenarios. This thesis also presents the user testing performed to collect both qualitative and quantitative data, which serves to substantiate the hypothesis. What sets this XR system apart is its incorporation of fully functional prototypes into a mixed reality environment, providing users with a unique dimension within an immersive digital landscape. The outcomes derived from the experimental studies demonstrate that XR-based co-creation surpasses conventional desktop co-creation methods and remarkably, the results are even comparable to a full mock-up test. In conclusion, the research underscores that the utilization of XR as a tool for co-creation generates substantial value. It serves as a method that enhances the process, an environment that fosters interaction and collaboration, and a platform that equips stakeholders with the means to engage effectively.

Building 3D City Models: Testing and Comparing Laser Scanning and Low-Cost UAV Data Using FOSS Technologies

Contém resumo

Evaluating ubiquitous computing environments using 3D simulation

Human activity is very dynamic and subtle, and most physical environments are also highly dynamic and support a vast range of social practices that do not map directly into any immediate ubiquitous computing functionally. Identifying what is valuable to people is very hard and obviously leads to great uncertainty regarding the type of support needed and the type of resources needed to create such support. We have addressed the issues of system development through the adoption of a Crowdsourced software development model [13]. We have designed and developed Anywhere places, an open and flexible system support infrastructure for Ubiquitous Computing that is based on a balanced combination between global services and applications and situated devices. Evaluation, however, is still an open problem. The characteristics of ubiquitous computing environments make their evaluation very complex: there are no globally accepted metrics and it is very difficult to evaluate large-scale and long-term environments in real contexts. In this paper, we describe a first proposal of an hybrid 3D simulated prototype of Anywhere places that combines simulated and real components to generate a mixed reality which can be used to assess the envisaged ubiquitous computing environments [17].

Cost-effective and lightweight mobile units for MixAR: A comparative trial among different setups

Cultural heritage has arousing the interest of the general public (e.g. tourists), resulting in the increasing number of visitations to archaeological sites. However, many buildings and monuments are severely damaged or completely destroyed, which doesn’t allow to get a full experience of “travelling in time”. Over the years, several Augmented Reality (AR) approaches were proposed to overcome these issues by providing three-dimensional visualization of reconstructed ancient structures in situ. However, most of these systems were made available through heavy and expensive technological bundles. Alternatively, MixAR intends to be a lightweight and cost-effective Mixed Reality system which aims to provide the visualization of virtual ancient buildings reconstructions in situ, properly superimposed and aligned with real-world ruins. This paper proposes and compares different AR mobile units setups to be used in the MixAR system, with low-cost and lightweight requirements in mind, providing different levels of immersion. It was propounded four different mobile units, based on: a laptop computer, a single-board computer (SBC), a tablet and a smartphone, which underwent a set of tests to evaluate their performances. The results show that mobile units based on laptop computer and SBC reached a good overall performance while mobile units based on tablet and smartphone did not meet such a satisfactory result even though they are acceptable for the intended use.

MixAR mobile prototype: visualizing virtually reconstructed ancient structures in situ

Archeology and related areas have a special interest on cultural heritage sites since they provide valuable information about past civilizations. However, the ancient buildings present in these sites are commonly found in an advanced state of degradation which difficult the professional/expert analysis. Virtual reconstructions of such buildings aim to provide a digital insight of how these historical places could have been in ancient times. Moreover, the visualization of such models has been explored by some Augmented Reality (AR) systems capable of providing support to experts. Their compelling and appealing environments have also been applied to promote the social and cultural participation of general public. The existing AR solutions regarding this thematic rarely explore the potential of realism, due to the following lacks: the exploration of mixed environments is usually only supported for indoors or outdoors, not both in the same system; the adaptation of the illumination conditions to the reconstructed structures is rarely addressed causing a decrease of credibility. MixAR [1] is a system concerned with those challenges, aiming to provide the visualization of virtual buildings augmented upon real ruins, allowing soft transitions among its interiors and exteriors and using relighting techniques for a faithful interior illumination, while the user freely moves in a given cultural heritage site, carrying a mobile unit. Regarding the focus of this paper, we intend to report the current state of MixAR mobile unit prototype, which allows visualizing virtual buildings – properly aligned with real-world structures – based on user's location, during outdoor navigation. In order to evaluate the prototype performance, a set of tests were made using virtual models with different complexities.

Realitat augmentada per Android a la Vall d'Incles

En aquest treball s'exposa un petit estudi de la tecnologia Android, també es fa un anàlisi de la realitat augmentada i del framework LookAR. Es comença amb una visió general del funcionament d'Android, es repassa el concepte de realitat augmentada i s'analitzen diferents eines de treball per RA. Es fa una descripció del funcionament de LookAR i s'analitzen les eines per a mapes GoogleMaps i OpenstreetMaps. Finalment es realitza una aplicació en Android amb quatres funcionalitats. Una funció de càmera de realitat augmentada amb el framework Lookar, una funció de GoogleMaps per mostrar la nostra ubicació en un mapa, una altre funció per mostrar la localització via GPS o WIFI i finalment una funció per mostrar una llista de diferents punts d'interès que s'utilitzaran per mostrar informació sobre el mapa i en la càmera de realitat augmentada.

Coupling digital and physical worlds in an AR magic show performance: lessons learned

“Magic for a Pixeloscope” is a one hour show conceived to berepresented in a theater scenario that merges mixed and augmented reality (MR/AR) and full-body interaction with classical magic to create new tricks. The show was conceived by an interdisciplinary team composed by a magician, twointeraction designers, a theater director and a stage designer. Themagician uses custom based hardware and software to createnew illusions which are a starting point to explore new languagefor magical expression. In this paper we introduce a conceptualframework used to inform the design of different tricks; weexplore the design and production of some tricks included in theshow and we describe the feedback received on the world premiere and some of the conclusions obtained.

La stratégie sénégalaise du faire faire et la construction du sens de la gouvernance de l’éducation non formelle

Traduction du titre en anglais: Making sense of governance in non-formal education : A critical analysis of the Senegalese faire faire strategy

On lions, impala, and bigraphs: modelling interactions in Ubiquitous Computing

As ubiquitous systems have moved out of the lab and into the world the need to think more systematically about how there are realised has grown. This talk will present intradisciplinary work I have been engaged in with other computing colleagues on how we might develop more formal models and understanding of ubiquitous computing systems. The formal modelling of computing systems has proved valuable in areas as diverse as reliability, security and robustness. However, the emergence of ubiquitous computing raises new challenges for formal modelling due to their contextual nature and dependence on unreliable sensing systems. In this work we undertook an exploration of modelling an example ubiquitous system called the Savannah game using the approach of bigraphical rewriting systems. This required an unusual intra-disciplinary dialogue between formal computing and human- computer interaction researchers to model systematically four perspectives on Savannah: computational, physical, human and technical. Each perspective in turn drew upon a range of different modelling traditions. For example, the human perspective built upon previous work on proxemics, which uses physical distance as a means to understand interaction. In this talk I hope to show how our model explains observed inconsistencies in Savannah and ex- tend it to resolve these. I will then reflect on the need for intradisciplinary work of this form and the importance of the bigraph diagrammatic form to support this form of engagement. Speaker Biography Tom Rodden Tom Rodden (rodden.info) is a Professor of Interactive Computing at the University of Nottingham. His research brings together a range of human and technical disciplines, technologies and techniques to tackle the human, social, ethical and technical challenges involved in ubiquitous computing and the increasing used of personal data. He leads the Mixed Reality Laboratory (www.mrl.nott.ac.uk) an interdisciplinary research facility that is home of a team of over 40 researchers. He founded and currently co-directs the Horizon Digital Economy Research Institute (www.horizon.ac.uk), a university wide interdisciplinary research centre focusing on ethical use of our growing digital footprint. He has previously directed the EPSRC Equator IRC (www.equator.ac.uk) a national interdisciplinary research collaboration exploring the place of digital interaction in our everyday world. He is a fellow of the British Computer Society and the ACM and was elected to the ACM SIGCHI Academy in 2009 (http://www.sigchi.org/about/awards/).