Interactive music visualization: implementation, realization and evaluation

This thesis describes all process of the development of music visualization, starting with the implementation, followed by realization and then evaluation. The main goal is to have to knowledge of how the audience live performance experience can be enhanced through music visualization. With music visualization is possible to give a better understanding about the music feelings constructing an intensive atmosphere in the live music performance, which enhances the connection between the live music and the audience through visuals. These visuals have to be related to the live music, furthermore has to quickly respond to live music changes and introduce novelty into the visuals. The mapping between music and visuals is the focus of this project, in order to improve the relationship between the live performance and the spectators. The implementation of music visualization is based on the translation of music into graphic visualizations, therefore at the beginning the project was based on the existent works. Later on, it was decided to introduce new ways of conveying music into visuals. Several attempts were made in order to discover the most efficient mapping between music and visualization so people can fully connect with the performance. Throughout this project, those attempts resulted in several music visualizations created for four live music performances, afterwards it was produced an online survey to evaluate those live performances with music visualization. In the end, all conclusions are presented based on the results of the online survey, and also is explained which music elements should be depicted in the visuals, plus how those visuals should respond to the selected music elements.

WOW: wiki aided organization draWing

As the world evolves, organizations are becoming more and more complex, and the need to understand that complexity is increasing as well. With this demand, arises organizational engineering, which is a subject that emerged with the purpose to make organizations easier to understand, by putting in practice the concept of organizational self-awareness, which means that that the collaborators who are part of an organization, need to understand it and know what their role in it is. The DEMO methodology (Design Engineering Methodology for Organizations), came up with the purpose of representing these organizations’ self-awareness, through the definition and creation of consistent and coherent diagrams. Semantic wikis have features that can help in enterprise modelling. UEAOM (Universal Enterprise Adaptive Organization Model) is a model that allows the specification and dynamic evolution of languages, meta-models, models, and their representations as diagrams and tables. In this project, it was implemented a system based on UEAOM, and Semantic Media Wiki which allows a graphical creation and edition of diagrams. UEAOM can be divided into the meta-modeling level where a language is defined, and the modelling level where instances of classes of that language are created. The system we developed focuses on the modeling level, but will takes as a basis the project that focuses on meta-modeling. The DEMO language was used as an example for the implementation and tests of a graphical editor, based in web technologies and SVG, integrated with SemanticMediaWiki to allow an intuitive, coherent and consistent navigation and editing of organization diagrams.

DEMO models based automatic workflow process generation

Nowadays, more than half of the computer development projects fail to meet the final users' expectations. One of the main causes is insufficient knowledge about the organization of the enterprise to be supported by the respective information system. The DEMO methodology (Design and Engineering Methodology for Organizations) has been proved as a well-defined method to specify, through models and diagrams, the essence of any organization at a high level of abstraction. However, this methodology is platform implementation independent, lacking the possibility of saving and propagating possible changes from the organization models to the implemented software, in a runtime environment. The Universal Enterprise Adaptive Object Model (UEAOM) is a conceptual schema being used as a basis for a wiki system, to allow the modeling of any organization, independent of its implementation, as well as the previously mentioned change propagation in a runtime environment. Based on DEMO and UEAOM, this project aims to develop efficient and standardized methods, to enable an automatic conversion of DEMO Ontological Models, based on UEAOM specification into BPMN (Business Process Model and Notation) models of processes, using clear semantics, without ambiguities, in order to facilitate the creation of processes, almost ready for being executed on workflow systems that support BPMN.

Organizations redesign and building of information systems

Develop software is still a risky business. After 60 years of experience, this community is still not able to consistently build Information Systems (IS) for organizations with predictable quality, within previously agreed budget and time constraints. Although software is changeable we are still unable to cope with the amount and complexity of change that organizations demand for their IS. To improve results, developers followed two alternatives: Frameworks that increase productivity but constrain the flexibility of possible solutions; Agile ways of developing software that keep flexibility with less upfront commitments. With strict frameworks, specific hacks have to be put in place to get around the framework construction options. In time this leads to inconsistent architectures that are harder to maintain due to incomplete documentation and human resources turnover. The main goals of this work is to create a new way to develop flexible IS for organizations, using web technologies, in a faster, better and cheaper way that is more suited to handle organizational change. To do so we propose an adaptive object model that uses a new ontology for data and action with strict normalizing rules. These rules should bound the effects of changes that can be better tested and therefore corrected. Interfaces are built with templates of resources that can be reused and extended in a flexible way. The “state of the world” for each IS is determined by all production and coordination acts that agents performed over time, even those performed by external systems. When bugs are found during maintenance, their past cascading effects can be checked through simulation, re-running the log of transaction acts over time and checking results with previous records. This work implements a prototype with part of the proposed system in order to have a preliminary assessment its feasibility and limitations.

BlueFriends: measuring, analyzing and preventing social exclusion between elementary school students

Social exclusion is a relatively recent term, whose creation is attributed to René Lenoir(Lenoir, 1974). Its concept covers a remarkably wide range of social and economic problems, and can be triggered for various reasons: mentally and physically handicapped, abused children, delinquents, multi-problem households, asocial people, and other social “misfits” (Silver, 1995, pp. 63; Foucault, 1992). With an increasingly multi-cultural population, cultural and social inequalities rapidly ascend, bringing with them the need for educational restructuring. We are living in an evermore diverse world, and children need to be educated to be receptive to the different types of people around them, especially considering social and cultural aspects. It is with these goals that inclusive education has seen an increased trend in today’s academic environment, reminding us that even though children may be taught under the same roof, discriminatory practices might still happen. There are, however, a number of developed tools to assess the various dimensions of social networks. These are mostly based on questionnaires and interviews, which tend to be fastidious and don’t allow for longitudinal, large scale measurement. This thesis introduces BlueFriends, a Bluetooth-based measurement tool for social inclusion/exclusion on elementary school classes. The main goals behind the development of this tool were a) understanding how exclusion manifests in students’ behaviors, and b) motivating pro-social behaviors on children through the use of a persuasive technology. BlueFriends is a distributed application, comprised by an application running on several smartphones, a web-hosted database and a computer providing a visual representation of the data collected on a TV screen, attempting to influence children behaviors. The application makes use of the Bluetooth device present on each phone to continuously sample the RSSI (Received Signal Strength Indication) from other phones, storing the data locally on each phone. All of the stored data is collected, processed and then inserted into the database at the end of each day. At the beginning of each recess, children are reminded of how their behaviors affect others with the help of a visual display, which consists of interactions between dogs. This display illustrates every child’s best friends, as well as which colleagues they don’t interact with as much. Several tips encouraging social interaction and inclusiveness are displayed, inspiring children to change their behaviors towards the colleagues they spend less time with. This thesis documents the process of designing, deploying and analyzing the results of two field studies. On the first study, we assess how the current developed tools are inferior to our measuring tool by deploying a measurement only study, aimed at perceiving how much information can be obtained by the BlueFriends application and attempting to understand how exclusion manifests itself in the school environment. On the second study, we pile on the previous to try and motivate pro-social behaviors on students, with the use of visual cues and recommendations. Ultimately, we confirm that our measurement tool’s results were satisfying towards measuring and changing children’s behaviors, and conclude with our thoughts on possible future work, suggesting a number of possible extensions and improvements.

Hospital hero: a game for reducing stress and anxiety of children while waiting in emergency room

This report tells a story which started as an idea that came to us to fight the battle-cry feeling commonly known as stress and anxiety. Before creating the solution of the idea, we first need to understand the feelings underneath and its effects on our well-being. Throughout the course of our lives, we experience states of weakness and fear. These feelings can arise, for instance, while we are in an emergency room. Needless to say, how much it would have imaginable effects on children, who are unfamiliar to such environments. We ran through a serious of scenarios to find the most suitable solution, among them the study of interaction with positive expressions by Dr. Baldwin, proved to be a valued resource. It was reduced due to its length and to be suitable to our public audience. The game was then created in order to reduce or even eliminate the stress and anxiety of children. Since the game was initially released, some modifications had been made but the original idea - interaction with positive expressions – remained. When the time came, we asked children to play one of the two versions of the game while waiting in the emergency room. This not only created a diversion for them but also a learning experience as it displayed some hospital equipment. The difference between the two versions is that one provides expressions, while the other does not. After all our hard work, we felt rewarded because the project proved its worth and we would see that in the expressions on children’s faces while they played. Most importantly, their anxiety level numbers were significantly reduced during that short period of time.

WalkNRide: contextualising feedback in physical activity trackers

Increasing levels of sedentarism and obesity, along with advances in sensor technologies have instigated a market for wearable activity trackers, electronic devices that sense users’ physical activity levels with the goals of self-monitoring and behaviour change. Nowadays, activity trackers are one of the most desirable technologies, making up for a market of over $230 million in 2013. However, despite the spike of users’ interest, activity trackers have been shown to lose their appeal over time, with a recent survey suggesting that one out of three users discard the tracker in the course of the first six months of use. The question we pose is: how can we design activity tracker so that users’ interests is sustained over the long term? Our design approach focuses on contextualising physical activity. We do this through sensing users’ locations and activities (such as being still, walking or commuting through a car, bus or other means) and thus providing innovative ways of presenting feedback on users. This thesis presents the design and evaluation of WalkNRide, a physical activity tracker for Google Android. Through a longitudinal field study of WalkNRide, we attempt to inquire into the factors that drive the adoption (or non-adoption) of the tool as well as the ways in which the use of the tool contributes towards habit formation.

Seven stories: location based story-delivery system

Location aware content-based experiences have a substantial tradition in HCI, several projects over the last two decades have explored the association of digital media to specific locations or objects. However, a large portion of the literature has little focus on the creative side of designing of the experience and on the iterative process of user evaluations. In this thesis we present two iterations in the design and evaluation of a location based story delivery system (LBSDS), inspired by local folklore and oral storytelling in Madeira. We started by testing an already existing location based story platform, PlaceWear, with short multimedia clips that recounted local traditions and folktales, to this experience we called iLand. An initial evaluation of iLand, was conducted; we shadowed users during the experience and then they responded to a questionnaire. By analyzing the evaluation results we uncovered several issues that informed the redesign of the system itself as well as part of the story content. The outcome of this re design was the 7Stories experience. In the new experience we performed the integration of visual markers in the interface and the framing of the fragmented story content through the literary technique of the narrator. This was done aiming to improving the connection of the audience to the physical context where the experience is delivered. The 7Stories experience was evaluated following a similar methodology to the iLand evaluation but the user’s experience resulted considerably different; because of the same setting for the experience in both versions and the constancy of the most of the content across the two versions we were able to assess the specific effect of the new design and discuss its strengths and shortcomings. Although we did not run a formal and strict comparative test between the two evaluations, it is evident from the collected data how the specific design changes to our LBSDS influenced the user experience.

Graphical constraints: a graphical user interface for constraint problems

A constraint satisfaction problem is a classical artificial intelligence paradigm characterized by a set of variables (each variable with an associated domain of possible values), and a set of constraints that specify relations among subsets of these variables. Solutions are assignments of values to all variables that satisfy all the constraints. Many real world problems may be modelled by means of constraints. The range of problems that can use this representation is very diverse and embraces areas like resource allocation, scheduling, timetabling or vehicle routing. Constraint programming is a form of declarative programming in the sense that instead of specifying a sequence of steps to execute, it relies on properties of the solutions to be found, which are explicitly defined by constraints. The idea of constraint programming is to solve problems by stating constraints which must be satisfied by the solutions. Constraint programming is based on specialized constraint solvers that take advantage of constraints to search for solutions. The success and popularity of complex problem solving tools can be greatly enhanced by the availability of friendly user interfaces. User interfaces cover two fundamental areas: receiving information from the user and communicating it to the system; and getting information from the system and deliver it to the user. Despite its potential impact, adequate user interfaces are uncommon in constraint programming in general. The main goal of this project is to develop a graphical user interface that allows to, intuitively, represent constraint satisfaction problems. The idea is to visually represent the variables of the problem, their domains and the problem constraints and enable the user to interact with an adequate constraint solver to process the constraints and compute the solutions. Moreover, the graphical interface should be capable of configure the solver’s parameters and present solutions in an appealing interactive way. As a proof of concept, the developed application – GraphicalConstraints – focus on continuous constraint programming, which deals with real valued variables and numerical constraints (equations and inequalities). RealPaver, a state-of-the-art solver in continuous domains, was used in the application. The graphical interface supports all stages of constraint processing, from the design of the constraint network to the presentation of the end feasible space solutions as 2D or 3D boxes.

Color measurement using a smartphone applied to Madeira wines

Computer vision is a field that uses techniques to acquire, process, analyze and understand images from the real world in order to produce numeric or symbolic information in the form of decisions [1]. This project aims to use computer vision to prepare an app to analyze a Madeira Wine and characterize it (identify its variety) by its color. Dry or sweet wines, young or old wines have a specific color. It uses techniques to compare histograms in order to analyze the images taken from a test sample inside a special container designed for this purpose. The color analysis from a wine sample using an image captured by a smartphone can be difficult. Many factors affect the captured image such as, light conditions, the background of the sample container due to the many positions the photo can be taken (different to capture facing a white wall or facing the floor for example). Using new technologies such as 3D printing it was possible to create a prototype that aims to control the effect of those external factors on the captured image. The results for this experiment are good indicators for future works. Although it’s necessary to do more tests, the first tests had a success rate of 80% to 90% of correct results. This report documents the development of this project and all the techniques and steps required to execute the tests.

Integrating eye tracking in virtual reality for stroke rehabilitation

This thesis reports on research done for the integration of eye tracking technology into virtual reality environments, with the goal of using it in rehabilitation of patients who suffered from stroke. For the last few years, eye tracking has been a focus on medical research, used as an assistive tool  to help people with disabilities interact with new technologies  and as an assessment tool  to track the eye gaze during computer interactions. However, tracking more complex gaze behaviors and relating them to motor deficits in people with disabilities is an area that has not been fully explored, therefore it became the focal point of this research. During the research, two exploratory studies were performed in which eye tracking technology was integrated in the context of a newly created virtual reality task to assess the impact of stroke. Using an eye tracking device and a custom virtual task, the system developed is able to monitor the eye gaze pattern changes over time in patients with stroke, as well as allowing their eye gaze to function as an input for the task. Based on neuroscientific hypotheses of upper limb motor control, the studies aimed at verifying the differences in gaze patterns during the observation and execution of the virtual goal-oriented task in stroke patients (N=10), and also to assess normal gaze behavior in healthy participants (N=20). Results were found consistent and supported the hypotheses formulated, showing that eye gaze could be used as a valid assessment tool on these patients. However, the findings of this first exploratory approach are limited in order to fully understand the effect of stroke on eye gaze behavior. Therefore, a novel model-driven paradigm is proposed to further understand the relation between the neuronal mechanisms underlying goal-oriented actions and eye gaze behavior.

Using Neo4J geospatial data storage and integration

Online geographic-databases have been growing increasingly as they have become a crucial source of information for both social networks and safety-critical systems. Since the quality of such applications is largely related to the richness and completeness of their data, it becomes imperative to develop adaptable and persistent storage systems, able to make use of several sources of information as well as enabling the fastest possible response from them. This work will create a shared and extensible geographic model, able to retrieve and store information from the major spatial sources available. A geographic-based system also has very high requirements in terms of scalability, computational power and domain complexity, causing several difficulties for a traditional relational database as the number of results increases. NoSQL systems provide valuable advantages for this scenario, in particular graph databases which are capable of modeling vast amounts of inter-connected data while providing a very substantial increase of performance for several spatial requests, such as finding shortestpath routes and performing relationship lookups with high concurrency. In this work, we will analyze the current state of geographic information systems and develop a unified geographic model, named GeoPlace Explorer (GE). GE is able to import and store spatial data from several online sources at a symbolic level in both a relational and a graph databases, where several stress tests were performed in order to find the advantages and disadvantages of each database paradigm.

SysPRE: systematized process for requirements engineering in knowledge discovery projects

The domain of Knowledge Discovery (KD) and Data Mining (DM) is of growing importance in a time where more and more data is produced and knowledge is one of the most precious assets. Having explored both the existing underlying theory, the results of the ongoing research in academia and the industry practices in the domain of KD and DM, we have found that this is a domain that still lacks some systematization. We also found that this systematization exists to a greater degree in the Software Engineering and Requirements Engineering domains, probably due to being more mature areas. We believe that it is possible to improve and facilitate the participation of enterprise stakeholders in the requirements engineering for KD projects by systematizing requirements engineering process for such projects. This will, in turn, result in more projects that end successfully, that is, with satisfied stakeholders, including in terms of time and budget constraints. With this in mind and based on all information found in the state-of-the art, we propose SysPRE - Systematized Process for Requirements Engineering in KD projects. We begin by proposing an encompassing generic description of the KD process, where the main focus is on the Requirements Engineering activities. This description is then used as a base for the application of the Design and Engineering Methodology for Organizations (DEMO) so that we can specify a formal ontology for this process. The resulting SysPRE ontology can serve as a base that can be used not only to make enterprises become aware of their own KD process and requirements engineering process in the KD projects, but also to improve such processes in reality, namely in terms of success rate.

Technologies that motivates healthy toothbrushing: practices through social translucence

Fifty percent of the European Union’s population suffers from an oral disease. Studies have repeatedly shown that while acquiring healthy toothbrushing practices early on in one’s life is of significance, children and adults often fail to adhere to those. In this thesis we attempt to design and prototype interactive technologies that motivate healthy tooth brushing habits on individuals. Rather than focusing on the technologies’ persuasive power over individuals, we tap on the social mechanisms employed by families. In this sense, we think of these technologies as social translucent rather than persuasive, whose goal is to raise awareness within the family on each other’s habits and that aim at leveraging families’ existing social mechanisms for behavior change, rather than replacing them. More specifically, we aim to gain insights with respect to the following questions: a) What are the drivers and barriers towards adhering to healthy tooth brushing behaviors? b) Can we effectively measure toothbrushing behaviors? c) How can technologies leverage family communication practices in motivating proper toothbrushing behaviors? First, we present two studies about children and adults’ tooth brushing behaviors and how these are influenced by social interactions within the family. Secondly, we present the design and prototyping of two systems that sense toothbrushing practices and provide feedback, using the Social Translucence Framework as a design lens. We conclude with an overview of lessons learnt from the prototyping of these systems supported by an analysis of the strengths and pitfalls of the developed technologies.

Breadcrumbs: location and context aware mobile platform for story sharing

With the current proliferation of sensor equipped mobile devices such as smartphones and tablets, location aware services are expanding beyond the mere efficiency and work related needs of users, evolving in order to incorporate fun, culture and the social life of users. Today people on the move have more and more connectivity and are expected to be able to communicate with their usual and familiar social networks. That means communications not only with their peers and colleagues, friends and family but also with unknown people that might share their interests, curiosities or happen to use the same social network. Through social networks, location aware blogging, cultural mobile applications relevant information is now available at specific geographical locations and open to feedback and conversations among friends as well as strangers. In fact, nowadays smartphone technologies aloud users to post and retrieve content while on the move, often relating to specific physical landmarks or locations, engaging and being engaged in conversations with strangers as much as their own social network. The use of such technologies and applications while on the move can often lead people to serendipitous discoveries and interactions. Throughout our thesis we are engaging on a two folded investigation: how can we foster and support serendipitous discoveries and what are the best interfaces for it? In fact, to read and write content while on the move is a cognitively intensive task. While the map serves the function of orienting the user, it also absorbs most of the user’s concentration. In order to address this kind of cognitive overload issue with Breadcrumbs we propose a 360 degrees interface that enables the user to find content around them by means of scanning the surrounding space with the mobile device. By using a loose metaphor of a periscope, harnessing the power of the smartphone sensors we designed an interactive interface capable of detecting content around the users and display it in the form of 2 dimensional bubbles which diameter depends on their distance from the users. Users will navigate the space in relation to the content that they are curious about, rather than in relation to the traditional geographical map. Through this model we envisage alleviating a certain cognitive overload generated by having to continuously confront a two dimensional map with the real three dimensional space surrounding the user, but also use the content as a navigational filter. Furthermore this alternative mean of navigating space might bring serendipitous discovery about places that user where not aware of or intending to reach. We hence conclude our thesis with the evaluation of the Breadcrumbs application and the comparison of the 360 degrees interface with a traditional 2 dimensional map displayed on the devise screen. Results from the evaluation are compiled in findings and insights for future use in designing and developing context aware mobile applications.