Towards combining interactive mobile TV and smart spaces : architectures, tools and application development

Technological developments in microprocessors and ICT landscape have made a shift to a new era where computing power is embedded in numerous small distributed objects and devices in our everyday lives. These small computing devices are ne-tuned to perform a particular task and are increasingly reaching our society at every level. For example, home appliances such as programmable washing machines, microwave ovens etc., employ several sensors to improve performance and convenience. Similarly, cars have on-board computers that use information from many di erent sensors to control things such as fuel injectors, spark plug etc., to perform their tasks e ciently. These individual devices make life easy by helping in taking decisions and removing the burden from their users. All these objects and devices obtain some piece of information about the physical environment. Each of these devices is an island with no proper connectivity and information sharing between each other. Sharing of information between these heterogeneous devices could enable a whole new universe of innovative and intelligent applications. The information sharing between the devices is a diffcult task due to the heterogeneity and interoperability of devices. Smart Space vision is to overcome these issues of heterogeneity and interoperability so that the devices can understand each other and utilize services of each other by information sharing. This enables innovative local mashup applications based on shared data between heterogeneous devices. Smart homes are one such example of Smart Spaces which facilitate to bring the health care system to the patient, by intelligent interconnection of resources and their collective behavior, as opposed to bringing the patient into the health system. In addition, the use of mobile handheld devices has risen at a tremendous rate during the last few years and they have become an essential part of everyday life. Mobile phones o er a wide range of different services to their users including text and multimedia messages, Internet, audio, video, email applications and most recently TV services. The interactive TV provides a variety of applications for the viewers. The combination of interactive TV and the Smart Spaces could give innovative applications that are personalized, context-aware, ubiquitous and intelligent by enabling heterogeneous systems to collaborate each other by sharing information between them. There are many challenges in designing the frameworks and application development tools for rapid and easy development of these applications. The research work presented in this thesis addresses these issues. The original publications presented in the second part of this thesis propose architectures and methodologies for interactive and context-aware applications, and tools for the development of these applications. We demonstrated the suitability of our ontology-driven application development tools and rule basedapproach for the development of dynamic, context-aware ubiquitous iTV applications.

Inviting the Audience – Interactive, Participatory, and Social Television in Finland

The television and the ways it has invited the audience to take part have been changing during the last decade. Today’s interaction, or rather participation, comes from multiplatform formats, such as TV spectacles that combine TV and web platforms in order to create a wider TV experience. Multiplatform phenomena have spread television consumption and traditional coffee table discussions to several different devices and environments. Television has become a part of the bigger puzzle of interconnected devices that operates on several platforms instead of just one. This thesis examines the Finnish television (2004–2014) through the notion of audience participation and introduces the technical, thematic, and social linkages as three different phases, interactive, participatory, social, and their most characteristic features in terms of audience participation. The aim of the study is also to focus on the idea of a possible change by addressing the possible and subtler variations that have taken place through the concept of digital television. Firstly, Finnish television history has gone through numerous trials, exploring the interactive potential of television formats. Finnish SMS-based iTV had its golden era around 2005, when nearly 50% of the television formats were to some extent interactive. Nowadays, interactive television formats have vanished due to their negative reputation and this important part of recent history is mainly been neglected in the academic scope. The dissertation focuses also on the present situation and the ways television content invites the audience to take part. “TV meets the Internet” is a global expression that characterises digital TV, and the use of the Web combined with television content is also examined. Also the linkages between television and social media are identified. Since television can nowadays be described multifaceted, the research approaches are also versatile. The research is based on qualitative content analysis, media observation, and Internet inquiry. The research material also varies. It consists of primary data: taped iTV formats, website material, and social media traces both from Twitter and Facebook and secondary data: discussion forums, observations from the media and Internet inquiry data. To sum up the results, the iTV phase represented, through its content, a new possibility for audiences to take part in a TV show (through gameful and textual features) in real-time. In participatory phase, the most characteristic features from TV-related content view, is the fact that online platform(s) were used to immerse the audience with additional material and, due to this, to extend the TV watching enjoyment beyond the actual broadcast. During the Social (media) phase, both of these features, real-timeness, and extended enjoyment through additional material, are combined and Facebook & Twitter, for example, are used to immerse people in live events (in real-time) via broadcast-related tweets and extra-material offered on a Facebook page. This thesis fills in the gap in Finnish television research by examining the rapid changes taken place on the field within the last ten years. The main results is that the development of Finnish digital television has been much more diverse and subtle than has been anticipated by following only the news, media, and contemporary discourses on the subject of television. The results will benefit both practitioners and academics by identifying the recent history of Finnish television.

Influencing Perceived Agency: A Study into User Experiences in Digital Interactive Storytelling

User experience is a crucial element in interactive storytelling, and as such it is important to recognize the different aspects of a positive user experience in an interactive story. Towards that goal, in the first half of this thesis, we will go through the different elements that make up the user experience, with a strong focus on agency. Agency can be understood as the user’s ability to affect the story or the world in which the story is told with interesting and satisfying choices. The freedoms granted by agency are not completely compatible with traditional storytelling, and as such we will also go through some of the issues of agency-centric design philosophies and explore alternate schools of thought. The core purpose of this thesis is to determine the most important aspects of agency with regards to a positive user experience and attempt to find ways for authors to improve the overall quality of user experience in interactive stories. The latter half of this thesis deals with the research conducted on this matter. This research was carried out by analyzing data from an online survey coupled with data gathered by the interactive storytelling system specifically made for this research (Regicide). The most important aspects of this research deal with influencing perceived agency and facilitating an illusion of agency in different ways, and comparing user experiences in these different test environments. The most important findings based on this research include the importance of context-controlled and focused agency and settings in which the agency takes place and the importance of ensuring user-competency within an interactive storytelling system. Another essential conclusion to this research boils down to communication between the user and the system; the goal of influencing perceived agency should primarily be to ensure that the user is aware of all the theoretical agency they possess.

Metrics for Predicting User Behavior and Experience in an Interactive Storytelling System

In much of the previous research into the field of interactive storytelling, the focus has been on the creation of complete systems, then evaluating the performance of those systems based on user experience. Less focus has been placed on finding general solutions to problems that manifest in many different types of interactive storytelling systems. The goal of this thesis was to identify potential candidates for metrics that a system could use to predict player behavior or how players experience the story they are presented with, and to put these metrics to an empirical test. The three metrics that were used were morality, relationships and conflict. The game used for user testing of the metrics, Regicide is an interactive storytelling experience that was created in conjunction with Eero Itkonen. Data, in the forms of internal system data and survey answers, collected through user testing, was used to evaluate hypotheses for each metric. Out of the three chosen metrics, morality performed the best in this study. Though further research and refinement may be required, the results were promising, and point to the conclusion that user responses to questions of morality are a strong predictor for their choices in similar situations later on in the course of an interactive story. A similar examination for user relationships with other characters in the story did not produce promising results, but several problems were recognized in terms of methodology and further research with a better optimized system may yield different results. On the subject of conflict, several aspects, proposed by Ware et al. (2012), were evaluated separately. Results were inconclusive, with the aspect of directness showing the most promise.