Designing for Awareness: An Experience-focused HCI Perspective

Within Human-Computer Interaction (HCI) and Computer Supported Cooperative Work (CSCW) research, the notion of technologically-mediated awareness is often used for allowing relevant people to maintain a mental model of activities, behaviors and status information about each other so that they can organize and coordinate work or other joint activities. The initial conceptions of awareness focused largely on improving productivity and efficiency within work environments. With new social, cultural and commercial needs and the emergence of novel computing technologies, the focus of technologically-mediated awareness has extended from work environments to people’s everyday interactions. Hence, the scope of awareness has extended from conveying work related activities to people’s emotions, love, social status and other broad range of aspects. This trend of conceptualizing HCI design is termed as experience-focused HCI. In my PhD dissertation, designing for awareness, I have reported on how we, as HCI researchers, can design awareness systems from experience-focused HCI perspective that follow the trend of conveying awareness beyond the task-based, instrumental and productive needs. Within the overall aim to design for awareness, my research advocates ethnomethodologically-informed approaches for conceptualizing and designing for awareness. In this sense, awareness is not a predefined phenomenon but something that is situated and particular to a given environment. I have used this approach in two design cases of developing interactive systems that support awareness beyond task-based aspects in work environments. In both the cases, I have followed a complete design cycle: collecting an in-situ understanding of an environment, developing implications for a new technology, implementing a prototype technology to studying the use of the technology in its natural settings.

Non-formal techniques for early assessment of design ideas for services

Designing systems for multiple stakeholders requires frequent collaboration with multiple stakeholders from the start. In many cases at least some stakeholders lack a professional habit of formal modeling. We report observations from student design teams as well as two case studies, respectively of a prototype for supporting creative communication to design objects, and of stakeholder-involvement in early design. In all observations and case studies we found that non-formal techniques supported strong collaboration resulting in deep understanding of early design ideas, of their value and of the feasibility of solutions.

Engineering social awareness in work environments

A growing interest is seen for designing intelligent environments that support personally meaningful, sociable and rich everyday experiences. In this paper we describe an intelligent, large screen display called Panorama that is aimed at supporting and enhancing social awareness within an academic work environment. Panorama is not intended to provide instrumental or other productivity related information. Rather, the goal of Panorama is to enhance social awareness by providing interpersonal and rich information related to co-workers and their everyday interactions in the department. A two-phase assessment of Panorama showed to promote curiosity and interest in exploring different activities in the environment.

Inpatient facial expression recognition with SMS alert

Facial expression recognition (FER) has been dramatically developed in recent years, thanks to the advancements in related fields, especially machine learning, image processing and human recognition. Accordingly, the impact and potential usage of automatic FER have been growing in a wide range of applications, including human-computer interaction, robot control and driver state surveillance. However, to date, robust recognition of facial expressions from images and videos is still a challenging task due to the difficulty in accurately extracting the useful emotional features. These features are often represented in different forms, such as static, dynamic, point-based geometric or region-based appearance. Facial movement features, which include feature position and shape changes, are generally caused by the movements of facial elements and muscles during the course of emotional expression. The facial elements, especially key elements, will constantly change their positions when subjects are expressing emotions. As a consequence, the same feature in different images usually has different positions. In some cases, the shape of the feature may also be distorted due to the subtle facial muscle movements. Therefore, for any feature representing a certain emotion, the geometric-based position and appearance-based shape normally changes from one image to another image in image databases, as well as in videos. This kind of movement features represents a rich pool of both static and dynamic characteristics of expressions, which playa critical role for FER. The vast majority of the past work on FER does not take the dynamics of facial expressions into account. Some efforts have been made on capturing and utilizing facial movement features, and almost all of them are static based. These efforts try to adopt either geometric features of the tracked facial points, or appearance difference between holistic facial regions in consequent frames or texture and motion changes in loca- facial regions. Although achieved promising results, these approaches often require accurate location and tracking of facial points, which remains problematic.

A design approach to the study of people's experiences with technologies in the context of public transport

Relevant to the study of people’s attitudes towards public transport use is the consideration to the role of technology as part of the travel experience. Technologies aim to enhance daily tasks but tend to change the way people interact with products and can be perceived as difficult to use. This is critical in the context of “public use” where products and services are to be used by the population at large: adults, children, elderly, people with disabilities, and tourists. From different perspectives, the topic of users and the use of technologies have been studied in the social sciences and human computer interaction fields; however, earlier approaches fail to address the ways in which experiential knowledge informs people’s interactions with products and technologies, and how such information could guide the design of future technologies. This paper describes a pilot study, part of a larger ongoing exploratory research that investigates people’s experiences with infrastructure, systems, and technologies in the context of public transport. The methodological approach included focus groups, field observations, and retrospective verbal reports. At this stage, the study found that four context led factors were the primary source of reference informing participants’ actions and interactions; they are: (i) context >> experience, (ii) context >> interface, (iii) context >> knowledge, (iv) context >> emotion.

Connecting people to their resource consumption through real-time data visualisations

Combining human-computer interaction and urban informatics, this design research developed and tested novel interfaces offering users real-time feedback on their paper and energy consumption. Findings from deploying these interfaces in both domestic and office environments in Australia, the UK, and Ireland, will innovate future generations of resource monitoring technologies. The study draws conclusions with implications for government policy, the energy industry, and sustainability researchers.

Atmosphere : a framework for contextual awareness

This article enhances existing approaches to present-day asynchronous awareness concepts by providing the means to explicitly represent and mediate contextual information. The resulting concept of contextual awareness takes different notions of the term context into account. Following a human-centered approach, the proposed methods serve as mediators for context between persons rather than automatically detecting context. Based on this variant of awareness, the atmosphere framework is introduced to provide mechanisms to deal with the problem of workload in tandem with contextual information. Atmosphere provides a highly tailorable structure and interface to deal with a wide variance of user and organizational requirements. The article closes with the description of a partial implementation of the framework and its evaluation.

Reciprocal habituation : a study of older people and the Kinect

We explore relationships between habits and technology interaction by reporting on older people's experience of the Kinect for Xbox. We contribute to theoretical and empirical understandings of habits in the use of technology to inform understanding of the habitual qualities of our interactions with computing technologies, particularly systems exploiting natural user interfaces. We situate ideas of habit in relation to user experience and usefulness in interaction design, and draw on critical approaches to the concept of habit from cultural theory to understand the embedded, embodied, and situated contexts in our interactions with technologies. We argue that understanding technology habits as a process of reciprocal habituation in which people and technologies adapt to each other over time through design, adoption, and appropriation offers opportunities for research on user experience and interaction design within human-computer interaction, especially as newer gestural and motion control interfaces promise to reshape the ways in which we interact with computers.

Tangible E-Learning

Tangible User Interfaces increasingly gain attention for their supportive potential in cognitive processes. More and more often the terms e-Learning and tangible interaction are been referred to in one word as Tangible e-Learning. This paper gives a general overview on the topic in reference to development history, research and effectiveness. It explains how epistemology, together with its idea that physicality enhances learning and that the cognitive process can happen in expressive or exploratory manner, motivates the emerging of TUIs and acts as a basis for the classification of Tangible e-Learning Systems. The benefits of TUIs in comparison to classical GUIs in terms of their contribution to the learning process, engagement, enjoyment and collaboration are empirically proven, although poorly. Nevertheless, it is not known whether TUIs have stronger potential than common Physical User Interfaces that are not electronically augmented. Still, TUIs that support learning have a strong potential to be integrated into real world scenarios.

Technicolouring the fridge : reducing food waste through uses of colour-coding and cameras

Domestic food wastage is a growing problem for the environment and food security. Some causes of domestic food wastes are attributed to a consumer’s behaviours during food purchasing, storage and consumption, such as: excessive food purchases and stockpiling in storage. Recent efforts in human-computer interaction research have examined ways of influencing consumer behaviour. The outcomes have led to a number of interventions that assist users with performing everyday tasks. The Internet Fridge is an example of such an intervention. However, new pioneering technologies frequently confront barriers that restrict their future impact in the market place, which has prompted investigations into the effectiveness of behaviour changing interventions used to encourage more sustainable practices. In this paper, we investigate and compare the effectiveness of two interventions that encourage behaviour change: FridgeCam and the Colour Code Project. We use FridgeCam to examine how improving a consumer’s food supply knowledge can reduce food stockpiling. We use the Colour Code Project to examine how improving consumer awareness of food location can encourage consumption of forgotten foods. We explore opportunities to integrate these interventions into commercially available technologies, such as the Internet Fridge, to: (i) increase the technology’s benefit and value to users, and (ii) promote reduced domestic food wastage. We conclude that interventions improving consumer food supply and location knowledge can promote behaviours that reduce domestic food waste over a longer term. The implications of this research present new opportunities for existing and future technologies to play a key role in reducing domestic food waste.

Designing for grassroots food production : an event-based urban agriculture community

As urbanisation of the global population has increased above 50%, growing food in urban spaces increases in importance, as it can contribute to food security, reduce food miles, and improve people’s physical and mental health. Approaching the task of growing food in urban environments is a mixture of residential growers and groups. Permablitz Brisbane is an event-centric grassroots community that organises daylong ‘working bee’ events, drawing on permaculture design principles in the planning and design process. Permablitz Brisbane provides a useful contrast from other location-centric forms of urban agriculture communities (such as city farms or community gardens), as their aim is to help encourage urban residents to grow their own food. We present findings and design implications from a qualitative study with members of this group, using ethnographic methods to engage with and understand how this group operates. Our findings describe four themes that include opportunities, difficulties, and considerations for the creation of interventions by Human-Computer Interaction (HCI) designers.

Citizen’s right to the digital city: Urban interfaces, activism, and placemaking

Edited by thought leaders of the fields of urban informatics and urban interaction design, this book brings together case studies and examples from around the world to discuss the role that urban Interfaces, citizen action, and city making play in the quest to create and maintain not only secure and resilient, but productive, sustainable, and liveable urban environments. The book debates the impact of these trends on theory, policy, and practice. The chapters in this book are sourced from blind peer reviewed contributions by leading researchers working at the intersection of the social / cultural, technical / digital, and physical / spatial domains of urbanism scholarship. The book appeals not only to research colleagues and students, but also to a vast number of practitioners in the private and public sector interested in accessible accounts that clearly and rigorously analyse the affordances and possibilities of urban interfaces, mobile technology, and location-based services to engage people towards open, smart and participatory urban environments.

Virtual business role-play : leveraging familiar environments to prime stakeholder memory during process elicitation

Business process models have traditionally been an effective way of examining business practices to identify areas for improvement. While common information gathering approaches are generally efficacious, they can be quite time consuming and have the risk of developing inaccuracies when information is forgotten or incorrectly interpreted by analysts. In this study, the potential of a role-playing approach for process elicitation and specification has been examined. This method allows stakeholders to enter a virtual world and role-play actions as they would in reality. As actions are completed, a model is automatically developed, removing the need for stakeholders to learn and understand a modelling grammar. Empirical data obtained in this study suggests that this approach may not only improve both the number of individual process task steps remembered and the correctness of task ordering, but also provide a reduction in the time required for stakeholders to model a process view.

Mobile phone use in Australian Indigenous communities : future pathways for HC14D

This paper collates recent research on mobile phone use in Indigenous communities in Australia. Its key finding is that mobile phones are heavily used in these communities, albeit in unique and unusual ways that may be difficult to comprehend beneath 'top-down' measurements. Rather than framing these uses as being compromises made in lieu of appropriate infrastructures or literacies, it is argued that HCI4D (Human-Computer Interaction for Development) would be better served by seriously plumbing into the information they reveal about how mobile phones are constructed and placed in these communities, and what these factors might reveal about local understandings of development and well-being. A consideration of these specific patterns of appropriation is necessary to push the field beyond top-down, rationalist approaches to development towards more flexible, creative solutions that build from local knowledge and competencies.

Instructional objectives to core-gameplay : a serious game design technique

This paper explores a gap within the serious game design research. That gap is the ambiguity surrounding the process of aligning the instructional objectives of serious games with their core-gameplay i.e. the moment-to-moment activity that is the core of player interaction. A core-gameplay focused design framework is proposed that can work alongside existing, more broadly focused serious games design frameworks. The framework utilises an inquiry-based approach that allows the serious game designer to use key questions as a means to clearly outline instructional objectives with the core-gameplay. The use of this design framework is considered in the context of a small section of gameplay from an educational game currently in development. This demonstration of the framework brings shows how instructional objectives can be embedded into a serious games core-gameplay.