Aesthetics of mundane interactions

John Dewey’s pragmatist aesthetics is used as a conceptual basis for designing new technologies that support staff-members’ mundane social interactions in an academic department. From this perspective, aesthetics is seen as a broader phenomenon that encompasses experiential aspects of staffmembers’ everyday lives and not only a look-&-feel aspect.

Designing for Awareness: An Experience-focused HCI Perspective

Within Human-Computer Interaction (HCI) and Computer Supported Cooperative Work (CSCW) research, the notion of technologically-mediated awareness is often used for allowing relevant people to maintain a mental model of activities, behaviors and status information about each other so that they can organize and coordinate work or other joint activities. The initial conceptions of awareness focused largely on improving productivity and efficiency within work environments. With new social, cultural and commercial needs and the emergence of novel computing technologies, the focus of technologically-mediated awareness has extended from work environments to people’s everyday interactions. Hence, the scope of awareness has extended from conveying work related activities to people’s emotions, love, social status and other broad range of aspects. This trend of conceptualizing HCI design is termed as experience-focused HCI. In my PhD dissertation, designing for awareness, I have reported on how we, as HCI researchers, can design awareness systems from experience-focused HCI perspective that follow the trend of conveying awareness beyond the task-based, instrumental and productive needs. Within the overall aim to design for awareness, my research advocates ethnomethodologically-informed approaches for conceptualizing and designing for awareness. In this sense, awareness is not a predefined phenomenon but something that is situated and particular to a given environment. I have used this approach in two design cases of developing interactive systems that support awareness beyond task-based aspects in work environments. In both the cases, I have followed a complete design cycle: collecting an in-situ understanding of an environment, developing implications for a new technology, implementing a prototype technology to studying the use of the technology in its natural settings.

Non-formal techniques for early assessment of design ideas for services

Designing systems for multiple stakeholders requires frequent collaboration with multiple stakeholders from the start. In many cases at least some stakeholders lack a professional habit of formal modeling. We report observations from student design teams as well as two case studies, respectively of a prototype for supporting creative communication to design objects, and of stakeholder-involvement in early design. In all observations and case studies we found that non-formal techniques supported strong collaboration resulting in deep understanding of early design ideas, of their value and of the feasibility of solutions.

Inpatient facial expression recognition with SMS alert

Facial expression recognition (FER) has been dramatically developed in recent years, thanks to the advancements in related fields, especially machine learning, image processing and human recognition. Accordingly, the impact and potential usage of automatic FER have been growing in a wide range of applications, including human-computer interaction, robot control and driver state surveillance. However, to date, robust recognition of facial expressions from images and videos is still a challenging task due to the difficulty in accurately extracting the useful emotional features. These features are often represented in different forms, such as static, dynamic, point-based geometric or region-based appearance. Facial movement features, which include feature position and shape changes, are generally caused by the movements of facial elements and muscles during the course of emotional expression. The facial elements, especially key elements, will constantly change their positions when subjects are expressing emotions. As a consequence, the same feature in different images usually has different positions. In some cases, the shape of the feature may also be distorted due to the subtle facial muscle movements. Therefore, for any feature representing a certain emotion, the geometric-based position and appearance-based shape normally changes from one image to another image in image databases, as well as in videos. This kind of movement features represents a rich pool of both static and dynamic characteristics of expressions, which playa critical role for FER. The vast majority of the past work on FER does not take the dynamics of facial expressions into account. Some efforts have been made on capturing and utilizing facial movement features, and almost all of them are static based. These efforts try to adopt either geometric features of the tracked facial points, or appearance difference between holistic facial regions in consequent frames or texture and motion changes in loca- facial regions. Although achieved promising results, these approaches often require accurate location and tracking of facial points, which remains problematic.

Connecting people to their resource consumption through real-time data visualisations

Combining human-computer interaction and urban informatics, this design research developed and tested novel interfaces offering users real-time feedback on their paper and energy consumption. Findings from deploying these interfaces in both domestic and office environments in Australia, the UK, and Ireland, will innovate future generations of resource monitoring technologies. The study draws conclusions with implications for government policy, the energy industry, and sustainability researchers.

Reciprocal habituation : a study of older people and the Kinect

We explore relationships between habits and technology interaction by reporting on older people's experience of the Kinect for Xbox. We contribute to theoretical and empirical understandings of habits in the use of technology to inform understanding of the habitual qualities of our interactions with computing technologies, particularly systems exploiting natural user interfaces. We situate ideas of habit in relation to user experience and usefulness in interaction design, and draw on critical approaches to the concept of habit from cultural theory to understand the embedded, embodied, and situated contexts in our interactions with technologies. We argue that understanding technology habits as a process of reciprocal habituation in which people and technologies adapt to each other over time through design, adoption, and appropriation offers opportunities for research on user experience and interaction design within human-computer interaction, especially as newer gestural and motion control interfaces promise to reshape the ways in which we interact with computers.

Technicolouring the fridge : reducing food waste through uses of colour-coding and cameras

Domestic food wastage is a growing problem for the environment and food security. Some causes of domestic food wastes are attributed to a consumer’s behaviours during food purchasing, storage and consumption, such as: excessive food purchases and stockpiling in storage. Recent efforts in human-computer interaction research have examined ways of influencing consumer behaviour. The outcomes have led to a number of interventions that assist users with performing everyday tasks. The Internet Fridge is an example of such an intervention. However, new pioneering technologies frequently confront barriers that restrict their future impact in the market place, which has prompted investigations into the effectiveness of behaviour changing interventions used to encourage more sustainable practices. In this paper, we investigate and compare the effectiveness of two interventions that encourage behaviour change: FridgeCam and the Colour Code Project. We use FridgeCam to examine how improving a consumer’s food supply knowledge can reduce food stockpiling. We use the Colour Code Project to examine how improving consumer awareness of food location can encourage consumption of forgotten foods. We explore opportunities to integrate these interventions into commercially available technologies, such as the Internet Fridge, to: (i) increase the technology’s benefit and value to users, and (ii) promote reduced domestic food wastage. We conclude that interventions improving consumer food supply and location knowledge can promote behaviours that reduce domestic food waste over a longer term. The implications of this research present new opportunities for existing and future technologies to play a key role in reducing domestic food waste.

Designing for grassroots food production : an event-based urban agriculture community

As urbanisation of the global population has increased above 50%, growing food in urban spaces increases in importance, as it can contribute to food security, reduce food miles, and improve people’s physical and mental health. Approaching the task of growing food in urban environments is a mixture of residential growers and groups. Permablitz Brisbane is an event-centric grassroots community that organises daylong ‘working bee’ events, drawing on permaculture design principles in the planning and design process. Permablitz Brisbane provides a useful contrast from other location-centric forms of urban agriculture communities (such as city farms or community gardens), as their aim is to help encourage urban residents to grow their own food. We present findings and design implications from a qualitative study with members of this group, using ethnographic methods to engage with and understand how this group operates. Our findings describe four themes that include opportunities, difficulties, and considerations for the creation of interventions by Human-Computer Interaction (HCI) designers.

Citizen’s right to the digital city: Urban interfaces, activism, and placemaking

Edited by thought leaders of the fields of urban informatics and urban interaction design, this book brings together case studies and examples from around the world to discuss the role that urban Interfaces, citizen action, and city making play in the quest to create and maintain not only secure and resilient, but productive, sustainable, and liveable urban environments. The book debates the impact of these trends on theory, policy, and practice. The chapters in this book are sourced from blind peer reviewed contributions by leading researchers working at the intersection of the social / cultural, technical / digital, and physical / spatial domains of urbanism scholarship. The book appeals not only to research colleagues and students, but also to a vast number of practitioners in the private and public sector interested in accessible accounts that clearly and rigorously analyse the affordances and possibilities of urban interfaces, mobile technology, and location-based services to engage people towards open, smart and participatory urban environments.

Virtual business role-play : leveraging familiar environments to prime stakeholder memory during process elicitation

Business process models have traditionally been an effective way of examining business practices to identify areas for improvement. While common information gathering approaches are generally efficacious, they can be quite time consuming and have the risk of developing inaccuracies when information is forgotten or incorrectly interpreted by analysts. In this study, the potential of a role-playing approach for process elicitation and specification has been examined. This method allows stakeholders to enter a virtual world and role-play actions as they would in reality. As actions are completed, a model is automatically developed, removing the need for stakeholders to learn and understand a modelling grammar. Empirical data obtained in this study suggests that this approach may not only improve both the number of individual process task steps remembered and the correctness of task ordering, but also provide a reduction in the time required for stakeholders to model a process view.

Mobile phone use in Australian Indigenous communities : future pathways for HC14D

This paper collates recent research on mobile phone use in Indigenous communities in Australia. Its key finding is that mobile phones are heavily used in these communities, albeit in unique and unusual ways that may be difficult to comprehend beneath 'top-down' measurements. Rather than framing these uses as being compromises made in lieu of appropriate infrastructures or literacies, it is argued that HCI4D (Human-Computer Interaction for Development) would be better served by seriously plumbing into the information they reveal about how mobile phones are constructed and placed in these communities, and what these factors might reveal about local understandings of development and well-being. A consideration of these specific patterns of appropriation is necessary to push the field beyond top-down, rationalist approaches to development towards more flexible, creative solutions that build from local knowledge and competencies.

Instructional objectives to core-gameplay : a serious game design technique

This paper explores a gap within the serious game design research. That gap is the ambiguity surrounding the process of aligning the instructional objectives of serious games with their core-gameplay i.e. the moment-to-moment activity that is the core of player interaction. A core-gameplay focused design framework is proposed that can work alongside existing, more broadly focused serious games design frameworks. The framework utilises an inquiry-based approach that allows the serious game designer to use key questions as a means to clearly outline instructional objectives with the core-gameplay. The use of this design framework is considered in the context of a small section of gameplay from an educational game currently in development. This demonstration of the framework brings shows how instructional objectives can be embedded into a serious games core-gameplay.

Transdisciplinary approaches to urban computing

The research field of urban computing – defined as “the integration of computing, sensing, and actuation technologies into everyday urban settings and lifestyles” – considers the design and use of ubiquitous computing technology in public and shared urban environments. Its impact on cities, buildings, and spaces evokes innumerable kinds of change. Embedded into our everyday lived environments, urban computing technologies have the potential to alter the meaning of physical space, and affect the activities performed in those spaces. This paper starts a multi-themed discussion of various aspects that make up the, at times, messy and certainly transdisciplinary field of urban computing and urban informatics.

Affordances of ICTs: an environmental study of a French language unit offered at university level

This project investigates the integration of Information Communication Technologies (ICTs) into educational settings by closely looking at the uptake of the perceived affordances offered by ICTs by students enrolled in a French language course at Queensland University of Technology. This cross-disciplinary research uses the theoretical concepts of: Ecological Psychology (Gibson, 1979; Good, 2007; Reed, 1996); Ecological Linguistics (Greeno, 1994; Leather & van Dam, 2003; van Lier 2000, 2003, 2004a, 2004b); Design (Norman, 1988, 1999); Software Design/ Human-Computer Interaction (Hartson, 2003; McGrenere & Ho, 2000); Learning Design (Conole & Dyke, 2004a, 2004b; Laurillard et al. 2000;); Education (Kirschner, 2002; Salomon, 1993; Wijekumar et al., 2006) and Educational Psychology (Greeno, 1994). In order to investigate this subject, the following research questions, rooted in the theoretical foundations of the thesis, were formulated: (1) What are the learners’ attitudes towards the ICT tools used in the project?; (2) What are the affordances offered by ICTs used in a specific French language course at university level from the perspective of the teacher and from the perspective of language learners?; (3) What affordances offered by ICT tools used by the teacher within the specific teaching and learning environment have been taken up by learners?; and (4) What factors influence the uptake by learners of the affordances created by ICT tools used by the teacher within the specific teaching and learning environment? The teaching phase of this project, conducted between 2006 and 2008, used Action Research procedures (Hopkins, 2002; McNiff & Whitehead, 2002; van Lier 1994) as a research framework. The data were collected using the following combination of qualitative and quantitative methods: (1) questionnaires administered to students (Hopkins, 2002; McNiff & Whitehead, 2002) using Likert-scale questions, open questions, yes/no questions; (2) partnership classroom observations of research participants conducted by Research Participant Advocates (Hopkins, 2002; McNiff & Whitehead, 2002); and (3) a focus group with volunteering students who participated in the unit (semi-structured interview) (Hopkins, 2002; McNiff & Whitehead, 2002). The data analysis confirms the importance of a careful examination of the teaching and learning environment and reveals differences in the ways in which the opportunities for an action offered by the ICTs were perceived by teacher and students, which impacted on the uptake of affordances. The author applied the model of affordance, as described by Good (2007), to explain these differences and to investigate their consequences. In conclusion, the teacher-researcher considers that the discrepancies in perceiving the affordances result from the disparities between the frames of reference and the functional contexts of the teacher-researcher and students. Based on the results of the data analysis, a series of recommendations is formulated supporting calls for careful analysis of frames of reference and the functional contexts of all participants in the learning and teaching process. The author also suggests a modified model of affordance, outlining the important characteristics of its constituents.

Achievement unlocked: Investigating the design of effective gamification experiences for mobile applications and devices

This thesis investigates the design of motivating and engaging software experiences. In particular it examines the use of video game elements in non-game contexts, known as gamification, and how to effectively design gamification experiences for smartphone applications. The original contribution of this thesis is a novel framework for designing gamification, derived from an iterative process of evaluating gamified prototypes. The outcomes of this research can help us to better understand the impact of gamification in today's society and how it can be used to design more effective software.