Designing and evaluating mobile multimedia user experiences in public urban places : Making sense of the field

The majority of the world’s population now lives in cities (United Nations, 2008) resulting in an urban densification requiring people to live in closer proximity and share urban infrastructure such as streets, public transport, and parks within cities. However, “physical closeness does not mean social closeness” (Wellman, 2001, p. 234). Whereas it is a common practice to greet and chat with people you cross paths with in smaller villages, urban life is mainly anonymous and does not automatically come with a sense of community per se. Wellman (2001, p. 228) defines community “as networks of interpersonal ties that provide sociability, support, information, a sense of belonging and social identity.” While on the move or during leisure time, urban dwellers use their interactive information communication technology (ICT) devices to connect to their spatially distributed community while in an anonymous space. Putnam (1995) argues that available technology privatises and individualises the leisure time of urban dwellers. Furthermore, ICT is sometimes used to build a “cocoon” while in public to avoid direct contact with collocated people (Mainwaring et al., 2005; Bassoli et al., 2007; Crawford, 2008). Instead of using ICT devices to seclude oneself from the surrounding urban environment and the collocated people within, such devices could also be utilised to engage urban dwellers more with the urban environment and the urban dwellers within. Urban sociologists found that “what attracts people most, it would appear, is other people” (Whyte, 1980, p. 19) and “people and human activity are the greatest object of attention and interest” (Gehl, 1987, p. 31). On the other hand, sociologist Erving Goffman describes the concept of civil inattention, acknowledging strangers’ presence while in public but not interacting with them (Goffman, 1966). With this in mind, it appears that there is a contradiction between how people are using ICT in urban public places and for what reasons and how people use public urban places and how they behave and react to other collocated people. On the other hand there is an opportunity to employ ICT to create and influence experiences of people collocated in public urban places. The widespread use of location aware mobile devices equipped with Internet access is creating networked localities, a digital layer of geo-coded information on top of the physical world (Gordon & de Souza e Silva, 2011). Foursquare.com is an example of a location based 118 Mobile Multimedia – User and Technology Perspectives social network (LBSN) that enables urban dwellers to virtually check-in into places at which they are physically present in an urban space. Users compete over ‘mayorships’ of places with Foursquare friends as well as strangers and can share recommendations about the space. The research field of Urban Informatics is interested in these kinds of digital urban multimedia augmentations and how such augmentations, mediated through technology, can create or influence the UX of public urban places. “Urban informatics is the study, design, and practice of urban experiences across different urban contexts that are created by new opportunities of real-time, ubiquitous technology and the augmentation that mediates the physical and digital layers of people networks and urban infrastructures” (Foth et al., 2011, p. 4). One possibility to augment the urban space is to enable citizens to digitally interact with spaces and urban dwellers collocated in the past, present, and future. “Adding digital layer to the existing physical and social layers could facilitate new forms of interaction that reshape urban life” (Kjeldskov & Paay, 2006, p. 60). This methodological chapter investigates how the design of UX through such digital placebased mobile multimedia augmentations can be guided and evaluated. First, we describe three different applications that aim to create and influence the urban UX through mobile mediated interactions. Based on a review of literature, we describe how our integrated framework for designing and evaluating urban informatics experiences has been constructed. We conclude the chapter with a reflective discussion on the proposed framework.

Cognitive engagement and questioning online

This chapter discusses a range of issues associated with supporting inquiry and deep reasoning while utilising information and communications technology (ICT). The role of questioning in critical thinking and reflection is considered in the context of scaffolding and new opportunities for ICT-enabled scaffolding identified. In particular, why-questioning provides a key point of focus and is presented as an important consideration in the design of systems that not only require cognitive engagement but aim to nurture it. Advances in automated question generation within intelligent tutoring systems are shown to hold promise for both teaching and learning in a range of other applications. While shortening attention spans appear to be a hazard of engaging with digital media cognitive engagement is presented as something with broader scope than attention span and is best conceived of as a crucible within which a rich mix of cognitive activities take place and from which new knowledge is created.

Stomp : an interactive platform for people with intellectual disabilities

For people with intellectual disabilities there are significant barriers to inclusion in socially cooperative endeavours. This paper investigates the effectiveness of Stomp, a tangible user interface (TUI) designed to provide new participatory experiences for people with intellectual disability. Results from an observational study reveal the extent to which the Stomp system supports social and physical interaction. The tangible, spatial and embodied qualities of Stomp result in an experience that does not rely on the acquisition of specific competencies before interaction and engagement can occur.

Effect of topic domain and task type on Web image searching

Many user studies in Web information searching have found the significant effect of task types on search strategies. However, little attention was given to Web image searching strategies, especially the query reformulation activity despite that this is a crucial part in Web image searching. In this study, we investigated the effects of topic domains and task types on user’s image searching behavior and query reformulation strategies. Some significant differences in user’s tasks specificity and initial concepts were identified among the task domains. Task types are also found to influence participant’s result reviewing behavior and query reformulation strategies.

Engaging bodily with video in design

Video is commonly used as a method for recording embodied interaction for purposes of analysis and design and has been proposed as a useful ‘material’ for interaction designers to engage with. But video is not a straight forward reproduction of embodied activity – in themselves video recordings ‘flatten’ the space of embodied interaction, they impose a perspective on unfolding action, and remove the embodied spatial and social context within which embodied interaction unfolds. This does not mean that video is not a useful medium with which to engage as part of a process of investigating and designing for embodied interaction – but crucially, it requires that as people attempting to engage with video, designers own bodies and bodily understandings must be engaged with and brought into play. This paper describes and reflects upon our experiences of engaging with video in two different activities as part of a larger research project investigating the design of gestural interfaces for a dental surgery context.

Human seat modelling using inverse dynamic musculoskeletal models

In this work a biomechanical model is used for simulation of muscle forces necessary to maintain the posture in a car seat under different support conditions.

The effect of lumbar support on the trunk muscle activity and pelvic tilt in a passenger vehicle car seat

In order to gain a competitive edge in the market, automotive manufacturers and automotive seat suppliers have identified seat ergonomics for further development to improve overall vehicle comfort. Adjustable lumbar support devices have been offered since long as comfort systems in either a 2-way or 4-way adjustable configuration, although their effect on lumbar strain is not well documented. The effect of a lumbar support on posture and muscular strain, and therefore the relationship between discomfort and comfort device parameter settings, requires clarification. The aim of this paper is to study the effect of a 4-way lumbar support on lower trunk and pelvis muscle activity, pelvic tilt and spine curvature during a car seating activity. 10 healthy subjects (5 m/f; age 19-39) performed a seating activity in a passenger vehicle with seven different static lumbar support positions. The lumbar support was tested in 3 different height positions in relation to the seatback surface centreline (high, centre, low), each having 2 depths positions (lumbar prominence). An extra depth position was added for the centre position. Posture data were collected using a VICON MX motion capture system and NORAXON DTS goniometers and inclinometer. A rigid-body model of an adjustable car seat with four-way adjustable lumbar support was constructed in UGS Siemens NX and connected to a musculoskeletal model of a seated-human, modelled in AnyBody. Wireless electromyography (EMG) was used to calibrate the musculoskeletal model and assess the relationship between (a) muscular strain and lumbar prominence (normal to seatback surface) respective to the lumbar height (alongside seatback surface), (b) hip joint moment and lumbar prominence (normal to seatback surface) respective to lumbar height (alongside seatback surface) and (c) pelvic tilt and lumbar prominence (normal to seatback surface) respective to the lumbar height (alongside seatback surface). This study was based on the assumption that the musculoskeletal human model was seated at the correct R-Point (SgRP), determined via the occupant packaging toolkit in the JACK digital human model. The effect of the interaction between the driver/car-seat has been investigated for factors resulting from the presence and adjustment of a 4-way lumbar support. The results obtained show that various seat adjustments, and driver’s lumbar supports can have complex influence on the muscle activation, joint forces and moments, all of which can affect the comfort perception of the driver. This study enables the automotive industry to optimise passenger vehicle seat development and design. It further more supports the evaluation of static postural and dynamic seat comfort in normal everyday driving tasks and can be applied for future car design to reduce investment and improve comfort.

Designing well : sustain-able interaction design and vegetarianism

Designing Well: Vegetarianism Sustainability and Interaction Design, focuses on the field of Interaction Design and is an exploration of how design can be reconsidered by employing a different critical lens – that of vegetarianism. By extending the eating analogy to design, other aspects of practice can be reframed and reviewed. This is done through a survey of different ways designers and artists have approached the problems of electricity use. This survey begins by looking at a number of functional products that are currently on the market, and then turns to consider a range of alternate approaches taken in research, art and critical design. The second half of the paper can be considered as a form of contextual review, as a survey of different approaches artists and designers employ to address a specific issue in and through practice. This ranges from pragmatic design to critical and radical interventions.

Kiss

In an age of mobile phones, Facebook, Twitter and online dating, interactions in mediated environments often outnumber face to face encounters. Kiss is an interactive light artwork by artists Priscilla Bracks & Gavin Sade. Kiss reacts to people standing in front of the artwork looking at each other - the moment before kissing. Without interaction the work generates a seductive, ambient, red lighting display, that creates the restful sense of staring into a fire. A fleeting response of white light – like sparks flying in the air – occurs the moment before two faces touch. These sparks are visible in peripheral vision, but fade when the kissing couple turns to look at the work. This moment - as two people look at each other - is a primal moment when two people recognise each other. Face to face encounters with another person are a privileged phenomenon in which the other person's presence and proximity are strongly felt. Kiss does not respond to every instance of a kiss or a look. Its recognition algorithms are fussy, selecting some faces and not others. As in life it’s difficult to tell why sparks fly with some people but not with others. For some this will be felt as a glitch. “This machine should be part of my social life!” But it does promote trial and error, asking viewers to be intimate in public and look at each other for longer than otherwise socially normal. 10 minutes continuous eye contact is said in most cases to arouse sexual feelings in both parties. But even if we don’t look that long, a short time may be all that is needed to explore the face of the person we are looking at. We see that they are human like us. We experience beauty, difference, discomfort, perhaps even nervous laughing, before turning to a more intimate moment of recognition.

A cross-cultural approach towards designing digital noticeboards with a remote aboriginal community

This working paper reflects upon the opportunities and challenges of designing a form of digital noticeboard system with a remote Aboriginal community that supports their aspirations for both internal and external communication. The project itself has evolved from a relationship built through ecological work between scientists and the local community on the Groote Eylandt archipelago to study native populations of animal species over the long term. In the course of this work the aspiration has emerged to explore how digital noticeboards might support communication on the island and externally. This paper introduces the community, the context and the history of the project. We then reflect upon the science project, its outcomes and a framework empowering the Aboriginal viewpoint, in order to draw lessons for extending what we see as a pragmatic and relationship based approach towards cross-cultural design.

Books, toys and tablets : playing and learning in the age of digital media

Introduction During a recent study of how parents source information about children‘s early learning, one of us made our first serious foray into a local store licensed to the global chain Toys'R' Us. While walking the aisles, closely observing layout, signage and stock, several things became obvious. Firstly, large numbers of toys were labeled'educational'. Secondly, many toys in that category were intended for children under the age of two years. These were further differentiated as intended for 'babies' or 'infants', and sub-categorized on packaging or shelving using even smaller age increments (e.g. 0-3 months, 12-18 months, and so on). Thirdly, many products were labeled as 'interactive' and 'learning' toys that promised to assist children‘s early learning and development. The activation of some of these toys relied on embedded computer chip technology and promised to 'connect' children with the home television, computer and the Internet. These products were hybrids between a toy and a platform for digital media interaction. Closer inspection of toy packaging and other promotional material suggested that industry had begun to invest heavily in developing highly differentiated children‘s markets for products that yoked together concepts of learning and development, the 'fun toy' that incorporates digital technology, and offline- and online participation. In this chapter we explore the growth of this contemporary cultural phenomenon that now connects books, toys and mobile digital media with children‘s play and learning.

Discussions in space : interactive urban screens for enhancing citizen engagement

Local governments struggle to engage time poor and seemingly apathetic citizens, as well as the city's young digital natives, the digital locals. Capturing the attention of this digitally literate community who are technology and socially savvy adds a new quality to the challenge of community engagement for urban planning. This project developed and tested a lightweight design intervention towards removing the hierarchy between those who plan the city and those who use it. The aim is to narrow this gap by enhancing people's experience of physical spaces with digital, civic technologies that are directly accessible within that space. The study's research informed the development of a public screen system called Discussions In Space (DIS). It facilitates a feedback platform about specific topics, e.g., a concrete urban planning project, and encourages direct, in-situ, real-time user responses via SMS and Twitter. The thesis presents the findings of deploying and integrating DIS in a wide range of public and urban environments, including the iconic urban screen at Federation Square in Melbourne, to explore the Human-Computer Interaction (HCI) related challenges and implications. It was also deployed in conjunction with a major urban planning project in Brisbane to explore the system's opportunities and challenges of better engaging with Australia's new digital locals. Finally, the merits of the short-texted and ephemeral data generated by the system were evaluated in three focus groups with professional urban planners. DIS offers additional benefits for civic participation as it gives voice to residents who otherwise would not be easily heard. It also promotes a positive attitude towards local governments and gathers complementary information that is different than that captured by more traditional public engagement tools.

Stigmergy in Web 2.0 : a model for site dynamics

Building Web 2.0 sites does not necessarily ensure the success of the site. We aim to better understand what improves the success of a site by drawing insight from biologically inspired design patterns. Web 2.0 sites provide a mechanism for human interaction enabling powerful intercommunication between massive volumes of users. Early Web 2.0 site providers that were previously dominant are being succeeded by newer sites providing innovative social interaction mechanisms. Understanding what site traits contribute to this success drives research into Web sites mechanics using models to describe the associated social networking behaviour. Some of these models attempt to show how the volume of users provides a self-organising and self-contextualisation of content. One model describing coordinated environments is called stigmergy, a term originally describing coordinated insect behavior. This paper explores how exploiting stigmergy can provide a valuable mechanism for identifying and analysing online user behavior specifically when considering that user freedom of choice is restricted by the provided web site functionality. This will aid our building better collaborative Web sites improving the collaborative processes.

Domestic energy monitoring in Victorian households with PV solar installations : feasibility report for GV Community Energy

Australia requires decisive action on climate change and issues of sustainability. The Urban Informatics Research Lab has been funded by the Queensland State Government to conduct a three year study (2009 – 2011) exploring ways to support Queensland residents in making more sustainable consumer and lifestyle choices. We conduct user-centred design research that inform the development of real-time, mobile, locational, networked information interfaces, feedback mechanisms and persuasive and motivational approaches that in turn assist in-situ decision making and environmental awareness in everyday settings. The study aims to deliver usable and useful prototypes offering individual and collective visualisations of ecological impact and opportunities for engagement and collaboration in order to foster a participatory and sustainable culture of life in Australia. Raising people’s awareness with environmental data and educational information does not necessarily trigger sufficient motivation to change their habits towards a more environmentally friendly and sustainable lifestyle. Our research seeks to develop a better understanding how to go beyond just informing and into motivating and encouraging action and change. Drawing on participatory culture, ubiquitous computing, and real-time information, the study delivers research that leads to viable new design approaches and information interfaces which will strengthen Australia’s position to meet the targets of the Clean Energy Future strategy, and contribute to the sustainability of a low-carbon future in Australia. As part of this program of research, the Urban Informatics Research Lab has been invited to partner with GV Community Energy Pty Ltd on a project funded by the Victorian Government Sustainability Fund. This feasibility report specifically looks at the challenges and opportunities of energy monitoring in households in Victoria that include a PV solar installation. The report is structured into two parts: In Part 1, we first review a range of energy monitoring solutions, both stand-alone and internet-enabled. This section primarily focusses on the technical capacilities. However, in order to understand this information and make an informed decision, it is crucial to understand the basic principles and limitations of energy monitoring as well as the opportunities and challenges of a networked approach towards energy monitoring which are discussed in Section 2.

Human–computer interaction : the impact of users’ cognitive styles on query reformulation behaviour during web searching

This paper discusses users’ query reformulation behaviour while searching information on the Web. Query reformulations have emerged as an important component of Web search behaviour and human-computer interaction (HCI) because a user’s success of information retrieval (IR) depends on how he or she formulates queries. There are various factors, such as cognitive styles, that influence users’ query reformulation behaviour. Understanding how users with different cognitive styles formulate their queries while performing Web searches can help HCI researchers and information systems (IS) developers to provide assistance to the users. This paper aims to examine the effects of users’ cognitive styles on their query reformation behaviour. To achieve the goal of the study, a user study was conducted in which a total of 3613 search terms and 872 search queries were submitted by 50 users who engaged in 150 scenario-based search tasks. Riding’s (1991) Cognitive Style Analysis (CSA) test was used to assess users’ cognitive style as wholist or analytic, and verbaliser or imager. The study findings show that users’ query reformulation behaviour is affected by their cognitive styles. The results reveal that analytic users tended to prefer Add queries while all other users preferred New queries. A significant difference was found among wholists and analytics in the manner they performed Remove query reformulations. Future HCI researchers and IS developers can utilize the study results to develop interactive and user-cantered search model, and to provide context-based query suggestions for users.