Quality delivery of mobile video : in-depth understanding of user requirements

The increase of powerful mobile devices has accelerated the demand for mobile videos. Previous studies in mobile video have focused on understanding of mobile video usage, improvement of video quality, and user interface design in video browsing. However, research focusing on a deep understanding of users’ needs for a pleasing quality delivery of mobile video is lacking. In particular, what quality-delivery mode users prefer and what information relevant to video quality they need requires attention. This paper presents a qualitative interview study with 38 participants to gain an insight into three aspects: influencing factors of user-desired video quality, user-preferred quality-delivery modes, and user-required interaction information of mobile video. The results show that user requirements for video quality are related to personal preference, technology background and video viewing experience, and the preferred quality-delivery mode and interactive mode are diverse. These complex user requirements call for flexible and personalised quality delivery and interaction of mobile video.

Detecting gesture force peaks for intuitive interaction

With the release of the Nintendo Wii in 2006, the use of haptic force gestures has become a very popular form of input for interactive entertainment. However, current gesture recognition techniques utilised in Nintendo Wii games fall prey to a lack of control when it comes to recognising simple gestures. This paper presents a simple gesture recognition technique called Peak Testing which gives greater control over gesture interaction. This recognition technique locates force peaks in continuous force data (provided by a gesture device such as the Wiimote) and then cancels any peaks which are not meant for input. Peak Testing is therefore technically able to identify movements in any direction. This paper applies this recognition technique to control virtual instruments and investigates how users respond to this interaction. The technique is then explored as the basis for a robust way to navigate menus with a simple flick of the wrist. We propose that this flick-form of interaction could be a very intuitive way to navigate Nintendo Wii menus instead of the current pointer techniques implemented.

Simple classification of walking activities using commodity smart phones

People interact with mobile computing devices everywhere, while sitting, walking, running or even driving. Adapting the interface to suit these contexts is important, thus this paper proposes a simple human activity classification system. Our approach uses a vector magnitude recognition technique to detect and classify when a person is stationary (or not walking), casually walking, or jogging, without any prior training. The user study has confirmed the accuracy.

Orientation passport : using gamification to engage university students

Adding game elements to an application to motivate use and enhance the user experience is a growing trend known as gamification. This study explores the use of game achievements when applied to a mobile application designed to help new students at university. This paper describes the foundations of a design framework used to integrate game elements to Orientation Passport, a personalised orientation event application for smart phones. Orientation Passport utilises game achievements to present orientation information in an engaging way and to encourage use of the application. The system is explained in terms of the design framework, and the findings of a pilot study involving 26 new students are presented. This study contributes the foundations of a design framework for general gamified achievement design. It also suggests that added game elements can be enjoyable but can potentially encourage undesirable use by some, and aren't as enjoyable if not enforced properly by the technology. Consideration is also needed when enforcing stricter game rules as usability can be affected.

Content-based video indexing for sports applications using integrated multi-modal approach

To sustain an ongoing rapid growth of video information, there is an emerging demand for a sophisticated content-based video indexing system. However, current video indexing solutions are still immature and lack of any standard. This doctoral consists of a research work based on an integrated multi-modal approach for sports video indexing and retrieval. By combining specific features extractable from multiple audio-visual modalities, generic structure and specific events can be detected and classified. During browsing and retrieval, users will benefit from the integration of high-level semantic and some descriptive mid-level features such as whistle and close-up view of player(s).

Deformation behaviours of coarse-grained and nanocrystalline Mg-5wt% Al alloys

Magnesium alloys have been of growing interest to various engineering applications, such as the automobile, aerospace, communication and computer industries due to their low density, high specific strength, good machineability and availability as compared with other structural materials. However, most Mg alloys suffer from poor plasticity due to their Hexagonal Close Packed structure. Grain refinement has been proved to be an effective method to enhance the strength and alter the ductility of the materials. Several methods have been proposed to produce materials with nanocrystalline grain structures. So far, most of the research work on nanocrystalline materials has been carried out on Face-Centered Cubic and Body-Centered Cubic metals. However, there has been little investigation of nanocrystalline Mg alloys. In this study, bulk coarse-grained and nanocrystalline Mg alloys were fabricated by a mechanical alloying method. The mixed powder of Mg chips and Al powder was mechanically milled under argon atmosphere for different durations of 0 hours (MA0), 10 hours (MA10), 20 hours (MA20), 30 hours (MA30) and 40 hours (MA40), followed by compaction and sintering. Then the sintered billets were hot-extruded into metallic rods with a 7 mm diameter. The obtained Mg alloys have a nominal composition of Mg–5wt% Al, with grain sizes ranging from 13 μm down to 50 nm, depending on the milling durations. The microstructure characterization and evolution after deformation were carried out by means of Optical microscopy, X-Ray Diffraction, Scanning Electron Microscopy, Transmission Electron Microscopy, Scanning Probe Microscopy and Neutron Diffraction techniques. Nanoindentaion, compression and micro-compression tests on micro-pillars were used to study the size effects on the mechanical behaviour of the Mg alloys. Two kinds of size effects on the mechanical behaviours and deformation mechanisms were investigated: grain size effect and sample size effect. The nanoindentation tests were composed of constant strain rate, constant loading rate and indentation creep tests. The normally reported indentation size effect in single crystal and coarse-grained crystals was observed in both the coarse-grained and nanocrystalline Mg alloys. Since the indentation size effect is correlated to the Geometrically Necessary Dislocations under the indenter to accommodate the plastic deformation, the good agreement between the experimental results and the Indentation Size Effect model indicated that, in the current nanocrystalline MA20 and MA30, the dislocation plasticity was still the dominant deformation mechanism. Significant hardness enhancement with decreasing grain size, down to 58 nm, was found in the nanocrystalline Mg alloys. Further reduction of grain size would lead to a drop in the hardness values. The failure of grain refinement strengthening with the relatively high strain rate sensitivity of nanocrystalline Mg alloys suggested a change in the deformation mechanism. Indentation creep tests showed that the stress exponent was dependent on the loading rate during the loading section of the indentation, which was related to the dislocation structures before the creep starts. The influence of grain size on the mechanical behaviour and strength of extruded coarse-grained and nanocrystalline Mg alloys were investigated using uniaxial compression tests. The macroscopic response of the Mg alloys transited from strain hardening to strain softening behaviour, with grain size reduced from 13 ìm to 50 nm. The strain hardening was related to the twinning induced hardening and dislocation hardening effect, while the strain softening was attributed to the localized deformation in the nanocrystalline grains. The tension–compression yield asymmetry was noticed in the nanocrystalline region, demonstrating the twinning effect in the ultra-fine-grained and nanocrystalline region. The relationship k tensions < k compression failed in the nanocrystalline Mg alloys; this was attributed to the twofold effect of grain size on twinning. The nanocrystalline Mg alloys were found to exhibit increased strain rate sensitivity with decreasing grain size, with strain rate ranging from 0.0001/s to 0.01/s. Strain rate sensitivity of coarse-grained MA0 was increased by more than 10 times in MA40. The Hall-Petch relationship broke down at a critical grain size in the nanocrystalline region. The breakdown of the Hall-Petch relationship and the increased strain rate sensitivity were due to the localized dislocation activities (generalization and annihilation at grain boundaries) and the more significant contribution from grain boundary mediated mechanisms. In the micro-compression tests, the sample size effects on the mechanical behaviours were studied on MA0, MA20 and MA40 micro-pillars. In contrast to the bulk samples under compression, the stress-strain curves of MA0 and MA20 micro-pillars were characterized with a number of discrete strain burst events separated by nearly elastic strain segments. Unlike MA0 and MA20, the stress-strain curves of MA40 micro-pillars were smooth, without obvious strain bursts. The deformation mechanisms of the MA0 and MA20 micro-pillars under micro-compression tests were considered to be initially dominated by deformation twinning, followed by dislocation mechanisms. For MA40 pillars, the deformation mechanisms were believed to be localized dislocation activities and grain boundary related mechanisms. The strain hardening behaviours of the micro-pillars suggested that the grain boundaries in the nanocrystalline micro-pillars would reduce the source (nucleation sources for twins/dislocations) starvation hardening effect. The power law relationship of the yield strength on pillar dimensions in MA0, MA20 supported the fact that the twinning mechanism was correlated to the pre-existing defects, which can promote the nucleation of the twins. Then, we provided a latitudinal comparison of the results and conclusions derived from the different techniques used for testing the coarse-grained and nanocrystalline Mg alloy; this helps to better understand the deformation mechanisms of the Mg alloys as a whole. At the end, we summarized the thesis and highlighted the conclusions, contributions, innovations and outcomes of the research. Finally, it outlined recommendations for future work.

Saving bitrate vs. pleasing users : where is the break-even point in mobile video quality?

This paper presents a comprehensive study to find the most efficient bitrate requirement to deliver mobile video that optimizes bandwidth, while at the same time maintains good user viewing experience. In the study, forty participants were asked to choose the lowest quality video that would still provide for a comfortable and long-term viewing experience, knowing that higher video quality is more expensive and bandwidth intensive. This paper proposes the lowest pleasing bitrates and corresponding encoding parameters for five different content types: cartoon, movie, music, news and sports. It also explores how the lowest pleasing quality is influenced by content type, image resolution, bitrate, and user gender, prior viewing experience, and preference. In addition, it analyzes the trajectory of users’ progression while selecting the lowest pleasing quality. The findings reveal that the lowest bitrate requirement for a pleasing viewing experience is much higher than that of the lowest acceptable quality. Users’ criteria for the lowest pleasing video quality are related to the video’s content features, as well as its usage purpose and the user’s personal preferences. These findings can provide video providers guidance on what quality they should offer to please mobile users.

Face recognition across pose on video using eigen light-fields

We propose an approach to employ eigen light-fields for face recognition across pose on video. Faces of a subject are collected from video frames and combined based on the pose to obtain a set of probe light-fields. These probe data are then projected to the principal subspace of the eigen light-fields within which the classification takes place. We modify the original light-field projection and found that it is more robust in the proposed system. Evaluation on VidTIMIT dataset has demonstrated that the eigen light-fields method is able to take advantage of multiple observations contained in the video.

Designing and evaluating mobile multimedia user experiences in public urban places : Making sense of the field

The majority of the world’s population now lives in cities (United Nations, 2008) resulting in an urban densification requiring people to live in closer proximity and share urban infrastructure such as streets, public transport, and parks within cities. However, “physical closeness does not mean social closeness” (Wellman, 2001, p. 234). Whereas it is a common practice to greet and chat with people you cross paths with in smaller villages, urban life is mainly anonymous and does not automatically come with a sense of community per se. Wellman (2001, p. 228) defines community “as networks of interpersonal ties that provide sociability, support, information, a sense of belonging and social identity.” While on the move or during leisure time, urban dwellers use their interactive information communication technology (ICT) devices to connect to their spatially distributed community while in an anonymous space. Putnam (1995) argues that available technology privatises and individualises the leisure time of urban dwellers. Furthermore, ICT is sometimes used to build a “cocoon” while in public to avoid direct contact with collocated people (Mainwaring et al., 2005; Bassoli et al., 2007; Crawford, 2008). Instead of using ICT devices to seclude oneself from the surrounding urban environment and the collocated people within, such devices could also be utilised to engage urban dwellers more with the urban environment and the urban dwellers within. Urban sociologists found that “what attracts people most, it would appear, is other people” (Whyte, 1980, p. 19) and “people and human activity are the greatest object of attention and interest” (Gehl, 1987, p. 31). On the other hand, sociologist Erving Goffman describes the concept of civil inattention, acknowledging strangers’ presence while in public but not interacting with them (Goffman, 1966). With this in mind, it appears that there is a contradiction between how people are using ICT in urban public places and for what reasons and how people use public urban places and how they behave and react to other collocated people. On the other hand there is an opportunity to employ ICT to create and influence experiences of people collocated in public urban places. The widespread use of location aware mobile devices equipped with Internet access is creating networked localities, a digital layer of geo-coded information on top of the physical world (Gordon & de Souza e Silva, 2011). Foursquare.com is an example of a location based 118 Mobile Multimedia – User and Technology Perspectives social network (LBSN) that enables urban dwellers to virtually check-in into places at which they are physically present in an urban space. Users compete over ‘mayorships’ of places with Foursquare friends as well as strangers and can share recommendations about the space. The research field of Urban Informatics is interested in these kinds of digital urban multimedia augmentations and how such augmentations, mediated through technology, can create or influence the UX of public urban places. “Urban informatics is the study, design, and practice of urban experiences across different urban contexts that are created by new opportunities of real-time, ubiquitous technology and the augmentation that mediates the physical and digital layers of people networks and urban infrastructures” (Foth et al., 2011, p. 4). One possibility to augment the urban space is to enable citizens to digitally interact with spaces and urban dwellers collocated in the past, present, and future. “Adding digital layer to the existing physical and social layers could facilitate new forms of interaction that reshape urban life” (Kjeldskov & Paay, 2006, p. 60). This methodological chapter investigates how the design of UX through such digital placebased mobile multimedia augmentations can be guided and evaluated. First, we describe three different applications that aim to create and influence the urban UX through mobile mediated interactions. Based on a review of literature, we describe how our integrated framework for designing and evaluating urban informatics experiences has been constructed. We conclude the chapter with a reflective discussion on the proposed framework.

Effect of topic domain and task type on Web image searching

Many user studies in Web information searching have found the significant effect of task types on search strategies. However, little attention was given to Web image searching strategies, especially the query reformulation activity despite that this is a crucial part in Web image searching. In this study, we investigated the effects of topic domains and task types on user’s image searching behavior and query reformulation strategies. Some significant differences in user’s tasks specificity and initial concepts were identified among the task domains. Task types are also found to influence participant’s result reviewing behavior and query reformulation strategies.

Understanding user experience of mobile video : framework, measurement, and optimization

Since users have become the focus of product/service design in last decade, the term User eXperience (UX) has been frequently used in the field of Human-Computer-Interaction (HCI). Research on UX facilitates a better understanding of the various aspects of the user’s interaction with the product or service. Mobile video, as a new and promising service and research field, has attracted great attention. Due to the significance of UX in the success of mobile video (Jordan, 2002), many researchers have centered on this area, examining users’ expectations, motivations, requirements, and usage context. As a result, many influencing factors have been explored (Buchinger, Kriglstein, Brandt & Hlavacs, 2011; Buchinger, Kriglstein & Hlavacs, 2009). However, a general framework for specific mobile video service is lacking for structuring such a great number of factors. To measure user experience of multimedia services such as mobile video, quality of experience (QoE) has recently become a prominent concept. In contrast to the traditionally used concept quality of service (QoS), QoE not only involves objectively measuring the delivered service but also takes into account user’s needs and desires when using the service, emphasizing the user’s overall acceptability on the service. Many QoE metrics are able to estimate the user perceived quality or acceptability of mobile video, but may be not enough accurate for the overall UX prediction due to the complexity of UX. Only a few frameworks of QoE have addressed more aspects of UX for mobile multimedia applications but need be transformed into practical measures. The challenge of optimizing UX remains adaptations to the resource constrains (e.g., network conditions, mobile device capabilities, and heterogeneous usage contexts) as well as meeting complicated user requirements (e.g., usage purposes and personal preferences). In this chapter, we investigate the existing important UX frameworks, compare their similarities and discuss some important features that fit in the mobile video service. Based on the previous research, we propose a simple UX framework for mobile video application by mapping a variety of influencing factors of UX upon a typical mobile video delivery system. Each component and its factors are explored with comprehensive literature reviews. The proposed framework may benefit in user-centred design of mobile video through taking a complete consideration of UX influences and in improvement of mobile videoservice quality by adjusting the values of certain factors to produce a positive user experience. It may also facilitate relative research in the way of locating important issues to study, clarifying research scopes, and setting up proper study procedures. We then review a great deal of research on UX measurement, including QoE metrics and QoE frameworks of mobile multimedia. Finally, we discuss how to achieve an optimal quality of user experience by focusing on the issues of various aspects of UX of mobile video. In the conclusion, we suggest some open issues for future study.