Impact of region-of-interest video coding on perceived quality in mobile video

Effective streaming of video can be achieved by providing more bits to the most important region in the frame at the cost of reduced bits in the less important regions. This strategy can be beneficial for delivering high quality videos in mobile devices, especially when the availability of bandwidth is usually low and limited. While the state-of-the-art video codecs such as H.264 may have been optimised for perceived quality, it is hypothesised that users will give more attention to interesting region/object when watching videos. Therefore, giving a higher quality to region of interest (ROI)while reducing quality of other areas may result in improving the overall perceived quality without necessarily increasing the bitrate. In this paper, the impact of ROI-based encoded video on perceived quality is investigated by conducting a user study for varous target bitrates. The results from the user study demonstrate that ROI-based video coding has superior perceived quality compared to normal encoded video at the same bitrate in the lower bitrate range.

Measuring reef complexity and rugosity from monocular video bathymetric reconstruction

Topographic structural complexity of a reef is highly correlated to coral growth rates, coral cover and overall levels of biodiversity, and is therefore integral in determining ecological processes. Modeling these processes commonly includes measures of rugosity obtained from a wide range of different survey techniques that often fail to capture rugosity at different spatial scales. Here we show that accurate estimates of rugosity can be obtained from video footage captured using underwater video cameras (i.e., monocular video). To demonstrate the accuracy of our method, we compared the results to in situ measurements of a 2m x 20m area of forereef from Glovers Reef atoll in Belize. Sequential pairs of images were used to compute fine scale bathymetric reconstructions of the reef substrate from which precise measurements of rugosity and reef topographic structural complexity can be derived across multiple spatial scales. To achieve accurate bathymetric reconstructions from uncalibrated monocular video, the position of the camera for each image in the video sequence and the intrinsic parameters (e.g., focal length) must be computed simultaneously. We show that these parameters can be often determined when the data exhibits parallax-type motion, and that rugosity and reef complexity can be accurately computed from existing video sequences taken from any type of underwater camera from any reef habitat or location. This technique provides an infinite array of possibilities for future coral reef research by providing a cost-effective and automated method of determining structural complexity and rugosity in both new and historical video surveys of coral reefs.

Towards spontaneous facial expression recognition in real-world video

Facial expression is an important channel of human social communication. Facial expression recognition (FER) aims to perceive and understand emotional states of humans based on information in the face. Building robust and high performance FER systems that can work in real-world video is still a challenging task, due to the various unpredictable facial variations and complicated exterior environmental conditions, as well as the difficulty of choosing a suitable type of feature descriptor for extracting discriminative facial information. Facial variations caused by factors such as pose, age, gender, race and occlusion, can exert profound influence on the robustness, while a suitable feature descriptor largely determines the performance. Most present attention on FER has been paid to addressing variations in pose and illumination. No approach has been reported on handling face localization errors and relatively few on overcoming facial occlusions, although the significant impact of these two variations on the performance has been proved and highlighted in many previous studies. Many texture and geometric features have been previously proposed for FER. However, few comparison studies have been conducted to explore the performance differences between different features and examine the performance improvement arisen from fusion of texture and geometry, especially on data with spontaneous emotions. The majority of existing approaches are evaluated on databases with posed or induced facial expressions collected in laboratory environments, whereas little attention has been paid on recognizing naturalistic facial expressions on real-world data. This thesis investigates techniques for building robust and high performance FER systems based on a number of established feature sets. It comprises of contributions towards three main objectives: (1) Robustness to face localization errors and facial occlusions. An approach is proposed to handle face localization errors and facial occlusions using Gabor based templates. Template extraction algorithms are designed to collect a pool of local template features and template matching is then performed to covert these templates into distances, which are robust to localization errors and occlusions. (2) Improvement of performance through feature comparison, selection and fusion. A comparative framework is presented to compare the performance between different features and different feature selection algorithms, and examine the performance improvement arising from fusion of texture and geometry. The framework is evaluated for both discrete and dimensional expression recognition on spontaneous data. (3) Evaluation of performance in the context of real-world applications. A system is selected and applied into discriminating posed versus spontaneous expressions and recognizing naturalistic facial expressions. A database is collected from real-world recordings and is used to explore feature differences between standard database images and real-world images, as well as between real-world images and real-world video frames. The performance evaluations are based on the JAFFE, CK, Feedtum, NVIE, Semaine and self-collected QUT databases. The results demonstrate high robustness of the proposed approach to the simulated localization errors and occlusions. Texture and geometry have different contributions to the performance of discrete and dimensional expression recognition, as well as posed versus spontaneous emotion discrimination. These investigations provide useful insights into enhancing robustness and achieving high performance of FER systems, and putting them into real-world applications.

Can you describe him for me? A technique for semantic person search in video

From a law enforcement standpoint, the ability to search for a person matching a semantic description (i.e. 1.8m tall, red shirt, jeans) is highly desirable. While a significant research effort has focused on person re-detection (the task of identifying a previously observed individual in surveillance video), these techniques require descriptors to be built from existing image or video observations. As such, person re-detection techniques are not suited to situations where footage of the person of interest is not readily available, such as a witness reporting a recent crime. In this paper, we present a novel framework that is able to search for a person based on a semantic description. The proposed approach uses size and colour cues, and does not require a person detection routine to locate people in the scene, improving utility in crowded conditions. The proposed approach is demonstrated with a new database that will be made available to the research community, and we show that the proposed technique is able to correctly localise a person in a video based on a simple semantic description.

Ideas as "possessitives" : claims and counter claims in a playground dispute

In the shared space of a school playground, matters of ownership and possession are seriously attended to by children in their everyday encounters with others. The study reported here uses conversation analysis and an ethnomethodological approach to investigate a dispute between two children, aged four to six years, as they decide whose idea for the game will be used. Drawing on Sacks’ (1995a) notion of possession, and Sharrock’s (1974) paper “on owning knowledge”, this paper demonstrates how children draw on the phrase, “that’s my idea”, to claim ownership. Analysis of their video-recorded interaction shows how the children used physical actions, gaze and talk to invoke their own intellectual property as a commodity in the dispute. Whilst invoking ownership, analysis highlights that entitlement over people, objects and the decisions of the shared interactional space did not occur unproblematically. Material objects were used to counter claims to ideas, and it was the uptake of the game and the use of play objects by others that led to whether the idea of game category was upheld. This analysis enables adults a glimpse into the complex social organisation of children’s peer group.

Real-time power line extraction from unmanned aerial system video images

In this paper a real-time vision based power line extraction solution is investigated for active UAV guidance. The line extraction algorithm starts from ridge points detected by steerable filters. A collinear line segments fitting algorithm is followed up by considering global and local information together with multiple collinear measurements. GPU boosted algorithm implementation is also investigated in the experiment. The experimental result shows that the proposed algorithm outperforms two baseline line detection algorithms and is able to fitting long collinear line segments. The low computational cost of the algorithm make suitable for real-time applications.

Mystery at the library : encouraging library exploration using a pervasive mobile game

This paper presents Secret SLQ, a pervasive mobile game that aims to encourage eight to fourteen year olds to engage with the State Library of Queensland. The game sets out to encourage people to visit and explore the library, as well as educate a generation of young people and parents who may visit the library but have no idea of the treasures that it holds. The research explores how smartphone technology can be used to deliver an engaging and educational experience. The game aims to provide a fun and interactive way to guide participants through a multi-leveled library building, to search for unique QR codes to unlock clues, answer quiz questions and progress further up a leaderboard. This paper outlines the design and initial deployment of the game, reporting on results from a usability study and discussing initial observations made by librarians. Findings indicate that the mobile platform is suitable for delivering such experiences but consideration is needed when embedding games in such large environments so as not to confuse players as they play.

Quality based frame selection for video face recognition

Quality based frame selection is a crucial task in video face recognition, to both improve the recognition rate and to reduce the computational cost. In this paper we present a framework that uses a variety of cues (face symmetry, sharpness, contrast, closeness of mouth, brightness and openness of the eye) to select the highest quality facial images available in a video sequence for recognition. Normalized feature scores are fused using a neural network and frames with high quality scores are used in a Local Gabor Binary Pattern Histogram Sequence based face recognition system. Experiments on the Honda/UCSD database shows that the proposed method selects the best quality face images in the video sequence, resulting in improved recognition performance.

Encouraging learners to drive using game elements and smartphones

Young drivers aged 17-24 years are at a risk of death and injury from road crashes primarily due to their age and inexperience on the road. Our research aims to investigate if a gamified mobile tracking and intervention tool can help to address this issue. We aim to build a smartphone application to support the current process of logging driving hours using a physical logbook and pen in Queensland. This provides an easier way to log driving hours than recording them in a logbook. In an attempt to engage Learners and encourage them to undertake more diverse driving practice we will explore how game elements can be integrated into the experience to motivate Learners. Previous research in other domains has shown that framing tasks as game-like can help engage and motivate users, however the addition of game elements to this space provides some interesting design challenges. This paper presents an overview of the research and presents these challenges for further discussion.

Performing design: game design, practice, praxis and the theatre of the impressed

This paper is a reflection on a design teaching project that endeavours to establish a culture of critical design thinking in a tertiary game design course. In the first instance, the ‘performing design’ project arose as a response to contemporary issues and tensions in the Australian games industry and game design education, in essence, the problem of how to scaffold undergraduate students from their entry point as ‘players’ (the impressed) into becoming designers. The performing design project therefore started as a small-scale intervention to inspire reflection in a wider debate that includes: the potential evolution of the contemporary games industry; the purpose of game design education; and the positioning of game design as a design discipline. Our position is that designing interactive playful works or games is victim of a tendency to simplify the discipline and view it from either the perspective of science or art. In this paper we look at some of the historical discussions on the distinct identity of games. Then we present an overview of the typical state of play in contemporary game design education which inspires the performing design project as an intervention or teaching technique. This leads us to question understandings of education and training and creativity and innovation. Finally we reflect on insights arising from the performing design project which lead us to support Archer’s call for a ‘third area’ that balances the monolithic practices of the two major academic disciplines.

Effects of acute multinutrient supplementation on rugby union game performance and recovery

Purpose: To investigate the effects of an acute multinutrient supplement on game-based running performance, peak power output, anaerobic by-products, hormonal profiles, markers of muscle damage, and perceived muscular soreness before, immediately after, and 24 h following competitive rugby union games. Methods: Twelve male rugby union players ingested either a comprehensive multinutrient supplement (SUPP), [RE-ACTIVATE:01], or a placebo (PL) for 5 d. Participants then performed a competitive rugby union game (with global positioning system tracking), with associated blood draws and vertical jump assessments pre, immediately post and 24 h following competition. Results: SUPP ingestion resulted in moderate to large effects for augmented 1st half very high intensity running (VHIR) mean speed (5.9 ± 0.4 vs 4.8 ± 2.3 m·min–1; d= 0.93). Further, moderate increases in 2nd half VHIR distance (137 ± 119 vs 83 ± 89 m; d= 0.73) and VHIR mean speed (5.9 ± 0.6 v 5.3 ± 1.7 m·min–1; d= 0.56) in SUPP condition were also apparent. Postgame aspartate aminotransferase (AST; 44.1 ± 11.8 vs 37.0 ± 3.2 UL; d= 1.16) and creatine kinase (CK; 882 ± 472 vs. 645 ± 123 UL; d= 0.97) measures demonstrated increased values in the SUPP condition, while AST and CK values correlated with 2nd half VHIR distance (r= –0.71 and r= –0.76 respectively). Elevated C-reactive protein (CRP) was observed postgame in both conditions; however, it was significantly blunted with SUPP (P= .05). Conclusions: These findings suggest SUPP may assist in the maintenance of VHIR during rugby union games, possibly via the buffering qualities of SUPP ingredients. However, correlations between increased work completed at very high intensities and muscular degradation in SUPP conditions, may mask any anticatabolic properties of the supplement.

Heart beats and economic decisions : Observing mental stress in the ultimatum bargaining game

One aim of experimental economics is to try to better understand human economic decision making. Early research of the ultimatum bargaining game (Gueth et al., 1982) revealed that other motives than pure monetary reward play a role. Neuroeconomic research has introduced the recording of physiological observations as signals of emotional responses. In this study, we apply heart rate variability (HRV) measuring technology to explore the behaviour and physiological reactions of proposers and responders in the ultimatum bargaining game. Since this technology is small and non-intrusive, we are able to run the experiment in a standard experimental economic setup. We show that low o�ers by a proposer cause signs of mental stress in both the proposer and the responder, as both exhibit high ratios of low to high frequency activity in the HRV spectrum.