Image segmentation and pose estimation of humans in video

This thesis introduces improved techniques towards automatically estimating the pose of humans from video. It examines a complete workflow to estimating pose, from the segmentation of the raw video stream to extract silhouettes, to using the silhouettes in order to determine the relative orientation of parts of the human body. The proposed segmentation algorithms have improved performance and reduced complexity, while the pose estimation shows superior accuracy during difficult cases of self occlusion.

Exchanging data between Digital Human Modelling systems : a review of data formats

Digital human modeling (DHM) systems underwent significant development within the last years. They achieved constantly growing importance in the field of ergonomic workplace design, product development, product usability, ergonomic research, ergonomic education, audiovisual marketing and the entertainment industry. They help to design ergonomic products as well as healthy and safe socio-technical work systems. In the domain of scientific DHM systems, no industry specific standard interfaces are defined which could facilitate the exchange of 3D solid body data, anthropometric data or motion data. The focus of this article is to provide an overview of requirements for a reliable data exchange between different DHM systems in order to identify suitable file formats. Examples from the literature are discussed in detail. Methods: As a first step a literature review is conducted on existing studies and file formats for exchanging data between different DHM systems. The found file formats can be structured into different categories: static 3D solid body data exchange, anthropometric data exchange, motion data exchange and comprehensive data exchange. Each file format is discussed and advantages as well as disadvantages for the DHM context are pointed out. Case studies are furthermore presented, which show first approaches to exchange data between DHM systems. Lessons learnt are shortly summarized. Results: A selection of suitable file formats for data exchange between DHM systems is determined from the literature review.

Patron-driven acquisition of online video

Letting the patron choose ebooks has been a successful experience. Why not apply the same purchase model to other formats? This showcase outlines Queensland University of Technology’s experience with a trial of patron driven acquisition (PDA) for online video. The trial commencing in August 2012 provided access to over 700 online videos licensed from Kanopy across a number of discipline areas. As online video publishing is still in the early stages of development, and as the trial is only in the very early stages, it is too early to draw any firm conclusions about the likely suitability of this model for online video selection and acquisition. However, the trial provides some interesting initial comparisons with ebook PDA and existing online video purchase models and prompts further consideration of PDA as a method for online video selection and licensing.

Possible, inevitable or fait accompli? An analysis of streaming video acquisition, acceptance and use in higher education

This paper explores the potential for online video as a mechanism to transform the ways students learn, as measured by research, user experience and usage following surveys and trials of patron-driven acquisition collaboratively undertaken by Queensland University of Technology, La Trobe University and Kanopy.

The Internet of Things : new digital capital in the hands of customers

The Internet of Things facilitates the identification, digitization, and control of physical objects. However, it is the availability of cost effective sensors, mobile smart devices, scalable cloud infrastructure, and advanced analytics that have consumerized the Internet of Things. The accessibility of digital representations of things has transformative potential and provides entire new affordances for organizations and their ecosystems across most industries.

Swimmer localization from a moving camera

At the highest level of competitive sport, nearly all performances of athletes (both training and competitive) are chronicled using video. Video is then often viewed by expert coaches/analysts who then manually label important performance indicators to gauge performance. Stroke-rate and pacing are important performance measures in swimming, and these are previously digitised manually by a human. This is problematic as annotating large volumes of video can be costly, and time-consuming. Further, since it is difficult to accurately estimate the position of the swimmer at each frame, measures such as stroke rate are generally aggregated over an entire swimming lap. Vision-based techniques which can automatically, objectively and reliably track the swimmer and their location can potentially solve these issues and allow for large-scale analysis of a swimmer across many videos. However, the aquatic environment is challenging due to fluctuations in scene from splashes, reflections and because swimmers are frequently submerged at different points in a race. In this paper, we temporally segment races into distinct and sequential states, and propose a multimodal approach which employs individual detectors tuned to each race state. Our approach allows the swimmer to be located and tracked smoothly in each frame despite a diverse range of constraints. We test our approach on a video dataset compiled at the 2012 Australian Short Course Swimming Championships.

Acceptability-based QoE models for mobile video

Quality of experience (QoE) measures the overall perceived quality of mobile video delivery from subjective user experience and objective system performance. Current QoE computing models have two main limitations: 1) insufficient consideration of the factors influencing QoE, and; 2) limited studies on QoE models for acceptability prediction. In this paper, a set of novel acceptability-based QoE models, denoted as A-QoE, is proposed based on the results of comprehensive user studies on subjective quality acceptance assessments. The models are able to predict users’ acceptability and pleasantness in various mobile video usage scenarios. Statistical regression analysis has been used to build the models with a group of influencing factors as independent predictors, including encoding parameters and bitrate, video content characteristics, and mobile device display resolution. The performance of the proposed A-QoE models has been compared with three well-known objective Video Quality Assessment metrics: PSNR, SSIM and VQM. The proposed A-QoE models have high prediction accuracy and usage flexibility. Future user-centred mobile video delivery systems can benefit from applying the proposed QoE-based management to optimize video coding and quality delivery decisions.

The Australian screen producer in transition

The role of the screen producer is ramifying. Not only are there numerous producer categories, but the screen producer function is also found on a continuum across film, television, advertising, corporate video, and the burgeoning digital media sector. In recent years, fundamental changes to distribution and consumption practices and technologies should have had a correlate impact on screen production practices and on the role of existing screen producers. At the same time, new and recent producers are learning and practicing their craft in a field that has already been transformed by digitisation and media convergence. Our analysis of the work, experience and outlook of screen producers in this chapter is based on data collected in the Australian Screen Producer Survey (ASPS), a nation-wide survey conducted by the ARC Centre of Excellence for Creative Industries and Innovation, the media marketing firm Bergent Research, and the Centre for Screen Business at the Australian Film, Television and Radio School (AFTRS) in 2008/09 and 2011. We analyse the results to better understand the practice of screen production in a period of industry transition, and to recognise the persistence of established production cultures that serve to distinguish different industry sectors.

Opening digital learning to deeper inquiry

This chapter presents an historical narrative on the recent evolution of information and communications technology (ICT) that has been, and is, utilized for purposes of learning. In other words, it presents an account of the development of e-learning supported through the Web and other similar virtual environments. It does not attempt to present a definitive account; as such an exercise is fraught with assumptions, contextual bias, and probable conjecture. The concern here is more with contextualizing the role of inquiry in learning and the evolving digital tools that enable interfaces that promote and support it. In tracking this evolution, both multi-disciplinary and trans-disciplinary research has been pursued. Key historical developments are identified as well as interpretations of the key drivers of e-learning over time and into what might be better described as digital learning. Innovations in the development of digital tools are described as dynamic and emergent, evolving as a consequence of multiple, sometimes hidden drivers of change. But conflating advancements in learning technologies with e-learning seems to be pervasive. As is the push for the “open” agenda – a growing number of initiatives and movements dominated by themes associated with access, intellectual property, public benefit, sharing and technical interoperability. Openness is also explored in this chapter, however, more in terms of what it means when associated with inquiry. By investigating opportunities for the stimulation and support of questioning online – in particular, why-questioning – this chapter is focused on “opening” content – not just for access but for inquiry and deeper learning.

Design and ethics in digital mental health promotion

This chapter presents a case study of Participatory Design as a design framework for developing interactive digital tools for promoting children’s resilience. The author argues for a participatory methodology as an ethical approach that involves children as co-designers in the process from which they are traditionally excluded, namely the creative design process and the process of mental health promotion.

Broadcasting digital stories on Australian community television : the Digistories Anthology

Community-based arts and media movements have been intsrumental in building population-wide creative capacity for cultural development, social participation and social transformation in many parts of the world. Digital storytelling is a form of media practice that was pioneered in the United States at the intersection of these movements. It is described here as a ‘co-creative’ media production method. This description aims to differentiate the approaches to collaborative content creation that are used in community cultural development (CCD) and community media movements from those valued in professional and consumer modes of media production. Yet, the products of co-creative practices, such as digital stories, do not circulate widely through existing media networks or through the newer social media networks that Australian CCD and community media movements anticipated by at least twenty years. The complex politics of story ownership are one of a number of factors that often render ‘publication’ a secondary consideration in the making of digital stories. The possibility of ‘downstream’ use and re-use of stories in other networks is not usually considered in initial planning and development processes. As landmark projects such as Capture Wales indicate, even where stories are made for broadcast outcomes, television can be a problematic window for exhibiting digital stories. Scepticism about the brave new world of reality television and user generated content also circulates in digital storytelling networks, especially when it comes to ethical concerns for managing the risks of harm associated with widespread distribution of digital stories to indiscriminate publics. This publication reports on a collaborative action research project that took a closer look at some of the constraints relating to the problems of re-purposing digital stories for television. It focussed on ‘best practice’ for managing the risks of harm to storytellers in the process of re-purposing digital stories for broadcast on community television.

Talking Turkey : digital storytelling goes to Ankara in 2013

In the last fifteen years digital storytelling has come to stand for considerably more than a specific form of collaborative media production. It is also an international network of new media artists, creative practitioners, curators, scholars, and facilitating community media organisations. In May this year the movement will converge on Ankara, Turkey for its Fifth International Conference and Exhibition. The event will draw together key adopters, adapters and innovators in community-based methods of collaborative media production from around the world. Researchers from the Queensland University of Technology will lead a delegation that will include key players in the Australian digital storytelling movement.

Governance challenges in the global games industry

Current governance challenges facing the global games industry are heavily dominated by online games. Whilst much academic and industry attention has been afforded to Virtual Worlds, the more pressing contemporary challenges may arise in casual games, especially when found on social networks. As authorities are faced with an increasing volume of disputes between participants and platform operators, the likelihood of external regulation increases, and the role that such regulation would have on the industry – both internationally and within specific regions – is unclear. Kelly (2010) argues that “when you strip away the graphics of these [social] games, what you are left with is simply a button [...] You push it and then the game returns a value of either Win or Lose”. He notes that while “every game developer wants their game to be played, preferably addictively, because it’s so awesome”, these mechanics lead not to “addiction of engagement through awesomeness” but “the addiction of compulsiveness”, surmising that “the reality is that they’ve actually sort-of kind-of half-intentionally built a virtual slot machine industry”. If such core elements of social game design are questioned, this gives cause to question the real-money options to circumvent them. With players able to purchase virtual currency and speed the completion of tasks, the money invested by the 20% purchasing in-game benefits (Zainwinger, 2012) may well be the result of compulsion. The decision by the Japanese Consumer Affairs agency to investigate the ‘Kompu Gacha’ mechanic (in which players are rewarded for completing a set of items obtained through purchasing virtual goods such as mystery boxes), and the resultant verdict that such mechanics should be regulated through gambling legislation, demonstrates that politicians are beginning to look at the mechanics deployed in these environments. Purewal (2012) states that “there’s a reasonable argument that complete gacha would be regulated under gambling law under at least some (if not most) Western jurisdictions”. This paper explores the governance challenged within these games and platforms, their role in the global industry, and current practice amongst developers in the Australian and United States to address such challenges.

Innovation & workplace culture in the Australian interactive entertainment industry : the Halfbrick story

A recent success story of the Australian videogames industry is Brisbane based Halfbrick Studios, developer of the hit game for mobile devices, Fruit Ninja. Halfbrick not only survived the global financial crisis and an associated downturn in the Australian industry, but grew strongly, moving rapidly from developing licensed properties for platforms such as Game Boy Advance, Nintendo DS, and Playstation Portable (PSP) to becoming an independent developer and publisher of in-house titles, generating revenue both through App downloads and merchandise sales. Amongst the reasons for Halfbrick’s success is their ability to adaptively transform by addressing different technical platforms, user dynamics, business models and market conditions. Our ongoing case-study research from 2010 into Halfbrick’s innovation processes, culminating with some 10 semi-structured interviews with senior managers and developers, has identified a strong focus on workplace organisational culture, with staff reflecting that the company is a flat, team-based organisation devolving as much control as possible to the development teams directly, and encouraging a work-life balance in which creativity can thrive. The success of this strategy is evidenced through Halfbrick’s low staff turnover; amongst our interviewees most of the developers had been with the company for a number of years, with all speaking positively of the workplace culture and sense of creative autonomy they enjoyed. Interviews with the CEO, Shainiel Deo, and team leaders highlighted the autonomy afforded to each team and the organisation and management of the projects on which they work. Deo and team leaders emphasised the collaboration and communication skills they require in the developers that they employ, and that these characteristics were considered just as significant in hiring decisions as technical skills. Halfbrick’s developers celebrate their workplace culture and insist it has contributed to their capacity for innovation and to their commercial success with titles such as Fruit Ninja. This model of organisational management is reflected in both Stark’s (2009) idea of heterarchy, and Neff’s (2012) concept of venture labour, and provides a different perspective on the industry than the traditional political economy critique of precarious labour exploited by gaming conglomerates. Nevertheless, throughout many of the interviews and in our informal discussions with Halfbrick developers there is also a sense that this rewarding culture is quite tenuous and precarious in the context of a rapidly changing and uncertain global videogames industry. Whether such a workplace culture represents the future of the games industry, or is merely a ‘Prague Spring’ before companies such as Halfbrick are swallowed by traditional players’ remains to be seen. However, as the process of rapid and uncertain transformation plays out across the videogames industry, it is important to pay attention to emerging modes of organisation and workplace culture, even whilst they remain at the margins of the industry. In this paper we investigate Halfbrick’s workplace culture and ask how sustainable is this kind of rewarding and creative workplace?

Video analytics for the detection of near-miss incidents on approach to railway level crossings

Recent modelling of socio-economic costs by the Australian railway industry in 2010 has estimated the cost of level crossing accidents to exceed AU$116 million annually. To better understand causal factors that contribute to these accidents, the Cooperative Research Centre for Rail Innovation is running a project entitled Baseline Level Crossing Video. The project aims to improve the recording of level crossing safety data by developing an intelligent system capable of detecting near-miss incidents and capturing quantitative data around these incidents. To detect near-miss events at railway level crossings a video analytics module is being developed to analyse video footage obtained from forward-facing cameras installed on trains. This paper presents a vision base approach for the detection of these near-miss events. The video analytics module is comprised of object detectors and a rail detection algorithm, allowing the distance between a detected object and the rail to be determined. An existing publicly available Histograms of Oriented Gradients (HOG) based object detector algorithm is used to detect various types of vehicles in each video frame. As vehicles are usually seen from a sideway view from the cabin’s perspective, the results of the vehicle detector are verified using an algorithm that can detect the wheels of each detected vehicle. Rail detection is facilitated using a projective transformation of the video, such that the forward-facing view becomes a bird’s eye view. Line Segment Detector is employed as the feature extractor and a sliding window approach is developed to track a pair of rails. Localisation of the vehicles is done by projecting the results of the vehicle and rail detectors on the ground plane allowing the distance between the vehicle and rail to be calculated. The resultant vehicle positions and distance are logged to a database for further analysis. We present preliminary results regarding the performance of a prototype video analytics module on a data set of videos containing more than 30 different railway level crossings. The video data is captured from a journey of a train that has passed through these level crossings.