Discovering the best feature extraction and selection algorithms for spontaneous facial expression recognition

Feature extraction and selection are critical processes in developing facial expression recognition (FER) systems. While many algorithms have been proposed for these processes, direct comparison between texture, geometry and their fusion, as well as between multiple selection algorithms has not been found for spontaneous FER. This paper addresses this issue by proposing a unified framework for a comparative study on the widely used texture (LBP, Gabor and SIFT) and geometric (FAP) features, using Adaboost, mRMR and SVM feature selection algorithms. Our experiments on the Feedtum and NVIE databases demonstrate the benefits of fusing geometric and texture features, where SIFT+FAP shows the best performance, while mRMR outperforms Adaboost and SVM. In terms of computational time, LBP and Gabor perform better than SIFT. The optimal combination of SIFT+FAP+mRMR also exhibits a state-of-the-art performance.

Strengthening the role of the adult education sector in training workers for the digital content industries in Australia and Singapore

In 2009, QUT’s Office of Research and the Institute for Adult Learning Singapore funded a six-month pilot project that represented the first stage of a larger international comparative study. The study is the first of its kind to investigate to what extent and how digital content workers’ learning needs are being met by adult education and training in Australia and Singapore. The pilot project involved consolidating key theoretical literature, studies, policies, programs and statistical data relevant to the digital content industries in Australia and Singapore. This had not been done before, and represented new knowledge generation. Digital content workers include professionals within and beyond the creative industries as follows: Visual effects and animation (including virtual reality and 3D products); Interactive multimedia (e.g. websites, CD-ROMs) and software development; Computer and online games; and Digital film & TV production and film & TV post-production. In the last decade, the digital content industries have been recognised as an industry sector of strong and increasing significance. The project compared Australia and Singapore on aspects of the digital content industries’ labour market, skill requirements, human capital challenges, the role of adult education in building a workforce for the digital content industries, and innovation policies. The consolidated report generated from the project formed the basis of the proposal for an ARC Linkage Project application submitted in the May 2010 round.

On the application of the probabilistic linear discriminant analysis to face recognition across expression

Facial expression is one of the main issues of face recognition in uncontrolled environments. In this paper, we apply the probabilistic linear discriminant analysis (PLDA) method to recognize faces across expressions. Several PLDA approaches are tested and cross-evaluated on the Cohn-Kanade and JAFFE databases. With less samples per gallery subject, high recognition rates comparable to previous works have been achieved indicating the robustness of the approaches. Among the approaches, the mixture of PLDAs has demonstrated better performances. The experimental results also indicate that facial regions around the cheeks, eyes, and eyebrows are more discriminative than regions around the mouth, jaw, chin, and nose.

Adaptive bilateral filtering using saliency map for deblocking low bit rate videos

This paper proposes a novel approach to video deblocking which performs perceptually adaptive bilateral filtering by considering color, intensity, and motion features in a holistic manner. The method is based on bilateral filter which is an effective smoothing filter that preserves edges. The bilateral filter parameters are adaptive and avoid over-blurring of texture regions and at the same time eliminate blocking artefacts in the smooth region and areas of slow motion content. This is achieved by using a saliency map to control the strength of the filter for each individual point in the image based on its perceptual importance. The experimental results demonstrate that the proposed algorithm is effective in deblocking highly compressed video sequences and to avoid over-blurring of edges and textures in salient regions of image.

Perceiving and pursuing novelty : a grounded theory of adolescent creativity

Creativity plays an increasingly important role in our personal, social, educational, and community lives. For adolescents, creativity can enable self-expression, be a means of pushing boundaries, and assist learning, achievement, and completion of everyday tasks. Moreover, adolescents who demonstrate creativity can potentially enhance their capacity to face unknown future challenges, address mounting social and ecological issues in our global society, and improve their career opportunities and contribution to the economy. For these reasons, creativity is an essential capacity for young people in their present and future, and is highlighted as a priority in current educational policy nationally and internationally. Despite growing recognition of creativity’s importance and attention to creativity in research, the creative experience from the perspectives of the creators themselves and the creativity of adolescents are neglected fields of study. Hence, this research investigated adolescents’ self-reported experiences of creativity to improve understandings of their creative processes and manifestations, and how these can be supported or inhibited. Although some aspects of creativity have been extensively researched, there were no comprehensive, multidisciplinary theoretical frameworks of adolescent creativity to provide a foundation for this study. Therefore, a grounded theory methodology was adopted for the purpose of constructing a new theory to describe and explain adolescents’ creativity in a range of domains. The study’s constructivist-interpretivist perspective viewed the data and findings as interpretations of adolescents’ creative experiences, co-constructed by the participants and the researcher. The research was conducted in two academically selective high schools in Australia: one arts school, and one science, mathematics, and technology school. Twenty adolescent participants (10 from each school) were selected using theoretical sampling. Data were collected via focus groups, individual interviews, an online discussion forum, and email communications. Grounded theory methods informed a process of concurrent data collection and analysis; each iteration of analysis informed subsequent data collection. Findings portray creativity as it was perceived and experienced by participants, presented in a Grounded Theory of Adolescent Creativity. The Grounded Theory of Adolescent Creativity comprises a core category, Perceiving and Pursuing Novelty: Not the Norm, which linked all findings in the study. This core category explains how creativity involved adolescents perceiving stimuli and experiences differently, approaching tasks or life unconventionally, and pursuing novel ideas to create outcomes that are not the norm when compared with outcomes by peers. Elaboration of the core category is provided by the major categories of findings. That is, adolescent creativity entailed utilising a network of Sub-Processes of Creativity, using strategies for Managing Constraints and Challenges, and drawing on different Approaches to Creativity – adaptation, transfer, synthesis, and genesis – to apply the sub-processes and produce creative outcomes. Potentially, there were Effects of Creativity on Creators and Audiences, depending on the adolescent and the task. Three Types of Creativity were identified as the manifestations of the creative process: creative personal expression, creative boundary pushing, and creative task achievement. Interactions among adolescents’ dispositions and environments were influential in their creativity. Patterns and variations of these interactions revealed a framework of four Contexts for Creativity that offered different levels of support for creativity: high creative disposition–supportive environment; high creative disposition–inhibiting environment; low creative disposition–supportive environment; and low creative disposition–inhibiting environment. These contexts represent dimensional ranges of how dispositions and environments supported or inhibited creativity, and reveal that the optimal context for creativity differed depending on the adolescent, task, domain, and environment. This study makes four main contributions, which have methodological and theoretical implications for researchers, as well as practical implications for adolescents, parents, teachers, policy and curriculum developers, and other interested stakeholders who aim to foster the creativity of adolescents. First, this study contributes methodologically through its constructivist-interpretivist grounded theory methodology combining the grounded theory approaches of Corbin and Strauss (2008) and Charmaz (2006). Innovative data collection was also demonstrated through integration of data from online and face-to-face interactions with adolescents, within the grounded theory design. These methodological contributions have broad applicability to researchers examining complex constructs and processes, and with populations who integrate multimedia as a natural form of communication. Second, applicable to creativity in diverse domains, the Grounded Theory of Adolescent Creativity supports a hybrid view of creativity as both domain-general and domain-specific. A third major contribution was identification of a new form of creativity, educational creativity (ed-c), which categorises creativity for learning or achievement within the constraints of formal educational contexts. These theoretical contributions inform further research about creativity in different domains or multidisciplinary areas, and with populations engaged in formal education. However, the key contribution of this research is that it presents an original Theory and Model of Adolescent Creativity to explain the complex, multifaceted phenomenon of adolescents’ creative experiences.

Improved Subject Identification in Surveillance Video using Super Resolution

The time consuming and labour intensive task of identifying individuals in surveillance video is often challenged by poor resolution and the sheer volume of stored video. Faces or identifying marks such as tattoos are often too coarse for direct matching by machine or human vision. Object tracking and super-resolution can then be combined to facilitate the automated detection and enhancement of areas of interest. The object tracking process enables the automatic detection of people of interest, greatly reducing the amount of data for super-resolution. Smaller regions such as faces can also be tracked. A number of instances of such regions can then be utilized to obtain a super-resolved version for matching. Performance improvement from super-resolution is demonstrated using a face verification task. It is shown that there is a consistent improvement of approximately 7% in verification accuracy, using both Eigenface and Elastic Bunch Graph Matching approaches for automatic face verification, starting from faces with an eye to eye distance of 14 pixels. Visual improvement in image fidelity from super-resolved images over low-resolution and interpolated images is demonstrated on a small database. Current research and future directions in this area are also summarized.

Development issues for the creative economy in Malaysia

Cultural tourism and creative industries have intersecting policy agendas and economic interdependencies. Most studies of the creative industries have focused on western countries. Cultural tourism is rarely included. However the arrival of the creative economy and its movement through developing countries has changed the relationship. Supporters of the creative economy now see fit to include tourism. This thesis addresses the development of the creative economy in Malaysia. The thesis conducted case studies on animation and museum sectors in Malaysia. These two case studies provide information on the development of creative economy in Malaysia. The study found that a top-down cultural management approach is being practised but that Malaysia is now influenced by new ideas concerning innovation and technical creativity. The study examined whether or not technical innovation by itself is enough. The reference points here are the Multimedia Super Corridor in Cyberjaya and other similar projects in the region. The museum case study was situated in Malacca. It showed that museums needed to adapt new media and new experiences to remain relevant in today’s world. In applying a case study approach, the thesis made use of interviews with key stakeholders, as well consulting numerous policy documents and web sites. Both case studies imitated similar products and services in the market but added local characteristics. This research project contributes significantly to the existing body of knowledge in the field of creative economy within the context of developing countries. Finally the thesis makes recommendations for Malaysia to better position itself in the regional economy while retaining its distinctive cultural identity.

Spectrum sensing using two-stage detection to compensate for reduced primary user duty cycle

Spectrum sensing is considered to be one of the most important tasks in cognitive radio. One of the common assumption among current spectrum sensing detectors is the full presence or complete absence of the primary user within the sensing period. In reality, there are many situations where the primary user signal only occupies a portion of the observed signal and the assumption of primary user duty cycle not necessarily fulfilled. In this paper we show that the true detection performance can degrade from the assumed achievable values when the observed primary user exhibits a certain duty cycle. Therefore, a two-stage detection method incorporating primary user duty cycle that enhances the detection performance is proposed. The proposed detector can improve the probability of detection under low duty cycle at the expense of a small decrease in performance at high duty cycle.

The pomegranate cycle : reconfiguring opera through performance, technology & composition

The Pomegranate Cycle is a practice-led enquiry consisting of a creative work and an exegesis. This project investigates the potential of self-directed, technologically mediated composition as a means of reconfiguring gender stereotypes within the operatic tradition. This practice confronts two primary stereotypes: the positioning of female performing bodies within narratives of violence and the absence of women from authorial roles that construct and regulate the operatic tradition. The Pomegranate Cycle redresses these stereotypes by presenting a new narrative trajectory of healing for its central character, and by placing the singer inside the role of composer and producer. During the twentieth and early twenty-first century, operatic and classical music institutions have resisted incorporating works of living composers into their repertory. Consequently, the canon’s historic representations of gender remain unchallenged. Historically and contemporarily, men have almost exclusively occupied the roles of composer, conductor, director and critic, and therefore men have regulated the pedagogy, performance practices, repertoire and organisations that sustain classical music. In this landscape, women are singers, and few have the means to challenge the constructions of gender they are asked to reproduce. The Pomegranate Cycle uses recording technologies as the means of driving change because these technologies have already challenged the regulation of the classical tradition by changing people’s modes of accessing, creating and interacting with music. Building on the work of artists including Phillips and van Veen, Robert Ashley and Diamanda Galas, The Pomegranate Cycle seeks to broaden the definition of what opera can be. This work examines the ways in which the operatic tradition can be hybridised with contemporary musical forms such as ambient electronica, glitch, spoken word and concrete sounds as a way of bringing the form into dialogue with contemporary music cultures. The ultilisation of other sound cultures within the context of opera enables women’s voices and stories to be presented in new ways, while also providing a point of friction with opera’s traditional storytelling devices. The Pomegranate Cycle simulates aesthetics associated with Western art music genres by drawing on contemporary recording techniques, virtual instruments and sound-processing plug-ins. Through such simulations, the work disrupts the way virtuosic human craft has been used to generate authenticity and regulate access to the institutions that protect and produce Western art music. The DIY approach to production, recording, composition and performance of The Pomegranate Cycle demonstrates that an opera can be realised by a single person. Access to the broader institutions which regulate the tradition are not necessary. In short, The Pomegranate Cycle establishes that a singer can be more than a voice and a performing body. She can be her own multimedia storyteller. Her audience can be anywhere.

The web site and brand trust as antecedents of online loyalty

As online business thrives, a company’s Web presence holds enormous importance as a source of information, entertainment, and customer service for Internet users. Besides being user-friendly, a Web site should offer interesting and enjoyable content to attract online visitors in an ever-changing multimedia environment. Companies that operate globally must know how cultural differences influence the way potential customers perceive their sites. This paper presents a model that highlights the importance of ease of use, enjoyment, content, and brand trust for Web site loyalty. The model is subsequently tested in four countries: Australia, Japan, Mongolia, and the USA. The results show that perceptual differences exist: while ease of use is crucial for Web site loyalty in all four countries, the importance of content, perceived enjoyment, and brand trust varies across different cultures.

Impact of region-of-interest video coding on perceived quality in mobile video

Effective streaming of video can be achieved by providing more bits to the most important region in the frame at the cost of reduced bits in the less important regions. This strategy can be beneficial for delivering high quality videos in mobile devices, especially when the availability of bandwidth is usually low and limited. While the state-of-the-art video codecs such as H.264 may have been optimised for perceived quality, it is hypothesised that users will give more attention to interesting region/object when watching videos. Therefore, giving a higher quality to region of interest (ROI)while reducing quality of other areas may result in improving the overall perceived quality without necessarily increasing the bitrate. In this paper, the impact of ROI-based encoded video on perceived quality is investigated by conducting a user study for varous target bitrates. The results from the user study demonstrate that ROI-based video coding has superior perceived quality compared to normal encoded video at the same bitrate in the lower bitrate range.

The sound of music : sharing song selections between collocated strangers in public urban places

This paper presents Capital Music, a mobile application enabling real-time sharing of song choices with collocated urban dwellers. Due to the real-time, location-based peer-to-peer approach of the application, a user experience study was performed utilising the Wizard of Oz method. The study provides insight into how sharing non-privacy sensitive but personal data in an anonymous way can influence the user experience of people in public urban places. We discuss the findings in relation to how Capital Music influences the process of “cocooning” in public urban places, the practice of designing anonymous interactions between collocated strangers, and how the sharing of song choices can create a sense of commonality between anonymous users in the urban space. The outcomes of this study are relevant for future location-based social networking applications that aim to create interactions between collocated strangers.

Automatic region-of-interest detection and prioritisation for visually optimised coding of low bit rate videos

The increasing popularity of video consumption from mobile devices requires an effective video coding strategy. To overcome diverse communication networks, video services often need to maintain sustainable quality when the available bandwidth is limited. One of the strategy for a visually-optimised video adaptation is by implementing a region-of-interest (ROI) based scalability, whereby important regions can be encoded at a higher quality while maintaining sufficient quality for the rest of the frame. The result is an improved perceived quality at the same bit rate as normal encoding, which is particularly obvious at the range of lower bit rate. However, because of the difficulties of predicting region-of-interest (ROI) accurately, there is a limited research and development of ROI-based video coding for general videos. In this paper, the phase spectrum quaternion of Fourier Transform (PQFT) method is adopted to determine the ROI. To improve the results of ROI detection, the saliency map from the PQFT is augmented with maps created from high level knowledge of factors that are known to attract human attention. Hence, maps that locate faces and emphasise the centre of the screen are used in combination with the saliency map to determine the ROI. The contribution of this paper lies on the automatic ROI detection technique for coding a low bit rate videos which include the ROI prioritisation technique to give different level of encoding qualities for multiple ROIs, and the evaluation of the proposed automatic ROI detection that is shown to have a close performance to human ROI, based on the eye fixation data.

Ambient media for the third place in urban environments

As ambient computing blends into the fabric of the modern urban environment developing a positive interplay between people, places, and technology to create enlivened, interactive cities becomes a necessary priority in how we imagine, understand, design, and develop cities. Designing technology for art, culture and gastronomic experiences, that are rich in community, can provide the means for collaborative action to (re)create cities that are lively, engaging, and promote a sense of well being as well as belonging.