FACSGen: a tool to synthesize emotional facial expressions through systematic manipulation of facial action units

To investigate the perception of emotional facial expressions, researchers rely on shared sets of photos or videos, most often generated by actor portrayals. The drawback of such standardized material is a lack of flexibility and controllability, as it does not allow the systematic parametric manipulation of specific features of facial expressions on the one hand, and of more general properties of the facial identity (age, ethnicity, gender) on the other. To remedy this problem, we developed FACSGen: a novel tool that allows the creation of realistic synthetic 3D facial stimuli, both static and dynamic, based on the Facial Action Coding System. FACSGen provides researchers with total control over facial action units, and corresponding informational cues in 3D synthetic faces. We present four studies validating both the software and the general methodology of systematically generating controlled facial expression patterns for stimulus presentation.

An eye for an eye: robust motion segmentation by applying the latest in human vision research

Automatically extracting interesting objects from videos is a very challenging task and is applicable to many research areas such robotics, medical imaging, content based indexing and visual surveillance. Automated visual surveillance is a major research area in computational vision and a commonly applied technique in an attempt to extract objects of interest is that of motion segmentation. Motion segmentation relies on the temporal changes that occur in video sequences to detect objects, but as a technique it presents many challenges that researchers have yet to surmount. Changes in real-time video sequences not only include interesting objects, environmental conditions such as wind, cloud cover, rain and snow may be present, in addition to rapid lighting changes, poor footage quality, moving shadows and reflections. The list provides only a sample of the challenges present. This thesis explores the use of motion segmentation as part of a computational vision system and provides solutions for a practical, generic approach with robust performance, using current neuro-biological, physiological and psychological research in primate vision as inspiration.

Bridging a yawning chasm: EEG investigations into the debate concerning the role of the human mirror neuron system in contagious yawning

Ongoing debate in the literature concerns whether there is a link between contagious yawning and the human mirror neuron system (hMNS). One way of examining this issue is with the use of the electroencephalogram (EEG) to measure changes in mu activation during the observation of yawns. Mu oscillations are seen in the alpha bandwidth of the EEG (8–12 Hz) over sensorimotor areas. Previous work has shown that mu suppression is a useful index of hMNS activation and is sensitive to individual differences in empathy. In two experiments, we presented participants with videos of either people yawning or control stimuli. We found greater mu suppression for yawns than for controls over right motor and premotor areas, particularly for those scoring higher on traits of empathy. In a third experiment, auditory recordings of yawns were compared against electronically scrambled versions of the same yawns. We observed greater mu suppression for yawns than for the controls over right lateral premotor areas. Again, these findings were driven by those scoring highly on empathy. The results from these experiments support the notion that the hMNS is involved in contagious yawning, emphasise the link between contagious yawning and empathy, and stress the importance of good control stimuli.

Reduced cortico-motor facilitation in a normal sample with high traits of autism

Recent research in social neuroscience proposes a link between mirror neuron system (MNS) and social cognition. The MNS has been proposed to be the neural mechanism underlying action recognition and intention understanding and more broadly social cognition. Pre-motor MNS has been suggested to modulate the motor cortex during action observation. This modulation results in an enhanced cortico-motor excitability reflected in increased motor evoked potentials (MEPs) at the muscle of interest during action observation. Anomalous MNS activity has been reported in the autistic population whose social skills are notably impaired. It is still an open question whether traits of autism in the normal population are linked to the MNS functioning. We measured TMS-induced MEPs in normal individuals with high and low traits of autism as measured by the autistic quotient (AQ), while observing videos of hand or mouth actions, static images of a hand or mouth or a blank screen. No differences were observed between the two while they observed a blank screen. However participants with low traits of autism showed significantly greater MEP amplitudes during observation of hand/mouth actions relative to static hand/mouth stimuli. In contrast, participants with high traits of autism did not show such a MEP amplitude difference between observation of actions and static stimuli. These results are discussed with reference to MNS functioning.

Suck the living labour

The project, commissioned by Ort, Birmingham, explores geriatric vampirism. Austerity measures have indebted the young and the old through the privatisation of education and health. These age groups have been thrown into a relationship of mutual dependency and conflicting interests. As well as a new film, the exhibition featured six videos that have been outsourced using the services of sellers on the website Fiverr, ‘a place for people to share things they're willing to do for $5’. Interrogating the means of production and the meaning of work under post-Fordism, the Suck the Living Labour extends Marx’s metaphor, comparing Capital to a vampiric force that thirsts for infinite surplus.

Bronze Age Boat

Photographs, videos and datasets related to Morgawr, the Bronze Age-type sewn-plank boat.

Interactive sensory objects for and by people with learning disabilities

This project engages people with learning disabilities as co-researchers and co-designers in the development of multisensory interactive artworks, with the aim of making museums or heritage sites more interesting, meaningful, and fun. This article describes our explorations, within this context, of a range of technologies including squishy circuits, littleBits, and easy-build websites, and presents examples of objects created by the co-researchers such as “sensory boxes” and interactive buckets, baskets, and boots. Public engagement is an important part of the project and includes an annual public event and seminar day, a blog rich with photos and videos of the workshops, and an activities book to give people ideas for creating their own sensory explorations of museums and heritage sites.

ReadingAct RGB-D action dataset and human action recognition from local features

For general home monitoring, a system should automatically interpret people’s actions. The system should be non-intrusive, and able to deal with a cluttered background, and loose clothes. An approach based on spatio-temporal local features and a Bag-of-Words (BoW) model is proposed for single-person action recognition from combined intensity and depth images. To restore the temporal structure lost in the traditional BoW method, a dynamic time alignment technique with temporal binning is applied in this work, which has not been previously implemented in the literature for human action recognition on depth imagery. A novel human action dataset with depth data has been created using two Microsoft Kinect sensors. The ReadingAct dataset contains 20 subjects and 19 actions for a total of 2340 videos. To investigate the effect of using depth images and the proposed method, testing was conducted on three depth datasets, and the proposed method was compared to traditional Bag-of-Words methods. Results showed that the proposed method improves recognition accuracy when adding depth to the conventional intensity data, and has advantages when dealing with long actions.

Using mobile devices to enhance undergraduate field research

Mobile devices can enhance undergraduate research projects and students’ research capabilities. The use of mobile devices such as tablet computers will not automatically make undergraduates better researchers, but their use should make investigations, writing, and publishing more effective and may even save students time. We have explored some of the possibilities of using “tablets” and “smartphones” to aid the research and inquiry process in geography and bioscience fieldwork. We provide two case studies as illustration of how students working in small research groups use mobile devices to gather and analyze primary data in field-based inquiry. Since April 2010, Apple’s iPad has changed the way people behave in the digital world and how they access their music, watch videos, or read their email much as the entrepreneurs Steve Jobs and Jonathan Ive intended. Now with “apps” and “the cloud” and the ubiquitous references to them appearing in the press and on TV, academics’ use of tablets is also having an impact on education and research. In our discussion we will refer to use of smartphones such as the iPhone, iPod, and Android devices under the term “tablet”. Android and Microsoft devices may not offer the same facilities as the iPad/iphone, but many app producers now provide versions for several operating systems. Smartphones are becoming more affordable and ubiquitous (Melhuish and Falloon 2010), but a recent study of undergraduate students (Woodcock et al. 2012, 1) found that many students who own smartphones are “largely unaware of their potential to support learning”. Importantly, however, students were found to be “interested in and open to the potential as they become familiar with the possibilities” (Woodcock et al. 2012). Smartphones and iPads could be better utilized than laptops when conducting research in the field because of their portability (Welsh and France 2012). It is imperative for faculty to provide their students with opportunities to discover and employ the potential uses of mobile devices in their learning. However, it is not only the convenience of the iPad or tablet devices or smartphones we wish to promote, but also a way of thinking and behaving digitally. We essentially suggest that making a tablet the center of research increases the connections between related research activities.

Meeting detection in video through semantic analysis

In this paper we present a novel approach to detect people meeting. The proposed approach works by translating people behaviour from trajectory information into semantic terms. Having available a semantic model of the meeting behaviour, the event detection is performed in the semantic domain. The model is learnt employing a soft-computing clustering algorithm that combines trajectory information and motion semantic terms. A stable representation can be obtained from a series of examples. Results obtained on a series of videos with different types of meeting situations show that the proposed approach can learn a generic model that can effectively be applied on the behaviour recognition of meeting situations.

Generic intertextuality in online social activism: the case of the It Gets Better project

The It Gets Better project has been held up as a model of successful social media activism. This article explores how narrators of It Gets Better videos make use of generic intertextuality, strategically combining the canonical narrative genres of the exemplum, the testimony, and the confession in a way that allows them to claim ‘textual authority’ and to make available multiple moral positions for themselves and their listeners. This strategy is further facilitated by the ambiguous participation frameworks associated with digital media, which make it possible for storytellers to tell different kinds of stories to different kinds of listeners at the same time, to simultaneously comfort the victims of anti-gay violence, confront its perpetrators, and elicit sympathy from ‘onlookers’. This analysis highlights the potential of new practices of online storytelling for social activism, and challenges notions that new media are contributing to the demise of common narrative traditions.

Understanding digital literacies: a practical introduction

Understanding Digital Literacies provides an accessible and timely introduction to new media literacies. It supplies readers with the theoretical and analytical tools with which to explore the linguistic and social impact of a host of new digital literacy practices. Each chapter in the volume covers a different topic, presenting an overview of the major concepts, issues, problems and debates surrounding the topic, while also encouraging students to reflect on and critically evaluate their own language and communication practices. Features include: coverage of a diverse range of digital media texts, tools and practices including blogging, hypertextual organisation, Facebook, Twitter, YouTube, Wikipedia, websites and games an extensive range of examples and case studies to illustrate each topic, such as how blogs have affected our thinking about communication, how the creation and sharing of digital images and video can bring about shifts in social roles, and how the design of multiplayer online games for children can promote different ideologies a variety of discussion questions and mini-ethnographic research projects involving exploration of various patterns of media production and communication between peers, for example in the context of Wikinomics and peer production, social networking and civic participation, and digital literacies at work end of chapter suggestions for further reading and links to key web and video resources a companion website providing supplementary material for each chapter, including summaries of key issues, additional web-based exercises, and links to further resources such as useful websites, articles, videos and blogs.

Making: the invisible visible

In this book essay I argue that modern and contemporary works of art (i.e. paintings, photographs, films, and videos) really ought to retrieve something of their auratic-character, which turns the physical toward the metaphysical, the material toward the immaterial, the visible toward the invisible - making artworks, ‘things among things, something other than [a] thing’ (Theodor W. Adorno, Aesthetic Theory, 86). There is, perhaps, an aura to art or art is a medium or a conduit or a technology for rediscovering and reproducing aura, which makes it something other than a mere thing. Such works of art are constitutively enigmatic, a certain form of magic making: they (re-)distribute the visible and the invisible, they (re-)configure appearance and disappearance. Such works of art may become visual events, which begin an education in and through (dis-)appearances. To achieve this end, I detail Theodor W. Adorno’s and Walter Benjamin’s respective theories of (art’s) aura in the age of technological reproducibility, which I relate to Jacques Rancière’s more recent discussion of the ‘pensive image,’ and I focus my reading on a number of works by Susan Hiller (photographs), John Constable (paintings), Alfred Stieglitz (photographs), and Tacita Dean (photograph and 16mm film).

Sport and re/creation: what skateboarders can teach us about learning

This paper explores the role of digital media and creativity in the processes of learning that occur in groups of urban skateboarders. In particular, it examines how the production and consumption of amateur videos contribute to both skaters’ mastery of the techniques of the sport and their integration into the culture of the sport. The data come from an ethnographic study of skateboarders in Hong Kong, which included in-depth interviews, participant observation and the collection of texts and artifacts like magazines, blog entries and amateur skating videos. Skateboarders use video in a number of ways that significantly impact their learning and integration into their communities. They use it to analyze tricks and techniques, to document the stages of their learning and socialization into the group, to set community standards, to build a sense of belonging with their ‘crews’ and to imagine ‘idealized futures’ for themselves and their communities. Understanding the value and function of such ‘semiotic mediation’ in learning and socialization into sport cultures, I suggest, can contribute to helping physical educators design tasks that integrate training in physical skills with opportunities for students to make meaning around their experiences of sport and physical education.

Mediated addiction: The drug discourses of Hong Kong youth

This paper examines the ways young people in Hong Kong at different stages of involvement with illegal drugs respond to government produced anti-drug television commercials through a methodology which provided them with the technical skills and equipment to make their own short videos about drugs. An analysis of the videos they produced and their interaction while producing them reveals that participants with different drug-taking experiences have very different and often multiple ways of talking about drugs, and that these different ‘discourses’ and the ways they are deployed in different contexts affect how ‘at-risk’ they are for new or continued drug use and how they respond to anti-drug messages designed to mitigate this risk.