Distributed low-power image processing in wireless sensor networks for intelligent video surveillance applications

Distributed Wireless Smart Camera (DWSC) network is a special type of Wireless Sensor Network (WSN) that processes captured images in a distributed manner. While image processing on DWSCs sees a great potential for growth, with its applications possessing a vast practical application domain such as security surveillance and health care, it suffers from tremendous constraints. In addition to the limitations of conventional WSNs, image processing on DWSCs requires more computational power, bandwidth and energy that presents significant challenges for large scale deployments. This dissertation has developed a number of algorithms that are highly scalable, portable, energy efficient and performance efficient, with considerations of practical constraints imposed by the hardware and the nature of WSN. More specifically, these algorithms tackle the problems of multi-object tracking and localisation in distributed wireless smart camera net- works and optimal camera configuration determination. Addressing the first problem of multi-object tracking and localisation requires solving a large array of sub-problems. The sub-problems that are discussed in this dissertation are calibration of internal parameters, multi-camera calibration for localisation and object handover for tracking. These topics have been covered extensively in computer vision literatures, however new algorithms must be invented to accommodate the various constraints introduced and required by the DWSC platform. A technique has been developed for the automatic calibration of low-cost cameras which are assumed to be restricted in their freedom of movement to either pan or tilt movements. Camera internal parameters, including focal length, principal point, lens distortion parameter and the angle and axis of rotation, can be recovered from a minimum set of two images of the camera, provided that the axis of rotation between the two images goes through the camera's optical centre and is parallel to either the vertical (panning) or horizontal (tilting) axis of the image. For object localisation, a novel approach has been developed for the calibration of a network of non-overlapping DWSCs in terms of their ground plane homographies, which can then be used for localising objects. In the proposed approach, a robot travels through the camera network while updating its position in a global coordinate frame, which it broadcasts to the cameras. The cameras use this, along with the image plane location of the robot, to compute a mapping from their image planes to the global coordinate frame. This is combined with an occupancy map generated by the robot during the mapping process to localised objects moving within the network. In addition, to deal with the problem of object handover between DWSCs of non-overlapping fields of view, a highly-scalable, distributed protocol has been designed. Cameras that follow the proposed protocol transmit object descriptions to a selected set of neighbours that are determined using a predictive forwarding strategy. The received descriptions are then matched at the subsequent camera on the object's path using a probability maximisation process with locally generated descriptions. The second problem of camera placement emerges naturally when these pervasive devices are put into real use. The locations, orientations, lens types etc. of the cameras must be chosen in a way that the utility of the network is maximised (e.g. maximum coverage) while user requirements are met. To deal with this, a statistical formulation of the problem of determining optimal camera configurations has been introduced and a Trans-Dimensional Simulated Annealing (TDSA) algorithm has been proposed to effectively solve the problem.

West End : seat of power? (Griffith, QLD)

This video details interviews undertaken and shows a range of varying local opinions in West End within the Griffith electorate of Brisbane in the lead up to 2007's federal election. In 2007, West Enders had both the sitting Queensland Premier, Anna Bligh, and the impending Prime Minister, Kevin Rudd, as their local members. This video was produced as part of the YouDecide2007, a non-profit citizen journalism intiative led by QUT's Creative Industries and funded by the ARC. The camera man and editor was Barry Saunders.

An evaluation of different features and learning models for anomalous event detection

The huge amount of CCTV footage available makes it very burdensome to process these videos manually through human operators. This has made automated processing of video footage through computer vision technologies necessary. During the past several years, there has been a large effort to detect abnormal activities through computer vision techniques. Typically, the problem is formulated as a novelty detection task where the system is trained on normal data and is required to detect events which do not fit the learned ‘normal’ model. There is no precise and exact definition for an abnormal activity; it is dependent on the context of the scene. Hence there is a requirement for different feature sets to detect different kinds of abnormal activities. In this work we evaluate the performance of different state of the art features to detect the presence of the abnormal objects in the scene. These include optical flow vectors to detect motion related anomalies, textures of optical flow and image textures to detect the presence of abnormal objects. These extracted features in different combinations are modeled using different state of the art models such as Gaussian mixture model(GMM) and Semi- 2D Hidden Markov model(HMM) to analyse the performances. Further we apply perspective normalization to the extracted features to compensate for perspective distortion due to the distance between the camera and objects of consideration. The proposed approach is evaluated using the publicly available UCSD datasets and we demonstrate improved performance compared to other state of the art methods.

Pornography as creative industry

Much academic writing on pornography focuses on the genre’s exceptionalism (the ways in which it is different from other forms of culture). This paper rather focuses on its typicality as a Creative Industry. As with other Creative Industries, in the production and distribution of pornography it is producers who make most money. While a small number of on-camera performers become wealthy and powerful the majority lack creative control and are poorly paid. The careers of performers are typically short examples of “nomadic labour”. Many creative workers are involved in the production of pornography apart those in front of the camera, and the skills of these behind-the-camera creatives can be transferable across sectors. Like other Creative Industries, the pornography business is facing challenges from increased digitalization and globalization; and like other Creative Industries the solutions to these challenges lie in branding, niche marketing, and exploiting new technological possibilities.

Use of a photographic food diary method to document dietary intake in people with Parkinson's Disease

Cognitive impairment and physical disability are common in Parkinson’s disease (PD). As a result diet can be difficult to measure. This study aimed to evaluate the use of a photographic dietary record (PhDR) in people with PD. During a 12-week nutrition intervention study, 19 individuals with PD kept 3-day PhDRs on three occasions using point-and-shoot digital cameras. Details on food items present in the PhDRs and those not photographed were collected retrospectively during an interview. Following the first use of the PhDR method, the photographer completed a questionnaire (n=18). In addition, the quality of the PhDRs was evaluated at each time point. The person with PD was the sole photographer in 56% of the cases, with the remainder by the carer or combination of person with PD and the carer. The camera was rated as easy to use by 89%, keeping a PhDR was considered acceptable by 94% and none would rather use a “pen and paper” method. Eighty-three percent felt confident to use the camera again to record intake. Of the photos captured (n=730), 89% were of adequate quality (items visible, in-focus), while only 21% could be used alone (without interview information) to assess intake. Over the study, 22% of eating/drinking occasions were not photographed. PhDRs were considered an easy and acceptable method to measure intake among individuals with PD and their carers. The majority of PhDRs were of adequate quality, however in order to quantify intake the interview was necessary to obtain sufficient detail and capture missing items.

Innovations in dietary interventions : Use of a photographic food diary method and telephone linked computerized care in chronic disease

Access to dietetic care is important in chronic disease management and innovative technologies assists in this purpose. Photographic dietary records (PhDR) using mobile phones or cameras are valid and convenient for patients. Innovations in providing dietary interventions via telephone and computer can also inform dietetic practice. Three studies are presented. A mobile phone method was validated by comparing energy intake (EI) to a weighed food record and a measure of energy expenditure (EE) obtained using the doubly labelled water technique in 10 adults with T2 diabetes. The level of agreement between mean (±sd) energy intake mobile phone (8.2±1.7 MJ) and weighed record (8.5±1.6 MJ) was high (p=0.392), however EI/EE for both methods gave similar levels of under-reporting (0.69 and 0.72). All subjects preferred using the mobile phone vs. weighed record. Nineteen individuals with Parkinsons disease kept 3-day PhDRs on three occasions using point-and-shoot digital cameras over a 12 week period. The camera was rated as easy to use by 89%, keeping a PhDR was considered acceptable by 94% and none would rather use a “pen and paper” method. Eighty-three percent felt confident to use the camera again to record intake. An interactive, automated telephone system designed to coach people with T2 diabetes to adopt and maintain diabetes self-care behaviours, including nutrition, showed trends for improvements in total fat, saturated fat and vegetable intake of the intervention group compared to control participants over 6 months. Innovative technologies are acceptable to patients with chronic conditions and can be incorporated into dietetic care.

A security system based on human iris identification using wavelet transform

A security system based on the recognition of the iris of human eyes using the wavelet transform is presented. The zero-crossings of the wavelet transform are used to extract the unique features obtained from the grey-level profiles of the iris. The recognition process is performed in two stages. The first stage consists of building a one-dimensional representation of the grey-level profiles of the iris, followed by obtaining the wavelet transform zerocrossings of the resulting representation. The second stage is the matching procedure for iris recognition. The proposed approach uses only a few selected intermediate resolution levels for matching, thus making it computationally efficient as well as less sensitive to noise and quantisation errors. A normalisation process is implemented to compensate for size variations due to the possible changes in the camera-to-face distance. The technique has been tested on real images in both noise-free and noisy conditions. The technique is being investigated for real-time implementation, as a stand-alone system, for access control to high-security areas.

"Show me, how does it look now" : remote help-giving in collaborative design

This paper examines the role of visual information in a remote help-giving situation involving the collaborative physical task of designing a prototype remote control. We analyze a set of video recordings captured within an experimental setting. Our analysis shows that using gestures and relevant artefacts and by projecting activities on the camera, participants were able to discuss several design-related issues. The results indicate that with a limited camera view (mainly faces and shoulders), participants' conversations were centered at the physical prototype that they were designing. The socially organized use of our experimental setting provides some key implications for designing future remote collaborative systems.

A hierarchical model of goal directed navigation selects trajectories in a visual environment

We have developed a Hierarchical Look-Ahead Trajectory Model (HiLAM) that incorporates the firing pattern of medial entorhinal grid cells in a planning circuit that includes interactions with hippocampus and prefrontal cortex. We show the model’s flexibility in representing large real world environments using odometry information obtained from challenging video sequences. We acquire the visual data from a camera mounted on a small tele-operated vehicle. The camera has a panoramic field of view with its focal point approximately 5 cm above the ground level, similar to what would be expected from a rat’s point of view. Using established algorithms for calculating perceptual speed from the apparent rate of visual change over time, we generate raw dead reckoning information which loses spatial fidelity over time due to error accumulation. We rectify the loss of fidelity by exploiting the loop-closure detection ability of a biologically inspired, robot navigation model termed RatSLAM. The rectified motion information serves as a velocity input to the HiLAM to encode the environment in the form of grid cell and place cell maps. Finally, we show goal directed path planning results of HiLAM in two different environments, an indoor square maze used in rodent experiments and an outdoor arena more than two orders of magnitude larger than the indoor maze. Together these results bridge for the first time the gap between higher fidelity bio-inspired navigation models (HiLAM) and more abstracted but highly functional bio-inspired robotic mapping systems (RatSLAM), and move from simulated environments into real-world studies in rodent-sized arenas and beyond.

Social turkey

Social Turkey is a short digital dance video developed over a series of weekly meetings with a group of sprightly and defiant sixty-plus year olds resident in Limerick. Very early in the process artist Ciara Finnegan and choreographer Jenny Roche found each individual expressing a wonderful enthusiasm for dance, an eagerness to perform and a healthy refusal to conform to stereotypes of aging. Finnegan was keen that this project should support an exchange of ideas rather than employ a top-down directorial structure. While Roche devised the fundamentals of the dance and Finnegan manned the camera, each participant contributed thereafter - improvising on a step sequence and collaborating on patterns that ultimately determined much of the look of the result. The work seeks to amplify the represented interests of a wider community while celebrating the vivacity of the particular group and the sheer fun of the collaboration.

A glossary of bodily responses

A collaborative video with Avril Huddy where two viewpoints, performer and documenter, were presented simultaneously to investigate Arakawa and Gin’s notion of “boundary-swaying”. In this performance-work, the performer influences what the camera is able to capture by engaging the documenter in a form of improvised dance. The performer’s movements appear impulsive and unpredictable, testing ways for the documenter to frame the performer’s movement. The images revealed by the documenter’s camera reflect a complexity of moments and co-incidences, evoking a sense of the performer’s embodied thinking within improvised movement. While a second camera uses a conventional wide angle shot to document the unfolding of the performance-work and track the connection between the documenter and the performer. While the performance-work itself is still highly-experimental, the ideas underpinning this exploration suggest how future investigations integrating more sensitive technology such as motion capture and tracking devises may be investigated. This performance-work formed part of the Creative Response Exhibition curated by Alan Prohm, Bill Lavender and Jason Nelson and a peer-review committee as part of the proceedings of the AG3 Online: Third International Arakawa and Gins Architecture and Philosophy Conference, hosted by the Centre for Public Culture and Ideas at Griffith University.

Epistemological lens : birth, death and ecology of documentary practices

This paper considers the epistemological life cycle of the camera lens in documentary practices. The 19th century industrial economies that manufactured and commercialised the camera lens have engendered political and economic contingencies on documentary practices to sustain a hegemonic and singular interpretive epistemology. Colonial documentary practices are considered from the viewpoint of manipulative hegemonic practices - all of which use the interpretive epistemology of the camera lens to capitalise a viewpoint which is singular and possesses the power to sustain its own status and economic privilege. I suggest that decolonising documentary practices can be nurtured in what Boaventura de Sousa Santos proposes as an 'ecology of knowledges' (Andreotti, Ahenakew, & Cooper 2011) - a way of including the epistemologies of cultures beyond the 'abyssal' (Santos), outside the limits of epistemological dominance. If an 'epistemicide' (Santos) of indigenous knowledges in the dominant limits has occurred then in an ecology of knowledges the limits become limitless and what were once invisible knowledges, come into their own ontological and epistemological being: as free agents and on their own terms. In an ecology of knowledges, ignorance and blindness may still exist but are not privileged. The decolonisation of documentary practices inevitably destabilises prevailing historicities and initiates ways for equal privilege to exist between multiple epistemologies.

In-vehicle filming of driver fatigue on YouTube: Vlogs, crashes and bad advice

Background: Driver fatigue contributes to 15-30% of crashes, however it is difficult to objectively measure. Fatigue mitigation relies on driver self-moderation, placing great importance on the necessity for road safety campaigns to engage with their audience. Popular self-archiving website YouTube.com is a relatively unused source of public perceptions. Method: A systematic YouTube.com search (videos uploaded 2/12/09 - 2/12/14) was conducted using driver fatigue related search terms. 442 relevant videos were identified. In-vehicle footage was separated for further analysis. Video reception was quantified in terms of number of views, likes, comments, dislikes and times duplicated. Qualitative analysis of comments was undertaken to identify key themes. Results: 4.2% (n=107) of relevant uploaded videos contained in-vehicle footage. Three types of videos were identified: (1) dashcam footage (n=82); (2) speaking directly to the camera - vlogs (n=16); (3) passengers filming drivers (n=9). Two distinct types of comments emerged, those directly relating to driver fatigue and those more broadly about the video or its uploader. Driver fatigue comments included: attribution of behaviour cause, emotion experienced when watching the video and personal advice on staying awake while driving. Discussion: In-vehicle footage related to driver fatigue is prevalent on YouTube.com and is actively engaged with by viewers. Comments were mixed in terms of criticism and sympathy for drivers. Willingness to share advice on staying awake suggests driver fatigue may be seen as a common yet controllable occurrence. This project provides new insight into driver fatigue perception, which may be considered by safety authorities when designing education campaigns.

Family and guests at Aenny Catzenstein nee Gottschalk's 80th birthday party; London.

Dinner scene with Franz Mattheisen left, daughter Susan Mattheisen next to him, next daughter Maren Matthiesen, his wife Olga Matthiesen at the end of the table. Beatrice Durand is facing the camera

Strategies for collecting screen-less oscillation data

Screen-less oscillation photography is the method of choice for recording three-dimensional X-ray diffraction data for crystals of biological macromolecules. The geometry of an oscillation camera is extremely simple. However, the manner in which the reciprocal lattice is recorded in any experiment is fairly complex. This depends on the Laue symmetry of the reciprocal lattice, the lattice type, the orientation of the crystal on the camera and to a lesser extent on the unit-cell dimensions. Exploring the relative efficiency of collecting X-ray diffraction data for different crystal orientations prior to data collection might reduce the number of films required to record most of the unique data and the consequent amount of time required for processing these films. Here algorithms are presented suitable for this purpose and results are reported for the 11 Laue groups, different lattice types and crystal orientations often employed in data collection.