Low-cost real-time gesture recognition

A major impediment to developing real-time computer vision systems has been the computational power and level of skill required to process video streams in real-time. This has meant that many researchers have either analysed video streams off-line or used expensive dedicated hardware acceleration techniques. Recent software and hardware developments have greatly eased the development burden of realtime image analysis leading to the development of portable systems using cheap PC hardware and software exploiting the Multimedia Extension (MMX) instruction set of the Intel Pentium chip. This paper describes the implementation of a computationally efficient computer vision system for recognizing hand gestures using efficient coding and MMX-acceleration to achieve real-time performance on low cost hardware.

Work at hand: an exploration of gesture in the context of work and everyday life to inform the design of gestural input devices

This research explores gestures used in the context of activities in the workplace and in everyday life in order to understand requirements and devise concepts for the design of gestural information appliances. A collaborative method of video interaction analysis devised to suit design explorations, the Video Card Game, was used to capture and analyse how gesture is used in the context of six different domains: the dentist's office; PDA and mobile phone use; the experimental biologist's laboratory; a city ferry service; a video cassette player repair shop; and a factory flowmeter assembly station. Findings are presented in the form of gestural themes, derived from the tradition of qualitative analysis but bearing some similarity to Alexandrian patterns. Implications for the design of gestural devices are discussed.

Adult language input in the early childhood educational setting

Age-related changes in the adult language addressed to children aged 2;0-4;0 years in polyadic conditions were investigated in Australian childcare centres. The language that 21 staff members addressed to these children was coded for multiple variables in the broad social categories of prosody, context, speech act and gesture. The linguistic components were coded within the categories of phonology, lexicon, morphology, syntax and referential deixis. Minimal age-related differences were found. Explanations for the similarity of the adult language input across the age groups within the early childhood educational environment, will be discussed

Mummy! Ball! Fish!: Why English-learning children produce nouns earlier than verbs

When English-learning children begin using words the majority of their early utterances (around 80%) are nouns. Compared to nouns, there is a paucity of verbs or non-verb relational words, such as 'up' meaning 'pick me up'. The primary explanations to account for these differences in use either argue in support of a 'cognitive account', which claims that verbs entail more cognitive complexity than nouns, or they provide evidence challenging this account. In this paper I propose an additional explanation for children's noun/verb asymmetry. Presenting a 'multi-modal account' of word-learning based on children's gesture and word combinations, I show that at the one-word stage English-learning children use gestures to express verb-like elements which leaves their words free to express noun-like elements.

The selection of intended actions and the observation of others' actions: A time-resolved fMRI study

Whenever we plan, imagine, or observe an action, the motor systems that would be involved in preparing and executing that action are similarly engaged. The way in which such common motor activation is formed, however, is likely to differ depending on whether it arises from our own intentional selection of action or from the observation of another's action. In this study, we use time-resolved event-related functional MRI to tease apart neural processes specifically related to the processing of observed actions, the selection of our own intended actions, the preparation for movement, and motor response execution. Participants observed a finger gesture movement or a cue indicating they should select their own finger gesture to perform, followed by a 5-s delay period; participants then performed the observed or self-selected action. During the preparation and readiness for action, prior to initiation, we found activation in a common network of higher motor areas, including dorsal and ventral premotor areas and the pre-supplementary motor area (pre-SMA); the more caudal SMA showed greater activation during movement execution. Importantly, the route to this common motor activation differed depending on whether participants freely selected the actions to perform or whether they observed the actions performed by another person. Observation of action specifically involved activation of inferior and superior parietal regions, reflecting involvement of the dorsal visual pathway in visuomotor processing required for planning the action. In contrast, the selection of action specifically involved the dorsal lateral prefrontal and anterior cingulate cortex, reflecting the role of these prefrontal areas in attentional selection and guiding the selection of responses. (c) 2005 Elsevier Inc. All rights reserved.

Dating the dreaming? Creation of myths and rituals for mounds along the northern Australian coastline

Shell mounds ceased to be built in many parts of coastal northern Australia about 800-600 years ago. They are the subject of stories told by Aboriginal people and some have been incorporated in ritual and political activities during the last 150 ears. These understandings emerged only after termination of the economic and environmental system that created them, 800-600 years ago, in a number of widely separated coastal regions, Modern stories and treatments of these mounds by Aboriginal people concern modern or near-modern practices. Modern views of the mounds, their mythological and ritual associations, may be explained by reference to the socioeconomic transitions seen in the archaeological record; but the recent cultural, social and symbolic statements about these places cannot inform us of the process or ideology concerned with the formation of the mounds. Many Aboriginal communities over the last half a millennium actively,formed understandings of new landscapes and systems of land use. Attempts to impose historic ideologies and cosmologies on earlier times fail to acknowledge the magnitude and rate of economic and ideological change on the tropical coastline of Australia.