A Longitudinal Investigation of Infant Gesture Use and Parent Speech: Unique and Dynamic Influences on Infant Vocabulary Acquisition

How do infants learn word meanings? Research has established the impact of both parent and child behaviors on vocabulary development, however the processes and mechanisms underlying these relationships are still not fully understood. Much existing literature focuses on direct paths to word learning, demonstrating that parent speech and child gesture use are powerful predictors of later vocabulary. However, an additional body of research indicates that these relationships don’t always replicate, particularly when assessed in different populations, contexts, or developmental periods.

The current study examines the relationships between infant gesture, parent speech, and infant vocabulary over the course of the second year (10-22 months of age). Through the use of detailed coding of dyadic mother-child play interactions and a combination of quantitative and qualitative data analytic methods, the process of communicative development was explored. Findings reveal non-linear patterns of growth in both parent speech content and child gesture use. Analyses of contingency in dyadic interactions reveal that children are active contributors to communicative engagement through their use of gestures, shaping the type of input they receive from parents, which in turn influences child vocabulary acquisition. Recommendations for future studies and the use of nuanced methodologies to assess changes in the dynamic system of dyadic communication are discussed.

James Sacré, a writing of life gesture

In French contemporary poetry, some poets have wished to return to —and so to increase the value of— the enunciation of the poetic subject. In such poetic scenario, the poet James Sacré exemplifies a new approach that tries to re-establish contact with the expression of the poetic subject, albeit always avoiding the pitfalls of excessive ornamentation and poetic effusiveness. Based on the use of simple language, this approach attaches value to legibility and does not hesitate to tap into the most banal or dullest aspects of reality. This article studies one of the procedures used by the poet to reestablish the expression of the poetic subject. This procedure seeks to rewrite life gestures—a technique that evinces an unavoidable relationship between life and poetic words in the work of James Sacré.

Hand pose detection for vision-based gesture interfaces

[EN]Vision-based applications designed for humanmachine interaction require fast and accurate hand detection. However, previous works on this field assume different constraints, like a limitation in the number of detected gestures, because hands are highly complex objects to locate. This paper presents an approach which changes the detection target without limiting the number of detected gestures. Using a cascade classifier we detect hands based on their wrists. With this approach, we introduce two main contributions: (1) a reliable segmentation, independently of the gesture being made and (2) a training phase faster than previous cascade classifier based methods. The paper includes experimental evaluations with different video streams that illustrate the efficiency and suitability for perceptual interfaces.

Playing with sound and gesture in digital audio games

This article introduces the genre of a digital audio game and discusses selected play interaction solutions implemented in the Audio Game Hub, a prototype designed and evaluated in the years 2014 and 2015 at the Gamification Lab at Leuphana University Lüneburg.1 The Audio Game Hub constitutes a set of familiar playful activities (aiming at a target, reflex-based reacting to sound signals, labyrinth exploration) and casual games (e.g. Tetris, Memory) adapted to the digital medium and converted into the audio sphere, where the player is guided predominantly or solely by sound. The authors will discuss the design questions raised at early stages of the project, and confront them with the results of user experience testing performed on two groups of sighted and one group of visually impaired gamers.

A touchless passive Infrared gesture sensor.

A sensing device for a touchless, hand gesture, user interface based on an inexpensive passive infrared pyroelectric detector array is presented. The 2 x 2 element sensor responds to changing infrared radiation generated by hand movement over the array. The sensing range is from a few millimetres to tens of centimetres. The low power consumption (< 50 μW) enables the sensor’s use in mobile devices and in low energy applications. Detection rates of 77% have been demonstrated using a prototype system that differentiates the four main hand motion trajectories – up, down, left and right. This device allows greater non-contact control capability without an increase in size, cost or power consumption over existing on/off devices.

Interaction techniques with novel multimodal feedback for addressing gesture-sensing systems

Users need to be able to address in-air gesture systems, which means finding where to perform gestures and how to direct them towards the intended system. This is necessary for input to be sensed correctly and without unintentionally affecting other systems. This thesis investigates novel interaction techniques which allow users to address gesture systems properly, helping them find where and how to gesture. It also investigates audio, tactile and interactive light displays for multimodal gesture feedback; these can be used by gesture systems with limited output capabilities (like mobile phones and small household controls), allowing the interaction techniques to be used by a variety of device types. It investigates tactile and interactive light displays in greater detail, as these are not as well understood as audio displays. Experiments 1 and 2 explored tactile feedback for gesture systems, comparing an ultrasound haptic display to wearable tactile displays at different body locations and investigating feedback designs. These experiments found that tactile feedback improves the user experience of gesturing by reassuring users that their movements are being sensed. Experiment 3 investigated interactive light displays for gesture systems, finding this novel display type effective for giving feedback and presenting information. It also found that interactive light feedback is enhanced by audio and tactile feedback. These feedback modalities were then used alongside audio feedback in two interaction techniques for addressing gesture systems: sensor strength feedback and rhythmic gestures. Sensor strength feedback is multimodal feedback that tells users how well they can be sensed, encouraging them to find where to gesture through active exploration. Experiment 4 found that they can do this with 51mm accuracy, with combinations of audio and interactive light feedback leading to the best performance. Rhythmic gestures are continuously repeated gesture movements which can be used to direct input. Experiment 5 investigated the usability of this technique, finding that users can match rhythmic gestures well and with ease. Finally, these interaction techniques were combined, resulting in a new single interaction for addressing gesture systems. Using this interaction, users could direct their input with rhythmic gestures while using the sensor strength feedback to find a good location for addressing the system. Experiment 6 studied the effectiveness and usability of this technique, as well as the design space for combining the two types of feedback. It found that this interaction was successful, with users matching 99.9% of rhythmic gestures, with 80mm accuracy from target points. The findings show that gesture systems could successfully use this interaction technique to allow users to address them. Novel design recommendations for using rhythmic gestures and sensor strength feedback were created, informed by the experiment findings.

Gesture based IoT light control for smart clothing

In this paper, a smart wireless wristband is proposed. The potential of innovative gesture based interactivity with connected lighting solutions is reviewed. The solution is intended to offer numerous benefits, in terms of ease of use, and enhanced dynamic interactive functionality. A comparative analysis will be carried out between this work and existing solutions. The evolution of lighting and gesture controls will be discussed and an overview of alternative applications will be provided, as part of the critical analysis.

Show

Script for non-verbal performance. Research Component: Silent Treatment: Creating Non-verbal Performance Works for Children The research field of theatre for young people draws on theories of child development and popular culture. SHOW explored personal and social development, friendship and creative play through the lens of the experience of girls aged 8-12. This project consolidated and refined innovative approaches to creating non-verbal theatre performance, and addressed challenges inherent in the creation of a performance by adults for young audiences. A significant finding of the project was the unanticipated convergence of creative practice and research into child behaviour and development: the congruence of content (Female bullying) and theatrical form (non-verbal performance: “Within the hidden culture of aggression, girls fight with body language and relationships instead of fists and knives. In this world, friendship is a weapon, and the sting of a shout pales in comparison to a day of someone’s silence. There is no gesture more devastating than the back turning away Simmons, Rachel (2002:3) Odd Girl Out: The Hidden Culture Of Aggression In Girls Schwartz Books The creative development and drafting process focussed on negotiating the conceptual design and practical constraints of incorporating diegetic music and video sources into the narrative. The authorial (and production) challenges of creating a script that could facilitate the re-mount a non-verbal work for a company specialising in text-based theatre . Show was commissioned by the Queensland Theatre Company in 2003, toured into Queensland Schools by the Queensland Arts Council and in 2004 was performed at the Sydney Opera House.

Meaning in movement : a gestural design game

This paper describes a design game that we called 'Meaning in Movement'. The purpose was to explore notions of professional dental practice with dental practioners in terms of gestures, actions and movements. The game represents a first step towards involving gestures, actions and movements in a design dialog with practioners for the purpose of designing future interactive systems which are more appropriate to the type of skilful actions and richly structured environments of dentists and dental assistants.

A participatory design agenda for ubiquitous computing : a case study in dental practice

This paper reflects upon our attempts to bring a participatory design approach to design research into interfaces that better support dental practice. The project brought together design researchers, general and specialist dental practitioners, the CEO of a dental software company and, to a limited extent, dental patients. We explored the potential for deployment of speech and gesture technologies in the challenging and authentic context of dental practices. The paper describes the various motivations behind the project, the negotiation of access and the development of the participant relationships as seen from the researchers' perspectives. Conducting participatory design sessions with busy professionals demands preparation, improvisation, and clarity of purpose. The paper describes how we identified what went well and when to shift tactics. The contribution of the paper is in its description of what we learned in bringing participatory design principles to a project that spanned technical research interests, commercial objectives and placing demands upon the time of skilled professionals.

Nodule

Nodule is 19'54" musical work for two electronic music performers, two laptop computers and a custom built, sensor-based microphone controller - the e-Mic (Extended Mic-stand Interface Controller). This interface was developed by one of the co-authors, Donna Hewitt. The e-Mic allows a vocal performer to manipulate their voice in real time by capturing physical gestures via an array of sensors - pressure, distance, tilt – in addition to ribbon controllers and an X-Y joystick microphone mount. Performance data are then sent to a computer, running audio-processing software, which is used to transform the audio signal from the microphone in real time. The work seeks to explore the liminal space between the electro-acoustic music tradition and more recent developments in the electronic dance music tradition. It does so on both a performative (gestural) and compositional (sonic) level. Visually, the performance consists of a singer and a laptop performer, hybridising the gestural context of these traditions. On a sonic level, the work explores hybridity at deeper levels of the musical structure than simple bricolage or collage approaches. Hybridity is explored at the level of the sonic gesture (source material), in production (audio processing gestures), in performance gesture, and in approaches to the use of the frequency spectrum, pulse and meter. The work was designed to be performed in a range of contexts from concert halls, to clubs, to rock festivals, across a range of staging and production platforms. As a consequence, the work has been tested in a range of audience contexts, and has allowed the transportation of compositional and performance practices across traditional audience demographic boundaries.

Contour house

Set atop a magnificent site on the Bellarine Peninsula, Contour House anchors itself into the landscape with a 5.5 meter-high folding concrete wall. This gesture is both protective and revealing, simultaneously creating an internal courtyard, while extending the spectacular 270- degree views into the living areas. This residence extends our interest in 'the journey' and ideas of place-making, particularly the manner in which it might challenge preconceived ways of living.

AITPM Email Newsletter Volume 0902, February 2009: Presidents Message

President’s Report Hello fellow AITPM members, Welcome to the first edition of the AITPM National Newsletter for 2009! I trust we all had a relaxing break and managed to lose track of all things transport for just a little while. I know I had trouble doing so when hunting for a car space at the shopping centre, and experiencing new projects such as the Tugun Bypass – the new gateway between New South Wales and Queensland. Byron Bay is now as close as Noosa for those high profile beach goers of Brisbane. There was also my experience of the reduced posted speed of 90km/h on the Bruce Highway around the troublesome Gympie stretch, when returning from a short Fraser Coast holiday. I expect that this relatively inexpensive safety improvement will pay substantial dividends in terms of crash reduction. The Newsletter took its annual leave last month and is refreshed and ready for a new year to keep us all informed of the latest in traffic and transport engineering, planning and management. I would like to take this opportunity to acknowledge the ongoing significant contributions of many volunteers in the Newsletter’s production. Mr Andrew Hulse, AITPM’s Immediate Past National President, serves as the Editorial Coordinator on behalf of the Institute. Each Branch Committee also includes a Newsletter Coordinator and committee members frequently contribute as well. And the ongoing contributions of readers enable us to offer the Newsletter as a vehicle for dialogue and debate around our sector. If you would like to contribute please email AITPM’s administration officer Josephine Mitton at aitpm@aitpm.com or through your local Branch Committee. I would also like to welcome back on deck our Editor, Mr David Brown of Driven Media, who creates a fantastic package for us each month. Lastly, members would have received the Call for Papers for the AITPM 2009 National Conference, Traffic Beyond Tomorrow, to be held at the Adelaide Convention Centre between 5 – 7 August. Abstracts will be accepted up to 20 February 2009. We look forward to seeing everyone at this, our flagship event for the year. To all a good year ahead, Jon Bunker Post Script: We all will have seen through the media the enormous scale and nature of the two natural disasters Australia is experiencing at present. AITPM’s thoughts are with all of those members, family and friends who may be experiencing hardship as a result of the Victorian bushfires and North Queensland floods. AITPM is a not for profit organisation however the National Executive has taken the decision to donate in measure to the Red Cross Victorian Bushfire Disaster Relief fund and the Queensland Premier’s Disaster Relief fund as a gesture to support our fellow Australians in their time of need. Details about these funds can be found via the Victorian and Queensland Governments’ websites.