Affect computing in film through sound energy dynamics

We develop an algorithm for the detection and classification of affective sound events underscored by specific patterns of sound energy dynamics. We relate the portrayal of these events to proposed high level affect or emotional coloring of the events. In this paper, four possible characteristic sound energy events are identified that convey well established meanings through their dynamics to portray and deliver certain affect, sentiment related to the horror film genre. Our algorithm is developed with the ultimate aim of automatically structuring sections of films that contain distinct shades of emotion related to horror themes for nonlinear media access and navigation. An average of 82% of the energy events, obtained from the analysis of the audio tracks of sections of four sample films corresponded correctly to the proposed affect. While the discrimination between certain sound energy event types was low, the algorithm correctly detected 71% of the occurrences of the sound energy events within audio tracks of the films analyzed, and thus forms a useful basis for determining affective scenes characteristic of horror in movies.

Technology as collaborator in somatic photographic practice

This article will address several areas of research. Firstly it will propose that a dance experience can translate into another discipline such as visual art. In my visual art practice I combine both photography, which is traditionally seen as a still medium, and performance in order to create a new form of embodiment. By acknowledging the inter-relationship between the body and the camera my project seeks to challenge a perceived separation between the disciplines. Fly Rhythm, an exhibition of 13 photographs and one video projection was conceived through a performative somatic process. I have developed the term ‘somatic photography’ to articulate subjective experiences in the context of my process of imaging movement in stillness. My thinking has been informed by visual art practice exploring movement and meaning using video and an older history of performance as a dancer and choreographer. I am primarily interested in movement initiated by a bodily response to light through still rather than moving imagery although artists such as Maya Deren whose films explore themes of time and space have influenced me. In my practice the term ‘somatic photography’ helps articulate the act of taking photographs, which is how meaning is being created rather than purely in the finished art works. The term somatic photography puts emphasis on the action of taking the image. Through using a custom made camera I was able to negotiate time and space as a dancer and create a visual drawing that talked to both choreography and fine art practice. This article engages with the following ideas: somatic photography, photography as choreography, body memory, ageing body, technology as collaborator, gallery interface, screen interface and movement.