Inter-Frame Contextual Modelling For Visual Speech Recognition

In this paper, we present a new approach to visual speech recognition which improves contextual modelling by combining Inter-Frame Dependent and Hidden Markov Models. This approach captures contextual information in visual speech that may be lost using a Hidden Markov Model alone. We apply contextual modelling to a large speaker independent isolated digit recognition task, and compare our approach to two commonly adopted feature based techniques for incorporating speech dynamics. Results are presented from baseline feature based systems and the combined modelling technique. We illustrate that both of these techniques achieve similar levels of performance when used independently. However significant improvements in performance can be achieved through a combination of the two. In particular we report an improvement in excess of 17% relative Word Error Rate in comparison to our best baseline system.

Regarding the Real: Cinema, Documentary, and the Visual Arts

Regarding the Real: Cinema, Documentary, and the Visual Arts develops an interdisciplinary approach to documentary film, focusing on its cultural and formal relations to other visual arts, such as animation, assemblage, photography, painting, sculpture, and architecture. The book considers the work of figures whose preferred film language is associative and fragmentary, and for whom the documentary is an endlessly open form, an unstable expressive phenomenon that cannot but interrogate the validity of its own narratives and representational modes. Combining close analysis with cultural history, Regarding the Real calls for a re-assessment of the influence of the modern arts in subverting the structures of realism typically associated with documentary filmmaking.

Music, Magic, and the Mythic: The Dynamics of Visual and Aural Discourse in Souleymane Cissé’s Yeelen

The 1980s saw a wave of African films that aimed to represent, on both local and international screens, a sophisticated pre-colonial Africa, thus debunking notions of the continent as primitive. Toward this aim the films inscribed the conventions of oral performance within their visual styles, denying spectator identification with the protagonists and emphasising the presence of the narrator. However, some critics argued that these films exoticised Africa, while their use of oral performance’s distancing effect echoed the ‘scientific’ distance structured by the ethnographic film, in which African societies were represented as ‘the other’. Souleymane Cissé’s Yeelen exemplifies this tension, transposing into cinematic form oral storytelling techniques in the depiction of a power struggle within the covert cult of the komo, a Bambara initiation society unfamiliar to most non-Bambara viewers. This paper demonstrates how the film negotiates this tension via music, which interpellates the international spectator by eliciting a greater identification with the protagonists than that determined at a visual level, while encoding a verisimilitude to rituals that may otherwise be read as the superstitious practices of ‘the other’. In this way, music and image in Yeelen operate as parallel, though often overlapping, discourses, bridging the gap between the film’s culturally specific narrative and formal components, and its international spectators.

Correctable visual impairment in stroke rehabilitation patients

Background: after stroke, visual impairment may exacerbate the impact of other impairments on overall disability and negatively influence rehabilitation.