Toward automatic extraction of expressive elements from motion pictures : tempo

This paper addresses the challenge of bridging the semantic gap that exists between the simplicity of features that can be currently computed in automated content indexing systems and the richness of semantics in user queries posed for media search and retrieval. It proposes a unique computational approach to extraction of expressive elements of motion pictures for deriving high-level semantics of stories portrayed, thus enabling rich video annotation and interpretation. This approach, motivated and directed by the existing cinematic conventions known as film grammar, as a first step toward demonstrating its effectiveness, uses the attributes of motion and shot length to define and compute a novel measure of tempo of a movie. Tempo flow plots are defined and derived for a number of full-length movies and edge analysis is performed leading to the extraction of dramatic story sections and events signaled by their unique tempo. The results confirm tempo as a useful high-level semantic construct in its own right and a promising component of others such as rhythm, tone or mood of a film. In addition to the development of this computable tempo measure, a study is conducted as to the usefulness of biasing it toward either of its constituents, namely, motion or shot length. Finally, a refinement is made to the shot length normalizing mechanism, driven by the peculiar characteristics of shot length distribution exhibited by movies. Results of these additional studies, and possible applications and limitations are discussed.

Towards automatic extraction of expressive elements from motion pictures : tempo

This paper proposes a unique computational approach to extraction of expressive elements of motion pictures for deriving high level semantics of stories portrayed, thus enabling better video annotation and interpretation systems. This approach, motivated and directed by the existing cinematic conventions known as film grammar, as a first step towards demonstrating its effectiveness, uses the attributes of motion and shot length to define and compute a novel measure of tempo of a movie. Tempo flow plots are defined and derived for four full-length movies and edge analysis is performed leading to the extraction of dramatic story sections and events signaled by their unique tempo. The results confirm tempo as a useful attribute in its own right and a promising component of semantic constructs such as tone or mood of a film.

Detection of dynamic background due to swaying movements from motion features

Dynamically changing background (dynamic background) still presents a great challenge to many motion-based video surveillance systems. In the context of event detection, it is a major source of false alarms. There is a strong need from the security industry either to detect and suppress these false alarms, or dampen the effects of background changes, so as to increase the sensitivity to meaningful events of interest. In this paper, we restrict our focus to one of the most common causes of dynamic background changes: 1) that of swaying tree branches and 2) their shadows under windy conditions. Considering the ultimate goal in a video analytics pipeline, we formulate a new dynamic background detection problem as a signal processing alternative to the previously described but unreliable computer vision-based approaches. Within this new framework, we directly reduce the number of false alarms by testing if the detected events are due to characteristic background motions. In addition, we introduce a new data set suitable for the evaluation of dynamic background detection. It consists of real-world events detected by a commercial surveillance system from two static surveillance cameras. The research question we address is whether dynamic background can be detected reliably and efficiently using simple motion features and in the presence of similar but meaningful events, such as loitering. Inspired by the tree aerodynamics theory, we propose a novel method named local variation persistence (LVP), that captures the key characteristics of swaying motions. The method is posed as a convex optimization problem, whose variable is the local variation. We derive a computationally efficient algorithm for solving the optimization problem, the solution of which is then used to form a powerful detection statistic. On our newly collected data set, we demonstrate that the proposed LVP achieves excellent detection results and outperforms the best alternative adapted from existing art in the dynamic background literature.

Re-discovering Wardell’s Chantry Chapel for Lord Petre : a crumbling fabulation

In January 2009 The Times reported that the Historic Chapels Trust (HCT) was undertaking the preservation and conservation of the Chantry Chapel of Thorndon Hall, near Brentwood, Essex, England, once the seat of the Petre family, one of England’s oldest Catholic families. The chapel has lain severely neglected for many years with missing and loose tiles, blocked gutters, and heavily eroded stonework. In spite of its desperate need of repair, inside, glimpses of the richly carved and lavishly decorated interior remain, witness to exquisite craftsmanship. Because of its quality Nikolas Pevsner had attributed the building to A W N Pugin. More recent research has established that in fact William Wardell was the architect.

By 1854, when Lord Petre commissioned this mausoleum for his estate, Wardell would have been especially known for his London curvilinear decorated churches at Greenwich, Clapham and Hammersmith. Wardell produced three complete sets of drawings for the Chantry Chapel. Drawings for all three designs are extant, and give valuable insights into Wardell's design methods and the evolution of his design thinking. They raise questions about Early Victorian and High Victorian Gothic sensibilities and establish Wardell’s architectural and design credentials beyond a doubt. This paper explores Wardell’s debt to Pugin, posits the Chantry Chapel as a rival to Pugin’s St Giles Church, Cheadle, and considers the question of patronage.

Now acknowledged to be ‘of outstanding architectural and historic interest ‘ by HCT and English Heritage, the Chantry chapel - a crumbling fabulation - is the subject of major heritage considerations. Questions about authenticity in rebuilding and reconstruction are currently overridden by the urgent need to secure the structure from collapse.

Racism as a determinant of health: a protocol for conducting a systematic review and meta-analysis

Background: 

Inpainting images with curvilinear structures propagation

Inpainting images with smooth curvilinear structures interrupted is a challenging problem, because the structures are salient features sensitive to the human vision system and they are not easy to be completed in a visually pleasing way, especially when gaps are large. In this paper, we propose an approach to address this problem. A curve with a desired nice shape is first created to smoothly extend the missing structure from the known to unknown regions. As the curve partitions the unknown region into separate areas, textures can be filled independently into each area. We then adopt a patch-based texture inpainting method enhanced by a novel similarity measurement of patches. After that, very abrupt edges caused by different inpainted colours on their two sides need to be smoothed for natural colour transition across the curve. Experimental results demonstrate the effectiveness of the proposed approach. © 2014 Springer-Verlag Berlin Heidelberg.

Ductile thermoset polymers via controlling network flexibility

We report the design and synthesis of a polymer structure from a cross-linkable epoxy-ionic liquid system which behaves like a hard and brittle epoxy thermoset, perfectly ductile thermoplastic and an elastomer, all depending on controllable network compositions.

Indexing narrative structure and semantics in motion pictures with a probabilistic framework

This work constitutes the first attempt to extract an important narrative structure, the 3-Act story telling paradigm, in film. This narrative structure is prevalent in the domain of film as it forms the foundation and framework in which the film can be made to function as an effective tool for story telling, and its extraction is a vital step in automatic content management for film data. A novel act boundary likelihood function for Act 1 is derived using a Bayesian formulation under guidance from film grammar, tested under many configurations and the results are reported for experiments involving 25 full length movies. The formulation is shown to be a useful tool in both the automatic and semi-interactive setting for semantic analysis of film.

An information-theoretic approach to face recognition from face motion manifolds

In this work, we consider face recognition from face motion manifolds (FMMs). The use of the resistor-average distance (RAD) as a dissimilarity measure between densities confined to FMMs is motivated in the proposed information-theoretic approach to modelling face appearance. We introduce a kernel-based algorithm that makes use of the simplicity of the closed-form expression for RAD between two Gaussian densities, while allowing for modelling of complex and nonlinear, but intrinsically low-dimensional manifolds. Additionally, it is shown how geodesically local FMM structure can be modelled, naturally leading to a stochastic algorithm for generalizing to unseen modes of data variation. Recognition performance of our method is demonstrated experimentally and is shown to exceed that of state-of-the-art algorithms. Recognition rate of 98% was achieved on a database of 100 people under varying illumination

Translating text into motion : performance analysis for singers and directors

The study proposes a method of interpretation, which gives the contemporary singer-actor and director a method of performance analysis considering both the visual and the auditory aspects of vocal performance. The analysis begins with an analysis of the structure, which maps out the key ideas and translates them into main states of mind. The text analysis is followed by an analysis of the musical treatment of the text, also scanning for extra dramatic meaning inherent in vocal line and musical accompaniment. The so isolated dramatic ideas in text and musical structure and content are finally discussed in terms of their physical aspects, using the system of gesture as practiced by actors and singers before, during and beyond the Baroque period. The method is exemplified by the obbligato recitative "In quali eccessi" from Donna Elvira’s scene in the second act of the opera "Don Giovanni" by L. Da Ponte and W. A. Mozart. The musical example includes gestural notation and a table gestural notation symbols.