Semi-automatic knowledge extraction, representation and context-sensitive intelligent retrieval of video content using collateral context modelling with scalable ontological networks

Automatic indexing and retrieval of digital data poses major challenges. The main problem arises from the ever increasing mass of digital media and the lack of efficient methods for indexing and retrieval of such data based on the semantic content rather than keywords. To enable intelligent web interactions, or even web filtering, we need to be capable of interpreting the information base in an intelligent manner. For a number of years research has been ongoing in the field of ontological engineering with the aim of using ontologies to add such (meta) knowledge to information. In this paper, we describe the architecture of a system (Dynamic REtrieval Analysis and semantic metadata Management (DREAM)) designed to automatically and intelligently index huge repositories of special effects video clips, based on their semantic content, using a network of scalable ontologies to enable intelligent retrieval. The DREAM Demonstrator has been evaluated as deployed in the film post-production phase to support the process of storage, indexing and retrieval of large data sets of special effects video clips as an exemplar application domain. This paper provides its performance and usability results and highlights the scope for future enhancements of the DREAM architecture which has proven successful in its first and possibly most challenging proving ground, namely film production, where it is already in routine use within our test bed Partners' creative processes. (C) 2009 Published by Elsevier B.V.

Instantaneous threat detection based on a semantic representation of activities, zones and trajectories

Threat detection is a challenging problem, because threats appear in many variations and differences to normal behaviour can be very subtle. In this paper, we consider threats on a parking lot, where theft of a truck’s cargo occurs. The threats range from explicit, e.g. a person attacking the truck driver, to implicit, e.g. somebody loitering and then fiddling with the exterior of the truck in order to open it. Our goal is a system that is able to recognize a threat instantaneously as they develop. Typical observables of the threats are a person’s activity, presence in a particular zone and the trajectory. The novelty of this paper is an encoding of these threat observables in a semantic, intermediate-level representation, based on low-level visual features that have no intrinsic semantic meaning themselves. The aim of this representation was to bridge the semantic gap between the low-level tracks and motion and the higher-level notion of threats. In our experiments, we demonstrate that our semantic representation is more descriptive for threat detection than directly using low-level features. We find that a person’s activities are the most important elements of this semantic representation, followed by the person’s trajectory. The proposed threat detection system is very accurate: 96.6 % of the tracks are correctly interpreted, when considering the temporal context.

Meeting detection in video through semantic analysis

In this paper we present a novel approach to detect people meeting. The proposed approach works by translating people behaviour from trajectory information into semantic terms. Having available a semantic model of the meeting behaviour, the event detection is performed in the semantic domain. The model is learnt employing a soft-computing clustering algorithm that combines trajectory information and motion semantic terms. A stable representation can be obtained from a series of examples. Results obtained on a series of videos with different types of meeting situations show that the proposed approach can learn a generic model that can effectively be applied on the behaviour recognition of meeting situations.

Digitisation, representation, and formalisation - Digital libraries of mathematics

One of the main tasks of the mathematical knowledge management community must surely be to enhance access to mathematics on digital systems. In this paper we present a spectrum of approaches to solving the various problems inherent in this task, arguing that a variety of approaches is both necessary and useful. The main ideas presented are about the differences between digitised mathematics, digitally represented mathematics and formalised mathematics. Each has its part to play in managing mathematical information in a connected world. Digitised material is that which is embodied in a computer file, accessible and displayable locally or globally. Represented material is digital material in which there is some structure (usually syntactic in nature) which maps to the mathematics contained in the digitised information. Formalised material is that in which both the syntax and semantics of the represented material, is automatically accessible. Given the range of mathematical information to which access is desired, and the limited resources available for managing that information, we must ensure that these resources are applied to digitise, form representations of or formalise, existing and new mathematical information in such a way as to extract the most benefit from the least expenditure of resources. We also analyse some of the various social and legal issues which surround the practical tasks.

Can wavelets improve the representation of forecast error covariances in variational data assimilation?

Two wavelet-based control variable transform schemes are described and are used to model some important features of forecast error statistics for use in variational data assimilation. The first is a conventional wavelet scheme and the other is an approximation of it. Their ability to capture the position and scale-dependent aspects of covariance structures is tested in a two-dimensional latitude-height context. This is done by comparing the covariance structures implied by the wavelet schemes with those found from the explicit forecast error covariance matrix, and with a non-wavelet- based covariance scheme used currently in an operational assimilation scheme. Qualitatively, the wavelet-based schemes show potential at modeling forecast error statistics well without giving preference to either position or scale-dependent aspects. The degree of spectral representation can be controlled by changing the number of spectral bands in the schemes, and the least number of bands that achieves adequate results is found for the model domain used. Evidence is found of a trade-off between the localization of features in positional and spectral spaces when the number of bands is changed. By examining implied covariance diagnostics, the wavelet-based schemes are found, on the whole, to give results that are closer to diagnostics found from the explicit matrix than from the nonwavelet scheme. Even though the nature of the covariances has the right qualities in spectral space, variances are found to be too low at some wavenumbers and vertical correlation length scales are found to be too long at most scales. The wavelet schemes are found to be good at resolving variations in position and scale-dependent horizontal length scales, although the length scales reproduced are usually too short. The second of the wavelet-based schemes is often found to be better than the first in some important respects, but, unlike the first, it has no exact inverse transform.

The representation of conditional expectations of non-Gaussian noise

For Wiener spaces conditional expectations and $L^{2}$-martingales w.r.t. the natural filtration have a natural representation in terms of chaos expansion. In this note an extension to larger classes of processes is discussed. In particular, it is pointed out that orthogonality of the chaos expansion is not required.

View-based approaches to spatial representation in human vision

In an immersive virtual environment, observers fail to notice the expansion of a room around them and consequently make gross errors when comparing the size of objects. This result is difficult to explain if the visual system continuously generates a 3-D model of the scene based on known baseline information from interocular separation or proprioception as the observer walks. An alternative is that observers use view-based methods to guide their actions and to represent the spatial layout of the scene. In this case, they may have an expectation of the images they will receive but be insensitive to the rate at which images arrive as they walk. We describe the way in which the eye movement strategy of animals simplifies motion processing if their goal is to move towards a desired image and discuss dorsal and ventral stream processing of moving images in that context. Although many questions about view-based approaches to scene representation remain unanswered, the solutions are likely to be highly relevant to understanding biological 3-D vision.

Devolution and the political representation of business interests in the UK

The devolution of political power in Scotland, Wales and Northern Ireland and the developing regional agenda in England are widely read as a significant reconfiguration of the institutions and scales of economic governance. The process is furthest developed in Scotland while Wales and Northern Ireland, in their own distinct ways, provide intermediate cases. Devolution is least developed in England where regional political identities are generally weak and the historical legacy of regional institutions is limited. Within the overall context of devolution government policy has continued to emphasize partnership forms of. governance. Accordingly, the political representation of business interests has a particular salience in the new arrangements. This paper reports on findings from a study designed to examine the relationship between devolution and changes in the political representation of business interests in the territories and regions of the UK. It highlights a number of changes in the nature and extent of business representation. While some of these are significant the evidence suggests that they fail to mark a fundamental shift in the institutional foundation for sub-national business interest representation in the UK. Indeed the political geography of business representation remains dominated by an overarching centralism that is likely to provide a significant check on the further devolution of political power and democratic authority. (c) 2004 Elsevier Ltd. All rights reserved.

The social relations of business representation and devolved governance in the United Kingdom

The reform of regional governance in the United Kingdom has been, in part, premised on the notion that regions provide new territories of action in which cooperative networks between business communities and state-agencies can be established. Promoting business interests is seen as one mechanism for enhancing the economic competitiveness and performance of 'laggard' regions. Yet, within this context of change, business agendas and capacities are often assumed to exist 'out there, as a resource waiting to be tapped by state institutions. There is little recognition that business organisations' involvement in networks of governance owes much to historical patterns and practices of business representation, to the types of activities that exist within the business sector, and to interpretations of their own role and position within wider policymaking and implementation networks. This paper, drawing on a study of business agendas in post-devolution Scotland, demonstrates that in practice business agendas are highly complex. Their formation in any particular place depends on the actions of reflexive agents, whose perspectives and capacities are shaped by the social, economic, and political contexts within which they are operating. As such, any understanding of business agendas needs to identify the social relations of business as a whole, rather than assuming away such complexities.

Devolution and the political representation of business interests in the UK

The devolution of political power in Scotland, Wales and Northern Ireland and the developing regional agenda in England are widely read as a significant reconfiguration of the institutions and scales of economic governance. The process is furthest developed in Scotland while Wales and Northern Ireland, in their own distinct ways, provide intermediate cases. Devolution is least developed in England where regional political identities are generally weak and the historical legacy of regional institutions is limited. Within the overall context of devolution government policy has continued to emphasize partnership forms of. governance. Accordingly, the political representation of business interests has a particular salience in the new arrangements. This paper reports on findings from a study designed to examine the relationship between devolution and changes in the political representation of business interests in the territories and regions of the UK. It highlights a number of changes in the nature and extent of business representation. While some of these are significant the evidence suggests that they fail to mark a fundamental shift in the institutional foundation for sub-national business interest representation in the UK. Indeed the political geography of business representation remains dominated by an overarching centralism that is likely to provide a significant check on the further devolution of political power and democratic authority. (c) 2004 Elsevier Ltd. All rights reserved.