A framework towards multi-modal fingerprinting scheme for multimedia assets

Fingerprinting is a well known approach for identifying multimedia data without having the original data present but what amounts to its essence or ”DNA”. Current approaches show insufficient deployment of three types of knowledge that could be brought to bear in providing a finger printing framework that remains effective, efficient and can accommodate both the whole as well as elemental protection at appropriate levels of abstraction to suit various Foci of Interest (FoI) in an image or cross media artefact. Thus our proposed framework aims to deliver selective composite fingerprinting that remains responsive to the requirements for protection of whole or parts of an image which may be of particularly interest and be especially vulnerable to attempts at rights violation. This is powerfully aided by leveraging both multi-modal information as well as a rich spectrum of collateral context knowledge including both image-level collaterals as well as the inevitably needed market intelligence knowledge such as customers’ social networks interests profiling which we can deploy as a crucial component of our Fingerprinting Collateral Knowledge. This is used in selecting the special FoIs within an image or other media content that have to be selectively and collaterally protected.

A framework towards a multi-modal fingerprinting scheme for multimedia assets

Fingerprinting is a well known approach for identifying multimedia data without having the original data present but instead what amounts to its essence or 'DNA'. Current approaches show insufficient deployment of various types of knowledge that could be brought to bear in providing a fingerprinting framework that remains effective, efficient and can accommodate both the whole as well as elemental protection at appropriate levels of abstraction to suit various Zones of Interest (ZoI) in an image or cross media artefact. The proposed framework aims to deliver selective composite fingerprinting that is powerfully aided by leveraging both multi-modal information as well as a rich spectrum of collateral context knowledge including both image-level collaterals and also the inevitably needed market intelligence knowledge such as customers' social networks interests profiling which we can deploy as a crucial component of our fingerprinting collateral knowledge.

Multi-modal fingerprinting for multimedia assets: optimisation of media security protection in online distribution environments

Since the advent of the internet in every day life in the 1990s, the barriers to producing, distributing and consuming multimedia data such as videos, music, ebooks, etc. have steadily been lowered for most computer users so that almost everyone with internet access can join the online communities who both produce, consume and of course also share media artefacts. Along with this trend, the violation of personal data privacy and copyright has increased with illegal file sharing being rampant across many online communities particularly for certain music genres and amongst the younger age groups. This has had a devastating effect on the traditional media distribution market; in most cases leaving the distribution companies and the content owner with huge financial losses. To prove that a copyright violation has occurred one can deploy fingerprinting mechanisms to uniquely identify the property. However this is currently based on only uni-modal approaches. In this paper we describe some of the design challenges and architectural approaches to multi-modal fingerprinting currently being examined for evaluation studies within a PhD research programme on optimisation of multi-modal fingerprinting architectures. Accordingly we outline the available modalities that are being integrated through this research programme which aims to establish the optimal architecture for multi-modal media security protection over the internet as the online distribution environment for both legal and illegal distribution of media products.

Multi-level Input Fusion in multi-modal systems

Context-aware multimodal interactive systems aim to adapt to the needs and behavioural patterns of users and offer a way forward for enhancing the efficacy and quality of experience (QoE) in human-computer interaction. The various modalities that constribute to such systems each provide a specific uni-modal response that is integratively presented as a multi-modal interface capable of interpretation of multi-modal user input and appropriately responding to it through dynamically adapted multi-modal interactive flow management , This paper presents an initial background study in the context of the first phase of a PhD research programme in the area of optimisation of data fusion techniques to serve multimodal interactivite systems, their applications and requirements.

Information processing: US Patent 4,409,617

An information processor for rendering input data compatible with standard video recording and/or display equipment, comprizing means for digitizing the input data over periods which are synchronous with the fields of a standard video signal, a store adapted to store the digitized data and release stored digitized data in correspondence wiht the line scan of a standard video monitor, the store having two halves which correspond to the interlaced fields of a standard video signal and being so arranged that one half is filed while the other is emptied, and means for converting the released stored digitized data into video luminance signals. The input signals may be in digital or analogue form. A second stage which reconstitutes the recorded data is also described.

Effects of active information processing on the understanding of risk information

Two experiments investigated effects of active processing of risk information on participants' understanding and judgments. It was hypothesized that more active processing would lead to better understanding and differences in affective judgments (e.g. increased satisfaction and reduced perceived risk to health). In both experiments participants were given a written scenario about their being prescribed a fictitious medication. This medication was said to cause side effects in 2% of people who took it. Before answering a series of written questions, participants in the active conditions of both experiments were asked to carry out a reflective task (portraying the size of risk on a bar chart in Experiment 1 and answering a reflective question in Experiment 2). The results showed that active participants rated the likelihood of experiencing possible side effects significantly lower than passive participants (Experiment 1), and that active participants were significantly more satisfied with the information and judged perceived risk to health from taking the medication significantly lower than passive participants (Experiment 2). In both experiments, active participants were significantly more correct in their probability and frequency estimates. The studies demonstrate that active processing of risk information leads to improved understanding of the information given. This has important implications for risk communication. In the context of health, better understanding should lead to improved decision-making and health outcomes. Copyright (C) 2004 John Wiley Sons, Ltd.

Intrusions in trauma and psychosis: information processing and phenomenology

Background: Intrusions are common symptoms of both posttraumatic stress disorder (PTSD) and schizophrenia. Steel et al (2005) suggest that an information processing style characterized by weak trait contextual integration renders psychotic individuals vulnerable to intrusive experiences. This ‘contextual integration hypothesis’ was tested in individuals reporting anomalous experiences in the absence of a need-for-care. Methods: Twenty-six low schizotypes and twenty-three individuals reporting anomalous experiences were shown a traumatic film with and without a concurrent visuo-spatial task. Participants rated post-traumatic intrusions for frequency and form, and completed self-report measures of information processing style. It was predicted that, due to their weaker trait contextual integration, the anomalous experiences group would (1) exhibit more intrusions following exposure to the trauma-film; (2) display intrusions characterised by more PTSD qualities and (3) show a greater reduction of intrusions with the concurrent visuo-spatial task. Results: As predicted, the anomalous experiences group reported a lower level of trait contextual integration and more intrusions than the low schizotypes, both immediately after watching the film, and during the following seven days. Their post-traumatic intrusive memories were more PTSD-like (more intrusive, vivid and associated with emotion). The visuo-spatial task had no effect on number of intrusions in either group. Conclusions: These findings provide some support for the proposal that weak trait contextual integration underlies the development of intrusions within both PTSD and psychosis.

Situation assessment through multi-modal sensing of dynamic environments to support cognitive robot control

Awareness of emerging situations in a dynamic operational environment of a robotic assistive device is an essential capability of such a cognitive system, based on its effective and efficient assessment of the prevailing situation. This allows the system to interact with the environment in a sensible (semi)autonomous / pro-active manner without the need for frequent interventions from a supervisor. In this paper, we report a novel generic Situation Assessment Architecture for robotic systems directly assisting humans as developed in the CORBYS project. This paper presents the overall architecture for situation assessment and its application in proof-of-concept Demonstrators as developed and validated within the CORBYS project. These include a robotic human follower and a mobile gait rehabilitation robotic system. We present an overview of the structure and functionality of the Situation Assessment Architecture for robotic systems with results and observations as collected from initial validation on the two CORBYS Demonstrators.

Sequence-selective assembly of tweezer-molecules on linear templates enables frameshift-reading of sequence information

Monomer-sequence information in synthetic copolyimides can be recognised by tweezer-type molecules binding to adjacent triplet-sequences on the polymer chains. In the present paper different tweezer-molecules are found to have different sequence-selectivities, as demonstrated in solution by 1H NMR spectroscopy and in the solid state by single crystal X-ray analyses of tweezer-complexes with linear and macrocyclic oligo-imides. This work provides clear-cut confirmation of polyimide chain-folding and adjacent-tweezer-binding. It also reveals a new and entirely unexpected mechanism for sequence-recognition which, by analogy with a related process in biomolecular information processing, may be termed "frameshift-reading". The ability of one particular tweezer-molecule to detect, with exceptionally high sensitivity, long-range sequence-information in chain-folding aromatic copolyimides, is readily explained by this novel process.

Processing of faces and emotional expressions in infants at risk of social phobia

Individuals with social phobia display social information processing biases yet their aetiological significance is unclear. Infants of mothers with social phobia and control infants' responses were assessed at 10 days, 10 and 16 weeks, and 10 months to faces versus non-faces, variations in intensity of emotional expressions, and gaze direction. Infant temperament and maternal behaviours were also assessed. Both groups showed a preference for faces over non-faces at 10 days and 10 weeks, and full faces over profiles at 16 weeks; they also looked more to high vs. low intensity angry faces at 10 weeks, and fearful faces at 10 months; however, index infants' initial orientation and overall looking to high-intensity fear faces was relatively less than controls at 10 weeks. This was not explained by infant temperament or maternal behaviours. The findings suggest that offspring of mothers with social phobia show processing biases to emotional expressions in infancy.