Multi-modal fingerprinting for multimedia assets: optimisation of media security protection in online distribution environments

Since the advent of the internet in every day life in the 1990s, the barriers to producing, distributing and consuming multimedia data such as videos, music, ebooks, etc. have steadily been lowered for most computer users so that almost everyone with internet access can join the online communities who both produce, consume and of course also share media artefacts. Along with this trend, the violation of personal data privacy and copyright has increased with illegal file sharing being rampant across many online communities particularly for certain music genres and amongst the younger age groups. This has had a devastating effect on the traditional media distribution market; in most cases leaving the distribution companies and the content owner with huge financial losses. To prove that a copyright violation has occurred one can deploy fingerprinting mechanisms to uniquely identify the property. However this is currently based on only uni-modal approaches. In this paper we describe some of the design challenges and architectural approaches to multi-modal fingerprinting currently being examined for evaluation studies within a PhD research programme on optimisation of multi-modal fingerprinting architectures. Accordingly we outline the available modalities that are being integrated through this research programme which aims to establish the optimal architecture for multi-modal media security protection over the internet as the online distribution environment for both legal and illegal distribution of media products.

Multi-level Input Fusion in multi-modal systems

Context-aware multimodal interactive systems aim to adapt to the needs and behavioural patterns of users and offer a way forward for enhancing the efficacy and quality of experience (QoE) in human-computer interaction. The various modalities that constribute to such systems each provide a specific uni-modal response that is integratively presented as a multi-modal interface capable of interpretation of multi-modal user input and appropriately responding to it through dynamically adapted multi-modal interactive flow management , This paper presents an initial background study in the context of the first phase of a PhD research programme in the area of optimisation of data fusion techniques to serve multimodal interactivite systems, their applications and requirements.

Language processing with dynamic fields

We construct a mapping from complex recursive linguistic data structures to spherical wave functions using Smolensky's filler/role bindings and tensor product representations. Syntactic language processing is then described by the transient evolution of these spherical patterns whose amplitudes are governed by nonlinear order parameter equations. Implications of the model in terms of brain wave dynamics are indicated.

Inconsistencies between satellite estimates of longwave cloud forcing and dynamical fields from reanalyses

The greenhouse effect of cloud may be quantified as the difference between outgoing longwave radiation (OLR) and its clear-sky component (OLRc). Clear-sky measurements from satellite preferentially sample drier, more stable conditions relative to the monthly-mean state. The resulting observational bias is evident when OLRc is stratified by vertical motion; differences to climate model OLRc of 15 Wm−2 occur over warm regions of strong ascent. Using data from the ECMWF 40-year reanalysis, an estimate of cloud longwave radiative effect is made which is directly comparable with standard climate model diagnostics. The impact of this methodology on the cancellation of cloud longwave and shortwave radiative forcing in the tropics is estimated.

Contributions of labile and resistant organic materials to the immobilization of inorganic soil N when used in the restoration of abandoned agricultural fields

We have examined the contributions sucrose and sawdust make to the net immobilization of inorganic soil N and assimilation of both C and N into microbial biomass when they are used as part of a restoration plan to promote the establishment of indigenous vegetation on abandoned agricultural fields on the Central Hungarian Plain. Both amendments led to net N immobilization. Sucrose addition also led to mobilization of N from the soil organic N pool and its immobilization into microbial biomass, whereas sawdust addition apparently immobilized soil N into a non-biomass compartment or a biomass component that was not detected by the conventional biomass N assay (CHCl3 fumigation and extraction). This suggests that the N was either cycled through the biomass, but not immobilized within it, or that it was immobilized in a protected biomass fraction different to the fraction into which N was immobilized in response to sucrose addition.

Simulating the spatial variation of soil mineral N within fields using the model SUNDIAL

Variable rate applications of nitrogen (N) are of environmental and economic interest. Regular measurements of soil N supply are difficult to achieve practically. Therefore accurate model simulations of soil N supply might provide a practical solution for site-specific management of N. Mineral N, an estimate of N supply, was simulated by the model SUNDIAL (Simulation of Nitrogen Dynamics In Arable Land) at more than 100 locations within three arable fields in Bedfordshire, UK. The results were compared with actual measurements. The outcomes showed that the spatial patterns of the simulations of mineral N corresponded to the measurements but the range of values was underestimated.

Identifying management zones in agricultural fields using spatially constrained classification of soil and ancillary data

Site-specific management requires accurate knowledge of the spatial variation in a range of soil properties within fields. This involves considerable sampling effort, which is costly. Ancillary data, such as crop yield, elevation and apparent electrical conductivity (ECa) of the soil, can provide insight into the spatial variation of some soil properties. A multivariate classification with spatial constraint imposed by the variogram was used to classify data from two arable crop fields. The yield data comprised 5 years of crop yield, and the ancillary data 3 years of yield data, elevation and ECa. Information on soil chemical and physical properties was provided by intensive surveys of the soil. Multivariate variograms computed from these data were used to constrain sites spatially within classes to increase their contiguity. The constrained classifications resulted in coherent classes, and those based on the ancillary data were similar to those from the soil properties. The ancillary data seemed to identify areas in the field where the soil is reasonably homogeneous. The results of targeted sampling showed that these classes could be used as a basis for management and to guide future sampling of the soil.

Promoting microbial immobilization of soil nitrogen during restoration of abandoned agricultural fields by organic additions

Application of organic materials to soils to enhance N immobilization into microbial biomass, thereby reducing inorganic N concentrations, was studied as a management option to accelerate the reestablishment of the native vegetation on abandoned arable fields on sandy soils the Kiskunsag National Park, Hungary. Sucrose and sawdust were used at three different topographic sites over 4 years. N availability and extractable inorganic N concentrations were significantly reduced in all sites. Soil microbial biomass C and microbial biomass N increased significantly following C additions, but the microbial C to microbial N ratio remained unaffected. It is concluded that the combined application of the rapidly utilized C source (sucrose) promoted N immobilization, whereas the addition of the slowly utilized C source (sawdust) maintained the elevated microbial biomass C and microbial biomass N in the field.

Contributions of labile and resistant organic materials to the immobilization of inorganic soil N when used in the restoration of abandoned agricultural fields

We have examined the contributions sucrose and sawdust make to the net immobilization of inorganic soil N and assimilation of both C and N into microbial biomass when they are used as part of a restoration plan to promote the establishment of indigenous vegetation on abandoned agricultural fields on the Central Hungarian Plain. Both amendments led to net N immobilization. Sucrose addition also led to mobilization of N from the soil organic N pool and its immobilization into microbial biomass, whereas sawdust addition apparently immobilized soil N into a non-biomass compartment or a biomass component that was not detected by the conventional biomass N assay (CHCl3 fumigation and extraction). This suggests that the N was either cycled through the biomass, but not immobilized within it, or that it was immobilized in a protected biomass fraction different to the fraction into which N was immobilized in response to sucrose addition.

A contour-advective semi-lagrangian numerical algorithm for simulating fine-scale conservative dynamical fields

This paper describes a novel numerical algorithm for simulating the evolution of fine-scale conservative fields in layer-wise two-dimensional flows, the most important examples of which are the earth's atmosphere and oceans. the algorithm combines two radically different algorithms, one Lagrangian and the other Eulerian, to achieve an unexpected gain in computational efficiency. The algorithm is demonstrated for multi-layer quasi-geostrophic flow, and results are presented for a simulation of a tilted stratospheric polar vortex and of nearly-inviscid quasi-geostrophic turbulence. the turbulence results contradict previous arguments and simulation results that have suggested an ultimate two-dimensional, vertically-coherent character of the flow. Ongoing extensions of the algorithm to the generally ageostrophic flows characteristic of planetary fluid dynamics are outlined.

Viewing the body modulates tactile receptive fields

Tactile discrimination performance depends on the receptive field (RF) size of somatosensory cortical (SI) neurons. Psychophysical masking effects can reveal the RF of an idealized "virtual" somatosensory neuron. Previous studies show that top-down factors strongly affect tactile discrimination performance. Here, we show that non-informative vision of the touched body part influences tactile discrimination by modulating tactile RFs. Ten subjects performed spatial discrimination between touch locations on the forearm. Performance was improved when subjects saw their forearm compared to viewing a neutral object in the same location. The extent of visual information was relevant, since restricted view of the forearm did not have this enhancing effect. Vibrotactile maskers were placed symmetrically on either side of the tactile target locations, at two different distances. Overall, masking significantly impaired discrimination performance, but the spatial gradient of masking depended on what subjects viewed. Viewing the body reduced the effect of distant maskers, but enhanced the effect of close maskers, as compared to viewing a neutral object. We propose that viewing the body improves functional touch by sharpening tactile RFs in an early somatosensory map. Top-down modulation of lateral inhibition could underlie these effects.

Cross-modal preference acquisition: evaluative conditioning of pictures by affective olfactory and auditory cues

In this research, a cross-model paradigm was chosen to test the hypothesis that affective olfactory and auditory cues paired with neutral visual stimuli bearing no resemblance or logical connection to the affective cues can evoke preference shifts in those stimuli. Neutral visual stimuli of abstract paintings were presented simultaneously with liked and disliked odours and sounds, with neutral-neutral pairings serving as controls. The results confirm previous findings that the affective evaluation of previously neutral visual stimuli shifts in the direction of contingently presented affective auditory stimuli. In addition, this research shows the presence of conditioning with affective odours having no logical connection with the pictures.