State-of-the-art for entity-centric repository and authoring environment for multimedia

Many projects, e.g. VIKEF [13] and KIM [7], present grounded approaches for the use of entities as a means of indexing and retrieval of multimedia resources from heterogeneous sources. In this paper, we discuss the state-of-the-art of entity-centric approaches for multimedia indexing and retrieval. A summary of projects employing entity-centric repositories are portrayed. This paper also looks at the current state-of-the-art authoring environment, Macromedia Authorware, and the possibility of potential extension of this environment for entity-based multimedia authoring.

Semi-automatic annotation and retrieval of visual content using the topic map technology

There are still major challenges in the area of automatic indexing and retrieval of multimedia content data for very large multimedia content corpora. Current indexing and retrieval applications still use keywords to index multimedia content and those keywords usually do not provide any knowledge about the semantic content of the data. With the increasing amount of multimedia content, it is inefficient to continue with this approach. In this paper, we describe the project DREAM, which addresses such challenges by proposing a new framework for semi-automatic annotation and retrieval of multimedia based on the semantic content. The framework uses the Topic Map Technology, as a tool to model the knowledge automatically extracted from the multimedia content using an Automatic Labelling Engine. We describe how we acquire knowledge from the content and represent this knowledge using the support of NLP to automatically generate Topic Maps. The framework is described in the context of film post-production.

Multi-modal fingerprinting for multimedia assets: optimisation of media security protection in online distribution environments

Since the advent of the internet in every day life in the 1990s, the barriers to producing, distributing and consuming multimedia data such as videos, music, ebooks, etc. have steadily been lowered for most computer users so that almost everyone with internet access can join the online communities who both produce, consume and of course also share media artefacts. Along with this trend, the violation of personal data privacy and copyright has increased with illegal file sharing being rampant across many online communities particularly for certain music genres and amongst the younger age groups. This has had a devastating effect on the traditional media distribution market; in most cases leaving the distribution companies and the content owner with huge financial losses. To prove that a copyright violation has occurred one can deploy fingerprinting mechanisms to uniquely identify the property. However this is currently based on only uni-modal approaches. In this paper we describe some of the design challenges and architectural approaches to multi-modal fingerprinting currently being examined for evaluation studies within a PhD research programme on optimisation of multi-modal fingerprinting architectures. Accordingly we outline the available modalities that are being integrated through this research programme which aims to establish the optimal architecture for multi-modal media security protection over the internet as the online distribution environment for both legal and illegal distribution of media products.

The effects of scene heterogeneity on soil moisture retrieval from passive microwave data

The s–x model of microwave emission from soil and vegetation layers is widely used to estimate soil moisture content from passive microwave observations. Its application to prospective satellite-based observations aggregating several thousand square kilometres requires understanding of the effects of scene heterogeneity. The effects of heterogeneity in soil surface roughness, soil moisture, water area and vegetation density on the retrieval of soil moisture from simulated single- and multi-angle observing systems were tested. Uncertainty in water area proved the most serious problem for both systems, causing errors of a few percent in soil moisture retrieval. Single-angle retrieval was largely unaffected by the other factors studied here. Multiple-angle retrievals errors around one percent arose from heterogeneity in either soil roughness or soil moisture. Errors of a few percent were caused by vegetation heterogeneity. A simple extension of the model vegetation representation was shown to reduce this error substantially for scenes containing a range of vegetation types.

Effects of sub-pixel heterogeneity on the retrieval of soil moisture from passive microwave radiometry

A simple formulation relating the L-band microwave brightness temperature detected by a passive microwave radiometer to the near surface soil moisture was developed using MICRO-SWEAT, a coupled microwave emission model and soil-vegetation-atmosphere-transfer (SVAT) scheme. This simple model provides an ideal tool with which to explore the impact of sub-pixel heterogeneity on the retrieval of soil moisture from microwave brightness temperatures. In the case of a bare soil pixel, the relationship between apparent emissivity and surface soil moisture is approximately linear, with the clay content of the soil influencing just the intercept of this relationship. It is shown that there are no errors in the retrieved soil moisture from a bare soil pixel that is heterogeneous in soil moisture and texture. However, in the case of a vegetated pixel, the slope of the relationship between apparent emissivity and surface soil moisture decreases with increasing vegetation. Therefore for a pixel that is heterogeneous in vegetation and soil moisture, errors can be introduced into the retrieved soil moisture. Generally, under moderate conditions, the retrieved soil moisture is within 3% of the actual soil moisture. Examples illustrating this discussion use data collected during the Southern Great Plains '97 Experiment (SGP97).

Learning a procedural task: effectiveness of multimedia presentations

Three experiments investigated the effectiveness of presenting procedural information through different media and their combinations. Experiment 1 examined the effectiveness of text, line drawings, text and line drawings, video. and video stills for learning a first aid task. The results showed an advantage of text and line drawings and of the video presentation over the other three conditions for both bandaging performance and answering questions about the task. Experiment 2 showed that the beneficial effect of the combination of text and pictures could not be accounted for simply in terms of a dual coding explanation. Rather, the effectiveness of the media and their combinations was influenced by the extent to which they conveyed action information. Finally, Experiment 3 showed no evidence of a contiguity effect: text and pictures were as effective when presented together on the same screen as when they were presented separately. Copyright © 2000 John Wiley & Sons, Ltd.

A sensitivity analysis of soil moisture retrieval from the t-w microwave emission model

The potential of the τ-ω model for retrieving the volumetric moisture content of bare and vegetated soil from dual polarisation passive microwave data acquired at single and multiple angles is tested. Measurement error and several additional sources of uncertainty will affect the theoretical retrieval accuracy. These include uncertainty in the soil temperature, the vegetation structure and consequently its microwave singlescattering albedo, and uncertainty in soil microwave emissivity based on its roughness. To test the effects of these uncertainties for simple homogeneous scenes, we attempt to retrieve soil moisture from a number of simulated microwave brightness temperature datasets generated using the τ-ω model. The uncertainties for each influence are estimated and applied to curves generated for typical scenarios, and an inverse model used to retrieve the soil moisture content, vegetation optical depth and soil temperature. The effect of each influence on the theoretical soil moisture retrieval limit is explored, the likelihood of each sensor configuration meeting user requirements is assessed, and the most effective means of improving moisture retrieval indicated.