Multimedia authoring : human-computer partnership for harvesting metadata from the right sources

This chapter takes a look at the task of creating multimedia authoring tools for the amateur media creator, and the problems unique to the undertaking. It argues that a deep understanding of both the media creation process, together with insight into the precise nature of the relative strengths of computers and users, given the domain of application, is needed before this gap can be bridged by software technology. These issues are further demonstrated within the context of a novel media collection environment, including a real- world example of an occasion filmed in order to automatically create two movies of distinctly different styles. The authors hope that such tools will enable amateur videographers to produce technically polished and aesthetically effective media, regardless of their level of expertise.

Content-based video indexing for sports applications using integrated multi-modal approach

This thesis presents a research work based on an integrated multi-modal approach for sports video indexing and retrieval. By combining specific features extractable from multiple (audio-visual) modalities, generic structure and specific events can be detected and classified. During browsing and retrieval, users will benefit from the integration of high-level semantic and some descriptive mid-level features such as whistle and close-up view of player(s). The main objective is to contribute to the three major components of sports video indexing systems. The first component is a set of powerful techniques to extract audio-visual features and semantic contents automatically. The main purposes are to reduce manual annotations and to summarize the lengthy contents into a compact, meaningful and more enjoyable presentation. The second component is an expressive and flexible indexing technique that supports gradual index construction. Indexing scheme is essential to determine the methods by which users can access a video database. The third and last component is a query language that can generate dynamic video summaries for smart browsing and support user-oriented retrievals.

Injection, detection and repair of aesthetics in home movies

This paper details the design of an algorithm for automatically manipulating the important aesthetic element of video, visual tempo. Automatic injection, detection and repair of such aesthetic elements, it is argued, is vital to the next generation of amateur multimedia authoring tools. We evaluate the performance of the algorithm on a battery of synthetic data and demonstrate its ability to return the visual tempo of the final media a considerable degree closer to the target signal. The novelty of this work lies chiefly in the systematic manipulation of this high level aesthetic element of video.

Application of computational media aesthetics methodology to extracting color semantics in film

Using film grammar as the underpinning, we study the extraction of structures in video based on color using a wide configuration of clustering methods combined with existing and new similarity measures. We study the visualisation of these structures, which we call Scene-Cluster Temporal Charts and show how it can bring out the interweaving of different themes and settings in a film. We also extract color events that filmmakers use to draw/force a viewer's attention to a shot/scene. This is done by first extracting a set of colors used rarely in film, and then building a probabilistic model for color event detection. We demonstrate with experimental results from ten movies that our algorithms are effective in the extraction of both scene-cluster temporal charts and color events.

Reasoning with multimedia information using symbolic projection

In many multimedia application systems, it is not the final goal to retrieve the relevant multimedia information from different multimedia information sources. Rather, post-processing of the retrieved multimedia information is needed. For example, the retrieved information is used as “known facts”. The systems will do some reasoning to obtain further conclusions based on these multimedia form “known facts”. We call this reasoning with multimedia information. Most current research work in multimedia information processing is focused on multimedia information retrieval, but post-processing the retrieved information is more or less ignored. This paper explores the way to tackle this problem by using symbolic projection. A case study of reasoning with still image information is presented. Some extensions to symbolic projection- introducing auxiliary pictorial objects in symbolic pictures that need to be processed-are discussed. We expect this paper will stimulate further research on this important but ignored topic.

Towards institution-wide online teaching and learning systems: trends, drivers and issues

Universities worldwide are consolidating and enhancing their commitments to various models of e-learning. These activities are leading to the adoption of corporate-wide e-learning systems, and accompanying changes in structures, processes and infrastructure requirements. The professed ideal is to identify narrowly defined corporate IT solutions which can deliver the full range of educational, administrative and student support features to meet the organisational need to expand e-learning activities globally. The trend seems to be away from locally driven and controlled IT development and adoption towards investments in Instructional Management Systems (IMS). In reality, however, universities generally are developing and using a broader array of solutions to meet their needs than may be deemed desirable under a more centralised, corporatised IT approach. This paper examines these trends by analysing the drivers shaping corporate approaches to IT implementation, and reflects critically on some of the educational, economic and organisational tensions and issues evident in institutional approaches to establishing such systems. The paper highlights the ongoing need for innovative, dynamic organisational solutions to progress the e-learning agenda, and the thoughtful reconciliation of centralised and decentralised approaches to achieving desired ends.

Exploration of a first year university multimedia module on field geology

As part of the teaching programme within a first year university unit on the earth’s physical systems, a ‘virtual reality’ field trip has been developed to support field studies relating to geological materials and landscape history. This module aims to increase student understanding of the use of geological features in the evaluation of geological / landscape history. The module has various applications in the curriculum. For students attending a weekend excursion, the module is available as an adjunct to actual field studies and can be used by students as either a digital pre-lab or as an excursion review tutorial. For students not attending a weekend excursion (i.e. off campus students), it is used as a digital ‘virtual reality’ substitute for field site inspection. The module has simple linked interactive and dynamic image base digital media that provide a framework in which the geology and landscape history of excursion sites can be explored. This module is delivered as a website via CD, but can also be integrated with the 'online interface' for this unit via a QuickTime reference movie loaded inside a relevant 'Deakin (University) Studies Online’ web page. The latter strategy enables assimilation of large multimedia files into online teaching formats

Feedback credibility issues in trust management systems

The following topics are dealt with: soft computing in intelligent multimedia; grid and pervasive computing security; interactive multimedia & intelligent services in mobile and ubiquitous computing; data management in ubiquitous computing; smart living space; software effectiveness and efficiency.