Content Classification of Multimedia Documents using Partitions of Low-Level Features

Audio-visual documents obtained from German TV news are classified according to the IPTC topic categorization scheme. To this end usual text classification techniques are adapted to speech, video, and non-speech audio. For each of the three modalities word analogues are generated: sequences of syllables for speech, “video words” based on low level color features (color moments, color correlogram and color wavelet), and “audio words” based on low-level spectral features (spectral envelope and spectral flatness) for non-speech audio. Such audio and video words provide a means to represent the different modalities in a uniform way. The frequencies of the word analogues represent audio-visual documents: the standard bag-of-words approach. Support vector machines are used for supervised classification in a 1 vs. n setting. Classification based on speech outperforms all other single modalities. Combining speech with non-speech audio improves classification. Classification is further improved by supplementing speech and non-speech audio with video words. Optimal F-scores range between 62% and 94% corresponding to 50% - 84% above chance. The optimal combination of modalities depends on the category to be recognized. The construction of audio and video words from low-level features provide a good basis for the integration of speech, non-speech audio and video.

Bildanalyse und technologischer Standard - ein kritischer Rückblick auf Multimedia

In dem Beitrag geht es um einen Rückblick auf die Anfänge des manipulierbaren, digitalen Bildes im Kontext der Kunst. An einem Fallbeispiel, dem Johannesaltar des Rogier van der Weyden, erfolgt eine praktische Auseinandersetzung mit den technologisch bedingten Grenzen der Bildanalyse. Dies mündet in eine kritische Bilanz vorfabrizierter Wissensvermittlung und Sichtbarkeitserfahrung nicht nur im Bereich der Kunstgeschichte. Die These lautet von daher ganz allgemein gefasst: Tradierte Bildlichkeit fristet ihr Dasein nicht mehr allein im musealen Raum, sondern ist bereits in einen technologisch bedingten transferiert.

Articulated Narrowcasting for Privacy and Awareness in Multimedia Conferencing Systems and Design for Implementation Within a SIP Framework

This article proposes a new focus of research for multimedia conferencing systems which allows a participant to flexibly select another participant or a group for media transmission. For example, in a traditional conference system, participants voices might by default be shared with all others, but one might want to select a subset of the conference members to send his/her media to or receive media from. We review the concept of narrowcasting, a model for limiting such information streams in a multimedia conference, and describe a design to use existing standard protocols (SIP and SDP) for controlling fine-grained narrowcasting sessions.

On new maximal supergravity and its BPS domain-walls

We revise the SU(3)-invariant sector of N  = 8 supergravity with dyonic SO(8) gaugings. By using the embedding tensor formalism, analytic expressions for the scalar potential, superpotential(s) and fermion mass terms are obtained as a function of the electromagnetic phase ω and the scalars in the theory. Equipped with these results, we explore non-supersymmetric AdS critical points at ω ≠ 0 for which perturbative stability could not be analysed before. The ω-dependent superpotential is then used to derive first-order flow equations and obtain new BPS domain-wall solutions at ω ≠ 0. We numerically look at steepest-descent paths motivated by the (conjectured) RG flows.

QoE-aware Multiple Path Video Transmission for Wireless Multimedia Sensor Networks

Wireless Multimedia Sensor Networks (WMSNs) promise a wide scope of emerging potential applications in both civilian and military areas, which require visual and audio information to enhance the level of collected information. The transmission of multimedia content requires a minimal video quality level from the user’s perspective. However, links in WMSN communi- cations are typically unreliable, as they often experience fluctuations in quality and weak connectivity, and thus, the routing protocol must evaluate the routes by using end-to-end link quality information to increase the packet delivery ratio. Moreover, the use multiple paths together with key video metrics can enhance the video quality level. In this paper, we propose a video-aware multiple path hierarchical routing protocol for efficient multimedia transmission over WMSN, called video-aware MMtransmission. This protocol finds node-disjoint multiple paths, and implements an end-to-end link quality estimation with minimal over- head to score the paths. Thus, our protocol assures multimedia transmission with Quality of Experience (QoE) and energy-efficiency support. The simula- tion results show the benefits of video-aware MMtransmission for disseminating video content by means of energy-efficiency and QoE analysis.

An OMNeT++ Framework to Evaluate Video Transmission in Mobile Wireless Multimedia Sensor Networks

The development and evaluation of new algorithms and protocols for Wireless Multimedia Sensor Networks (WMSNs) are usually supported by means of a discrete event network simulator, where OMNeT++ is one of the most important ones. However, experiments involving multimedia transmission, video flows with different characteristics, genres, group of pictures lengths, and coding techniques must be evaluated based also on Quality of Experience (QoE) metrics to reflect the user's perception. Such experiments require the evaluation of video-related information, i.e., frame type, received/lost, delay, jitter, decoding errors, as well as inter and intra-frame dependency of received/distorted videos. However, existing OMNeT++ frameworks for WMSNs do not support video transmissions with QoE-awareness, neither a large set of mobility traces to enable evaluations under different multimedia/mobile situations. In this paper, we propose a Mobile MultiMedia Wireless Sensor Network OMNeT++ framework (M3WSN) to support transmission, control and evaluation of real video sequences in mobile WMSNs.

A real-time video quality estimator for emerging wireless multimedia systems

Wireless Mesh Networks (WMNs) are increasingly deployed to enable thousands of users to share, create, and access live video streaming with different characteristics and content, such as video surveillance and football matches. In this context, there is a need for new mechanisms for assessing the quality level of videos because operators are seeking to control their delivery process and optimize their network resources, while increasing the user’s satisfaction. However, the development of in-service and non-intrusive Quality of Experience assessment schemes for real-time Internet videos with different complexity and motion levels, Group of Picture lengths, and characteristics, remains a significant challenge. To address this issue, this article proposes a non-intrusive parametric real-time video quality estimator, called MultiQoE that correlates wireless networks’ impairments, videos’ characteristics, and users’ perception into a predicted Mean Opinion Score. An instance of MultiQoE was implemented in WMNs and performance evaluation results demonstrate the efficiency and accuracy of MultiQoE in predicting the user’s perception of live video streaming services when compared to subjective, objective, and well-known parametric solutions.

Harmonic Oscillator in a 1D or 2D Cavity with General Perfectly Reflecting Walls

We investigate the simple harmonic oscillator in a 1-d box, and the 2-d isotropic harmonic oscillator problem in a circular cavity with perfectly reflecting boundary conditions. The energy spectrum has been calculated as a function of the self-adjoint extension parameter. For sufficiently negative values of the self-adjoint extension parameter, there are bound states localized at the wall of the box or the cavity that resonate with the standard bound states of the simple harmonic oscillator or the isotropic oscillator. A free particle in a circular cavity has been studied for the sake of comparison. This work represents an application of the recent generalization of the Heisenberg uncertainty relation related to the theory of self-adjoint extensions in a finite volume.

COGNITIVE IMPACT OF INTERACTIVE MULTIMEDIA

Technology has been gradually introduced in heath education. One of the most attractive features of this technology-based education is the use of multimedia. In this article we explore the research evidence about the role that multimedia is playing in education. From that analysis we describe the most relevant features of this technology to prepare a common ground of discussion about the evaluation of its impact on educational outcomes. As part of this analysis, we organize current research evidence on the use of technology in medical education, distinguishing diverse variables involved in the process, like knowledge (declarative, procedural), learner characteristics, curricular scenario, etc. This article presents an overview of the Distributed Representations theory and its relationship with research on educational outcomes and multimedia. Next we discuss the relationship between media and diverse learning theories, proposing a theory based taxonomy for educational multimedia.

Theoretical Calving Rates from Glaciers Along Ice Walls Grounded in Water of Variable Depths

Calving has been studied for glaciers ranging from slow polar glaciers that calve on dry land, such as on Deception Island (63.0-degrees-S, 60.6-degrees-W) in Antarctica, through temperate Alaskan tide-water glaciers, to fast outlet glaciers that float in fiords and calve in deep water, such as Jakobshavns Isbrae (69.2-degrees-N, 49.9-degrees-W) in Greenland. Calving from grounded ice walls and floating ice shelves is the main ablation mechanism for the Antarctic and Greenland ice sheets, as it was along marine and lacustrine margins of former Pleistocene ice sheets, and is for tide-water and polar glaciers. Yet, the theory of ice calving is underdeveloped because of inherent dangers in obtaining field data to test and constrain calving models. An attempt is made to develop a calving theory for ice walls grounded in water of variable depth, and to relate slab calving from ice walls to tabular calving from ice shelves. A calving law is derived in which calving rates from ice walls are controled by bending creep behind the ice wall, and depend on wall height h, forward bending angle-theta, crevasse distance c behind the ice wall and depth d of water in front of the ice wall. Reasonable agreement with calving rates reported by Brown and others (1982) for Alaskan tide-water glaciers is obtained when c depends on wall height, wall height above water and water depth. More data are needed to determine which of these dependencies is correct. A calving ratio c/h is introduced to understand the transition from slab calving to tabular calving as water deepens and the calving glacier becomes afloat.