Dynamic path determination policy for distributed multimedia content adaptation

Multimedia content adaptation allows the ever increasing variety of handheld devices such as Smartphones to access distributed rich media resources available on the Internet today. Path planning and determination is a fundamental problem in enhancing performance of distributed multimedia content adaptation systems. Most of the existing path determination mechanisms use static path determination criteria based solely on associating a path with a single behavior aggregate score. However, some criteria such as availability are best represented using different functionality rather than being accumulated into the aggregate score. Moreover, since selection criteria have different behavior towards the score, this principle need to be considered. In this paper, we propose a dynamic multi-criteria path determination policy that selects an optimal path to the content adaptation services that best meet the user preferences and QoS requirements. The performance of the proposed approach is studied in terms of score’s fairness and reliability under different variations. The results indicate that the proposed policy performs substantially better than the baseline policy.

Multimedia content adaptation service discovery mechanism

Electronic information is becoming increasingly rich in content and varied in format and style while at the same time client devices are getting increasingly varied in their capabilities. This mismatch between rich contents and the end devices capability presents a challenge in providing seamless and ubiquitous access to electronic documents to interested users. Service-oriented content adaptation has emerged as a potential solution to the content-device mismatch problem. Since an adaptation task can potentially be performed by multiple content adaptation services (CAS), an approach for CAS discovery is a fundamental component of service-oriented content adaptation environment. In this paper, we propose a service discovery approach that considers the client device capability and the service’s attributes to discover appropriate CAS while optimizing performance and functionality. The efficiency of the proposed CAS discovery protocol is studied experimentally. The results show that the proposed discovery approach is effective in terms of discovering appropriate content adaptation services.

An SLA evaluator for multimedia content adaptation services

Content adaptation is used to adapt multimedia content to a version required by users. In the service-oriented scheme, adaptation functions are provided as services by third-party service providers. Clients pay for the consumed services and thus demand service quality. Providers advertise their services; each with varied quality-of-services (QoS). Some of these QoS however, may not be deliverable accordingly during the actual service execution due to heavy load. Thus, the provider should able to determine a current deliverable QoS before the service level agreement (SLA) is settled with the requesters. In this paper, we propose a strategy for service providers to evaluate incoming requests and capable of offering the new QoS to the requests potentially being initially rejected. The proposed strategy takes into account the current server load and requests' priority. We analysed the performance of the proposed strategy in terms of SLA settlement under various conditions. The results indicate that the proposed strategy performs well. © 2014 IEEE.

Rich media content adaptation in e-learning systems

The wide use of e-technologies represents a great opportunity for underserved segments of the population, especially with the aim of reintegrating excluded individuals back into society through education. This is particularly true for people with different types of disabilities who may have difficulties while attending traditional on-site learning programs that are typically based on printed learning resources. The creation and provision of accessible e-learning contents may therefore become a key factor in enabling people with different access needs to enjoy quality learning experiences and services. Another e-learning challenge is represented by m-learning (which stands for mobile learning), which is emerging as a consequence of mobile terminals diffusion and provides the opportunity to browse didactical materials everywhere, outside places that are traditionally devoted to education. Both such situations share the need to access materials in limited conditions and collide with the growing use of rich media in didactical contents, which are designed to be enjoyed without any restriction. Nowadays, Web-based teaching makes great use of multimedia technologies, ranging from Flash animations to prerecorded video-lectures. Rich media in e-learning can offer significant potential in enhancing the learning environment, through helping to increase access to education, enhance the learning experience and support multiple learning styles. Moreover, they can often be used to improve the structure of Web-based courses. These highly variegated and structured contents may significantly improve the quality and the effectiveness of educational activities for learners. For example, rich media contents allow us to describe complex concepts and process flows. Audio and video elements may be utilized to add a “human touch” to distance-learning courses. Finally, real lectures may be recorded and distributed to integrate or enrich on line materials. A confirmation of the advantages of these approaches can be seen in the exponential growth of video-lecture availability on the net, due to the ease of recording and delivering activities which take place in a traditional classroom. Furthermore, the wide use of assistive technologies for learners with disabilities injects new life into e-learning systems. E-learning allows distance and flexible educational activities, thus helping disabled learners to access resources which would otherwise present significant barriers for them. For instance, students with visual impairments have difficulties in reading traditional visual materials, deaf learners have trouble in following traditional (spoken) lectures, people with motion disabilities have problems in attending on-site programs. As already mentioned, the use of wireless technologies and pervasive computing may really enhance the educational learner experience by offering mobile e-learning services that can be accessed by handheld devices. This new paradigm of educational content distribution maximizes the benefits for learners since it enables users to overcome constraints imposed by the surrounding environment. While certainly helpful for users without disabilities, we believe that the use of newmobile technologies may also become a fundamental tool for impaired learners, since it frees them from sitting in front of a PC. In this way, educational activities can be enjoyed by all the users, without hindrance, thus increasing the social inclusion of non-typical learners. While the provision of fully accessible and portable video-lectures may be extremely useful for students, it is widely recognized that structuring and managing rich media contents for mobile learning services are complex and expensive tasks. Indeed, major difficulties originate from the basic need to provide a textual equivalent for each media resource composing a rich media Learning Object (LO). Moreover, tests need to be carried out to establish whether a given LO is fully accessible to all kinds of learners. Unfortunately, both these tasks are truly time-consuming processes, depending on the type of contents the teacher is writing and on the authoring tool he/she is using. Due to these difficulties, online LOs are often distributed as partially accessible or totally inaccessible content. Bearing this in mind, this thesis aims to discuss the key issues of a system we have developed to deliver accessible, customized or nomadic learning experiences to learners with different access needs and skills. To reduce the risk of excluding users with particular access capabilities, our system exploits Learning Objects (LOs) which are dynamically adapted and transcoded based on the specific needs of non-typical users and on the barriers that they can encounter in the environment. The basic idea is to dynamically adapt contents, by selecting them from a set of media resources packaged in SCORM-compliant LOs and stored in a self-adapting format. The system schedules and orchestrates a set of transcoding processes based on specific learner needs, so as to produce a customized LO that can be fully enjoyed by any (impaired or mobile) student.

Bounded non-deterministic planning for multimedia adaptation

This paper proposes a novel combination of artificial intelligence planning and other techniques for improving decision-making in the context of multi-step multimedia content adaptation. In particular, it describes a method that allows decision-making (selecting the adaptation to perform) in situations where third-party pluggable multimedia conversion modules are involved and the multimedia adaptation planner does not know their exact adaptation capabilities. In this approach, the multimedia adaptation planner module is only responsible for a part of the required decisions; the pluggable modules make additional decisions based on different criteria. We demonstrate that partial decision-making is not only attainable, but also introduces advantages with respect to a system in which these conversion modules are not capable of providing additional decisions. This means that transferring decisions from the multi-step multimedia adaptation planner to the pluggable conversion modules increases the flexibility of the adaptation. Moreover, by allowing conversion modules to be only partially described, the range of problems that these modules can address increases, while significantly decreasing both the description length of the adaptation capabilities and the planning decision time. Finally, we specify the conditions under which knowing the partial adaptation capabilities of a set of conversion modules will be enough to compute a proper adaptation plan.

Issues in delivering multimedia content to mobile devices

The scalability of a computer system is its response to growth. It is also depended on its hardware, its operating system and the applications it is running. Most distributed systems technology today still depends on bus-based shared memory which do not scale well, and systems based on the grid or hypercube scheme requires significantly less connections than a full inter-connection that would exhibit a quadratic growth rate. The rapid convergence of mobile communication, digital broadcasting and network infrastructures calls for rich multimedia content that is adaptive and responsive to the needs of individuals, businesses and the public organisations. This paper will discuss the emergence of mobile Multimedia systems and provides an overview of the issues regarding design and delivery of multimedia content to mobile devices.

A classification for content adaptation system

Content adaptation is an attractive solution for the ever growing desktop based Web content delivered to the user via heterogeneous devices, in order to provide acceptable experience while surfing the Web. Bridging the mismatch between the rich content and the user device's resources (display, processing, navigation, network bandwidth, media support) without user intervention requires a proactive behavior. While content adaptation poses multitude of benefits, without proper strategies, adaptation will not be truly optimized. There have been many projects focused on content adaptation that have been designed with different goals and approaches. In this paper, we introduce a comprehensive classification for content adaptation system. The classification is used to group the approaches applied in the implementation of existing content adaptation system. Survey on some content adaptation systems also been provided. We also present the research spectrum in content adaptation and discuss the challenges.

Request-driven cross-media content adaptation technique

Devices, standards and software develop rapidly, but still often independently of each other. This creates problems in terms of content suitability on various devices. Also, in mobile environment, user and system-level applications must execute subject to a variety of resource constraints. In order to deal with these constraints, content adaptation is required. In this chapter, we justify the need of distributed cross media content adaptation and the potential of utilizing Web Services as the adaptation providers. We introduce request-driven context to complement constraint-driven and utility-driven approaches. We describe the request context mapping and propose a novel path’s determination scheme for determining the optimal service proxies to facilitate the adaptation tasks. To better illustrate the disjoint portions in content passing between service proxies, two communication models were associated. Then, within Web Services, we explain the related protocols and socket connection between adaptation’s services. We conclude with discussion regarding the strengths of the proposed architecture.

Multi-criteria content adaptation service selection broker

In this paper, we propose a service-oriented content adaptation framework and an approach to the Content Adaptation Service Selection (CASS) problem. In particular, the problem is how to assign adaptation tasks (e.g., transcoding, video summarization, etc) together with respective content segments to appropriate adaptation services. Current systems tend to be mostly centralized suffering from single point failures. The proposed algorithm consists of a greedy and single objective assignment function that is constructed on top of an adaptation path tree. The performance of the proposed service selection framework is studied in terms of efficiency of service selection execution under various conditions. The results indicate that the proposed policy performs substantially better than the baseline approach.

Service discovery for service-oriented content adaptation

Service-Oriented Content Adaptation (SOCA) has emerged as a potential solution to the content-device mismatch problem. One of the key problems with the SOCA scheme is that a content adaptation task can potentially be performed by multiple services. In this paper, we propose an approach to the service discovery problem for SOCA and it is demonstrated to perform well.

A protocol for discovering content adaptation services

Service-oriented content adaptation scheme has emerged to address content adaptation problem. In this scheme, content adaptation functions are provided as services by multiple providers, located across wide area network. To benefit from these services, clients must be able to locate them in the network. This makes service discovery as an important component. In this paper, we propose a service discovery protocol that takes into account searching space, searching time, QoS and physical location of the potential providers. The performance of the proposed protocol is studied in term of discoverability under various conditions and shown to be substantially better than the keyword-based and QoS-based approaches.

Between context-aware media capture and multimedia content analysis - where do we find the promised land?

Various issues related to the multimedia information retrieval and media access are discussed. The feasible solutions for automatic signal-based analysis of media content are analyzed. The extent of user involvement in the content creation process is emphasized. The applications driving the creation and usage of context and metadata are also elaborated.

"You Tube and I Find" - personalizing multimedia content access

Recent growth in broadband access and proliferation of small personal devices that capture images and videos has led to explosive growth of multimedia content available everywhereVfrom personal disks to the Web. While digital media capture and upload has become nearly universal with newer device technology, there is still a need for better tools and technologies to search large collections of multimedia data and to find and deliver the right content to a user according to her current needs and preferences. A renewed focus on the subjective dimension in the multimedia lifecycle, fromcreation, distribution, to delivery and consumption, is required to address this need beyond what is feasible today. Integration of the subjective aspects of the media itselfVits affective, perceptual, and physiological potential (both intended and achieved), together with those of the users themselves will allow for personalizing the content access, beyond today’s facility. This integration, transforming the traditional multimedia information retrieval (MIR) indexes to more effectively answer specific user needs, will allow a richer degree of personalization predicated on user intention and mode of interaction, relationship to the producer, content of the media, and their history and lifestyle. In this paper, we identify the challenges in achieving this integration, current approaches to interpreting content creation processes, to user modelling and profiling, and to personalized content selection, and we detail future directions. The structure of the paper is as follows: In Section I, we introduce the problem and present some definitions. In Section II, we present a review of the aspects of personalized content and current approaches for the same. Section III discusses the problem of obtaining metadata that is required for personalized media creation and present eMediate as a case study of an integrated media capture environment. Section IV presents the MAGIC system as a case study of capturing effective descriptive data and putting users first in distributed learning delivery. The aspects of modelling the user are presented as a case study in using user’s personality as a way to personalize summaries in Section V. Finally, Section VI concludes the paper with a discussion on the emerging challenges and the open problems.

Broker-based service-oriented content adaptation framework

Content adaptation bridges the mismatch between rich contents and user preferences along with the end device capability. This thesis addresses five key issues: enabling content adaptation as services; locating and selecting best possible services in the network; and negotiating, providing and managing quality assurance of a service.

Management of service level agreement for service-oriented content adaptation platform

It is paramount to provide seamless and ubiquitous access to rich contents available online to interested users via a wide range of devices with varied characteristics. Recently, a service-oriented content adaptation scheme has emerged to address this content-device mismatch problem. In this scheme, content adaptation functions are provided as services by third-party providers. Clients pay for the consumed services and thus demand service quality. As such, negotiating for the QoS offers, assuring negotiated QoS levels and accuracy of adapted content version are essential. Any non-compliance should be handled and reported in real time. These issues elevate the management of service level agreement (SLA) as an important problem. This chapter presents prior work, important challenges, and a framework for managing SLA for service-oriented content adaptation platform.