Multimodal synthesis and the voice of the multimedia author in a Japanese EFL context

This paper examines a powerful potential of multimodal design: meaning that transcends the total semiotic contribution of a text's constituent parts. With reference to data drawn from the digital storytelling practices of Japanese university students, the author argues and demonstrates that in the current semiotic climate, characterised by the increasing availability and complexity of communication tools and ready appropriation of available designs, practices of multimedia authorship truly can evince expression that is authentically multiplicative. However, this sort of meaning making does not automatically come about. Controlling the inherent polysemy of multimodal texts, in the author's view, is a matter of recognising points of semantic correspondence among co-deployed images, language, etc. and creating syntheses of potential meaning that cut across these semiotic modes. The author further argues that it is in this way that the voice of the multimodal author can most clearly be heard, particularly in cases in which a language learner–author integrates elements within a multimedia text that encode meaning in the L2.

Challenges of multimedia self-presentation : taking, and mistaking, the show on the road

One privilege enjoyed by new-media authors is the opportunity to realize representations of Self that are rich textual worlds in themselves and also to engage the wider world, with a voice, a smile, imagery, and sound. Still, closer investigation of multimedia composition practices reveals levels of complexity with which the verbal virtuoso is unconcerned. This article argues that while technology-afforded multimedia tools make it comparatively easy to author a vivid text, it is a multiplicatively more complicated matter to vividly realize and publicize an authorial intention. Based on analysis of the digital story creation process of a youth named “Steven,” the authors attempt to demonstrate the operation of two forces upon which the successful multimodal realization of the author's intention may hinge: “fixity” and “fluidity.” The authors show how, within the process of digital self-representation, these forces can intersect to influence multimodal meaning making, and an author's life, in consequential ways.

Conceptual representation for multimedia information

Multimedia information is now routinely available in the forms of text, pictures, animation and sound. Although text objects are relatively easy to deal with (in terms of information search and retrieval), other information bearing objects (such as sound, images, animation) are more difficult to index. Our research is aimed at developing better ways of representing multimedia objects by using a conceptual representation based on Schank's conceptual dependencies. Moreover, the representation allows for users' individual interpretations to be embedded in the system. This will alleviate the problems associated with traditional semantic networks by allowing for coexistence of multiple views of the same information. The viability of the approach is tested, and the preliminary results reported.

Authoring multimedia authoring tools

Capturing devices, while continually becoming smaller and easier to use, have increased in capacity. They are also more connectable and interoperable, and their propensity to show up where they are least expected is surprising. Despite these advances, the video-capture experience is still frustrating. To achieve success, two issues need consideration. One is to determine what to capture and how, and how to handle the ensuring process required to transform the raw captured footage into a presentable multimedia artifact. Continual query on discourse theory, domain distinctives such as media aesthetics, human-computer interface issues, and multimedia data description standards is also important.

A cooperative cache architecture in support of caching multimedia objects in MANETs

This paper presents a cooperative caching architecture suitable for continuous media (CM) proxy caching in MANET environments. The proposed scheme introduces an application manager component, which is interposed between traditional Internet CM applications and the network layer. The application manager transparently performs data location and service migration of active CM streaming sessions so as to exploit nearby data sources based on the dynamic topology of a MANET. We propose two data location schemes - Cache-State - a link-state based scheme and Reactive - an on-demand scheme. Since service migration can occur frequently, the application manager uses soft-state signaling techniques to communicate between remote application managers by translating hard-state application signaling, such as Real Time Streaming Protocol (RTSP) into soft-state messages. The proposed schemes are evaluated through simulation studies using the NS simulator. Simulation studies show that both Cache-State and Reactive schemes demonstrate significant QoS improvements and reduced bandwidth consumption.

Networking of Multimedia Women Event : beyond epsilon science - "where to look and how to realize new opportunities"

"Networking of Multimedia Women" event is a continuation of an on-going conversation in the multimedia research community and efforts by the ACM SIGMM to engage and promote female researchers in multimedia community, enable networking of junior and senior female researchers, and give insights towards successful professional careers based on examples. This year, the event will have a theme, called "Beyond Epsilon Science", where preeminent senior female researchers from academia, industry and government, Svetha Venkatesh, Nalini Venkatasubramanian, Dulce Ponceleon, Susanne Boll, and Maria Zemankova will present and discuss how to go beyond epsilon science, where to look for big ideas with high social impact, as well as how to obtain funding to realize these ideas, innovations and opportunities. Their current research projects and funding efforts, and their personal experiences will drive the event's discussions, awareness of major research and funding initiatives, answers to open questions and insights into successful professional careers.

Cognitive intervention in autism using multimedia stimulus

We demonstrate an open multimedia-based system for delivering early intervention therapy for autism. Using exible multi-touch interfaces together with principled ways to access rich content and tasks, we show how a syllabus can be translated into stimulus sets for early intervention. Media stimuli are able to be presented agnostic to language and media modality due to a semantic network of concepts and relations that are fundamental to language and cognitive development, which enable stimulus complexity to be adjusted to child performance. Being open, the system is able to assemble enough media stimuli to avoid children over-learning, and is able to be customised to a specific child which aids with engagement. Computer-based delivery enables automation of session logging and reporting, a fundamental and time-consuming part of therapy.

Contextual navigation in a multimedia journal

This work presents a framework for multimedia journaling,maintaining strong relationships between the document and embedded media. This enables media archives that are robust to changes in software environments, such as changes in web-sharing services, proprietary file formats and enables portability across operating system. We develop a journaling application using an existing multimedia framework, and show the power of the paradigm with specific case studies.

Between context-aware media capture and multimedia content analysis - where do we find the promised land?

Various issues related to the multimedia information retrieval and media access are discussed. The feasible solutions for automatic signal-based analysis of media content are analyzed. The extent of user involvement in the content creation process is emphasized. The applications driving the creation and usage of context and metadata are also elaborated.