Mobile learning and video experience in delivering digital content

In recent years, the worldwide distribution of smartphone devices has been growing rapidly. Mobile technologies are evolving fast, a situation which provides new possibilities for mobile learning applications. Along with new delivery methods, this development enables new concepts for learning. This study focuses on the effectiveness and experience of a mobile learning video promoting the key features of a specific device. Through relevant learning theories, mobile technologies and empirical findings, the thesis presents the key elements for a mobile learning video that are essential for effective learning. This study also explores how previous experience with mobile services and knowledge of a mobile handset relate to final learning results. Moreover, this study discusses the optimal delivery mechanisms for a mobile video. The target group for the study consists of twenty employees of a Sanoma Company. The main findings show that the individual experience of learning and the actual learning results may differ and that the design for certain video elements, such as sound and the presentation of technical features, can have an impact on the experience and effectiveness of a mobile learning video. Moreover, a video delivery method based on cloud technologies and HTML5 is suggested to be used in parallel with standalone applications.

Co-created Mobile Narratives

FM Marjo Mäenpään Turun yliopiston Humanistisen tiedekunnan Kulttuurituotannon ja maisemantutkimuksen digitaalisen kulttuurin oppialalle valmistunut väitöskirja Co-created Mobile Narratives tarkastetaan Porin yliopistokeskuksessa 27. huhtikuuta 2013. Marjo Mäenpää tutkii, kuinka ihmiset tarinallistavat elämänsä, kuvittavat ja jakavat kokemuksiaan toisten ihmisten kanssa mobiilin median avulla. Elämänjulkaisemisesta on tullut ihmisten arkista toimintaa. Mäenpää lähestyy jaettuja kännykkävideotarinoita kolmesta eri näkökulmasta. Hän tutkii tarinoiden rakennetta, julkaisemista ja julkaisevia yhteisöjä narratologian, yhteisöjen toiminnan ja mediantutkimuksen valossa. Teoreetikot aina Aristoteleesta klassisen narratologian tutkijoihin ovat esittäneet erilaisia tarinallisuuden kaavoja ja rakenteita, joita on havaittavissa myös yhteisössä tuotetuista videotarinoista. Myöhemmän alan tutkimustradition, mm. kognitiivisen narratologian mukaan ihmiset hahmottavat tarinallisia kokonaisuuksia pienemmistäkin fragmenteista ja vihjeistä. Elämän tarinaa, käännekohtia ja elämyksiä kerrotaan usein – esimerkiksi Facebookissa – yksittäisillä, sattumanvaraisilla kuvilla. Yhteisöllinen tuotanto edellyttää luottamusta. Yhteisö jakaa tarinoita, jotka voivat olla hyvinkin fragmentaarisia, mutta saavat merkityksensä yhteisestä kokemusmaailmasta ja kulttuurista. Julkaiseminen on sattumanvaraista, luovaa toimintaa, jonka lopputulos voi olla ennalta arvaamaton. Kuitenkin julkaiseminen edellyttää jonkinlaista aktiivista toimijaa tai tuottajaa. Rakenteen julkaisemiselle voi antaa tuottaja, moderaattori tai hyvin rakennettu teknologinen julkaisualusta. Monitieteisen väitöstutkimuksen aineisto on peräisin Turun yliopiston, Tampereen teknillisen yliopiston ja Aalto- yliopiston Porin yksiköiden yhteisestä Mobile Social Media -tutkimushankkeesta. Vuosina 2008-2010 hankkeessa suunniteltiin MoViE (Mobile Video Experience) -sovellusta, jonka avulla ihmiset voivat julkaista omia lyhyitä videoitaan ja jakaa niitä toisten käyttäjien kanssa. MoViE-sovelluksen avulla käyttäjät voivat editoida omia ja toisten kuvaamia videoita sekä julkaista kuvallisia tarinoita yhteisöllisistä kokemuksista. MoViE-sovellusta kokeiltiin mm. Pori Jazz -konserteissa. Samasta konsertista taltioitui kännykkävideoille useita näkökulmia, ja testikäyttäjäryhmä koosti useita erilaisia videotarinoita yhteisestä konserttikokemuksestaan. Marjo Mäenpää (1959) työskentelee opetus- ja kulttuuriministeriössä kulttuuriasiainneuvoksena. Hän on toiminut mm. kustantajana, multimedian dramaturgian opettajana Teatterikorkeakoulussa, digitaalisen mediatuotannon professorina Aalto-yliopiston Taiteen ja suunnittelun korkeakoulussa vuosina 2006-2012 sekä Taiteen edistämiskeskuksen väliaikaisena johtajana vuonna 2013.

Étude empirique du contexte d’utilisation des interfaces de vidéocommunication mobile

Ce document présente les résultats d’une étude empirique sur l’utilisation de la vidéoconférence mobile selon le contexte de l’usager afin de proposer des lignes directrices pour la conception des interfaces des dispositifs de communication vidéo mobile. Grâce à un échange riche d’informations, ce type de communication peut amener un sentiment de présence fort, mais les interfaces actuelles manquent de flexibilité qui permettrait aux usagers d’être créatifs et d’avoir des échanges plus riches lors d’une vidéoconférence. Nous avons mené une recherche avec seize participants dans trois activités où leurs conversations, leurs réactions et leurs comportements ont été observés. Deux groupes de discussion ont aussi servi à identifier les habitudes développées à partir de leur utilisation régulière de la vidéoconférence. Les résultats suggèrent une différence importante entre l’utilisation de la caméra avant et la caméra arrière de l’appareil mobile, et la nécessité de fournir des outils qui offrent plus de contrôle sur l’échange dans la conversation. L’étude propose plusieurs lignes directrices de conception pour les interfaces de communication vidéo mobiles, concernant la construction du contexte mobile de l’utilisateur.

Quality of experience in skype video calls

Skype is one of the well-known applications that has guided the evolution of real-time video streaming and has become one of the most used software in everyday life. It provides VoIP audio/video calls as well as messaging chat and file transfer. Many versions are available covering all the principal operating systems like Windows, Macintosh and Linux but also mobile systems. Voice quality decreed Skype success since its birth in 2003 and peer-to-peer architecture has allowed worldwide diffusion. After video call introduction in 2006 Skype became a complete solution to communicate between two or more people. As a primarily video conferencing application, Skype assumes certain characteristics of the delivered video to optimize its perceived quality. However in the last years, and with the recent release of SkypeKit1, many new Skype video-enabled devices came out especially in the mobile world. This forced a change to the traditional recording, streaming and receiving settings allowing for a wide range of network and content dynamics. Video calls are not anymore based on static ‘chatting’ but mobile devices have opened new possibilities and can be used in several scenarios. For instance, lecture streaming or one-to-one mobile video conferences exhibit more dynamics as both caller and callee might be on move. Most of these cases are different from “head&shoulder” only content. Therefore, Skype needs to optimize its video streaming engine to cover more video types. Heterogeneous connections require different behaviors and solutions and Skype must face with this variety to maintain a certain quality independently from connection used. Part of the present work will be focused on analyzing Skype behavior depending on video content. Since Skype protocol is proprietary most of the studies so far have tried to characterize its traffic and to reverse engineer its protocol. However, questions related to the behavior of Skype, especially on quality as perceived by users, remain unanswered. We will study Skype video codecs capabilities and video quality assessment. Another motivation of our work is the design of a mechanism that estimates the perceived cost of network conditions on Skype video delivery. To this extent we will try to assess in an objective way the impact of network impairments on the perceived quality of a Skype video call. Traditional video streaming schemes lack the necessary flexibility and adaptivity that Skype tries to achieve at the edge of a network. Our contribution will lye on a testbed and consequent objective video quality analysis that we will carry out on input videos. We will stream raw video files with Skype via an impaired channel and then we will record it at the receiver side to analyze with objective quality of experience metrics.

Vídeo-Mapa: uma interface de geovisualização multimídia aplicada a transportes e meio ambiente.

A presente tese propõe uma metodologia de vídeo-mapeamento móvel georreferenciado a partir do desenvolvimento de protótipos que utilizam uma Interface de Geovisualização Multimídia para sincronizar o registro (em vídeo) de um local ou evento de interesse com a rota percorrida pelo veículo de inspeção (sobre mapa ou imagem), através da coleta de dados por sensores móveis: câmera digital, microfone, receptor GNSS e bússola digital. A interface permite a integração desses sensores com os atuais serviços de mapas digitais disponíveis na web. Sistemas como esse melhoram significativamente as análises temporais, a gestão e a tomada de decisão. A interface proposta e desenvolvida no presente trabalho é útil para muitas aplicações como ferramenta de monitoramento e inventário. Esta interface pode ser entendida como o componente visual de um sistema de mapeamento móvel ou como um sistema cartográfico alternativo ou complementar, para aplicações em que a precisão geométrica do receptor GNSS, na modalidade de navegação, é suficiente e sua acessibilidade, um fator competitivo. As aplicações desenvolvidas no presente trabalho foram duas: um sistema de monitoramento e inventário de placas de sinalização viária e um sistema de monitoramento de cheias/secas e inventário de propriedades na borda de reservatórios de hidroelétricas, ambos em pleno funcionamento.

How to design and develop There App: A mobile app focused on live video streaming, promoting new social interactions

This work project aims to demonstrate how to design and develop an innovative concept of video streaming app. The project combines technology push and market pull theories into developing a product that is more suitable for the customer needs, with the particularity that there is no other way of seeing any place in the world, live and ondemand. An analysis on the bigger influencers in terms of design-thinking and new product development, as Tim Brown or Paul Trott, lead to a better understanding on how There App should evolve, keeping in mind the customer desires and technical features.

An OMNeT++ Framework to Evaluate Video Transmission in Mobile Wireless Multimedia Sensor Networks

The development and evaluation of new algorithms and protocols for Wireless Multimedia Sensor Networks (WMSNs) are usually supported by means of a discrete event network simulator, where OMNeT++ is one of the most important ones. However, experiments involving multimedia transmission, video flows with different characteristics, genres, group of pictures lengths, and coding techniques must be evaluated based also on Quality of Experience (QoE) metrics to reflect the user's perception. Such experiments require the evaluation of video-related information, i.e., frame type, received/lost, delay, jitter, decoding errors, as well as inter and intra-frame dependency of received/distorted videos. However, existing OMNeT++ frameworks for WMSNs do not support video transmissions with QoE-awareness, neither a large set of mobility traces to enable evaluations under different multimedia/mobile situations. In this paper, we propose a Mobile MultiMedia Wireless Sensor Network OMNeT++ framework (M3WSN) to support transmission, control and evaluation of real video sequences in mobile WMSNs.

A Link Quality and Geographical-aware Routing Protocol for Video Transmission in Mobile IoT

Wireless mobile sensor networks are enlarging the Internet of Things (IoT) portfolio with a huge number of multimedia services for smart cities. Safety and environmental monitoring multimedia applications will be part of the Smart IoT systems, which aim to reduce emergency response time, while also predicting hazardous events. In these mobile and dynamic (possible disaster) scenarios, opportunistic routing allows routing decisions in a completely distributed manner, by using a hop- by-hop route decision based on protocol-specific characteristics, and a predefined end-to-end path is not a reliable solution. This enables the transmission of video flows of a monitored area/object with Quality of Experience (QoE) support to users, headquarters or IoT platforms. However, existing approaches rely on a single metric to make the candidate selection rule, including link quality or geographic information, which causes a high packet loss rate, and reduces the video perception from the human standpoint. This article proposes a cross-layer Link quality and Geographical-aware Opportunistic routing protocol (LinGO), which is designed for video dissemination in mobile multimedia IoT environments. LinGO improves routing decisions using multiple metrics, including link quality, geographic loca- tion, and energy. The simulation results show the benefits of LinGO compared with well-known routing solutions for video transmission with QoE support in mobile scenarios.

Incorporating global positioning data in real time P2P audio/video streams for mobile devices

We propose an original method to geoposition an audio/video stream with multiple emitters that are at the same time receivers of the mixed signal. The achieved method is suitable for those comes where a list of positions within a designated area is encoded with a degree of precision adjusted to the visualization capabilities; and is also easily extensible to support new requirements. This method extends a previously proposed protocol, without incurring in any performance penalty.

P2P audio/video protocol with global positioning data in real time for mobile devices

In this paper, we propose an original method to geoposition an audio/video stream with multiple emitters that are at the same time receivers of the mixed signal. The obtained method is suitable when a list of positions within a known area is encoded with precision tailored to the visualization capabilities of the target device. Nevertheless, it is easily adaptable to new precision requirements, as well as parameterized data precision. This method extends a previously proposed protocol, without incurring in any performance penalty.

A quality driven framework for adaptive video streaming in mobile wireless networks

The concern over the quality of delivering video streaming services in mobile wireless networks is addressed in this work. A framework that enhances the Quality of Experience (QoE) of end users through a quality driven resource allocation scheme is proposed. To play a key role, an objective no-reference quality metric, Pause Intensity (PI), is adopted to derive a resource allocation algorithm for video streaming. The framework is examined in the context of 3GPP Long Term Evolution (LTE) systems. The requirements and structure of the proposed PI-based framework are discussed, and results are compared with existing scheduling methods on fairness, efficiency and correlation (between the required and allocated data rates). Furthermore, it is shown that the proposed framework can produce a trade-off between the three parameters through the QoE-aware resource allocation process.

Ensuring QoE in contemporary mobile networks for video content distribution

A framework that aims to best utilize the mobile network resources for video applications is presented in this paper. The main contribution of the work proposed is the QoE-driven optimization method that can maintain a desired trade-off between fairness and efficiency in allocating resources in terms of data rates to video streaming users in LTE networks. This method is concerned with the control of the user satisfaction level from the service continuity's point of view and applies appropriate QoE metrics (Pause Intensity and variations) to determine the scheduling strategies in combination with the mechanisms used for adaptive video streaming such as 3GP/MPEG-DASH. The superiority of the proposed algorithms are demonstrated, showing how the resources of a mobile network can be optimally utilized by using quantifiable QoE measurements. This approach can also find the best match between demand and supply in the process of network resource distribution.

Advanced side information creation techniques and framework for Wyner-Ziv video coding

Recently, several distributed video coding (DVC) solutions based on the distributed source coding (DSC) paradigm have appeared in the literature. Wyner-Ziv (WZ) video coding, a particular case of DVC where side information is made available at the decoder, enable to achieve a flexible distribution of the computational complexity between the encoder and decoder, promising to fulfill novel requirements from applications such as video surveillance, sensor networks and mobile camera phones. The quality of the side information at the decoder has a critical role in determining the WZ video coding rate-distortion (RD) performance, notably to raise it to a level as close as possible to the RD performance of standard predictive video coding schemes. Towards this target, efficient motion search algorithms for powerful frame interpolation are much needed at the decoder. In this paper, the RD performance of a Wyner-Ziv video codec is improved by using novel, advanced motion compensated frame interpolation techniques to generate the side information. The development of these type of side information estimators is a difficult problem in WZ video coding, especially because the decoder only has available some reference, decoded frames. Based on the regularization of the motion field, novel side information creation techniques are proposed in this paper along with a new frame interpolation framework able to generate higher quality side information at the decoder. To illustrate the RD performance improvements, this novel side information creation framework has been integrated in a transform domain turbo coding based Wyner-Ziv video codec. Experimental results show that the novel side information creation solution leads to better RD performance than available state-of-the-art side information estimators, with improvements up to 2 dB: moreover, it allows outperforming H.264/AVC Intra by up to 3 dB with a lower encoding complexity.