Asymmetric 3D video coding based on regions of perceptual relevance

This dissertation presents a study and experimental research on asymmetric coding of stereoscopic video. A review on 3D technologies, video formats and coding is rst presented and then particular emphasis is given to asymmetric coding of 3D content and performance evaluation methods, based on subjective measures, of methods using asymmetric coding. The research objective was de ned to be an extension of the current concept of asymmetric coding for stereo video. To achieve this objective the rst step consists in de ning regions in the spatial dimension of auxiliary view with di erent perceptual relevance within the stereo pair, which are identi ed by a binary mask. Then these regions are encoded with better quality (lower quantisation) for the most relevant ones and worse quality (higher quantisation) for the those with lower perceptual relevance. The actual estimation of the relevance of a given region is based on a measure of disparity according to the absolute di erence between views. To allow encoding of a stereo sequence using this method, a reference H.264/MVC encoder (JM) has been modi ed to allow additional con guration parameters and inputs. The nal encoder is still standard compliant. In order to show the viability of the method subjective assessment tests were performed over a wide range of objective qualities of the auxiliary view. The results of these tests allow us to prove 3 main goals. First, it is shown that the proposed method can be more e cient than traditional asymmetric coding when encoding stereo video at higher qualities/rates. The method can also be used to extend the threshold at which uniform asymmetric coding methods start to have an impact on the subjective quality perceived by the observers. Finally the issue of eye dominance is addressed. Results from stereo still images displayed over a short period of time showed it has little or no impact on the proposed method.

Multi-dimensional summarization in cyber-physical society

Text summarization has been studied for over a half century, but traditional methods process texts empirically and neglect the fundamental characteristics and principles of language use and understanding. Automatic summarization is a desirable technique for processing big data. This reference summarizes previous text summarization approaches in a multi-dimensional category space, introduces a multi-dimensional methodology for research and development, unveils the basic characteristics and principles of language use and understanding, investigates some fundamental mechanisms of summarization, studies dimensions on representations, and proposes a multi-dimensional evaluation mechanism. Investigation extends to incorporating pictures into summary and to the summarization of videos, graphs and pictures, and converges to a general summarization method. Further, some basic behaviors of summarization are studied in the complex cyber-physical-social space. Finally, a creative summarization mechanism is proposed as an effort toward the creative summarization of things, which is an open process of interactions among physical objects, data, people, and systems in cyber-physical-social space through a multi-dimensional lens of semantic computing. The insights can inspire research and development of many computing areas.

Effective video content distribution by combining TCP with adaptive FEC coding

This paper will look at the benefits and limitations of content distribution using Forward Error Correction (FEC) in conjunction with the Transmission Control Protocol (TCP). FEC can be used to reduce the number of retransmissions which would usually result from a lost packet. The requirement for TCP to deal with any losses is then greatly reduced. There are however side-effects to using FEC as a countermeasure to packet loss: an additional requirement for bandwidth. When applications such as real-time video conferencing are needed, delay must be kept to a minimum, and retransmissions are certainly not desirable. A balance, therefore, between additional bandwidth and delay due to retransmissions must be struck. Our results show that the throughput of data can be significantly improved when packet loss occurs using a combination of FEC and TCP, compared to relying solely on TCP for retransmissions. Furthermore, a case study applies the result to demonstrate the achievable improvements in the quality of streaming video perceived by end users.

Robust H.264/AVC video transmission using data partitioning and unequal loss protection

In this work, we present an adaptive unequal loss protection (ULP) scheme for H264/AVC video transmission over lossy networks. This scheme combines erasure coding, H.264/AVC error resilience techniques and importance measures in video coding. The unequal importance of the video packets is identified in the group of pictures (GOP) and the H.264/AVC data partitioning levels. The presented method can adaptively assign unequal amount of forward error correction (FEC) parity across the video packets according to the network conditions, such as the available network bandwidth, packet loss rate and average packet burst loss length. A near optimal algorithm is developed to deal with the FEC assignment for optimization. The simulation results show that our scheme can effectively utilize network resources such as bandwidth, while improving the quality of the video transmission. In addition, the proposed ULP strategy ensures graceful degradation of the received video quality as the packet loss rate increases. © 2010 IEEE.

Introduction of novel video-based tasks to clinical fMRI: Comparing traditional fMRI tasks with novel video-based tasks for mapping brain language areas

Recently, blood oxygen level-dependent (BOLD) functional magnetic resonance imaging (fMRI) has become a routine clinical procedure for localization of language and motor brain regions and has been replacing more invasive preoperative procedures. However, the fMRI results from these tasks are not always reproducible even from the same patient. Evaluating the reproducibility of language and speech mapping is especially complicated due to the complex brain circuitry that may become activated during the functional task. Non-language areas such as sensory, attention, decision-making, and motor brain regions may also be activated in addition to the specific language regions during a traditional sentence-completion task. In this study, I test a new approach, which utilizes 4-minute video-based tasks, to map language and speech brain regions for patients undergoing brain surgery. Results from 35 subjects have shown that the video-based task activates Wernicke’s area, as well as Broca’s area in most subjects. The computed laterality indices, which indicate the dominant hemisphere from that functional task, have indicated left dominance from the video-based tasks. This study has shown that the video-based task may be an alternative method for localization of language and speech brain regions for patients who are unable to complete the sentence-completion task.

Mining the Online Social Network Data: Influence, Summarization, and Organization

Online Social Network (OSN) services provided by Internet companies bring people together to chat, share the information, and enjoy the information. Meanwhile, huge amounts of data are generated by those services (they can be regarded as the social media ) every day, every hour, even every minute, and every second. Currently, researchers are interested in analyzing the OSN data, extracting interesting patterns from it, and applying those patterns to real-world applications. However, due to the large-scale property of the OSN data, it is difficult to effectively analyze it. This dissertation focuses on applying data mining and information retrieval techniques to mine two key components in the social media data — users and user-generated contents. Specifically, it aims at addressing three problems related to the social media users and contents: (1) how does one organize the users and the contents? (2) how does one summarize the textual contents so that users do not have to go over every post to capture the general idea? (3) how does one identify the influential users in the social media to benefit other applications, e.g., Marketing Campaign? The contribution of this dissertation is briefly summarized as follows. (1) It provides a comprehensive and versatile data mining framework to analyze the users and user-generated contents from the social media. (2) It designs a hierarchical co-clustering algorithm to organize the users and contents. (3) It proposes multi-document summarization methods to extract core information from the social network contents. (4) It introduces three important dimensions of social influence, and a dynamic influence model for identifying influential users.

(Table 1) Hydrocarbon gas composition of sediment and gas hydrate collected in video-guided grabs from Chapopote

In the Campeche Knolls, in the southern Gulf of Mexico, lava-like flows of solidified asphalt cover more than 1 square kilometer of the rim of a dissected salt dome at a depth of 3000 meters below sea level. Chemosynthetic tubeworms and bivalves colonize the sea floor near the asphalt, which chilled and contracted after discharge. The site also includes oil seeps, gas hydrate deposits, locally anoxic sediments, and slabs of authigenic carbonate. Asphalt volcanism creates a habitat for chemosynthetic life that may be widespread at great depth in the Gulf of Mexico.

Data S1. Results of the analyses considering developmental time, supplementary figures and tables & Video S1

Our ability to project the impact of global change on marine ecosystem is limited by our poor understanding on how to predict species sensitivity. For example, the impact of ocean acidification is highly species-specific, even in closely related taxa. The aim of this study was to test the hypothesis that the tolerance range of a given species to decreased pH corresponds to their natural range of exposure. Larvae of the green sea urchin Strongylocentrotus droebachiensis were cultured from fertilization to metamorphic competence (29 days) under a wide range of pH (from pHT = 8.0/pCO2 ~ 480 ?atm to pHT = 6.5/pCO2 ~ 20 000 ?atm) covering present (from pHT 8.7 to 7.6), projected near-future variability (from pHT 8.3 to 7.2) and beyond. Decreasing pH impacted all tested parameters (mortality, symmetry, growth, morphometry and respiration). Development of normal, although showing morphological plasticity, swimming larvae was possible as low as pHT >= 7.0. Within that range, decreasing pH increased mortality and asymmetry and decreased body length (BL) growth rate. Larvae raised at lowered pH and with similar BL had shorter arms and a wider body. Relative to a given BL, respiration rates and stomach volume both increased with decreasing pH suggesting changes in energy budget. At the lowest pHs (pHT <= 6.5), all the tested parameters were strongly negatively affected and no larva survived past 13 days post fertilization. In conclusion, sea urchin larvae appeared to be highly plastic when exposed to decreased pH until a physiological tipping point at pHT = 7.0. However, this plasticity was associated with direct (increased mortality) and indirect (decreased growth) consequences for fitness.

The Efficacy of a Novel Video Game Intervention (MindLight) in Reducing Children's Anxiety

Anxiety disorders are the most prevalent form of psychopathology among children and adolescents. Because demand for treatment far exceeds availability, there is a need for alternative approaches that are engaging, accessible, cost-effective, and incorporate practice to reach as many youth as possible. One novel approach is a video game intervention called MindLight that uses two evidence-based strategies to target childhood anxiety problems. Using neurofeedback mechanics to train players to: (1) attend to positive rather than threatening stimuli and (2) down-regulate arousal during stressful situations, MindLight teaches children how to practice overcoming anxious thoughts and arousal in a fun and engaging context. The present study examined the effectiveness of MindLight versus online cognitive-behavioural therapy (CBT) based psychoeducation sessions as a comparison in reducing anxiety in a sample of 144 anxious children, which was measured in three ways: (1) anxiety symptoms, (2) state anxiety in response to stress, and (3) psychophysiological arousal in response to stress. Children between the ages of 8.05–17.78 years (M=13.61, SD=1.79) were randomly assigned to play MindLight or complete psychoeducation for five hours over three weeks. State anxiety and psychophysiological arousal were assessed in response to two stress tasks before and after exposure to MindLight or psychoeducation. Anxiety symptoms were also measured via a questionnaire. Overall, participants showed significant reductions in anxiety symptoms and state anxiety in response to stress, but not psychophysiological arousal in response to stress. Moreover, the magnitude of reductions in anxiety did not differ between interventions but by age and sex. Specifically, older participants showed a greater decrease in severity of state anxiety in response to a social stressor than younger participants and girls showed a greater decrease in severity of state anxiety in response to a cognitive stressor than boys. The present study suggests that playing MindLight results in similar reductions in anxiety as one of the more common means of delivering CBT principles to youth.

Scenes of provincial life: an online video sequence and commentary

I present here a sequence of short videos, Scenes of Provincial Life, forming a unified, ongoing online work. In my written commentary I discuss the work‘s context, genesis and facture and presentation and thereby demonstrate its claim to originality as art work. I go on to suggest one possible interpretive framework for it. I then discuss the nature of art works as candidates for the generation of new knowledge and conclude that art works in general fulfil this function, in a very carefully defined way, as a necessary condition of being art works. I further connect the success of any work as art work with the richness of its knowledge generating capacity, inseparably allied to its aesthetic force. I conclude that if Scenes of Provincial Life is seen to have value as artwork it will therefore by definition be a creator of new knowledge.

A Framework to Capture and Share Knowledge Using Storytelling and Video Sharing in Global Product Development

In global engineering enterprises, information and knowledge sharing are critical factors that can determine a project’s success. This statement is widely acknowledged in published literature. However, according to some academics, tacit knowledge is derived from a person’s lifetime of experience, practice, perception and learning, which makes it hard to capture and document in order to be shared. This project investigates if social media tools can be used to improve and enable tacit knowledge sharing within a global engineering enterprise. This paper first provides a brief background of the subject area, followed by an explanation of the industrial investigation, from which the proposed knowledge framework to improve tacit knowledge sharing is presented. This project’s main focus is on the improvement of collaboration and knowledge sharing amongst product development engineers in order to improve the whole product development cycle.

Viewbrics: Formatief evalueren van complexe vaardigheden middels ‘video-rubrics’ in het Voortgezet Onderwijs

Presentatie over de doelstelling en aanpak binnen het Viewbrics-project (www.viewbrics.nl), waarin gekeken wordt naar het effect van het gecombineerd gebruik van tekstuele rubrieken met videovoorbeelden op de kwaliteit van de feedback, mentale modellen en het aanleren van een aantal complexe (21e eeuwse) vaardigheden (samenwerken, presenteren, informatievaardigheden) in het Voortgezet Onderwijs.

A First Step Towards Synthesising Rubrics and Video for the Formative Assessment of Complex Skills

Abstract. The performance objectives used for the formative assessment of com- plex skills are generally set through text-based analytic rubrics[1]. Moreover, video modeling examples are a widely applied method of observational learning, providing students with context-rich modeling examples of complex skills that act as an analogy for problem solving [1]. The purpose of this theoretical paper is to synthesize the components of video modeling and rubrics to support the formative assessment of complex skills. Based on theory, we argue that application of the developed Video Enhanced Rubrics (VER) fosters learners’ development of mental models, quality of provided feedback by various actors and finally, the learners mastery of complex skills.

Viewbrics: Formative Assessment of Complex Skills with Video-Enhanced Rubrics (VER) in Dutch Secondary Education

To learn complex skills, like collaboration, learners need to acquire a concrete and consistent mental model of what it means to master this skill. If learners know their current mastery level and know their targeted mastery level, they can better determine their subsequent learning activities. Rubrics support learners in judging their skill performance as they provide textual descriptions of skills’ mastery levels with performance indicators for all constituent subskills. However, text-based rubrics have a limited capacity to support the formation of mental models with contextualized, time-related and observable behavioral aspects of a complex skill. This paper outlines the design of a study that intends to investigate the effect of rubrics with video modelling examples compared to text-based rubrics on skills acquisition and feedback provisioning. The hypothesis is that video-enhanced rubrics, compared to text based rubrics, will improve mental model formation of a complex skill and improve the feedback quality a learner receives (from e.g. teachers, peers) while practicing a skill, hence positively effecting final mastery of a skill.

A First Step Towards Video Enhanced Rubrics for the Formative Assessment of Complex Skills : A literature review and a plea

Paper presentation at the TEA2016 conference, Tallinn, Estonia.