Interactive free viewpoint video streaming using prioritized network coding

In free viewpoint applications, the images are captured by an array of cameras that acquire a scene of interest from different perspectives. Any intermediate viewpoint not included in the camera array can be virtually synthesized by the decoder, at a quality that depends on the distance between the virtual view and the camera views available at decoder. Hence, it is beneficial for any user to receive camera views that are close to each other for synthesis. This is however not always feasible in bandwidth-limited overlay networks, where every node may ask for different camera views. In this work, we propose an optimized delivery strategy for free viewpoint streaming over overlay networks. We introduce the concept of layered quality-of-experience (QoE), which describes the level of interactivity offered to clients. Based on these levels of QoE, camera views are organized into layered subsets. These subsets are then delivered to clients through a prioritized network coding streaming scheme, which accommodates for the network and clients heterogeneity and effectively exploit the resources of the overlay network. Simulation results show that, in a scenario with limited bandwidth or channel reliability, the proposed method outperforms baseline network coding approaches, where the different levels of QoE are not taken into account in the delivery strategy optimization.

Context-aware Adaptation Mechanism for Video Dissemination over Flying Ad-Hoc Networks

The user experience on watching live video se- quences transmitted over a Flying Ad-Hoc Networks (FANETs) must be considered to drop packets in overloaded queues, in scenarios with high buffer overflow and packet loss rate. In this paper, we introduce a context-aware adaptation mechanism to manage overloaded buffers. More specifically, we propose a utility function to compute the dropping probability of each packet in overloaded queues based on video context information, such as frame importance, packet deadline, and sensing relevance. In this way, the proposed mechanism drops the packet that adds the minimum video distortion. Simulation evaluation shows that the proposed adaptation mechanism provides real-time multimedia dissemination with QoE support in a multi-hop, multi-flow, and mobile network environments.

Individual Video Training - Entwicklung einer nationalen Infrastruktur für Video-unterstütztes Lernen

Video-basiertes Lernen ist besonders effektiv, wo es um Fertigkeiten und Verhalten geht. Videoaufzeichnungen von Gesprächen, Unterrichtssituationen oder der Durchführung praktischer Tätigkeiten wie dem Nähen einer Wunde erlauben es den Ausführenden, ihren Peers und ihren Tutoren, die Qualität der Leistung zu beurteilen und Anregungen zur Verbesserung zu formulieren. Wissend um den grossen didaktischen Wert von Videoaufzeichnungen haben sich vier Pädagogische Hochschulen (Zürich, Freiburg, Thurgau, Luzern) und zwei Medizinische Fakultäten (Bern, Lausanne) zusammen getan, um eine nationale Infrastruktur für Video-unterstütztes Lernen anzustossen. Ziel was es, ein System zu entwickeln, das einfach zu bedienen ist, bei dem viele Arbeitsschritte automatisiert sind und das die Videos im Internet bereit stellt. Zusammen mit SWITCH, der nationalen IT-Support-Organisation der Schweizer Hochschulen, wurde basierend auf den vorbestehenden Technologien AAI und SWITCHcast das Programm iVT (Individual Video Training) entwickelt. Die Integration des nationalen Single Logon System AAI (Authentification and Authorization Infrastructure) erlaubt es, die Videos mit dem jeweiligen User eindeutig zu verknüpfen, so dass die Videos nur für diesen User im Internet zugänglich sind. Mit dem Podcast-System SWITCHcast können Videos automatisch ins Internet hochgeladen und bereit gestellt werden. Es wurden je ein Plugin für die Learning Management Systeme ILIAS (PH Zürich, Uni Bern) und Moodle (Uni Lausanne) entwickelt. Dank dieser Plugins werden die Videos in den jeweiligen LMS verfügbar gemacht. Der Einsatz von iVT ist beim Kommunikationstraining unserer Medizinstudierenden in Bern inzwischen Standard. Das Login gilt gleichzeitig als Beleg für das Testat. Studierende, die keine Videoaufzeichnung wünschen, können diese nach dem Login stoppen. Bis anhin ist das Betrachten der Videos freiwillig. Szenarios mit Peer Feedback sind geplant. Eine entsprechende Erweiterung des Systems um gegenseitige Annotationsmöglichkeiten besteht bereits und wird fortlaufend weiterentwickelt.

Individual Video Training iVT - Development of a National Infrastructure for Video-Supported Learning

Introduction: Video‐Supported Learning is particularly effective when it comes to skills and behaviors. Video registration of patient‐physician interviews, class room instruction or practical skills allow it to learners themselves, their peers, and their tutors to assess the quality of the learner's performance, to give specific feedback, and to make suggestions for improvement. Methods: In Switzerland, four pedagogical universities and two medical faculties joined to initiate the development of a national infrastructure for Video Supported Learning. The goal was to have a system that is simple to use, has most steps automated, provides the videos over the Internet, and has a sophisticated access control. Together with SWITCH, the national IT‐Support‐Organisation for Swiss Universities, the program iVT (Individual Video Training) was developed by integrating two preexisting technologies. The first technology is SWITCHcast, a podcast system. With SWITCHcast, videos are automatically uploaded to a server as soon as the registration is over. There the videos are processed and converted to different formats. The second technology is the national Single Logon System AAI (Authentification and Authorization Infrastructure) that enables iVT to link each video with the corresponding learner. The learner starts the registration with his Single Logon. Thus, the video can unambiguously be assigned. Via his institution's Learning Management System (LMS), the learner can access his video and give access to his video to peers and tutors. Results: iVT is now used at all involved institutions. The system works flawlessly. In Bern, we use iVT for the communications skills training in the forth and sixth year. Since students meet with patient actors alone, iVT is also used to certify attendance. Students are encouraged to watch the videos of the interview and the feedback of the patient actor. The offer to discuss a video with a tutor was not used by the students. Discussion: We plan to expand the use of iVT by making peer assessment compulsory. To support this, annotation capabilities are currently added to iVT. We also want to use iVT in training of practical skills, again for self as well as for peer assessment.  At present, we use iVT for quality control of patient actor's performance.

Limbic brain responses in mothers with post-traumatic stress disorder and comorbid dissociation to video clips of their children.

Maternal dissociative symptoms which can be comorbid with interpersonal violence-related post-traumatic stress disorder (IPV-PTSD) have been linked to decreased sensitivity and responsiveness to children's emotional communication. This study examined the influence of dissociation on neural activation independently of IPV-PTSD symptom severity when mothers watch video-stimuli of their children during stressful and non-stressful mother-child interactions. Based on previous observations in related fields, we hypothesized that more severe comorbid dissociation in IPV-PTSD would be associated with lower limbic system activation and greater neural activity in regions of the emotion regulation circuit such as the medial prefrontal cortex and dorsolateral prefrontal cortex (dlPFC). Twenty mothers (of children aged 12-42 months), with and without IPV-PTSD watched epochs showing their child during separation and play while undergoing functional magnetic resonance imaging (fMRI). Multiple regression indicated that when mothers diagnosed with IPV-PTSD watched their children during separation compared to play, dissociative symptom severity was indeed linked to lowered activation within the limbic system, while greater IPV-PTSD symptom severity was associated with heightened limbic activity. Concerning emotion regulation areas, there was activation associated to dissociation in the right dlPFC. Our results are likely a neural correlate of affected mothers' reduced capacity for sensitive responsiveness to their young child following exposure to interpersonal stress, situations that are common in day-to-day parenting.

Insights to Indigenous Media and collaborative Video Work

Indigenous media as a phenomenon cannot be reduced to a reaction to western hegemony and colonial legacies, but is often rooted in the context of resistance, empowerment, self-determination and the reclaiming of symbolic representation. Therefore I would like to reflect on different cases of indigenous film and participatory video work in an attempt to highlight the multiple dynamics that arise due to the desideratum of self-representation and to finally locate us as anthropologists in that context.

Content-Aware Delivery of Scalable Video in Network Coding Enabled Named Data Networks

In this work, we propose a novel network coding enabled NDN architecture for the delivery of scalable video. Our scheme utilizes network coding in order to address the problem that arises in the original NDN protocol, where optimal use of the bandwidth and caching resources necessitates the coordination of the forwarding decisions. To optimize the performance of the proposed network coding based NDN protocol and render it appropriate for transmission of scalable video, we devise a novel rate allocation algorithm that decides on the optimal rates of Interest messages sent by clients and intermediate nodes. This algorithm guarantees that the achieved flow of Data objects will maximize the average quality of the video delivered to the client population. To support the handling of Interest messages and Data objects when intermediate nodes perform network coding, we modify the standard NDN protocol and introduce the use of Bloom filters, which store efficiently additional information about the Interest messages and Data objects. The proposed architecture is evaluated for transmission of scalable video over PlanetLab topologies. The evaluation shows that the proposed scheme performs very close to the optimal performance

Evaluation of Video Transmission Energy Consumption and Quality

The widespread use of wireless enabled devices and the increasing capabilities of wireless technologies has promoted multimedia content access and sharing among users. However, the quality perceived by the users still depends on multiple factors such as video characteristics, device capabilities, and link quality. While video characteristics include the video time and spatial complexity as well as the coding complexity, one of the most important device characteristics is the battery lifetime. There is the need to assess how these aspects interact and how they impact the overall user satisfaction. This paper advances previous works by proposing and validating a flexible framework, named EViTEQ, to be applied in real testbeds to satisfy the requirements of performance assessment. EViTEQ is able to measure network interface energy consumption with high precision, while being completely technology independent and assessing the application level quality of experience. The results obtained in the testbed show the relevance of combined multi-criteria measurement approaches, leading to superior end-user satisfaction perception evaluation .

Video-based quantification of body movement indicates negative symptoms: a replication

Objective: In schizophrenia, abnormalities in nonverbal behaviors have always been considered as highly relevant. However, due to methodological limitations, nonverbal behavior was rarely quantified objectively. Recent methodological advances now allow a quantification of body movement from ordinary video recordings. We showed that patients’ objectively measured amount of movement in social role-play interactions was closely associated with their symptom profiles (Kupper, Ramseyer, Hoffmann, & Tschacher, Schizophrenia Research 2010). In the present study, a replication of these results in the context of semi-standardized PANSS (Positive and Negative Syndrome Scale) interviews was intended. Methods: 17 patients with schizophrenia were analyzed during the initial 15-min sequence of a videotaped PANSS interview using Motion Energy Analysis (MEA). The amount of patients’ movement was then correlated with their PANSS symptom scores. Results: Sizeable and significant correlations between negative symptoms and reduced movements (r = -.68, p<0.01) and reduced movement speed (r = -.80, p<0.001) were found. Moreover, cognitive symptoms were related to reduced movement speed (r = -.70, p<.01). Conclusion: Negative symptoms were reliably indicated by patients’ nonverbal behavior in psychopathology interviews. Hence, the main result of our earlier study, examining patients’ nonverbal behavior in role play tests, was replicated for the less structured interactions in psychopathological interviews. Results could encourage the use of MEA in a wide range of videotaped social interactions of patients with schizophrenia and other psychiatric disorders.

The video head impulse test during post-rotatory nystagmus: physiology and clinical implications.

The aim of this study was to test the effects of a sustained nystagmus on the head impulse response of the vestibulo-ocular reflex (VOR) in healthy subjects. VOR gain (slow-phase eye velocity/head velocity) was measured using video head impulse test goggles. Acting as a surrogate for a spontaneous nystagmus (SN), a post-rotatory nystagmus (PRN) was elicited after a sustained, constant-velocity rotation, and then head impulses were applied. 'Raw' VOR gain, uncorrected for PRN, in healthy subjects in response to head impulses with peak velocities in the range of 150°/s-250°/s was significantly increased (as reflected in an increase in the slope of the gain versus head velocity relationship) after inducing PRN with slow phases of nystagmus of high intensity (>30°/s) in the same but not in the opposite direction as the slow-phase response induced by the head impulses. The values of VOR gain themselves, however, remained in the normal range with slow-phase velocities of PRN < 30°/s. Finally, quick phases of PRN were suppressed during the first 20-160 ms of a head impulse; the time frame of suppression depended on the direction of PRN but not on the duration of the head impulse. Our results in normal subjects suggest that VOR gains measured using head impulses may have to be corrected for any superimposed SN when the slow-phase velocity of nystagmus is relatively high and the peak velocity of the head movements is relatively low. The suppression of quick phases during head impulses may help to improve steady fixation during rapid head movements.

Quantifying the vestibulo-ocular reflex with video-oculography: nature and frequency of artifacts

Video-oculography devices are now used to quantify the vestibulo-ocular reflex (VOR) at the bedside using the head impulse test (HIT). Little is known about the impact of disruptive phenomena (e.g. corrective saccades, nystagmus, fixation losses, eye-blink artifacts) on quantitative VOR assessment in acute vertigo. This study systematically characterized the frequency, nature, and impact of artifacts on HIT VOR measures. From a prospective study of 26 patients with acute vestibular syndrome (16 vestibular neuritis, 10 stroke), we classified findings using a structured coding manual. Of 1,358 individual HIT traces, 72% had abnormal disruptive saccades, 44% had at least one artifact, and 42% were uninterpretable. Physicians using quantitative recording devices to measure head impulse VOR responses for clinical diagnosis should be aware of the potential impact of disruptive eye movements and measurement artifacts.

VOR gain by head impulse video-oculography differentiates acute vestibular neuritis from stroke

OBJECTIVE Vestibular neuritis is often mimicked by stroke (pseudoneuritis). Vestibular eye movements help discriminate the two conditions. We report vestibulo-ocular reflex (VOR) gain measures in neuritis and stroke presenting acute vestibular syndrome (AVS). METHODS Prospective cross-sectional study of AVS (acute continuous vertigo/dizziness lasting >24 h) at two academic centers. We measured horizontal head impulse test (HIT) VOR gains in 26 AVS patients using a video HIT device (ICS Impulse). All patients were assessed within 1 week of symptom onset. Diagnoses were confirmed by clinical examinations, brain magnetic resonance imaging with diffusion-weighted images, and follow-up. Brainstem and cerebellar strokes were classified by vascular territory-posterior inferior cerebellar artery (PICA) or anterior inferior cerebellar artery (AICA). RESULTS Diagnoses were vestibular neuritis (n = 16) and posterior fossa stroke (PICA, n = 7; AICA, n = 3). Mean HIT VOR gains (ipsilesional [standard error of the mean], contralesional [standard error of the mean]) were as follows: vestibular neuritis (0.52 [0.04], 0.87 [0.04]); PICA stroke (0.94 [0.04], 0.93 [0.04]); AICA stroke (0.84 [0.10], 0.74 [0.10]). VOR gains were asymmetric in neuritis (unilateral vestibulopathy) and symmetric in PICA stroke (bilaterally normal VOR), whereas gains in AICA stroke were heterogeneous (asymmetric, bilaterally low, or normal). In vestibular neuritis, borderline gains ranged from 0.62 to 0.73. Twenty patients (12 neuritis, six PICA strokes, two AICA strokes) had at least five interpretable HIT trials (for both ears), allowing an appropriate classification based on mean VOR gains per ear. Classifying AVS patients with bilateral VOR mean gains of 0.70 or more as suspected strokes yielded a total diagnostic accuracy of 90%, with stroke sensitivity of 88% and specificity of 92%. CONCLUSION Video HIT VOR gains differ between peripheral and central causes of AVS. PICA strokes were readily separated from neuritis using gain measures, but AICA strokes were at risk of being misclassified based on VOR gain alone.