Informative State-Based Video Communication

We study state-based video communication where a client simultaneously informs the server about the presence status of various packets in its buffer. In sender-driven transmission, the client periodically sends to the server a single acknowledgement packet that provides information about all packets that have arrived at the client by the time the acknowledgment is sent. In receiver-driven streaming, the client periodically sends to the server a single request packet that comprises a transmission schedule for sending missing data to the client over a horizon of time. We develop a comprehensive optimization framework that enables computing packet transmission decisions that maximize the end-to-end video quality for the given bandwidth resources, in both prospective scenarios. The core step of the optimization comprises computing the probability that a single packet will be communicated in error as a function of the expected transmission redundancy (or cost) used to communicate the packet. Through comprehensive simulation experiments, we carefully examine the performance advances that our framework enables relative to state-of-the-art scheduling systems that employ regular acknowledgement or request packets. Consistent gains in video quality of up to 2B are demonstrated across a variety of content types. We show that there is a direct analogy between the error-cost efficiency of streaming a single packet and the overall rate-distortion performance of streaming the whole content. In the case of sender-driven transmission, we develop an effective modeling approach that accurately characterizes the end-to-end performance as a function of the packet loss rate on the backward channel and the source encoding characteristics.

Evaluation of Video Transmission Energy Consumption and Quality

The widespread use of wireless enabled devices and the increasing capabilities of wireless technologies has promoted multimedia content access and sharing among users. However, the quality perceived by the users still depends on multiple factors such as video characteristics, device capabilities, and link quality. While video characteristics include the video time and spatial complexity as well as the coding complexity, one of the most important device characteristics is the battery lifetime. There is the need to assess how these aspects interact and how they impact the overall user satisfaction. This paper advances previous works by proposing and validating a flexible framework, named EViTEQ, to be applied in real testbeds to satisfy the requirements of performance assessment. EViTEQ is able to measure network interface energy consumption with high precision, while being completely technology independent and assessing the application level quality of experience. The results obtained in the testbed show the relevance of combined multi-criteria measurement approaches, leading to superior end-user satisfaction perception evaluation .

The video head impulse test during post-rotatory nystagmus: physiology and clinical implications.

The aim of this study was to test the effects of a sustained nystagmus on the head impulse response of the vestibulo-ocular reflex (VOR) in healthy subjects. VOR gain (slow-phase eye velocity/head velocity) was measured using video head impulse test goggles. Acting as a surrogate for a spontaneous nystagmus (SN), a post-rotatory nystagmus (PRN) was elicited after a sustained, constant-velocity rotation, and then head impulses were applied. 'Raw' VOR gain, uncorrected for PRN, in healthy subjects in response to head impulses with peak velocities in the range of 150°/s-250°/s was significantly increased (as reflected in an increase in the slope of the gain versus head velocity relationship) after inducing PRN with slow phases of nystagmus of high intensity (>30°/s) in the same but not in the opposite direction as the slow-phase response induced by the head impulses. The values of VOR gain themselves, however, remained in the normal range with slow-phase velocities of PRN < 30°/s. Finally, quick phases of PRN were suppressed during the first 20-160 ms of a head impulse; the time frame of suppression depended on the direction of PRN but not on the duration of the head impulse. Our results in normal subjects suggest that VOR gains measured using head impulses may have to be corrected for any superimposed SN when the slow-phase velocity of nystagmus is relatively high and the peak velocity of the head movements is relatively low. The suppression of quick phases during head impulses may help to improve steady fixation during rapid head movements.

Retinal slit lamp video mosaicking

Purpose To this day, the slit lamp remains the first tool used by an ophthalmologist to examine patient eyes. Imaging of the retina poses, however, a variety of problems, namely a shallow depth of focus, reflections from the optical system, a small field of view and non-uniform illumination. For ophthalmologists, the use of slit lamp images for documentation and analysis purposes, however, remains extremely challenging due to large image artifacts. For this reason, we propose an automatic retinal slit lamp video mosaicking, which enlarges the field of view and reduces amount of noise and reflections, thus enhancing image quality. Methods Our method is composed of three parts: (i) viable content segmentation, (ii) global registration and (iii) image blending. Frame content is segmented using gradient boosting with custom pixel-wise features. Speeded-up robust features are used for finding pair-wise translations between frames with robust random sample consensus estimation and graph-based simultaneous localization and mapping for global bundle adjustment. Foreground-aware blending based on feathering merges video frames into comprehensive mosaics. Results Foreground is segmented successfully with an area under the curve of the receiver operating characteristic curve of 0.9557. Mosaicking results and state-of-the-art methods were compared and rated by ophthalmologists showing a strong preference for a large field of view provided by our method. Conclusions The proposed method for global registration of retinal slit lamp images of the retina into comprehensive mosaics improves over state-of-the-art methods and is preferred qualitatively.