Quality of experience of adaptive video streaming: investigation in service parameters and subjective quality assessment methodology

The usage of HTTP adaptive streaming (HAS) has become widely spread in multimedia services. Because it allows the service providers to improve the network resource utilization and user׳s Quality of Experience (QoE). Using this technology, the video playback interruption is reduced since the network and server status in addition to capability of user device, all are taken into account by HAS client to adapt the quality to the current condition. Adaptation can be done using different strategies. In order to provide optimal QoE, the perceptual impact of adaptation strategies from point of view of the user should be studied. However, the time-varying video quality due to the adaptation which usually takes place in a long interval introduces a new type of impairment making the subjective evaluation of adaptive streaming system challenging. The contribution of this paper is two-fold: first, it investigates the testing methodology to evaluate HAS QoE by comparing the subjective experimental outcomes obtained from ACR standardized method and a semi-continuous method developed to evaluate the long sequences. In addition, influence of using audiovisual stimuli to evaluate the video-related impairment is inquired. Second, impact of some of the adaptation technical factors including the quality switching amplitude and chunk size in combination with high range of commercial content type is investigated. The results of this study provide a good insight toward achieving appropriate testing method to evaluate HAS QoE, in addition to designing switching strategies with optimal visual quality.

Propagation, structural similarity and image quality

Póster presentado en SPIE Photonics Europe, Brussels, 16-19 April 2012.

Comparative analysis of the visual performance and aberrometric outcomes with a new hybrid and two silicone hydrogel multifocal contact lenses: a pilot study

Background: The aim was to evaluate the visual performance achieved with a new multifocal hybrid contact lens and to compare it with that obtained with two other currently available multifocal soft contact lenses. Methods: This pilot prospective comparative study comprised a total of 16 presbyopic eyes of eight patients ranging in age from 43 to 58 years. All patients were fitted with three different models of multifocal contact lens: Duette multifocal (SynergEyes), Air Optix AQUA multifocal (Alcon) and Biofinity multifocal (CooperVision). Fittings were performed randomly in each patient according to a random number sequence, with a wash-out period between fittings of seven days. At two weeks post-fitting, visual, photopic contrast sensitivity and ocular aberrometry were evaluated. Results: No statistically significant differences were found in distance and near visual acuity achieved with the three different types of multifocal contact lens (p ≥ 0.05). Likewise, no significant differences between lenses were found in the monocular and binocular defocus curve (p ≥ 0.10). Concerning contrast sensitivity, better monocular contrast sensitivities for 6, 12 and 18 cycles per degree were found with the Duette and Air Optix multifocal compared to Biofinity (p = 0.02). Binocularly, differences between lenses were not significant (p ≥ 0.27). Furthermore, trefoil aberration was significantly higher with Biofinity multifocal (p < 0.01) and Air Optix (p = 0.01) multifocal compared to Duette. Conclusions: The Duette multifocal hybrid contact lens seems to provide similar visual quality outcomes in presbyopic patients with low corneal astigmatism, when compared with other soft multifocal contact lenses. This preliminary result should be confirmed in studies with larger samples.

An investigation of reading ability and visual function with eccentric visual field

This study investigated the detrimental effect of central field loss (CFL) on reading ability and general visual function. The aim was to improve the understanding of reading with eccentric retina in order that reading performances of individuals with CFL may be maximised. To improve visual ability of individuals with CFL, it is important to be able to accurately measure the outcome of any intervention. Various methods for determining visual function were therefore compared with perceived visual performance (as measured with a quality of life questionnaire) before and after surgical removal of choroidal new vessels (CNV) in macular disease patients. The results highlight the importance of low contrast measures (low contrast visual acuity and contrast sensitivity) when investigating perceived reading performance. Reading speed was found to be important for reflecting changes in general visual quality of life. Potential causes for reduced peripheral reading ability were investigated using both normally sighted and CFL subjects. For normally sighted subjects reading eccentrically with rapid serial visual presentation (RSVP) text, the inferior visual field was a better position (in terms of reading speed) for the presentation of the text. The size of the visual span was found to reduce with increasing eccentricity of fixation, providing a potential reason for reduced peripheral reading performances. The investigation of the ability to use context when reading with peripheral retina resulted in conflicting results. Studies in this thesis found both a reduction and no reduction in the ability of the peripheral retina to utilise context compared to the fovea. Individuals with long-term CFL showed no improvement in peripheral reading ability over that found for normally sighted subjects reading at the same eccentricity.

No-reference image quality assessment in contourlet domain

The target of no-reference (NR) image quality assessment (IQA) is to establish a computational model to predict the visual quality of an image. The existing prominent method is based on natural scene statistics (NSS). It uses the joint and marginal distributions of wavelet coefficients for IQA. However, this method is only applicable to JPEG2000 compressed images. Since the wavelet transform fails to capture the directional information of images, an improved NSS model is established by contourlets. In this paper, the contourlet transform is utilized to NSS of images, and then the relationship of contourlet coefficients is represented by the joint distribution. The statistics of contourlet coefficients are applicable to indicate variation of image quality. In addition, an image-dependent threshold is adopted to reduce the effect of content to the statistical model. Finally, image quality can be evaluated by combining the extracted features in each subband nonlinearly. Our algorithm is trained and tested on the LIVE database II. Experimental results demonstrate that the proposed algorithm is superior to the conventional NSS model and can be applied to different distortions. © 2009 Elsevier B.V. All rights reserved.

Evaluating techniques to improve visual performance with and assessment of premium intraocular lenses

Premium Intraocular Lenses (IOLs) such as toric IOLs, multifocal IOLs (MIOLs) and accommodating IOLs (AIOLs) can provide better refractive and visual outcomes compared to standard monofocal designs, leading to greater levels of post-operative spectacle independence. The principal theme of this thesis relates to the development of new assessment techniques that can help to improve future premium IOL design. IOLs designed to correct astigmatism form the focus of the first part of the thesis. A novel toric IOL design was devised to decrease the effect of toric rotation on patient visual acuity, but found to have neither a beneficial or detrimental impact on visual acuity retention. IOL tilt, like rotation, may curtail visual performance; however current IOL tilt measurement techniques require the use of specialist equipment not readily available in most ophthalmological clinics. Thus a new idea that applied Pythagoras’s theory to digital images of IOL optic symmetricality in order to calculate tilt was proposed, and shown to be both accurate and highly repeatable. A literature review revealed little information on the relationship between IOL tilt, decentration and rotation and so this was examined. A poor correlation between these factors was found, indicating they occur independently of each other. Next, presbyopia correcting IOLs were investigated. The light distribution of different MIOLs and an AIOL was assessed using perimetry, to establish whether this could be used to inform optimal IOL design. Anticipated differences in threshold sensitivity between IOLs were not however found, thus perimetry was concluded to be ineffective in mapping retinal projection of blur. The observed difference between subjective and objective measures of accommodation, arising from the influence of pseudoaccommodative factors, was explored next to establish how much additional objective power would be required to restore the eye’s focus with AIOLs. Blur tolerance was found to be the key contributor to the ocular depth of focus, with an approximate dioptric influence of 0.60D. Our understanding of MIOLs may be limited by the need for subjective defocus curves, which are lengthy and do not permit important additional measures to be undertaken. The use of aberrometry to provide faster objective defocus curves was examined. Although subjective and objective measures related well, the peaks of the MIOL defocus curve profile were not evident with objective prediction of acuity, indicating a need for further refinement of visual quality metrics based on ocular aberrations. The experiments detailed in the thesis evaluate methods to improve visual performance with toric IOLs. They also investigate new techniques to allow more rapid post-operative assessment of premium IOLs, which could allow greater insights to be obtained into several aspects of visual quality, in order to optimise future IOL design and ultimately enhance patient satisfaction.

Visual Discrimination Increase by Yellow Filters in Retinitis Pigmentosa

PURPOSE: The objective of this study was to evaluate, by halometry and under low illumination conditions, the effects of short-wavelength light absorbance filters on visual discrimination capacity in retinitis pigmentosa patients. METHODS: This was an observational, prospective, analytic, and transversal study on 109 eyes of 57 retinitis pigmentosa patients with visual acuity better than 1.25 logMAR. Visual disturbance index (VDI) was determined using the software Halo 1.0, with and without the interposition of filters which absorb (totally or partially) short-wavelength light between 380 and 500 nm. RESULTS: A statistically significant reduction in the VDI values determined using filters which absorb short-wavelength light was observed (p < 0.0001). The established VDIs in patients with VA logMAR <0.4 were 0.30 ± 0.05 (95% CI, 0.26–0.36) for the lens alone, 0.20 ± 0.04 (95% CI, 0.16–0.24) with the filter that completely absorbs wavelengths shorter than 450 nm, and 0.24 ± 0.04 (95% CI, 0.20–0.28) with the filter that partially absorbs wavelengths shorter than 450 nm, which implies a 20 to 33% visual discrimination capacity increase. In addition, a decrease of VDI in at least one eye was observed in more than 90% of patients when using a filter. CONCLUSIONS: Short-wavelength light absorbance filters increase visual discrimination capacity under low illumination conditions in retinitis pigmentosa patients. Use of such filters constitutes a suitable method to improve visual quality related to intraocular light visual disturbances under low illumination conditions in this group of patients. © 2016 American Academy of Optometry

Response of minimally processed carambola to chemical treatments and low-oxygen atmospheres

Fresh-cut carambola (Averrhoa carambola L.) has limited marketability due to cut-surface browning. The effect of chemical treatments (ascorbic acid, citric acid and Ca-EDTA), controlled atmosphere (0.4-20.3% O2) and the association of these processes was investigated. Post-cutting dip and low-oxygen atmospheres did not prevent discoloration or improve sensory and physicochemical parameters. However, ascorbic acid (0.5% and 1%) dips reduced polyphenol oxidase (PPO) activity during storage at 4.5 °C, with 1% ascorbic acid inducing the lowest activity. Although cut-surface browning of 'Maha' slices was not relevant, carambola slices treated with 1% ascorbic acid in association with 0.4% oxygen did not present significant browning or loss of visual quality for up to 12 days, 3 days longer than low oxygen alone (0.4% O2), thus, their quality can be significantly improved by combining both treatments.

Reducing luminance contrast on the window wall and users’ interventions in an office room

High luminance contrast between windows and surrounding surfaces could cause discomfort glare, which could reduce office workers’ productivity. It might also increase energy usage of buildings due to occupants’ interventions in lighting conditions to improve indoor visual quality. It is presumed that increasing the luminance of the areas surrounding the windows using a supplementary system, such Light Emitting Diodes (LEDs), could reduce discomfort glare. This paper reports on the results of a pilot study in a conventional office in Brisbane, Australia. The outcomes of this study indicated that a supplementary LED system could reduce the luminance contrast on the window wall from values in the order of 24:1 to 12:1. The results suggest that this reduction could significantly reduce discomfort glare from windows, as well as diminishing the likelihood of users’ intention to turn on the ceiling lights and/ or to move the blind down.

IMAGE DENOISING IN MULTIPLICATIVE NOISE

We address the problem of denoising images corrupted by multiplicative noise. The noise is assumed to follow a Gamma distribution. Compared with additive noise distortion, the effect of multiplicative noise on the visual quality of images is quite severe. We consider the mean-square error (MSE) cost function and derive an expression for an unbiased estimate of the MSE. The resulting multiplicative noise unbiased risk estimator is referred to as MURE. The denoising operation is performed in the wavelet domain by considering the image-domain MURE. The parameters of the denoising function (typically, a shrinkage of wavelet coefficients) are optimized for by minimizing MURE. We show that MURE is accurate and close to the oracle MSE. This makes MURE-based image denoising reliable and on par with oracle-MSE-based estimates. Analogous to the other popular risk estimation approaches developed for additive, Poisson, and chi-squared noise degradations, the proposed approach does not assume any prior on the underlying noise-free image. We report denoising results for various noise levels and show that the quality of denoising obtained is on par with the oracle result and better than that obtained using some state-of-the-art denoisers.

Dealing with Energy-QoE Trade-Offs in Mobile Video

Scalable video coding allows an efficient provision of video services at different quality levels with different energy demands. According to the specific type of service and network scenario, end users and/or operators may decide to choose among different energy versus quality combinations. In order to deal with the resulting trade-off, in this paper we analyze the number of video layers that are worth to be received taking into account the energy constraints. A single-objective optimization is proposed based on dynamically selecting the number of layers, which is able to minimize the energy consumption with the constraint of a minimal quality threshold to be reached. However, this approach cannot reflect the fact that the same increment of energy consumption may result in different increments of visual quality. Thus, a multiobjective optimization is proposed and a utility function is defined in order to weight the energy consumption and the visual quality criteria. Finally, since the optimization solving mechanism is computationally expensive to be implemented in mobile devices, a heuristic algorithm is proposed. This way, significant energy consumption reduction will be achieved while keeping reasonable quality levels.

Visibility recovery on images acquired in attenuating media. Application to underwater, fog, and mammographic imaging

136 p.

沈阳城市公园植物景观美学质量测定方法研究——美景度评估法、平均值法和成对比较法的比较

运用心理物理学派研究方法,对沈阳城市公园植物景观美学进行了公众审美偏好程度的研究,并系统地分析和比较了常用的心理物理学派美景度测定与统计方法———美景度评估法(scen ic beauty estim ation)、平均值法(average visual quality)和成对比较法(pairw ise comparison)。本研究选择了15张反映城市公园植物景观的彩色照片,向公众进行了当面问卷调查。调查数据分别利用美景度评估法、平均值法、层次分析法进行了美景度代表值的统计。结果表明:(1)城市公园植物景观的美学质量评价可以通过基于照片媒介的心理物理学研究方法而完成,公众对于不同评价样本的审美偏好是有差别的;(2)本研究中采用3种美景度代表值统计方法获得的最终结果显示,3种方法无显著性差异;(3)通过3种评价方法表现均为较好与较差的评判样本B13与B04来看,样本间存在明显的差异,比如植物本身的形态特征、遮荫效果和空间感等等。但这些特征是否是影响评判结果的关键因素,还有待进一步研究加以验证。

A Low Complexity Video Watermarking in H.264 Compressed Domain

In this paper, a new blind and readable H.264 compressed domain watermarking scheme is proposed in which the embedding/extracting is performed using the syntactic elements of the compressed bit stream. As a result, it is not necessary to fully decode a compressed video stream both in the embedding and extracting processes. The method also presents an inexpensive spatiotemporal analysis that selects the appropriate submacroblocks for embedding, increasing watermark robustness while reducing its impact on visual quality. Meanwhile, the proposed method prevents bit-rate increase and restricts it within an acceptable limit by selecting appropriate quantized residuals for watermark insertion. Regarding watermarking demands such as imperceptibility, bit-rate control, and appropriate level of security, a priority matrix is defined which can be adjusted based on the application requirements. The resulted flexibility expands the usability of the proposed method.

Rendu d'images en demi-tons par diffusion d'erreur sensible à la structure

Le présent mémoire comprend un survol des principales méthodes de rendu en demi-tons, de l’analog screening à la recherche binaire directe en passant par l’ordered dither, avec une attention particulière pour la diffusion d’erreur. Ces méthodes seront comparées dans la perspective moderne de la sensibilité à la structure. Une nouvelle méthode de rendu en demi-tons par diffusion d’erreur est présentée et soumise à diverses évaluations. La méthode proposée se veut originale, simple, autant à même de préserver le caractère structurel des images que la méthode à l’état de l’art, et plus rapide que cette dernière par deux à trois ordres de magnitude. D’abord, l’image est décomposée en fréquences locales caractéristiques. Puis, le comportement de base de la méthode proposée est donné. Ensuite, un ensemble minutieusement choisi de paramètres permet de modifier ce comportement de façon à épouser les différents caractères fréquentiels locaux. Finalement, une calibration détermine les bons paramètres à associer à chaque fréquence possible. Une fois l’algorithme assemblé, toute image peut être traitée très rapidement : chaque pixel est attaché à une fréquence propre, cette fréquence sert d’indice pour la table de calibration, les paramètres de diffusion appropriés sont récupérés, et la couleur de sortie déterminée pour le pixel contribue en espérance à souligner la structure dont il fait partie.