Analysis, monitoring, and management of quality of experience in video delivery services over IP

Esta tesis estudia la monitorización y gestión de la Calidad de Experiencia (QoE) en los servicios de distribución de vídeo sobre IP. Aborda el problema de cómo prevenir, detectar, medir y reaccionar a las degradaciones de la QoE desde la perspectiva de un proveedor de servicios: la solución debe ser escalable para una red IP extensa que entregue flujos individuales a miles de usuarios simultáneamente. La solución de monitorización propuesta se ha denominado QuEM(Qualitative Experience Monitoring, o Monitorización Cualitativa de la Experiencia). Se basa en la detección de las degradaciones de la calidad de servicio de red (pérdidas de paquetes, disminuciones abruptas del ancho de banda...) e inferir de cada una una descripción cualitativa de su efecto en la Calidad de Experiencia percibida (silencios, defectos en el vídeo...). Este análisis se apoya en la información de transporte y de la capa de abstracción de red de los flujos codificados, y permite caracterizar los defectos más relevantes que se observan en este tipo de servicios: congelaciones, efecto de “cuadros”, silencios, pérdida de calidad del vídeo, retardos e interrupciones en el servicio. Los resultados se han validado mediante pruebas de calidad subjetiva. La metodología usada en esas pruebas se ha desarrollado a su vez para imitar lo más posible las condiciones de visualización de un usuario de este tipo de servicios: los defectos que se evalúan se introducen de forma aleatoria en medio de una secuencia de vídeo continua. Se han propuesto también algunas aplicaciones basadas en la solución de monitorización: un sistema de protección desigual frente a errores que ofrece más protección a las partes del vídeo más sensibles a pérdidas, una solución para minimizar el impacto de la interrupción de la descarga de segmentos de Streaming Adaptativo sobre HTTP, y un sistema de cifrado selectivo que encripta únicamente las partes del vídeo más sensibles. También se ha presentado una solución de cambio rápido de canal, así como el análisis de la aplicabilidad de los resultados anteriores a un escenario de vídeo en 3D. ABSTRACT This thesis proposes a comprehensive approach to the monitoring and management of Quality of Experience (QoE) in multimedia delivery services over IP. It addresses the problem of preventing, detecting, measuring, and reacting to QoE degradations, under the constraints of a service provider: the solution must scale for a wide IP network delivering individual media streams to thousands of users. The solution proposed for the monitoring is called QuEM (Qualitative Experience Monitoring). It is based on the detection of degradations in the network Quality of Service (packet losses, bandwidth drops...) and the mapping of each degradation event to a qualitative description of its effect in the perceived Quality of Experience (audio mutes, video artifacts...). This mapping is based on the analysis of the transport and Network Abstraction Layer information of the coded stream, and allows a good characterization of the most relevant defects that exist in this kind of services: screen freezing, macroblocking, audio mutes, video quality drops, delay issues, and service outages. The results have been validated by subjective quality assessment tests. The methodology used for those test has also been designed to mimic as much as possible the conditions of a real user of those services: the impairments to evaluate are introduced randomly in the middle of a continuous video stream. Based on the monitoring solution, several applications have been proposed as well: an unequal error protection system which provides higher protection to the parts of the stream which are more critical for the QoE, a solution which applies the same principles to minimize the impact of incomplete segment downloads in HTTP Adaptive Streaming, and a selective scrambling algorithm which ciphers only the most sensitive parts of the media stream. A fast channel change application is also presented, as well as a discussion about how to apply the previous results and concepts in a 3D video scenario.

A methodology to compare dimensionality reduction algorithms in terms of loss of quality

Dimensionality Reduction (DR) is attracting more attention these days as a result of the increasing need to handle huge amounts of data effectively. DR methods allow the number of initial features to be reduced considerably until a set of them is found that allows the original properties of the data to be kept. However, their use entails an inherent loss of quality that is likely to affect the understanding of the data, in terms of data analysis. This loss of quality could be determinant when selecting a DR method, because of the nature of each method. In this paper, we propose a methodology that allows different DR methods to be analyzed and compared as regards the loss of quality produced by them. This methodology makes use of the concept of preservation of geometry (quality assessment criteria) to assess the loss of quality. Experiments have been carried out by using the most well-known DR algorithms and quality assessment criteria, based on the literature. These experiments have been applied on 12 real-world datasets. Results obtained so far show that it is possible to establish a method to select the most appropriate DR method, in terms of minimum loss of quality. Experiments have also highlighted some interesting relationships between the quality assessment criteria. Finally, the methodology allows the appropriate choice of dimensionality for reducing data to be established, whilst giving rise to a minimum loss of quality.

Oxygen extended sooting index of FAME blends with aviation kerosene

The use of biofuels in the aviation sector has economic and environmental benefits. Among the options for the production of renewable jet fuels, hydroprocessed esters and fatty acids (HEFA) have received predominant attention in comparison with fatty acid methyl esters (FAME), which are not approved as additives for jet fuels. However, the presence of oxygen in methyl esters tends to reduce soot emissions and therefore particulate matter emissions. This sooting tendency is quantified in this work with an oxygen-extended sooting index, based on smoke point measurements. Results have shown considerable reduction in the sooting tendency for all biokerosenes (produced by transesterification and eventually distillation) with respect to fossil kerosenes. Among the tested biokerosenes, that made from palm kernel oil was the most effective one, and nondistilled methyl esters (from camelina and linseed oils) showed lower effectiveness than distilled biokerosenes to reduce the sooting tendency. These results may constitute an additional argument for the use of FAME’s as blend components of jet fuels. Other arguments were pointed out in previous publications, but some controversy has aroused over the use of these components. Some of the criticism was based on the fact that the methods used in our previous work are not approved for jet fuels in the standard methods and concluded that the use of FAME in any amount is, thus, inappropriate. However, some of the standard methods are not updated for considering oxygenated components (like the method for obtaining the lower heating value), and others are not precise enough (like the methods for measuring the freezing point), whereas some alternative methods may provide better reproducibility for oxygenated fuels.

A visual framework to accelerate knowledge discovery based on dimensionality reduction minimizing degradation of quality

Tradicionalmente, el uso de técnicas de análisis de datos ha sido una de las principales vías para el descubrimiento de conocimiento oculto en grandes cantidades de datos, recopilados por expertos en diferentes dominios. Por otra parte, las técnicas de visualización también se han usado para mejorar y facilitar este proceso. Sin embargo, existen limitaciones serias en la obtención de conocimiento, ya que suele ser un proceso lento, tedioso y en muchas ocasiones infructífero, debido a la dificultad de las personas para comprender conjuntos de datos de grandes dimensiones. Otro gran inconveniente, pocas veces tenido en cuenta por los expertos que analizan grandes conjuntos de datos, es la degradación involuntaria a la que someten a los datos durante las tareas de análisis, previas a la obtención final de conclusiones. Por degradación quiere decirse que los datos pueden perder sus propiedades originales, y suele producirse por una reducción inapropiada de los datos, alterando así su naturaleza original y llevando en muchos casos a interpretaciones y conclusiones erróneas que podrían tener serias implicaciones. Además, este hecho adquiere una importancia trascendental cuando los datos pertenecen al dominio médico o biológico, y la vida de diferentes personas depende de esta toma final de decisiones, en algunas ocasiones llevada a cabo de forma inapropiada. Ésta es la motivación de la presente tesis, la cual propone un nuevo framework visual, llamado MedVir, que combina la potencia de técnicas avanzadas de visualización y minería de datos para tratar de dar solución a estos grandes inconvenientes existentes en el proceso de descubrimiento de información válida. El objetivo principal es hacer más fácil, comprensible, intuitivo y rápido el proceso de adquisición de conocimiento al que se enfrentan los expertos cuando trabajan con grandes conjuntos de datos en diferentes dominios. Para ello, en primer lugar, se lleva a cabo una fuerte disminución en el tamaño de los datos con el objetivo de facilitar al experto su manejo, y a la vez preservando intactas, en la medida de lo posible, sus propiedades originales. Después, se hace uso de efectivas técnicas de visualización para representar los datos obtenidos, permitiendo al experto interactuar de forma sencilla e intuitiva con los datos, llevar a cabo diferentes tareas de análisis de datos y así estimular visualmente su capacidad de comprensión. De este modo, el objetivo subyacente se basa en abstraer al experto, en la medida de lo posible, de la complejidad de sus datos originales para presentarle una versión más comprensible, que facilite y acelere la tarea final de descubrimiento de conocimiento. MedVir se ha aplicado satisfactoriamente, entre otros, al campo de la magnetoencefalografía (MEG), que consiste en la predicción en la rehabilitación de lesiones cerebrales traumáticas (Traumatic Brain Injury (TBI) rehabilitation prediction). Los resultados obtenidos demuestran la efectividad del framework a la hora de acelerar y facilitar el proceso de descubrimiento de conocimiento sobre conjuntos de datos reales. ABSTRACT Traditionally, the use of data analysis techniques has been one of the main ways of discovering knowledge hidden in large amounts of data, collected by experts in different domains. Moreover, visualization techniques have also been used to enhance and facilitate this process. However, there are serious limitations in the process of knowledge acquisition, as it is often a slow, tedious and many times fruitless process, due to the difficulty for human beings to understand large datasets. Another major drawback, rarely considered by experts that analyze large datasets, is the involuntary degradation to which they subject the data during analysis tasks, prior to obtaining the final conclusions. Degradation means that data can lose part of their original properties, and it is usually caused by improper data reduction, thereby altering their original nature and often leading to erroneous interpretations and conclusions that could have serious implications. Furthermore, this fact gains a trascendental importance when the data belong to medical or biological domain, and the lives of people depends on the final decision-making, which is sometimes conducted improperly. This is the motivation of this thesis, which proposes a new visual framework, called MedVir, which combines the power of advanced visualization techniques and data mining to try to solve these major problems existing in the process of discovery of valid information. Thus, the main objective is to facilitate and to make more understandable, intuitive and fast the process of knowledge acquisition that experts face when working with large datasets in different domains. To achieve this, first, a strong reduction in the size of the data is carried out in order to make the management of the data easier to the expert, while preserving intact, as far as possible, the original properties of the data. Then, effective visualization techniques are used to represent the obtained data, allowing the expert to interact easily and intuitively with the data, to carry out different data analysis tasks, and so visually stimulating their comprehension capacity. Therefore, the underlying objective is based on abstracting the expert, as far as possible, from the complexity of the original data to present him a more understandable version, thus facilitating and accelerating the task of knowledge discovery. MedVir has been succesfully applied to, among others, the field of magnetoencephalography (MEG), which consists in predicting the rehabilitation of Traumatic Brain Injury (TBI). The results obtained successfully demonstrate the effectiveness of the framework to accelerate and facilitate the process of knowledge discovery on real world datasets.

Analysis of quality of experience in 3D video systems

Esta tesis presenta un estudio exhaustivo sobre la evaluación de la calidad de experiencia (QoE, del inglés Quality of Experience) percibida por los usuarios de sistemas de vídeo 3D, analizando el impacto de los efectos introducidos por todos los elementos de la cadena de procesamiento de vídeo 3D. Por lo tanto, se presentan varias pruebas de evaluación subjetiva específicamente diseñadas para evaluar los sistemas considerados, teniendo en cuenta todos los factores perceptuales relacionados con la experiencia visual tridimensional, tales como la percepción de profundidad y la molestia visual. Concretamente, se describe un test subjetivo basado en la evaluación de degradaciones típicas que pueden aparecer en el proceso de creación de contenidos de vídeo 3D, por ejemplo debidas a calibraciones incorrectas de las cámaras o a algoritmos de procesamiento de la señal de vídeo (p. ej., conversión de 2D a 3D). Además, se presenta el proceso de generación de una base de datos de vídeos estereoscópicos de alta calidad, disponible gratuitamente para la comunidad investigadora y que ha sido utilizada ampliamente en diferentes trabajos relacionados con vídeo 3D. Asimismo, se presenta otro estudio subjetivo, realizado entre varios laboratorios, con el que se analiza el impacto de degradaciones causadas por la codificación de vídeo, así como diversos formatos de representación de vídeo 3D. Igualmente, se describen tres pruebas subjetivas centradas en el estudio de posibles efectos causados por la transmisión de vídeo 3D a través de redes de televisión sobre IP (IPTV, del inglés Internet Protocol Television) y de sistemas de streaming adaptativo de vídeo. Para estos casos, se ha propuesto una innovadora metodología de evaluación subjetiva de calidad vídeo, denominada Content-Immersive Evaluation of Transmission Impairments (CIETI), diseñada específicamente para evaluar eventos de transmisión simulando condiciones realistas de visualización de vídeo en ámbitos domésticos, con el fin de obtener conclusiones más representativas sobre la experiencia visual de los usuarios finales. Finalmente, se exponen dos experimentos subjetivos comparando varias tecnologías actuales de televisores 3D disponibles en el mercado de consumo y evaluando factores perceptuales de sistemas Super Multiview Video (SMV), previstos a ser la tecnología futura de televisores 3D de consumo, gracias a una prometedora visualización de contenido 3D sin necesidad de gafas específicas. El trabajo presentado en esta tesis ha permitido entender los factores perceptuales y técnicos relacionados con el procesamiento y visualización de contenidos de vídeo 3D, que pueden ser de utilidad en el desarrollo de nuevas tecnologías y técnicas de evaluación de la QoE, tanto metodologías subjetivas como métricas objetivas. ABSTRACT This thesis presents a comprehensive study of the evaluation of the Quality of Experience (QoE) perceived by the users of 3D video systems, analyzing the impact of effects introduced by all the elements of the 3D video processing chain. Therefore, various subjective assessment tests are presented, particularly designed to evaluate the systems under consideration, and taking into account all the perceptual factors related to the 3D visual experience, such as depth perception and visual discomfort. In particular, a subjective test is presented, based on evaluating typical degradations that may appear during the content creation, for instance due to incorrect camera calibration or video processing algorithms (e.g., 2D to 3D conversion). Moreover, the process of generation of a high-quality dataset of 3D stereoscopic videos is described, which is freely available for the research community, and has been already widely used in different works related with 3D video. In addition, another inter-laboratory subjective study is presented analyzing the impact of coding impairments and representation formats of stereoscopic video. Also, three subjective tests are presented studying the effects of transmission events that take place in Internet Protocol Television (IPTV) networks and adaptive streaming scenarios for 3D video. For these cases, a novel subjective evaluation methodology, called Content-Immersive Evaluation of Transmission Impairments (CIETI), was proposed, which was especially designed to evaluate transmission events simulating realistic home-viewing conditions, to obtain more representative conclusions about the visual experience of the end users. Finally, two subjective experiments are exposed comparing various current 3D displays available in the consumer market, and evaluating perceptual factors of Super Multiview Video (SMV) systems, expected to be the future technology for consumer 3D displays thanks to a promising visualization of 3D content without specific glasses. The work presented in this thesis has allowed to understand perceptual and technical factors related to the processing and visualization of 3D video content, which may be useful in the development of new technologies and approaches for QoE evaluation, both subjective methodologies and objective metrics.

Valoración de Indicadores de calidad para el diseño e implementación de tecnologías de manejo en Luvisoles de la zona norte de la provincia de Las Tunas, Cuba

La calidad del suelo es una herramienta de evaluación que puede facilitar la adaptación de prácticas de manejo que promuevan sistemas agropecuarios sostenibles. La investigación de este trabajo se inició con un diagnóstico participativo en 12 comunidades rurales de la provincia de Las Tunas en el año 2009 en el cual los productores identificaron los puntos críticos de calidad de los suelos de la región y sirvieron de punta de partida para seleccionar las variables físicas, químicas y biológicas a determinar en cinco sistemas de uso agropecuario (arboleda, pasto natural, pasto cultivado y dos sistemas silvopastoriles) en la zona La Veguita, municipio Las Tunas. El sistema arboleda se utilizó como referencia de las propiedades naturales del suelo. El pasto natural se distingue por el desarrollo de especies de baja productividad, sin embargo el pasto cultivado está representado por Pennisetum purpureum vc CUBA CT-115, y constituye una contribución a la tecnología de bancos de biomasa, para utilizarse en el pastoreo durante la seca. Los sistemas silvopastoriles están representados por Leucaena leucocephala Lam. en franjas y Panicum maximun vc. Likoni, los que se diferencian en su diseño, manejo y propiedades mineralógicas. El objetivo fundamental fue valorar indicadores de calidad de los suelos Luvisoles háplicos sobre granitoides, para diseñar e implementar tecnologías de manejo que permitan incrementar la capacidad agroproductiva de los suelos. Mediante el análisis de componentes principales se obtuvo un conjunto mínimo de indicadores físicos, químicos y biológicos que proporcionaron información útil referente a los procesos edáficos y se integraron para determinar un índice de calidad. En el sistema de uso, caracterizado por el pasto cultivado (Pennisetum purpureum) se estableció, en parcelas experimentales, un ensayo de corta duración, en el que se comparó el laboreo tradicional y el laboreo sin inversión del prisma, con y sin aplicación de compost. En ambos sistemas de labranza se evaluó el desarrollo del cultivo e indicadores de calidad del suelo. Los resultados mostraron que del conjunto de indicadores edáficos estudiados se seleccionaron 6 en los que la capacidad de intercambio catiónico, materia orgánica, potasio intercambiable, contenido de arena, densidad aparente y biomasa de lombrices explicaron la mayor variabilidad y sirvieron de base para evaluar la calidad de estos suelos. Se establecieron valores umbrales de referencia de indicadores de calidad, que permitirán evaluar y monitorear los sistemas de uso y manejo de la región. El sistema Silvopastoril 2 resultó el de mayor índice de calidad de los suelos tomando como referencia la arboleda por su condición natural. El manejo silvopastoril influyó predominantemente en mejores resultados productivos pero las características edáficas principalmente físicas, deben definir su diseño y manejo. El sistema de pastos cultivados con Pennisetum purpureum vc CUBA CT 115, alcanzó la mayor acumulación de carbono orgánico, sin embargo, el manejo limitó su calidad física y el funcionamiento productivo del sistema. De manera general los sistemas de uso no garantizan un índice de la calidad del suelo, puesto que se ve afectado por las propiedades edáficas y las prácticas de manejo. En el ámbito biológico, las lombrices constituyeron los organismos más numerosos con predominio en los sistemas silvopastoriles y arboleda. Los valores superiores de densidad y biomasa de oligoquetos y mayor diversidad de otros individuos de la macrofauna, indican que la presencia de árboles en los pastizales de gramínea potencia y diversifican las comunidades de macroinvertebrados del suelo. El sistema de labranza sin inversión del prisma propicia una mejor calidad física del suelo, manteniendo el carbono e incrementando los rendimientos del Penisetum purpureum cv CUBA CT 115. La labranza tradicional, a base de aradura y grada, afecta a los contenidos de materia orgánica en el corto plazo y mantiene capas compactas en el horizonte subyacente, además influye desfavorablemente al flujo del aire, agua y al desarrollo radical de los pastos. La aplicación de compost favoreció mejores resultados productivos en ambas tecnologías de manejo. Los resultados alcanzados recomiendan la implantación de tecnologías de manejo conservacionistas y la aplicación de materiales orgánicos que restituyan los elementos nutricionales requeridos por los pastos, por lo que no se justifica la continuidad del uso de prácticas tradicionales de laboreo con inversión del prisma que se realizan actualmente. ABSTRACT The soil quality is an assessment tool, which could facilitate the adaptation of management practices that promote sustainable agricultural systems. The present investigation was carried out with a participatory diagnostic in twelve rural communities from Las Tunas province in 2009, in which producers identified the critical soil quality points of region and served as a starting point to select the physical, chemical and biological variables, in order to determine on five agricultural used systems (grove, natural grass, cultivated grass and two silvopastoral systems) in La Veguita zone from municipality Las Tunas. The system grove was used as reference of natural soil properties. The natural grass is distinguished by the development of low-productivity species, however the cultivated grass is represented by Pennisetum purpureum vc CUBA CT-115, and is a contribution to the biomass banks technology, in order to use in grazing during the dry season. The silvopastoral systems are represented by Leucaena leucocephala Lam. in stripes and Panicum maximum cv. Likoni, which differ in their design, handling and mineralogical properties. The main aim of this study was to assess the quality indicators for haplic Luvisols on granitoids for designing and implementing management technologies in order to increase the agroproductive capacity of soils. A minimal set of physical, chemical and biological indicators by Principal Component Analysis was obtained, which provided some useful information regarding soil processes and their integration for determining an index of quality. In the use system, characterized for the cultivated grass (Pennisetum purpureum) a short term assay in experimental plots was established, where the traditional and prism without inversion tillage were compared with and without compost application. In both tillage systems were evaluated the crop development and soil quality indicators. The results showed that the studied soil indicators set, six were selected, specifically the ones with exchangeable cationic capacity, organic matter, interchangeable potassium, sand content, bulk density and earthworm biomass, which explained the higher variability and served as the basis for evaluating the soil quality. The Reference threshold values of quality indicators for evaluating and monitoring the use and management systems from the region were established. The silvopastoral system 2 had the highest quality soil index, taking of reference the grove system for its natural condition. The silvopastoral management influenced on better productive results, but the soil characteristics, particularly the physical properties to be defined its design and management. However, the cultivated grass system with Pennisetum purpureum vc CUBA CT 115, reached the greatest accumulation of organic carbon. However, the management limited its physical quality and productive performance of the system. In addition, the use systems do not guarantee an index of soil quality, since it is affected by soil properties and management practices. From the biological aspect, the earthworms are the most numerous organisms on the silvopastoral systems and grove. The higher values of oligochaetes biomass and density and the greater diversity of other organisms from macrofauna indicate that the tree presence on the pasture grasses allows enhancing and diversifying soil macro invertebrate communities. The non-inversion prism tillage system provides a better physical quality of soil, maintaining the carbon content and increasing the yields of Penisetum purpureum vc CUBA CT 115. The traditional tillage, using the plowing and harrowing affects the organic matter content in a short term and keeps on compact layers of underlying horizon, and adversely affects the air and water flow, and pasture radical development. The compost application favored the best production results in both management technologies. The results obtained recommend the implementation of conservation management technologies and the application of organic materials that restore the nutritional elements required by the pasture, so it does not justify the continued use of traditional tillage practices with prism investment that are currently being made.

Examination of the quality of spinach leaves using hyperspectral imaging

The present research is focused on the application of hyperspectral images for the supervision of quality deterioration in ready to use leafy spinach during storage (Spinacia oleracea). Two sets of samples of packed leafy spinach were considered: (a) a first set of samples was stored at 20 °C (E-20) in order to accelerate the degradation process, and these samples were measured the day of reception in the laboratory and after 2 days of storage; (b) a second set of samples was kept at 10 °C (E-10), and the measurements were taken throughout storage, beginning the day of reception and repeating the acquisition of Images 3, 6 and 9 days later. Twenty leaves per test were analyzed. Hyperspectral images were acquired with a push-broom CCD camera equipped with a spectrograph VNIR (400–1000 nm). Calibration set of spectra was extracted from E-20 samples, containing three classes of degradation: class A (optimal quality), class B and class C (maximum deterioration). Reference average spectra were defined for each class. Three models, computed on the calibration set, with a decreasing degree of complexity were compared, according to their ability for segregating leaves at different quality stages (fresh, with incipient and non-visible symptoms of degradation, and degraded): spectral angle mapper distance (SAM), partial least squares discriminant analysis models (PLS-DA), and a non linear index (Leafy Vegetable Evolution, LEVE) combining five wavelengths were included among the previously selected by CovSel procedure. In sets E-10 and E-20, artificial images of the membership degree according to the distance of each pixel to the reference classes, were computed assigning each pixel to the closest reference class. The three methods were able to show the degradation of the leaves with storage time.