Visual attention and perception models for assessing quality in 2D and 3D stereoscopic video

La medida de calidad de vídeo sigue siendo necesaria para definir los criterios que caracterizan una señal que cumpla los requisitos de visionado impuestos por el usuario. Las nuevas tecnologías, como el vídeo 3D estereoscópico o formatos más allá de la alta definición, imponen nuevos criterios que deben ser analizadas para obtener la mayor satisfacción posible del usuario. Entre los problemas detectados durante el desarrollo de esta tesis doctoral se han determinado fenómenos que afectan a distintas fases de la cadena de producción audiovisual y tipo de contenido variado. En primer lugar, el proceso de generación de contenidos debe encontrarse controlado mediante parámetros que eviten que se produzca el disconfort visual y, consecuentemente, fatiga visual, especialmente en lo relativo a contenidos de 3D estereoscópico, tanto de animación como de acción real. Por otro lado, la medida de calidad relativa a la fase de compresión de vídeo emplea métricas que en ocasiones no se encuentran adaptadas a la percepción del usuario. El empleo de modelos psicovisuales y diagramas de atención visual permitirían ponderar las áreas de la imagen de manera que se preste mayor importancia a los píxeles que el usuario enfocará con mayor probabilidad. Estos dos bloques se relacionan a través de la definición del término saliencia. Saliencia es la capacidad del sistema visual para caracterizar una imagen visualizada ponderando las áreas que más atractivas resultan al ojo humano. La saliencia en generación de contenidos estereoscópicos se refiere principalmente a la profundidad simulada mediante la ilusión óptica, medida en términos de distancia del objeto virtual al ojo humano. Sin embargo, en vídeo bidimensional, la saliencia no se basa en la profundidad, sino en otros elementos adicionales, como el movimiento, el nivel de detalle, la posición de los píxeles o la aparición de caras, que serán los factores básicos que compondrán el modelo de atención visual desarrollado. Con el objetivo de detectar las características de una secuencia de vídeo estereoscópico que, con mayor probabilidad, pueden generar disconfort visual, se consultó la extensa literatura relativa a este tema y se realizaron unas pruebas subjetivas preliminares con usuarios. De esta forma, se llegó a la conclusión de que se producía disconfort en los casos en que se producía un cambio abrupto en la distribución de profundidades simuladas de la imagen, aparte de otras degradaciones como la denominada “violación de ventana”. A través de nuevas pruebas subjetivas centradas en analizar estos efectos con diferentes distribuciones de profundidades, se trataron de concretar los parámetros que definían esta imagen. Los resultados de las pruebas demuestran que los cambios abruptos en imágenes se producen en entornos con movimientos y disparidades negativas elevadas que producen interferencias en los procesos de acomodación y vergencia del ojo humano, así como una necesidad en el aumento de los tiempos de enfoque del cristalino. En la mejora de las métricas de calidad a través de modelos que se adaptan al sistema visual humano, se realizaron también pruebas subjetivas que ayudaron a determinar la importancia de cada uno de los factores a la hora de enmascarar una determinada degradación. Los resultados demuestran una ligera mejora en los resultados obtenidos al aplicar máscaras de ponderación y atención visual, los cuales aproximan los parámetros de calidad objetiva a la respuesta del ojo humano. ABSTRACT Video quality assessment is still a necessary tool for defining the criteria to characterize a signal with the viewing requirements imposed by the final user. New technologies, such as 3D stereoscopic video and formats of HD and beyond HD oblige to develop new analysis of video features for obtaining the highest user’s satisfaction. Among the problems detected during the process of this doctoral thesis, it has been determined that some phenomena affect to different phases in the audiovisual production chain, apart from the type of content. On first instance, the generation of contents process should be enough controlled through parameters that avoid the occurrence of visual discomfort in observer’s eye, and consequently, visual fatigue. It is especially necessary controlling sequences of stereoscopic 3D, with both animation and live-action contents. On the other hand, video quality assessment, related to compression processes, should be improved because some objective metrics are adapted to user’s perception. The use of psychovisual models and visual attention diagrams allow the weighting of image regions of interest, giving more importance to the areas which the user will focus most probably. These two work fields are related together through the definition of the term saliency. Saliency is the capacity of human visual system for characterizing an image, highlighting the areas which result more attractive to the human eye. Saliency in generation of 3DTV contents refers mainly to the simulated depth of the optic illusion, i.e. the distance from the virtual object to the human eye. On the other hand, saliency is not based on virtual depth, but on other features, such as motion, level of detail, position of pixels in the frame or face detection, which are the basic features that are part of the developed visual attention model, as demonstrated with tests. Extensive literature involving visual comfort assessment was looked up, and the development of new preliminary subjective assessment with users was performed, in order to detect the features that increase the probability of discomfort to occur. With this methodology, the conclusions drawn confirmed that one common source of visual discomfort was when an abrupt change of disparity happened in video transitions, apart from other degradations, such as window violation. New quality assessment was performed to quantify the distribution of disparities over different sequences. The results confirmed that abrupt changes in negative parallax environment produce accommodation-vergence mismatches derived from the increasing time for human crystalline to focus the virtual objects. On the other side, for developing metrics that adapt to human visual system, additional subjective tests were developed to determine the importance of each factor, which masks a concrete distortion. Results demonstrated slight improvement after applying visual attention to objective metrics. This process of weighing pixels approximates the quality results to human eye’s response.

Multi-textured 3D humanoid reconstruction through passive and active automatic techniques = Reconstrucción de humanoides 3D multi-texturados mediante técnicas pasivas y activas automáticas

The proliferation of video games and other applications of computer graphics in everyday life demands a much easier way to create animatable virtual human characters. Traditionally, this has been the job of highly skilled artists and animators that painstakingly model, rig and animate their avatars, and usually have to tune them for each application and transmission/rendering platform. The emergence of virtual/mixed reality environments also calls for practical and costeffective ways to produce custom models of actual people. The purpose of the present dissertation is bringing 3D human scanning closer to the average user. For this, two different techniques are presented, one passive and one active. The first one is a fully automatic system for generating statically multi-textured avatars of real people captured with several standard cameras. Our system uses a state-of-the-art shape from silhouette technique to retrieve the shape of subject. However, to deal with the lack of detail that is common in the facial region for these kind of techniques, which do not handle concavities correctly, our system proposes an approach to improve the quality of this region. This face enhancement technique uses a generic facial model which is transformed according to the specific facial features of the subject. Moreover, this system features a novel technique for generating view-independent texture atlases computed from the original images. This static multi-texturing system yields a seamless texture atlas calculated by combining the color information from several photos. We suppress the color seams due to image misalignments and irregular lighting conditions that multi-texturing approaches typically suffer from, while minimizing the blurring effect introduced by color blending techniques. The second technique features a system to retrieve a fully animatable 3D model of a human using a commercial depth sensor. Differently to other approaches in the current state of the art, our system does not require the user to be completely still through the scanning process, and neither the depth sensor is moved around the subject to cover all its surface. Instead, the depth sensor remains static and the skeleton tracking information is used to compensate the user’s movements during the scanning stage. RESUMEN La popularización de videojuegos y otras aplicaciones de los gráficos por ordenador en el día a día requiere una manera más sencilla de crear modelos virtuales humanos animables. Tradicionalmente, estos modelos han sido creados por artistas profesionales que cuidadosamente los modelan y animan, y que tienen que adaptar específicamente para cada aplicación y plataforma de transmisión o visualización. La aparición de los entornos de realidad virtual/mixta aumenta incluso más la demanda de técnicas prácticas y baratas para producir modelos 3D representando personas reales. El objetivo de esta tesis es acercar el escaneo de humanos en 3D al usuario medio. Para ello, se presentan dos técnicas diferentes, una pasiva y una activa. La primera es un sistema automático para generar avatares multi-texturizados de personas reales mediante una serie de cámaras comunes. Nuestro sistema usa técnicas del estado del arte basadas en shape from silhouette para extraer la forma del sujeto a escanear. Sin embargo, este tipo de técnicas no gestiona las concavidades correctamente, por lo que nuestro sistema propone una manera de incrementar la calidad en una región del modelo que se ve especialmente afectada: la cara. Esta técnica de mejora facial usa un modelo 3D genérico de una cara y lo modifica según los rasgos faciales específicos del sujeto. Además, el sistema incluye una novedosa técnica para generar un atlas de textura a partir de las imágenes capturadas. Este sistema de multi-texturización consigue un atlas de textura sin transiciones abruptas de color gracias a su manera de mezclar la información de color de varias imágenes sobre cada triángulo. Todas las costuras y discontinuidades de color debidas a las condiciones de iluminación irregulares son eliminadas, minimizando el efecto de desenfoque de la interpolación que normalmente introducen este tipo de métodos. La segunda técnica presenta un sistema para conseguir un modelo humano 3D completamente animable utilizando un sensor de profundidad. A diferencia de otros métodos del estado de arte, nuestro sistema no requiere que el usuario esté completamente quieto durante el proceso de escaneado, ni mover el sensor alrededor del sujeto para cubrir toda su superficie. Por el contrario, el sensor se mantiene estático y el esqueleto virtual de la persona, que se va siguiendo durante el proceso, se utiliza para compensar sus movimientos durante el escaneado.

Nonatomic games on Loeb spaces

In the setting of noncooperative game theory, strategic negligibility of individual agents, or diffuseness of information, has been modeled as a nonatomic measure space, typically the unit interval endowed with Lebesgue measure. However, recent work has shown that with uncountable action sets, for example the unit interval, there do not exist pure-strategy Nash equilibria in such nonatomic games. In this brief announcement, we show that there is a perfectly satisfactory existence theory for nonatomic games provided this nonatomicity is formulated on the basis of a particular class of measure spaces, hyperfinite Loeb spaces. We also emphasize other desirable properties of games on hyperfinite Loeb spaces, and present a synthetic treatment, embracing both large games as well as those with incomplete information.

Systematic Observation of Youth Ice Hockey Coaches During Games

The behaviors of youth ice hockey coaches during games are examined using the Coaches Observation System for Games. This tool identifies 16 types of coach behaviors and eight targets of such behaviors. Findings reveal that coaches spend 51.2% of their time simply observing the game. Other common coach behaviors are organizing (15%), directing the game (8.1%) and giving information (6.1%). Targets of these behaviors include players in action (40.9%), on the bench (30.4%) and in transition (22.3%).

Generalized correlated equilibrium for two-person games in extensive form with perfect information

A correlation scheme (leading to a special equilibrium called “soft” correlated equilibrium) is applied for two-person finite games in extensive form with perfect information. Randomization by an umpire takes place over the leaves of the game tree. At every decision point players have the choice either to follow the recommendation of the umpire blindly or freely choose any other action except the one suggested. This scheme can lead to Pareto-improved outcomes of other correlated equilibria. Computational issues of maximizing a linear function over the set of soft correlated equilibria are considered and a linear-time algorithm in terms of the number of edges in the game tree is given for a special procedure called “subgame perfect optimization”.

Systematic Observation of Youth Ice Hockey Coaches During Games

The behaviors of youth ice hockey coaches during games are examined using the Coaches Observation System for Games. This tool identifies 16 types of coach behaviors and eight targets of such behaviors. Findings reveal that coaches spend 51.2% of their time simply observing the game. Other common coach behaviors are organizing (15%), directing the game (8.1%) and giving information (6.1%). Targets of these behaviors include players in action (40.9%), on the bench (30.4%) and in transition (22.3%).

Games for groundwater governance: field experiments in Andhra Pradesh, India

Groundwater is a common-pool resource that is subject to depletion in many places around the world as a result of increased use of irrigation and water-demanding cash crops. Where state capacity to control groundwater use is limited, collective action is important to increase recharge and restrict highly water-consumptive crops. We present results of field experiments in hard rock areas of Andhra Pradesh, India, to examine factors affecting groundwater use. Two nongovernmental organizations (NGOs) ran the games in communities where they were working to improve watershed and water management. Results indicate that, when the links between crop choice and groundwater depletion is made explicit, farmers can act cooperatively to address this problem. Longer NGO involvement in the villages was associated with more cooperative outcomes in the games. Individuals with more education and higher perceived community social capital played more cooperatively, but neither gender nor method of payment had a significantly effect on individual behavior. When participants could repeat the game with communication, similar crop choice patterns were observed. The games provided an entry point for discussion on the understanding of communities of the interconnectedness of groundwater use and crop choice.

Spectral self-action of THz emission from ionizing two-color laser pulses in gases

The spectrum of terahertz (THz) emission in gases via ionizing two-color femtosecond pulses is analyzed by means of a semi-analytic model and numerical simulations in 1D, 2D and 3D geometries taking into account propagation effects of both pump and THz fields. We show that produced THz signals interact with free electron trajectories and thus significantly influence further THz generation upon propagation, i.e., make the process inherently nonlocal. This self-action contributes to the observed strong spectral broadening of the generated THz field. Weshow that diffraction of the generated THz radiation is the limiting factor for the co-propagating low frequency amplitudes and thus for the self-action mechanism in 2D and 3D geometries.

Contributions to 3D Data Registration and Representation

Nowadays, new computers generation provides a high performance that enables to build computationally expensive computer vision applications applied to mobile robotics. Building a map of the environment is a common task of a robot and is an essential part to allow the robots to move through these environments. Traditionally, mobile robots used a combination of several sensors from different technologies. Lasers, sonars and contact sensors have been typically used in any mobile robotic architecture, however color cameras are an important sensor due to we want the robots to use the same information that humans to sense and move through the different environments. Color cameras are cheap and flexible but a lot of work need to be done to give robots enough visual understanding of the scenes. Computer vision algorithms are computational complex problems but nowadays robots have access to different and powerful architectures that can be used for mobile robotics purposes. The advent of low-cost RGB-D sensors like Microsoft Kinect which provide 3D colored point clouds at high frame rates made the computer vision even more relevant in the mobile robotics field. The combination of visual and 3D data allows the systems to use both computer vision and 3D processing and therefore to be aware of more details of the surrounding environment. The research described in this thesis was motivated by the need of scene mapping. Being aware of the surrounding environment is a key feature in many mobile robotics applications from simple robotic navigation to complex surveillance applications. In addition, the acquisition of a 3D model of the scenes is useful in many areas as video games scene modeling where well-known places are reconstructed and added to game systems or advertising where once you get the 3D model of one room the system can add furniture pieces using augmented reality techniques. In this thesis we perform an experimental study of the state-of-the-art registration methods to find which one fits better to our scene mapping purposes. Different methods are tested and analyzed on different scene distributions of visual and geometry appearance. In addition, this thesis proposes two methods for 3d data compression and representation of 3D maps. Our 3D representation proposal is based on the use of Growing Neural Gas (GNG) method. This Self-Organizing Maps (SOMs) has been successfully used for clustering, pattern recognition and topology representation of various kind of data. Until now, Self-Organizing Maps have been primarily computed offline and their application in 3D data has mainly focused on free noise models without considering time constraints. Self-organising neural models have the ability to provide a good representation of the input space. In particular, the Growing Neural Gas (GNG) is a suitable model because of its flexibility, rapid adaptation and excellent quality of representation. However, this type of learning is time consuming, specially for high-dimensional input data. Since real applications often work under time constraints, it is necessary to adapt the learning process in order to complete it in a predefined time. This thesis proposes a hardware implementation leveraging the computing power of modern GPUs which takes advantage of a new paradigm coined as General-Purpose Computing on Graphics Processing Units (GPGPU). Our proposed geometrical 3D compression method seeks to reduce the 3D information using plane detection as basic structure to compress the data. This is due to our target environments are man-made and therefore there are a lot of points that belong to a plane surface. Our proposed method is able to get good compression results in those man-made scenarios. The detected and compressed planes can be also used in other applications as surface reconstruction or plane-based registration algorithms. Finally, we have also demonstrated the goodness of the GPU technologies getting a high performance implementation of a CAD/CAM common technique called Virtual Digitizing.

Spectral self-action of THz emission from ionizing two-color laser pulses in gases

The spectrum of terahertz (THz) emission in gases via ionizing two-color femtosecond pulses is analyzed by means of a semi-analytic model and numerical simulations in 1D, 2D and 3D geometries taking into account propagation effects of both pump and THz fields. We show that produced THz signals interact with free electron trajectories and thus significantly influence further THz generation upon propagation, i.e., make the process inherently nonlocal. This self-action contributes to the observed strong spectral broadening of the generated THz field. We show that diffraction of the generated THz radiation is the limiting factor for the co-propagating low frequency amplitudes and thus for the self-action mechanism in 2D and 3D geometries.

Subjective comparison of consumer television technologies for 3D visualization

This paper presents a comparison among different consumer 3D display technologies by means of a subjective assessment test. Therefore, four 55-in displays have been considered: one autostereoscopic display, one stereoscopic with polarized passive glasses, and two with active shutter glasses. In addition, a high-quality 3D video database has been used to show diverse material with both views in high definition. To carry out the test, standard recommendations have been followed considering also some modifications looking for a test environment more similar to real home viewing conditions, with the objective of obtaining more representative conclusions. Moreover, several perceptual factors have been considered to study the performance of the displays, such as picture quality, depth perception, and visual discomfort. The obtained results show interesting issues, like the performance improvement of active shutter glasses technology, the high performance of the polarized glasses technology in terms of quality and comfort, and the need of improvement of the autostereoscopic displays to complement the visual comfort to reach a global high-quality visual experience.

Finding line of action of the force exerted on erect spine based on lateral bending test in personalization of scoliotic spine models

In multi-body models of scoliotic spine, personalization of mechanical properties of joints significantly improves reconstruction of the spine shape. In personalization methods based on lateral bending test, simulation of bending positions is an essential step. To simulate, a force is exerted on the spine model in the erect position. The line of action of the force affects the moment of the force about the joints and thus, if not correctly identified, causes over/underestimation of mechanical properties. Therefore, we aimed to identify the line of action, which has got little attention in previous studies. An in-depth analysis was performed on the scoliotic spine movement from the erect to four spine positions in the frontal plane by using pre-operative X-rays of 18 adolescent idiopathic scoliosis (AIS) patients. To study the movement, the spine curvature was considered as a 2D chain of micro-scale motion segments (MMSs) comprising rigid links and 1-degree-of-freedom (DOF) rotary joints. It was found that two MMSs representing the inflection points of the erect spine had almost no rotation (0.0028° ± 0.0021°) in the movement. The small rotation can be justified by weak moment of the force about these MMSs due to very small moment arm. Therefore, in the frontal plane, the line of action of the force to simulate the left/right bending position was defined as the line that passes through these MMSs in the left/right bending position. Through personalization of a 3D spine model for our patients, we demonstrated that our line of action could result in good estimates of the spine shape in the bending positions and other positions not included in the personalization, supporting our proposed line of action.

Teaching games for understanding (TGFU) as a positive and versatile approach to teaching adapted games

This paper presents a small scale research project that focused on pre-service physical education (PE)teachers’ and sports coaches’ considerations of using Teaching Games for Understanding (TGfU) to teachgames. A research design akin to action research was adopted whereby pre-service PE teachers and sportscoaches (n = 72) completed a one-off 90 minute introduction to wheelchair rugby league utilising a TGfUapproach. Data were generated through end of session whole-class reflections, semi-structured individualinterviews undertaken (n = 3), and post session first-author/primary practitioner reflections. Data analysiswas conducted via inductive coding procedures and revealed three themes: 1) TGfU as a positive pedagogy;2) TGfU as a versatile approach, and 3) significance of content within a PE Teacher Education programme.

A model for games and literacy

Digital Games: Literacy in action is the result of a wide-ranging investigation into the educational possibilities involved in young people's games.

Literacy, identity and online fantasy sports games

Digital Games: Literacy in action is the result of a wide-ranging investigation into the educational possibilities involved in young people and games.