A Survey of Image-based Relighting Techniques

Image-based Relighting (IBRL) has recently attracted a lot of research interest for its ability to relight real objects or scenes, from novel illuminations captured in natural/synthetic environments. Complex lighting effects such as subsurface scattering, interreflection, shadowing, mesostructural self-occlusion, refraction and other relevant phenomena can be generated using IBRL. The main advantage of image-based graphics is that the rendering time is independent of scene complexity as the rendering is actually a process of manipulating image pixels, instead of simulating light transport. The goal of this paper is to provide a complete and systematic overview of the research in Imagebased Relighting. We observe that essentially all IBRL techniques can be broadly classified into three categories (Fig. 9), based on how the scene/illumination information is captured: Reflectance function-based, Basis function-based and Plenoptic function-based. We discuss the characteristics of each of these categories and their representative methods. We also discuss about the sampling density and types of light source(s), relevant issues of IBRL.

An image-based method to automatically propagate bony landmarks: application to computational spine biomechanics.

In attempts to elucidate the underlying mechanisms of spinal injuries and spinal deformities, several experimental and numerical studies have been conducted to understand the biomechanical behavior of the spine. However, numerical biomechanical studies suffer from uncertainties associated with hard- and soft-tissue anatomies. Currently, these parameters are identified manually on each mesh model prior to simulations. The determination of soft connective tissues on finite element meshes can be a tedious procedure, which limits the number of models used in the numerical studies to a few instances. In order to address these limitations, an image-based method for automatic morphing of soft connective tissues has been proposed. Results showed that the proposed method is capable to accurately determine the spatial locations of predetermined bony landmarks. The present method can be used to automatically generate patient-specific models, which may be helpful in designing studies involving a large number of instances and to understand the mechanical behavior of biomechanical structures across a given population.

Image-based vs. mesh-based statistical appearance models of the human femur: Implications for finite element simulations.

Statistical appearance models have recently been introduced in bone mechanics to investigate bone geometry and mechanical properties in population studies. The establishment of accurate anatomical correspondences is a critical aspect for the construction of reliable models. Depending on the representation of a bone as an image or a mesh, correspondences are detected using image registration or mesh morphing. The objective of this study was to compare image-based and mesh-based statistical appearance models of the femur for finite element (FE) simulations. To this aim, (i) we compared correspondence detection methods on bone surface and in bone volume; (ii) we created an image-based and a mesh-based statistical appearance models from 130 images, which we validated using compactness, representation and generalization, and we analyzed the FE results on 50 recreated bones vs. original bones; (iii) we created 1000 new instances, and we compared the quality of the FE meshes. Results showed that the image-based approach was more accurate in volume correspondence detection and quality of FE meshes, whereas the mesh-based approach was more accurate for surface correspondence detection and model compactness. Based on our results, we recommend the use of image-based statistical appearance models for FE simulations of the femur.

Image-based biomechanical assessment of vertebral body and intervertebral disc in the human lumbar spine

Life expectancy continuously increases but our society faces age-related conditions. Among musculoskeletal diseases, osteoporosis associated with risk of vertebral fracture and degenerative intervertebral disc (IVD) are painful pathologies responsible for tremendous healthcare costs. Hence, reliable diagnostic tools are necessary to plan a treatment or follow up its efficacy. Yet, radiographic and MRI techniques, respectively clinical standards for evaluation of bone strength and IVD degeneration, are unspecific and not objective. Increasingly used in biomedical engineering, CT-based finite element (FE) models constitute the state-of-art for vertebral strength prediction. However, as non-invasive biomechanical evaluation and personalised FE models of the IVD are not available, rigid boundary conditions (BCs) are applied on the FE models to avoid uncertainties of disc degeneration that might bias the predictions. Moreover, considering the impact of low back pain, the biomechanical status of the IVD is needed as a criterion for early disc degeneration. Thus, the first FE study focuses on two rigid BCs applied on the vertebral bodies during compression test of cadaver vertebral bodies, vertebral sections and PMMA embedding. The second FE study highlights the large influence of the intervertebral disc’s compliance on the vertebral strength, damage distribution and its initiation. The third study introduces a new protocol for normalisation of the IVD stiffness in compression, torsion and bending using MRI-based data to account for its morphology. In the last study, a new criterion (Otsu threshold) for disc degeneration based on quantitative MRI data (axial T2 map) is proposed. The results show that vertebral strength and damage distribution computed with rigid BCs are identical. Yet, large discrepancies in strength and damage localisation were observed when the vertebral bodies were loaded via IVDs. The normalisation protocol attenuated the effect of geometry on the IVD stiffnesses without complete suppression. Finally, the Otsu threshold computed in the posterior part of annulus fibrosus was related to the disc biomechanics and meet objectivity and simplicity required for a clinical application. In conclusion, the stiffness normalisation protocol necessary for consistent IVD comparisons and the relation found between degeneration, mechanical response of the IVD and Otsu threshold lead the way for non-invasive evaluation biomechanical status of the IVD. As the FE prediction of vertebral strength is largely influenced by the IVD conditions, this data could also improve the future FE models of osteoporotic vertebra.

Applications of image-based, multi-view stereo reconstruction methods = (Aplicaciones de los métodos de reconstrucción estéreo multivista)

These slides present several 3-D reconstruction methods to obtain the geometric structure of a scene that is viewed by multiple cameras. We focus on the combination of the geometric modeling in the image formation process with the use of standard optimization tools to estimate the characteristic parameters that describe the geometry of the 3-D scene. In particular, linear, non-linear and robust methods to estimate the monocular and epipolar geometry are introduced as cornerstones to generate 3-D reconstructions with multiple cameras. Some examples of systems that use this constructive strategy are Bundler, PhotoSynth, VideoSurfing, etc., which are able to obtain 3-D reconstructions with several hundreds or thousands of cameras. En esta presentación se tratan varios métodos de reconstrucción 3-D para la obtención de la estructura geométrica de una escena que es visualizada por varias cámaras. Se enfatiza la combinación de modelado geométrico del proceso de formación de la imagen con el uso de herramientas estándar de optimización para estimar los parámetros característicos que describen la geometría de la escena 3-D. En concreto, se presentan métodos de estimación lineales, no lineales y robustos de las geometrías monocular y epipolar como punto de partida para generar reconstrucciones con tres o más cámaras. Algunos ejemplos de sistemas que utilizan este enfoque constructivo son Bundler, PhotoSynth, VideoSurfing, etc., los cuales, en la práctica pueden llegar a reconstruir una escena con varios cientos o miles de cámaras.

Autonomous Landing of an Unmanned Aerial Vehicle using Image-Based Fuzzy Control

This paper presents a vision based autonomous landing control approach for unmanned aerial vehicles (UAV). The 3D position of an unmanned helicopter is estimated based on the homographies estimated of a known landmark. The translation and altitude estimation of the helicopter against the helipad position are the only information that is used to control the longitudinal, lateral and descend speeds of the vehicle. The control system approach consists in three Fuzzy controllers to manage the speeds of each 3D axis of the aircraft s coordinate system. The 3D position estimation was proven rst, comparing it with the GPS + IMU data with very good results. The robust of the vision algorithm against occlusions was also tested. The excellent behavior of the Fuzzy control approach using the 3D position estimation based in homographies was proved in an outdoors test using a real unmanned helicopter.

Targetless image-based method for measuring displacements and strains on concrete surfaces with a consumer camera

Measurement of concrete strain through non-invasive methods is of great importance in civil engineering and structural analysis. Traditional methods use laser speckle and high quality cameras that may result too expensive for many applications. Here we present a method for measuring concrete deformations with a standard reflex camera and image processing for tracking objects in the concretes surface. Two different approaches are presented here. In the first one, on-purpose objects are drawn on the surface, while on the second one we track small defects on the surface due to air bubbles in the hardening process. The method has been tested on a concrete sample under several loading/unloading cycles. A stop-motion sequence of the process has been captured and analyzed. Results have been successfully compared with the values given by a strain gauge. Accuracy of our methods in tracking objects is below 8 μm, in the order of more expensive commercial devices.

A study of feature combination for vehicle detection based on image processing

Video analytics play a critical role in most recent traffic monitoring and driver assistance systems. In this context, the correct detection and classification of surrounding vehicles through image analysis has been the focus of extensive research in the last years. Most of the pieces of work reported for image-based vehicle verification make use of supervised classification approaches and resort to techniques, such as histograms of oriented gradients (HOG), principal component analysis (PCA), and Gabor filters, among others. Unfortunately, existing approaches are lacking in two respects: first, comparison between methods using a common body of work has not been addressed; second, no study of the combination potentiality of popular features for vehicle classification has been reported. In this study the performance of the different techniques is first reviewed and compared using a common public database. Then, the combination capabilities of these techniques are explored and a methodology is presented for the fusion of classifiers built upon them, taking into account also the vehicle pose. The study unveils the limitations of single-feature based classification and makes clear that fusion of classifiers is highly beneficial for vehicle verification.

Using the Amazon metric to construct an image database based on what people do, not what they say

Current image database metadata schemas require users to adopt a specific text-based vocabulary. Text-based metadata is good for searching but not for browsing. Existing image-based search facilities, on the other hand, are highly specialised and so suffer similar problems. Wexelblat's semantic dimensional spatial visualisation schemas go some way towards addressing this problem by making both searching and browsing more accessible to the user in a single interface. But the question of how and what initial metadata to enter a database remains. Different people see different things in an image and will organise a collection in equally diverse ways. However, we can find some similarity across groups of users regardless of their reasoning. For example, a search on Amazon.com returns other products also, based on an averaging of how users navigate the database. In this paper, we report on applying this concept to a set of images for which we have visualised them using traditional methods and the Amazon.com method. We report on the findings of this comparative investigation in a case study setting involving a group of randomly selected participants. We conclude with the recommendation that in combination, the traditional and averaging methods would provide an enhancement to current database visualisation, searching, and browsing facilities.

Image calibration to like-values in mapping shallow water quality from multitemporal data

The applicability of image calibration to like-values in mapping water quality parameters from multitemporal images is explored, Six sets of water samples were collected at satellite overpasses over Moreton Bay, Brisbane, Australia. Analysis of these samples reveals that waters in this shallow bay are mostly TSS-dominated, even though they are occasionally dominated by chlorophyll as well. Three of the images were calibrated to a reference image based on invariant targets. Predictive models constructed from the reference image were applied to estimating total suspended sediment (TSS) and Secchi depth from another image at a discrepancy of around 35 percent. Application of the predictive model for TSS concentration to another image acquired at a time of different water types resulted in a discrepancy of 152 percent. Therefore, image calibration to like-values could be used to reliably map certain water quality parameters from multitemporal TM images so long as the water type under study remains unchanged. This method is limited in that the mapped results could be rather inaccurate if the water type under study has changed considerably. Thus, the approach needs to be refined in shallow water from multitemporal satellite imagery.

Voxel-based registration of simulated and real patient CBCT data for accurate dental implant pose estimation

The success of dental implant-supported prosthesis is directly linked to the accuracy obtained during implant’s pose estimation (position and orientation). Although traditional impression techniques and recent digital acquisition methods are acceptably accurate, a simultaneously fast, accurate and operator-independent methodology is still lacking. Hereto, an image-based framework is proposed to estimate the patient-specific implant’s pose using cone-beam computed tomography (CBCT) and prior knowledge of implanted model. The pose estimation is accomplished in a threestep approach: (1) a region-of-interest is extracted from the CBCT data using 2 operator-defined points at the implant’s main axis; (2) a simulated CBCT volume of the known implanted model is generated through Feldkamp-Davis-Kress reconstruction and coarsely aligned to the defined axis; and (3) a voxel-based rigid registration is performed to optimally align both patient and simulated CBCT data, extracting the implant’s pose from the optimal transformation. Three experiments were performed to evaluate the framework: (1) an in silico study using 48 implants distributed through 12 tridimensional synthetic mandibular models; (2) an in vitro study using an artificial mandible with 2 dental implants acquired with an i-CAT system; and (3) two clinical case studies. The results shown positional errors of 67±34μm and 108μm, and angular misfits of 0.15±0.08º and 1.4º, for experiment 1 and 2, respectively. Moreover, in experiment 3, visual assessment of clinical data results shown a coherent alignment of the reference implant. Overall, a novel image-based framework for implants’ pose estimation from CBCT data was proposed, showing accurate results in agreement with dental prosthesis modelling requirements.

Body image perception and weight-related behaviour among adolescents of the Seychelles

Background: We examined one's own body image perception and its association with reported weight-related behavior among adolescents of a rapidly developing country in the African region. Methods: We conducted a school-based survey of 1432 students aged 11-17 years in the Seychelles. Weight and height were measured, and thinness, normal weight and overweight were assessed along standard criteria. A self-administered and anonymous questionnaire was administered. Perception of body image was assessed using both a closed-ended question (CEQ) and the Stunkard's pictorial silhouettes (SPS). Finally, a question assessed voluntary attempts to change weight. Results: Overall, 14.1% of the students were thin, 63.9% were normal-weight, and 22.0% were overweight or obese. There was fair agreement between actual weight status and self-perceived body image based on either CEQ or SPS. However, a substantial proportion of the overweight students did not consider themselves as overweight (SPS: 24%, CEQ: 34%) and, inversely, a substantial proportion of the normal-weight students considered themselves as too thin (SPS: 29%, CEQ: 15%). Among the overweight students, an adequate attempt to lose weight was reported more often by boys and girls who perceived themselves as overweight vs. not overweight (72-88% vs. 40-71%, p <0.05 for most comparisons). Among the normal-weight students, an inadequate attempt to gain weight was reported more often by boys and girls who perceived themselves as thin vs. not thin (27-68% vs. 11-19%, p <0.05). Girls had leaner own body ideals than boys. Conclusions: We found that substantial proportions of overweight students did not perceive themselves as overweight and/or did not want to lose weight and, inversely, that many normalweight students perceived themselves as too thin and/or wanted to gain weight: this points to forces that can drive the upwards overweight trends. Appropriate perception of one's weight was associated with adequate weight-control behavior, although not strongly, emphasizing that appropriate weight perception is only one of several factors driving adequate weight-related behavior. These findings emphasize the need to address appropriate perception of one's own weight and adequate weight-related behavior in adolescents for both individual and community weight-related interventions.

Managing induced tourism image : relational patterns and the life cycle

The tourism image is an element that conditions the competitiveness of tourism destinations by making them stand out in the minds of tourists. In this context, marketers of tourism destinations endeavour to create an induced image based on their identity and distinctive characteristics.A number of authors have also recognized the complexity of tourism destinations and the need for coordination and cooperation among all tourism agents, in order to supply a satisfactory tourist product and be competitive in the tourism market. Therefore, tourism agents at the destination need to develop and integrate strategic marketing plans.The aim of this paper is to determine how cities of similar cultures use their resources with the purpose of developing a distinctive induced tourism image to attract tourists and the extent of coordination and cooperation among the various tourism agents of a destination in the process of induced image creation.In order to accomplish these aims, a comparative analysis of the induced image of two cultural cities is presented, Girona (Spain) and Perpignan (France). The induced image is assessed through the content analysis of promotional brochures and the extent of cooperation with in-depth interviews of the main tourism agents of these destinations.Despite the similarities of both cities in terms of tourism resources, results show the use of different attributes to configure the induced image of each destination, as well as a different configuration of the network of tourism agents that participate in the process of induced image creation

Application of morphometry, static DNA ploidy analysis, and steroid receptor expression in diagnosis and prognosis of Libyan breast cancer

The aim of this study was to describe the demographic, clinicopathological, biological and morphometric features of Libyan breast cancer patients. The supporting value of nuclear morphometry and static image cytometry in the sensitivity for detecting breast cancer in conventional fine-needle aspiration biopsies were estimated. The findings were compared with findings in breast cancer in Finland and Nigeria. In addation, the value of ER and PR were evaluated. There were 131 histological samples, 41 cytological samples, and demographic and clinicopathological data from 234 Libyan patients. The Libyan breast cancer is dominantly premenopausal and in this feature it is similar to breast cancer in sub-Saharan Africans, but clearly different from breast cancer in Europeans, whose cancers are dominantly postmenopausal in character. At presention most Libyan patients have locally advanced disease, which is associated with poor survival rates. Nuclear morphometry and image DNA cytometry agree with earlier published data in the Finnish population and indicate that nuclear size and DNA analysis of nuclear content can be used to increase the cytological sensitivity and specificity in doubtful breast lesions, particularly when free cell sampling method is used. Combination of the morphometric data with earlier free cell data gave the following diagnostic guidelines: Range of overlap in free cell samples: 55 μm2 -71 μm2. Cut-off values for diagnostic purposes: Mean nuclear area (MNA) >54 μm2 for 100% detection of malignant cases (specificity 84 %), MNA < 72 μm2 for 100% detection of benign cases (sensitivity 91%). Histomorphometry showed a significant correlation between the MNA and most clinicopathological features, with the strongest association observed for histological grade (p <0.0001). MNA seems to be a prognosticator in Libyan breast cancer (Pearson’s test r = - 0.29, p = 0.019), but at lower level of significance than in the European material. A corresponding relationship was not found in shape-related morphometric features. ER and PR staining scores were in correlation with the clinical stage (p= 0.017, and 0.015, respectively), and also associated with lymph node negative patients (p=0.03, p=0.05, respectively). Receptor-positive (HR+) patients had a better survival. The fraction of HR+ cases among Libyan breast cancers is about the same as the fraction of positive cases in European breast cancer. The study suggests that also weak staining (corresponding to as few as 1% positive cells) has prognostic value. The prognostic significance may be associated with the practice to use antihormonal therapy in HR+ cases. The low survival and advanced presentation is associated with active cell proliferation, atypical nuclear morphology and aneuploid nuclear DNA content in Libyan breast cancer patients. The findings support the idea that breast cancer is not one type of disease, but should probably be classified into premenopausal and post menopausal types.