Recent Advances in Adaptive Sampling and Reconstruction for Monte Carlo Rendering

Monte Carlo integration is firmly established as the basis for most practical realistic image synthesis algorithms because of its flexibility and generality. However, the visual quality of rendered images often suffers from estimator variance, which appears as visually distracting noise. Adaptive sampling and reconstruction algorithms reduce variance by controlling the sampling density and aggregating samples in a reconstruction step, possibly over large image regions. In this paper we survey recent advances in this area. We distinguish between “a priori” methods that analyze the light transport equations and derive sampling rates and reconstruction filters from this analysis, and “a posteriori” methods that apply statistical techniques to sets of samples to drive the adaptive sampling and reconstruction process. They typically estimate the errors of several reconstruction filters, and select the best filter locally to minimize error. We discuss advantages and disadvantages of recent state-of-the-art techniques, and provide visual and quantitative comparisons. Some of these techniques are proving useful in real-world applications, and we aim to provide an overview for practitioners and researchers to assess these approaches. In addition, we discuss directions for potential further improvements.

(Table 1) Summary of sampling points described and main petrographic, morphological and geochemical characteristics

Targeted sampling on the Dolgovskoy Mound (northern Shatsky Ridge) revealed the presence of spectacular laterally extensive and differently shaped authigenic carbonates. The sampling stations were selected based on sidescan sonar and profiler images that show patchy backscatter and irregular and discontinuous reflections in the near subsurface. The interpretation of acoustic data from the top part of the mound supports the seafloor observations and the sampling that revealed the presence of a complex subsurface plumbing system characterized by carbonates and gas. The crusts sampled consist of carbonate cemented layered hemipelagic sedimentary Unit 1 associated with several centimetres thick microbial mats. Three different carbonate morphologies were observed: (a) tabular slabs, (b) subsurface cavernous carbonates consisting of void chambers up to 20 cm**3 in size and (c) chimney and tubular conduits vertically oriented or forming a subhorizontal network in the subsurface. The methanogenic origin of the carbonates is established based on visual observations of fluids seepage structures, 13C depletion of the carbonates (d13C varying between -36.7 per mil and -27.4 per mil), and by thin carbonate layers present within the thick microbial mats. Laboratory experiments with a Hele-Shaw cell were conducted in order to simulate the gas seepage through contrasting grain size media present on the seafloor. Combined petrography, visual observations and sandbox simulations allowed a characterization of the dynamics and the structures of the plumbing system in the near subsurface. Based on sample observations and the experiments, three observed morphologies of authigenic carbonates are interpreted, respectively, as (a) Darcian porous flow through the finely laminated clayey/coccolith-rich layers, (b) gas accumulation chambers at sites where significant fluid escape was impeded by thicker clayey layers forming the laminated Unit1 and (c) focussed vertical fluid venting and subhorizontal migration of overpressured fluids released from (b). The Hele-Shaw cell experiments represent a promising tool for investigating shallow fluid flow pathways in marine systems.

Description of sampling sites in Northern Russia

The youngest ice marginal zone between the White Sea and the Ural mountains is the W-E trending belt of moraines called the Varsh-Indiga-Markhida-Harbei-Halmer-Sopkay, here called the Markhida line. Glacial elements show that it was deposited by the Kara Ice Sheet, and in the west, by the Barents Ice Sheet. The Markhida moraine overlies Eemian marine sediments, and is therefore of Weichselian age. Distal to the moraine are Eemian marine sediments and three Palaeolithic sites with many C-14 dates in the range 16-37 ka not covered by till, proving that it represents the maximum ice sheet extension during the Weichselian. The Late Weichselian ice limit of M. G. Grosswald is about 400 km (near the Urals more than 700 km) too far south. Shorelines of ice dammed Lake Komi, probably dammed by the ice sheet ending at the Markhida line, predate 37 ka. We conclude that the Markhida line is of Middle/Early Weichselian age, implying that no ice sheet reached this part of Northern Russia during the Late Weichselian. This age is supported by a series of C-14 and OSL dates inside the Markhida line all of >45 ka. Two moraine loops protrude south of the Markhida line; the Laya-Adzva and Rogavaya moraines. These moraines are covered by Lake Komi sediments, and many C-14 dates on mammoth bones inside the moraines are 26-37 ka. The morphology indicates that the moraines are of Weichselian age, but a Saalian age cannot be excluded. No post-glacial emerged marine shorelines are found along the Barents Sea coast north of the Markhida line.

IBAMar DATABASE: 4 decades of oceanographic sampling on the Western Mediterranean Sea

IBAMar (http://www.ba.ieo.es/ibamar) is a regional database that puts together all physical and biochemical data obtained by multiparametric probes (CTDs equipped with different sensors), during the cruises managed by the Balearic Center of the Spanish Institute of Oceanography (COB-IEO). It has been recently extended to include data obtained with classical hydro casts using oceanographic Niskin or Nansen bottles. The result is a database that includes a main core of hydrographic data: temperature (T), salinity (S), dissolved oxygen (DO), fluorescence and turbidity; complemented by bio-chemical data: dissolved inorganic nutrients (phosphate, nitrate, nitrite and silicate) and chlorophyll-a. In IBAMar Database, different technologies and methodologies were used by different teams along the four decades of data sampling in the COB-IEO. Despite of this fact, data have been reprocessed using the same protocols, and a standard QC has been applied to each variable. Therefore it provides a regional database of homogeneous, good quality data. Data acquisition and quality control (QC): 94% of the data are CTDs Sbe911 and Sbe25. S and DO were calibrated on board using water samples, whenever a Rossetta was available (70% of the cases). All CTD data from Seabird CTDs were reviewed and post processed with the software provided by Sea-Bird Electronics. Data were averaged to get 1 dbar vertical resolution. General sampling methodology and pre processing are described in https://ibamardatabase.wordpress.com/home/). Manual QC include visual checks of metadata, duplicate data and outliers. Automatic QC include range check of variables by area (north of Balearic Islands, south of BI and Alboran Sea) and depth (27 standard levels), check for spikes and check for density inversions. Nutrients QC includes a preliminary control and a range check on the observed level of the data to detect outliers around objectively analyzed data fields. A quality flag is assigned as an integer number, depending on the result of the QC check.

Bird observation and sampling in tropical agroforestry landscapes of the Napu Valley in Central Sulawesi, Indonesia

We investigated the local bird community in Central Sulawesi (Indonesia), with focus on insectivorous species in the agroforestry landscapes adjacent to the Lore Lindu National Park. All study sites were situated at the northern tip of Napu Valley in Central Sulawesi, Indonesia. After an initial mapping of the study area, we selected 15 smallholder cacao plantations as sites for our study in March 2010. These sides were mainly used for bird and bat exclosure experiments. All sited were situated along a local gradient (shade availability on each plantation) and a landscape gradient (distance to primary forest), which were independent from each other. In September 2010 and from February until June 2011, we assessed the bird community on our 15 study sites using monthly point count and mist netting sampling. Point count (20 minutes between 07 am and 10 am and in between the net checking hours) and mist netting surveys (12 hours, between 05:30 am and 17:30 pm) were conducted simultaneously but only once per month on each study site, to avoid habituation of the local bird community to our surveys. Further, point counts were conducted at least 100 m apart from the mist netting sites, to avoid potential disturbance between the two methods. We discarded all observations beyond 50 m (including those individuals that flew over the canopy) from the statistical analysis, as well as recaptures of individuals within identical mist netting rounds.

Probability sampling protocol of classification maps from spaceborne/airborne image

To deliver sample estimates provided with the necessary probability foundation to permit generalization from the sample data subset to the whole target population being sampled, probability sampling strategies are required to satisfy three necessary not sufficient conditions: (i) All inclusion probabilities be greater than zero in the target population to be sampled. If some sampling units have an inclusion probability of zero, then a map accuracy assessment does not represent the entire target region depicted in the map to be assessed. (ii) The inclusion probabilities must be: (a) knowable for nonsampled units and (b) known for those units selected in the sample: since the inclusion probability determines the weight attached to each sampling unit in the accuracy estimation formulas, if the inclusion probabilities are unknown, so are the estimation weights. This original work presents a novel (to the best of these authors' knowledge, the first) probability sampling protocol for quality assessment and comparison of thematic maps generated from spaceborne/airborne Very High Resolution (VHR) images, where: (I) an original Categorical Variable Pair Similarity Index (CVPSI, proposed in two different formulations) is estimated as a fuzzy degree of match between a reference and a test semantic vocabulary, which may not coincide, and (II) both symbolic pixel-based thematic quality indicators (TQIs) and sub-symbolic object-based spatial quality indicators (SQIs) are estimated with a degree of uncertainty in measurement in compliance with the well-known Quality Assurance Framework for Earth Observation (QA4EO) guidelines. Like a decision-tree, any protocol (guidelines for best practice) comprises a set of rules, equivalent to structural knowledge, and an order of presentation of the rule set, known as procedural knowledge. The combination of these two levels of knowledge makes an original protocol worth more than the sum of its parts. The several degrees of novelty of the proposed probability sampling protocol are highlighted in this paper, at the levels of understanding of both structural and procedural knowledge, in comparison with related multi-disciplinary works selected from the existing literature. In the experimental session the proposed protocol is tested for accuracy validation of preliminary classification maps automatically generated by the Satellite Image Automatic MapperT (SIAMT) software product from two WorldView-2 images and one QuickBird-2 image provided by DigitalGlobe for testing purposes. In these experiments, collected TQIs and SQIs are statistically valid, statistically significant, consistent across maps and in agreement with theoretical expectations, visual (qualitative) evidence and quantitative quality indexes of operativeness (OQIs) claimed for SIAMT by related papers. As a subsidiary conclusion, the statistically consistent and statistically significant accuracy validation of the SIAMT pre-classification maps proposed in this contribution, together with OQIs claimed for SIAMT by related works, make the operational (automatic, accurate, near real-time, robust, scalable) SIAMT software product eligible for opening up new inter-disciplinary research and market opportunities in accordance with the visionary goal of the Global Earth Observation System of Systems (GEOSS) initiative and the QA4EO international guidelines.

The representation of the ipsilateral visual field in human cerebral cortex

Previous studies of cortical retinotopy focused on influences from the contralateral visual field, because ascending inputs to cortex are known to be crossed. Here, functional magnetic resonance imaging was used to demonstrate and analyze an ipsilateral representation in human visual cortex. Moving stimuli, in a range of ipsilateral visual field locations, revealed activity: (i) along the vertical meridian in retinotopic (presumably lower-tier) areas; and (ii) in two large branches anterior to that, in presumptive higher-tier areas. One branch shares the anterior vertical meridian representation in human V3A, extending superiorly toward parietal cortex. The second branch runs antero-posteriorly along lateral visual cortex, overlying motion-selective area MT. Ipsilateral stimuli sparing the region around the vertical meridian representation also produced signal reductions (perhaps reflecting neural inhibition) in areas showing contralaterally driven retinotopy. Systematic sampling across a range of ipsilateral visual field extents revealed significant increases in ipsilateral activation in V3A and V4v, compared with immediately posterior areas V3 and VP. Finally, comparisons between ipsilateral stimuli of different types but equal retinotopic extent showed clear stimulus specificity, consistent with earlier suggestions of a functional segregation of motion vs. form processing in parietal vs. temporal cortex, respectively.

Sampling and measurement methods for a study of childhood refractive error in a UK population

Background There is a paucity of data describing the prevalence of childhood refractive error in the United Kingdom. The Northern Ireland Childhood Errors of Refraction study, along with its sister study the Aston Eye Study, are the first population-based surveys of children using both random cluster sampling and cycloplegic autorefraction to quantify levels of refractive error in the United Kingdom. Methods Children aged 6–7 years and 12–13 years were recruited from a stratified random sample of primary and post-primary schools, representative of the population of Northern Ireland as a whole. Measurements included assessment of visual acuity, oculomotor balance, ocular biometry and cycloplegic binocular open-field autorefraction. Questionnaires were used to identify putative risk factors for refractive error. Results 399 (57%) of 6–7 years and 669 (60%) of 12–13 years participated. School participation rates did not vary statistically significantly with the size of the school, whether the school is urban or rural, or whether it is in a deprived/non-deprived area. The gender balance, ethnicity and type of schooling of participants are reflective of the Northern Ireland population. Conclusions The study design, sample size and methodology will ensure accurate measures of the prevalence of refractive errors in the target population and will facilitate comparisons with other population-based refractive data.

Multiple Dipole Source Models for Scalp-Recorded Event-Related Potentials: Example from Complex Visual Processing in the Human Brain

2000 Mathematics Subject Classification: 62P10, 92C20

Alpha oscillations index the functionality and the plastic changes of the visual system

Alpha oscillations are linked to visual awareness and to the periodical sampling of visual information, suggesting that alpha rhythm reflect an index of the functionality of the posterior cortices, and hence of the visual system. Therefore, the present work described a series of studies investigating alpha oscillations as a biomarker of the functionality and the plastic modifications of the visual system in response to lesions to the visual cortices or to external stimulations. The studies presented in chapter 5 and 6 showed that posterior lesions alter alpha oscillations in hemianopic patients, with reduced alpha reactivity at the eyes opening and decreased alpha functional connectivity, especially in right-lesioned hemianopics, with concurrent dysfunctions in the theta range, suggesting a specialization of the right hemisphere in orchestrating alpha oscillations and coordinating complex interplays among different brain rhythms. The study presented in chapter 7 investigated a mechanism of rhythmical attentional sampling of visual information in healthy participants, showing that perceptual performance is influenced by a rhythmical mechanism of attentional allocation, occurring at lower-alpha frequencies (i.e., 7 Hz), when a single spatial location is monitored, and at lower frequencies (i.e., 5 Hz), when attention is allocated to two spatial locations. Moreover, the right hemisphere seemed to have a dominance in this rhythmical attentional sampling, distributing attentional resources to the entire visual field. Finally, the study presented in chapter 8 showed that prolonged visual entrainment induce long-term modulations of resting-state alpha activity in healthy participants, suggesting that persistent modifications in the functionality of the visual system are possible. Altogheter, these findings show that functional processes and plastic changes of the visual system are reflected in alpha oscillatory patterns. Therefore, investigating and promoting alpha oscillations may contribute to the development of rehabilitative protocols to ameliorate the functionality of the visual system, in brain lesioned patients.

Advancing Bag-of-visual-words Representations For Lesion Classification In Retinal Images.

Diabetic Retinopathy (DR) is a complication of diabetes that can lead to blindness if not readily discovered. Automated screening algorithms have the potential to improve identification of patients who need further medical attention. However, the identification of lesions must be accurate to be useful for clinical application. The bag-of-visual-words (BoVW) algorithm employs a maximum-margin classifier in a flexible framework that is able to detect the most common DR-related lesions such as microaneurysms, cotton-wool spots and hard exudates. BoVW allows to bypass the need for pre- and post-processing of the retinographic images, as well as the need of specific ad hoc techniques for identification of each type of lesion. An extensive evaluation of the BoVW model, using three large retinograph datasets (DR1, DR2 and Messidor) with different resolution and collected by different healthcare personnel, was performed. The results demonstrate that the BoVW classification approach can identify different lesions within an image without having to utilize different algorithms for each lesion reducing processing time and providing a more flexible diagnostic system. Our BoVW scheme is based on sparse low-level feature detection with a Speeded-Up Robust Features (SURF) local descriptor, and mid-level features based on semi-soft coding with max pooling. The best BoVW representation for retinal image classification was an area under the receiver operating characteristic curve (AUC-ROC) of 97.8% (exudates) and 93.5% (red lesions), applying a cross-dataset validation protocol. To assess the accuracy for detecting cases that require referral within one year, the sparse extraction technique associated with semi-soft coding and max pooling obtained an AUC of 94.2 ± 2.0%, outperforming current methods. Those results indicate that, for retinal image classification tasks in clinical practice, BoVW is equal and, in some instances, surpasses results obtained using dense detection (widely believed to be the best choice in many vision problems) for the low-level descriptors.