Assessing reproducibility of data obtained with instruments based on continuous measurements

Data obtained with any research tool must be reproducible, a concept referred to as reliability. Three techniques are often used to evaluate reliability of tools using continuous data in aging research: intraclass correlation coefficients (ICC), Pearson correlations, and paired t tests. These are often construed as equivalent when applied to reliability. This is not correct, and may lead researchers to select instruments based on statistics that may not reflect actual reliability. The purpose of this paper is to compare the reliability estimates produced by these three techniques and determine the preferable technique. A hypothetical dataset was produced to evaluate the reliability estimates obtained with ICC, Pearson correlations, and paired t tests in three different situations. For each situation two sets of 20 observations were created to simulate an intrarater or inter-rater paradigm, based on 20 participants with two observations per participant. Situations were designed to demonstrate good agreement, systematic bias, or substantial random measurement error. In the situation demonstrating good agreement, all three techniques supported the conclusion that the data were reliable. In the situation demonstrating systematic bias, the ICC and t test suggested the data were not reliable, whereas the Pearson correlation suggested high reliability despite the systematic discrepancy. In the situation representing substantial random measurement error where low reliability was expected, the ICC and Pearson coefficient accurately illustrated this. The t test suggested the data were reliable. The ICC is the preferred technique to measure reliability. Although there are some limitations associated with the use of this technique, they can be overcome.

Real-space mapping of dynamic phenomena during hysteresis loop measurements: Dynamic switching spectroscopy piezoresponse force microscopy

Dynamic switching spectroscopy piezoresponse force microscopy is developed to separate thermodynamic and kinetic effects in local bias-induced phase transitions. The approaches for visualization and analysis of five-dimensional data are discussed. The spatial and voltage variability of relaxation behavior of the a-c domain lead zirconate-titanate surface suggest the interpretation in terms of surface charge dynamics. This approach is applicable to local studies of dynamic behavior in any system with reversible bias-induced phase transitions ranging from ferroelectrics and multiferroics to ionic systems such as batteries, fuel cells, and electroresistive materials. (C) 2011 American Institute of Physics. [doi:10.1063/1.3590919]

Reproducibility of fundus autofluorescence measurements obtained using a confocal scanning laser ophthalmoscope

Aim - To evaluate the reproducibility of the background fundus autofluorescence measurements obtained using a confocal scanning laser ophthalmoscope. Methods - 10 normal volunteers and 10 patients with retinal disease were included in the study. One eye per subject was chosen randomly. Five images of the same eye of each individual were obtained, after pupillary dilatation, by two investigators using a confocal scanning laser ophthalmoscope. Background fundus autofluorescence was measured at 7 degrees temporal to the fovea in normal volunteers and between 7 and 15 degrees temporal to the fovea in patients. Within session reproducibility of the measurements obtained by each investigator and interobserver reproducibility were evaluated. Results - For investigator 1 the median values of fundus autofluorescence obtained were 31.9 units for normal volunteers and 27.3 units for patients. The median largest difference in readings in normal volunteers was 5.7 units (range 1.4-13.5 units) and in patients 4.2 units (1.5-15.1 units). For investigator 2 the median values of fundus autofluorescence obtained were 28.9 units for normal volunteers and 27.4 units for patients. The median largest difference in readings in normal volunteers was 3.6 units (2.7-11.7 units), and in patients 4.1 units (1.5-9.3 units). The median interobserver difference in readings in normal volunteers was 3.3 units and for patients 6.6 units. The median greatest interobserver difference in measurements obtained for normal volunteers was 8.8 units (8.4-23.0 units) and for patients 11.1 units (7.1-40.8 units). Conclusion - Within session reproducibility of the measurements of background fundus autofluorescence was satisfactory. Although interobserver reproducibility was moderate, the variability of the measurements of fundus autofluorescence between observers appears to be small when compared with variation in fundus autofluorescence with age and disease.

Reproducibility of optic disk topographic measurements with the Topcon ImageNet and the Heidelberg Retina Tomograph

Objective: To compare the reproducibility of optic disk measurements provided by an image analyzer and a scanning laser tomograph. Methods: Ten images of the same eye of 10 normal volunteers were taken with the Heidelberg Retina Tomograph and with the Topcon ImageNet. Intraclass correlation coefficient (ICC) and coefficient of variation (CV) were used to evaluate the reproducibility of the measurements. Results: Eleven parameters were analyzed with the Topcon ImageNet. Six parameters (55%) had ICC greater than 90%. Four parameters (36%) had CV less than 10%. Twelve parameters were evaluated with the Heidelberg Retina Tomograph. Nine parameters (75%) had ICC over 90%. Nine parameters (75%) had CV less than 10%. Conclusion: Both systems provided reproducible data. The optic disk parameters provided by the Heidelberg Retina Tomograph had a better reproducibility than those obtained from the Topcon ImageNet.

Evaluation of in Situ DGT Measurements for Predicting the Concentration of Cd in Chinese Field-Cultivated Rice: Impact of Soil Cd:Zn Ratios

DGT (diffusive gradients in thin-films) has been proposed as a tool for predicting Cd concentrations in rice grain, but there is a lack of authenticating data. To further explore the relationship between DGT measured Cd and concentrations in rice cultivated in challenging, metal degraded, field locations with different heavy metal pollutant sources, 77 paired soil and grain samples were collected in Southern China from industrial zones, a "cancer village" impacted by mining waste and an organic farm. In situ deployments of DGT in flooded paddy rice rhizospheres were compared with a laboratory DGT assay on dried and rewetted soil. Total soil concentrations were a very poor predictor of plant uptake. Laboratory and field deployed DGT assays and porewater measurements were linearly related to grain concentrations in all but the most contaminated samples where plant toxicity occurred. The laboratory DGT assay was the best predictor of grain Cd concentrations, accommodating differences in soil Cd, pollutant source, and Cd:Zn ratios. Field DGT measurements showed that Zn availability in the flooded rice rhizospheres was greatly diminished compared to that of Cd, resulting in very high Cd:Zn ratios (0.1) compared to commonly observed values (0.005). These results demonstrate the potential of the DGT technique to predict Cd concentrations in field cultivated rice and demonstrate its robustness in a range of environments. Although, field deployments provided important details about in situ element stoichiometry, due to the inherent heterogeneity of the rice rhizosphere soils, deployment of DGT in dried and homogenized soils offers the best possibility of a soil screening tool.