Validation of standard surface reproducibility. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

Reproducibility and accuracy of echocardiographic measurements of left ventricular parameters using real-time three-dimensional echocardiography

OBJECTIVES We sought to determine whether assessment of left ventricular (LV) function with real-time (RT) three-dimensional echocardiography (3DE) could reduce the variation of sequential LV measurements and provide greater accuracy than two-dimensional echocardiography (2DE). BACKGROUND Real-time 3DE has become feasible as a standard clinical tool, but its accuracy for LV assessment has not been validated. METHODS Unselected patients (n = 50; 41 men; age, 64 +/- 8 years) presenting for evaluation of LV function were studied with 2DE and RT-3DE. Test-retest variation was performed by a complete restudy by a separate sonographer within 1 h without alteration of hemodynamics or therapy. Magnetic resonance imaging (MRI) images were obtained during a breath-hold, and measurements were made off-line. RESULTS The test-retest variation showed similar measurements for volumes but wider scatter of LV mass measurements with M-mode and 2DE than 3DE. The average MRI end-diastolic volume was 172 +/- 53 ml; LV volumes were underestimated by 2DE (mean difference, -54 +/- 33; p < 0.01) but only slightly by RT-3DE (-4 +/- 29; p = 0.31). Similarly, end-systolic volume by MRI (91 +/- 53 ml) was underestimated by 2DE (mean difference, -28 +/- 28; p < 0.01) and by RT-3DE (mean difference, -3 +/- 18; p = 0.23). Ejection fraction by MRI was similar by 2DE (p = 0.76) and RT-3DE (p = 0.74). Left ventricular mass (183 +/- 50 g) was overestimated by M-mode (mean difference, 68 +/- 86 g; p < 0.01) and 2DE (16 +/- 57; p = 0.04) but not RT-3DE (0 +/- 38 g; p = 0.94). There was good inter- and intra-observer correlation between RT-3DE by two sonographers for volumes, ejection fraction, and mass. CONCLUSIONS Real-time 3DE is a feasible approach to reduce test-retest variation of LV volume, ejection fraction, and mass measurements in follow-up LV assessment in daily practice. (C) 2004 by the American College of Cardiology Foundation.

Reproducibility-repeatability of choroidal thickness calculation using optical coherence tomography

Purpose. To evaluate the repeatability and reproducibility of subfoveal choroidal thickness (CT) calculations performed manually using optical coherence tomography (OCT). Methods. The CT was imaged in vivo at each of two visits on 11 healthy volunteers (mean age, 35.72 ± 13.19 years) using the spectral domain OCT. CT was manually measured after applying ImageJ processing filters on 15 radial subfoveal scans. Each radial scan was spaced 12° from each other and contained 2500 A-scans. The coefficient of variability, coefficient of repeatability (CoR), coefficient of reproducibility, and intraclass correlation coefficient determined the reproducibility and repeatability of the calculation. Axial length (AL) and mean spherical equivalent refractive error were measured with the IOLMaster and an open view autorefractor to study their potential relationship with CT. Results. The within-visit and between-visit coefficient of variability, CoR, coefficient of reproducibility, and intraclass correlation coefficient were 0.80, 2.97% 2.44%, and 99%, respectively. The subfoveal CT correlated significantly with AL (R = -0.60, p = 0.05). Conclusions. The subfoveal CT could be measured manually in vivo using OCT and the readings obtained from the healthy subjects evaluated were repeatable and reproducible. It is proposed that OCT could be a useful instrument to perform in vivo assessment and monitoring of CT changes in retinal disease. The preliminary results suggest a negative correlation between subfoveal CT and AL in such a way that it decreases with increasing AL but not with refractive error.

Reproducibility and repeatability of the OcuSense TearLab™ osmometer

BACKGROUND: Some studies report that increased tear osmolarity is a reliable indicator of dry eye syndrome (DES). The OcuSense TearLab™ osmometer requires less than a 100-nl sample of tears and provides an instant quantitative result. Our aim was to clinically evaluate this instrument in terms of its reproducibility and repeatability. METHODS: Twenty-nine participants who ranged in age from 19 to 49 years (mean?±?SD: 23.3?±?5.5 years) were recruited. Osmolarity readings were collected by two operators, in two sessions separated by 1 or 2 weeks in order to assess test reproducibility and repeatability. RESULTS: The coefficient of reproducibility was 39 mOsms/l; the coefficient of repeatability was 33 mOsms/l. CONCLUSIONS: Our mean coefficient of variation over four readings for 29 subjects is 2.9%, which compares well with that reported by the manufacturer. Our results inform practitioners about the level of change over time that can be considered clinically relevant for healthy subjects. This value is 33mOsms/l; any change smaller than this could be attributed to measurement noise.

Retinal vessel analysis:flicker reproducibility, methodological standardisations and practical limitations

The Retinal Vessel Analyser (RVA) is a commercially available ophthalmoscopic instrument capable of acquiring vessel diameter fluctuations in real time and in high temporal resolution. Visual stimulation by means of flickering light is a unique exploration tool of neurovascular coupling in the human retina. Vessel reactivity as mediated by local vascular endothelial vasodilators and vasoconstrictors can be assessed non-invasively, in vivo. In brief, the work in this thesis • deals with interobserver and intraobserver reproducibility of the flicker responses in healthy volunteers • explains the superiority of individually analysed reactivity parameters over vendorgenerated output • links in static retinal measures with dynamic ones • highlights practical limitations in the use of the RVA that may undermine its clinical usefulness • provides recommendations for standardising measurements in terms of vessel location and vessel segment length and • presents three case reports of essential hypertensives in a -year follow-up. Strict standardisation of measurement procedures is a necessity when utilising the RVA system. Agreement between research groups on implemented protocols needs to be met, before it could be considered a clinically useful tool in detecting or predicting microvascular dysfunction.

samExploreR: exploring reproducibility and robustness of RNA-seq results based on SAM files

MOTIVATION: Data from RNA-seq experiments provide us with many new possibilities to gain insights into biological and disease mechanisms of cellular functioning. However, the reproducibility and robustness of RNA-seq data analysis results is often unclear. This is in part attributed to the two counter acting goals of (a) a cost efficient and (b) an optimal experimental design leading to a compromise, e.g., in the sequencing depth of experiments.

RESULTS: We introduce an R package called samExploreR that allows the subsampling (m out of n bootstraping) of short-reads based on SAM files facilitating the investigation of sequencing depth related questions for the experimental design. Overall, this provides a systematic way for exploring the reproducibility and robustness of general RNA-seq studies. We exemplify the usage of samExploreR by studying the influence of the sequencing depth and the annotation on the identification of differentially expressed genes.

AVAILABILITY: Availability: samExploreR is available as an R package from Bioconductor (after acceptance of the paper, download link: http://www.bio-complexity.com/samExploreR_1.0.0.tar.gz).

Multiple training interventions significantly improve reproducibility of PET/CT-based lung cancer radiotherapy target volume delineation using an IAEA study protocol

BACKGROUND AND PURPOSE: To assess the impact of a standardized delineation protocol and training interventions on PET/CT-based target volume delineation (TVD) in NSCLC in a multicenter setting.

MATERIAL AND METHODS: Over a one-year period, 11 pairs, comprised each of a radiation oncologist and nuclear medicine physician with limited experience in PET/CT-based TVD for NSCLC from nine different countries took part in a training program through an International Atomic Energy Agency (IAEA) study (NCT02247713). Teams delineated gross tumor volume of the primary tumor, during and after training interventions, according to a provided delineation protocol. In-house developed software recorded the performed delineations, to allow visual inspection of strategies and to assess delineation accuracy.

RESULTS: Following the first training, overall concordance indices for 3 repetitive cases increased from 0.57±0.07 to 0.66±0.07. The overall mean surface distance between observer and expert contours decreased from -0.40±0.03 cm to -0.01±0.33 cm. After further training overall concordance indices for another 3 repetitive cases further increased from 0.64±0.06 to 0.80±0.05 (p=0.01). Mean surface distances decreased from -0.34±0.16 cm to -0.05±0.20 cm (p=0.01).

CONCLUSION: Multiple training interventions improve PET/CT-based TVD delineation accuracy in NSCLC and reduces interobserver variation.

Myocardial blood flow quantification by Rb-82 cardiac PET/CT: A detailed reproducibility study between two semi-automatic analysis programs.

BACKGROUND: Several analysis software packages for myocardial blood flow (MBF) quantification from cardiac PET studies exist, but they have not been compared using concordance analysis, which can characterize precision and bias separately. Reproducible measurements are needed for quantification to fully develop its clinical potential. METHODS: Fifty-one patients underwent dynamic Rb-82 PET at rest and during adenosine stress. Data were processed with PMOD and FlowQuant (Lortie model). MBF and myocardial flow reserve (MFR) polar maps were quantified and analyzed using a 17-segment model. Comparisons used Pearson's correlation ρ (measuring precision), Bland and Altman limit-of-agreement and Lin's concordance correlation ρc = ρ·C b (C b measuring systematic bias). RESULTS: Lin's concordance and Pearson's correlation values were very similar, suggesting no systematic bias between software packages with an excellent precision ρ for MBF (ρ = 0.97, ρc = 0.96, C b = 0.99) and good precision for MFR (ρ = 0.83, ρc = 0.76, C b = 0.92). On a per-segment basis, no mean bias was observed on Bland-Altman plots, although PMOD provided slightly higher values than FlowQuant at higher MBF and MFR values (P < .0001). CONCLUSIONS: Concordance between software packages was excellent for MBF and MFR, despite higher values by PMOD at higher MBF values. Both software packages can be used interchangeably for quantification in daily practice of Rb-82 cardiac PET.

DEVELOPMENT AND REPRODUCIBILITY OF THE INSTRUMENTO DE AVALIAÇÃO DA PROMOÇÃO DA SAÚDE NA UNIVERSIDADE - IAPSU (ASSESSMENT TOOL FOR HEALTH PROMOTION AT THE UNIVERSITY)

Objective: To present the Instrumento de Avaliação da Promoção da Saúde na Universidade – IAPSU (Assessment Tool for Health Promotion at the University) and its reproducibility assessment process. Methods: Cross-sectional study conducted between May and July 2014 with 50 students from a university of Fortaleza, Ceará, which developed the IAPSU through the analysis of government documents and a systematic review of the literature on a potentially healthy university. The tool has 41 questions divided into five domains: physical activity, diet, environmental factors, psychosocial factors and alcohol and drug use, integrative and complementary practices. To assess the inter-examiner reproducibility, the students answered the IAPSU twice, applied by two different examiners; to assess the intraexaminer reproducibility, another application of the instrument was performed after seven days. Results: The study comprised 40 Nursing students and 10 Physical Therapy students, with a mean age of 25 ± 5.4 years; 88% were women and white individuals were predominant. In the reproducibility assessment, strong intraclass, intra- and inter-examiner correlation coefficients - above 0.8 - were observed in all the domains. Conclusion: The IAPSU is a reproducible and reliable instrument for assessing health promotion at the university.