Reproducibility and accuracy of the ICDAS-II for occlusal caries detection

OBJECTIVES: The aim of this in vitro study was to assess the inter- and intra-examiner reproducibility and the accuracy of the International Caries Detection and Assessment System-II (ICDAS-II) in detecting occlusal caries. METHODS: One hundred and sixty-three molars were independently assessed twice by two experienced dentists using the 0- to 6-graded ICDAS-II. The teeth were histologically prepared and classified using two different histological systems [Ekstrand et al. (1997) Caries Research vol. 31, pp. 224-231; Lussi et al. (1999) Caries Research vol. 33, pp. 261-266] and assessed for caries extension. Sensitivity, specificity, accuracy and area under the ROC curve (A(z)) were obtained at D(2) and D(3) thresholds. Unweighted kappa coefficient was used to assess inter- and intra-examiner reproducibility. RESULTS: For the Ekstrand et al. histological classification the sensitivity was 0.99 and 1.00, specificity 1.00 and 0.69 and accuracy 0.99 and 0.76 at D(2) and D(3), respectively. For the Lussi et al. histological classification the sensitivity was 0.91 and 0.75, specificity 0.47 and 0.62 and accuracy 0.86 and 0.68 at D(2) and D(3), respectively. The A(z) varied from 0.54 to 0.73. The inter- and intra-examiner kappa values were 0.51 and 0.58, respectively. CONCLUSIONS: ICDAS-II presented good reproducibility and accuracy in detecting occlusal caries, especially caries lesions in the outer half of the enamel.

In vitro comparison of laser fluorescence performance with visual examination for detection of occlusal caries in permanent and primary molars

The aim of this study was to compare the performance of the DIAGNOdent 2095 with visual examination for occlusal caries detection in permanent and primary molars. The sample comprised 148 permanent human molars and 179 primary human molars. The samples were measured and visually examined three times by two examiners. After measurement, the teeth were histologically prepared and assessed for caries extension. Sensitivity, specificity, accuracy and area under the receiver operating characteristics (ROC) curve were calculated. Intra-class correlation (ICC), unweighted kappa and the Bland and Altman method were used to assess inter- and intra-examiner reproducibility. DIAGNOdent showed higher specificity and lower sensitivity than did visual examination. The ICC values indicated an excellent agreement between the examinations. Kappa values varied from good to excellent for DIAGNOdent but from poor to good for visual examination. In conclusion, the DIAGNOdent may be a useful adjunct to conventional methods for occlusal caries detection.

In situ and in vitro comparison of laser fluorescence with visual inspection in detecting occlusal caries lesions

The aim of this study was to compare the in situ and in vitro performances of a laser fluorescence (LF) device (DIAGNOdent 2095) with visual inspection for the detection of occlusal caries in permanent teeth. Sixty-four sites were selected, and visual inspection and LF assessments were carried out, in vitro, three times by two independent examiners, with a 1-week interval between evaluations. Afterwards, the occlusal surfaces were mounted on the palatal portion of removable acrylic orthodontic appliances and placed in six volunteers. Assessments were repeated and validated by histological analysis of the tooth sections under a stereomicroscope. For both examiners, the highest intra-examiner values were observed for the visual inspection when in vitro and in situ evaluations were compared. The inter-examiner reproducibility varied from 0.61 to 0.64, except for the in vitro assessment using LF, which presented a lower value (0.43). The methods showed high specificity at the D(1) threshold (considering enamel and dentin caries as disease). In vitro evaluations showed the highest values of sensitivity for both methods when compared to the in situ evaluations at D(1) and D(2) (considering only dentinal caries as the disease) thresholds. For both methods, the results of sensitivity (at D(1) and D(2)) and accuracy (at D(1)) showed significant differences between in vitro and in situ conditions. However, the sensitivity (at D(1) and D(2)), specificity and accuracy (both at D(1)) of the methods were not significantly different when the same condition was considered. It can be concluded that visual inspection and LF showed better performance in vitro than in situ.

A multi-center study: Intra-scan and inter-scan variability of diffusion spectrum imaging

The objective of this study was to investigate whether it is possible to pool together diffusion spectrum imaging data from four different scanners, located at three different sites. Two of the scanners had identical configuration whereas two did not. To measure the variability, we extracted three scalar maps (ADC, FA and GFA) from the DSI and utilized a region and a tract-based analysis. Additionally, a phantom study was performed to rule out some potential factors arising from the scanner performance in case some systematic bias occurred in the subject study. This work was split into three experiments: intra-scanner reproducibility, reproducibility with twin-scanner settings and reproducibility with other configurations. Overall for the intra-scanner and twin-scanner experiments, the region-based analysis coefficient of variation (CV) was in a range of 1%-4.2% and below 3% for almost every bundle for the tract-based analysis. The uncinate fasciculus showed the worst reproducibility, especially for FA and GFA values (CV 3.7-6%). For the GFA and FA maps, an ICC value of 0.7 and above is observed in almost all the regions/tracts. Looking at the last experiment, it was found that there is a very high similarity of the outcomes from the two scanners with identical setting. However, this was not the case for the two other imagers. Given the fact that the overall variation in our study is low for the imagers with identical settings, our findings support the feasibility of cross-site pooling of DSI data from identical scanners.

Development and validation of a liquid chromatography-tandem mass spectrometry method for the simultaneous determination of nine corticosteroid residues in bovine liver samples

A liquid chromatography tandem mass spectrometry (LC-MS/MS) confirmatory method for the simultaneous determination of nine corticosteroids in liver, including the four MRL compounds listed in Council Regulation 37/2010, was developed. After an enzymatic deconjugation and a solvent extraction of the liver tissue, the resulting solution was cleaned up through an SPE Oasis HLB cartridge. The analytes were then detected by liquid chromatography-negative-ion electrospray tandem mass spectrometry, using deuterium-labelled internal standards. The procedure was validated as a quantitative confirmatory method according to the Commission Decision 2002/657/EC criteria. The results showed that the method was suitable for statutory residue testing regarding the following performance characteristics: instrumental linearity, specificity, precision (repeatability and intra-laboratory reproducibility), recovery, decision limit (CCα), detection capability (CCβ) and ruggedness. All the corticosteroids can be detected at a concentration around 1 μg kg(-1); the recoveries were above 62% for all the analytes. Repeatability and reproducibility (within-laboratory reproducibility) for all the analytes were below 7.65% and 15.5%, respectively.

Accuracy and consistency of the visual diagnosis of exposed dentine on worn occlusal/incisal surfaces

Most indices for the assessment of wear of various aetiologies include the distinction between 'enamel still present' and 'dentine exposed' for grading. Since the visual diagnosis of exposed dentine has not yet been validated, the present study is a first attempt to investigate its accuracy and consistency. Sixty-one examiners (23 scientists, 18 university dentists and 20 dental students) were asked to diagnose 49 tooth areas with different grades of wear and to decide whether dentine was exposed (positive test) or not (negative test). Afterwards, the teeth were histologically evaluated. In 44 areas, dentine (also in all cases with minor wear) was exposed, and in 5 areas enamel was present. Overall sensitivity was 0.65, specificity 0.88 and the proportion of correct diagnoses was 0.67. The diagnosis 'dentine is exposed' was about 5 times as likely and the diagnosis 'dentine is not exposed' half as likely to come from an area with exposed dentine than from an enamel-covered area. The closeness of the visual diagnosis to the histological findings was only fair (kappa=0.27), no significant impact of professional experience was found. For inter- and intra-examiner agreement, kappa was 0.28 and 0.55, respectively. It was concluded that the diagnosis of exposed dentine is difficult.

Performance of a new laser fluorescence device for the detection of occlusal caries in vitro

The new device DIAGNOdent pen based on red laser light induced fluorescence was introduced for the detection of approximal and occlusal caries. The aim of this study was to test its performance on occlusal surfaces. The new device comes with two different sapphire fibre tips: a cylindrical tip and a conical tip. The two new sapphire fibre tips were used and compared with the tip currently available with DIAGNOdent (DD). METHODS: The teeth were selected from a pool of extracted permanent human molars, which were stored frozen at -20 degrees C, until use. Prior to being measured the teeth were defrosted and cleaned. One hundred and nineteen teeth were selected and measured with the old tip and with the two new tips of the new device by two independent assessments. The teeth were histologically prepared and assessed for caries extension. RESULTS: Specificity values for D(1), D(2) and D(3) ranged between 0.69 and 0.89, sensitivity between 0.78 and 0.96. There were no statistically significant differences obtained between the two tips of the new and the one tip of the old device (p>0.05). Intra-examiner reliability with kappa values of >0.83 was high. CONCLUSIONS: In this study, the new laser fluorescence device performed on occlusal surfaces as well as the available device.

Evaluation of the maxillary sinus in panoramic radiography—a comparative study

Background: The aim of this study was to evaluate the validity and the inter- and intra-examiner reliability of panoramic-radiograph-driven findings of different maxillary sinus anatomic variations and pathologies, which had initially been prediagnosed by cone beam computed tomography (CBCT). Methods: After pairs of two-dimensional (2D) panoramic and three-dimensional (3D) CBCT images of patients having received treatment at the outpatient department had been screened, the predefinition of 54 selected maxillary sinus conditions was initially performed on CBCT images by two blinded consultants individually using a questionnaire that defined ten different clinically relevant findings. Using the identic questionnaire, these consultants performed the evaluation of the panoramic radiographs at a later time point. The results were analyzed for inter-imaging differences in the evaluation of the maxillary sinus between 2D and 3D imaging methods. Additionally, two resident groups (first year and last year of training) performed two diagnostic runs of the panoramic radiographs and results were analyzed for inter- and intra-observer reliability. Results: There is a moderate risk for false diagnosis of findings of the maxillary sinus if only panoramic radiography is used. Based on the ten predefined conditions, solely maxillary bone cysts penetrating into the sinus were frequently detected differently comparing 2D to 3D diagnostics. Additionally, on panoramic radiographs, the inter-observer comparison demonstrated that basal septa were significantly often rated differently and the intra-observer comparison showed a significant lack in reliability in detecting maxillary bone cysts penetrating into the sinus. Conclusions: Panoramic radiography provides the most information on the maxillary sinus, and it may be an adequate imaging method. However, particular findings of the maxillary sinus in panoramic imaging may be based on a rather examiner-dependent assessment. Therefore, a persistent and precise evaluation of specific conditions of the maxillary sinus may only be possible using CBCT because it provides additional information compared to panoramic radiography. This might be relevant for consecutive surgical procedures; consequently, we recommend CBCT if a precise preoperative evaluation is mandatory. However, higher radiation dose and costs of 3D imaging need to be considered. Keywords: Panoramic radiography; Cone beam computed tomography; Maxillary sinus; Inter-imaging method differences; Inter-examiner reliability; Intra-examiner reliability

Influence of examiner's clinical experience on the reproducibility and accuracy of radiographic examination in detecting occlusal caries

The aim of this in vitro study was to assess the influence of varying examiner's clinical experience on the reproducibility and accuracy of radiographic examination for occlusal caries detection. Standardized bitewing radiographs were obtained from 166 permanent molars. Radiographic examination was performed by final-year dental students from two universities (A, n = 5; B, n = 5) and by dentists with 5 to 7 years of experience who work in two different countries (C, n = 5; D, n = 5). All examinations were repeated after 1-week interval. The teeth were histologically prepared and assessed for caries extension. For intraexaminer reproducibility, the unweighted kappa values were: A (0.11-0.40), B (0.12-0.33), C (0.47-0.58), and D (0.42-0.71). Interexaminer reproducibility statistics were computed based on means ± SD of unweighted kappa values: A (0.07 ± 0.05), B (0.12 ± 0.09), C (0.24 ± 0.08), and D (0.33 ± 0.10). Sensitivity, specificity, and accuracy were calculated at D(1) and D(3) thresholds and compared by performing McNemar test (p = 0.05). D(1) sensitivity ranged between 0.29 and 0.75 and specificity between 0.24 and 0.85. D(3) specificity was moderate to high (between 0.62 and 0.95) for all groups, with statistically significant difference between the dentists groups (C and D). Sensitivity was low to moderate (between 0.21 and 0.57) with statistically significant difference for groups B and D. Accuracy was similar for all groups (0.55). Spearman's correlations were: A (0.12), B (0.24), C (0.30), and D (0.38). In conclusion, the reproducibility of radiographic examination was influenced by the examiner's clinical experience, training, and dental education as well as the accuracy in detecting occlusal caries.

Reproducibility and validity of video screen measurements of gait in children with spastic cerebral palsy

PURPOSE: To determine the reproducibility and validity of video screen measurement (VSM) of sagittal plane joint angles during gait. METHODS: 17 children with spastic cerebral palsy walked on a 10m walkway. Videos were recorded and 3d-instrumented gait analysis was performed. Two investigators measured six sagittal joint/segment angles (shank, ankle, knee, hip, pelvis, and trunk) using a custom-made software package. The intra- and interrater reproducibility were expressed by the intraclass correlation coefficient (ICC), standard error of measurements (SEM) and smallest detectable difference (SDD). The agreement between VSM and 3d joint angles was illustrated by Bland-Altman plots and limits of agreement (LoA). RESULTS: Regarding the intrarater reproducibility of VSM, the ICC ranged from 0.99 (shank) to 0.58 (trunk), the SEM from 0.81 degrees (shank) to 5.97 degrees (trunk) and the SDD from 1.80 degrees (shank) to 16.55 degrees (trunk). Regarding the interrater reproducibility, the ICC ranged from 0.99 (shank) to 0.48 (trunk), the SEM from 0.70 degrees (shank) to 6.78 degrees (trunk) and the SDD from 1.95 degrees (shank) to 18.8 degrees (trunk). The LoA between VSM and 3d data ranged from 0.4+/-13.4 degrees (knee extension stance) to 12.0+/-14.6 degrees (ankle dorsiflexion swing). CONCLUSION: When performed by the same observer, VSM mostly allows the detection of relevant changes after an intervention. However, VSM angles differ from 3d-IGA and do not reflect the real sagittal joint position, probably due to the additional movements in the other planes.

Reproducibility and day time bias correction of optoelectronic leg volumetry: a prospective cohort study

Background Leg edema is a common manifestation of various underlying pathologies. Reliable measurement tools are required to quantify edema and monitor therapeutic interventions. Aim of the present work was to investigate the reproducibility of optoelectronic leg volumetry over 3 weeks' time period and to eliminate daytime related within-individual variability. Methods Optoelectronic leg volumetry was performed in 63 hairdressers (mean age 45 ± 16 years, 85.7% female) in standing position twice within a minute for each leg and repeated after 3 weeks. Both lower leg (legBD) and whole limb (limbBF) volumetry were analysed. Reproducibility was expressed as analytical and within-individual coefficients of variance (CVA, CVW), and as intra-class correlation coefficients (ICC). Results A total of 492 leg volume measurements were analysed. Both legBD and limbBF volumetry were highly reproducible with CVA of 0.5% and 0.7%, respectively. Within-individual reproducibility of legBD and limbBF volumetry over a three weeks' period was high (CVW 1.3% for both; ICC 0.99 for both). At both visits, the second measurement revealed a significantly higher volume compared to the first measurement with a mean increase of 7.3 ml ± 14.1 (0.33% ± 0.58%) for legBD and 30.1 ml ± 48.5 ml (0.52% ± 0.79%) for limbBF volume. A significant linear correlation between absolute and relative leg volume differences and the difference of exact day time of measurement between the two study visits was found (P < .001). A therefore determined time-correction formula permitted further improvement of CVW. Conclusions Leg volume changes can be reliably assessed by optoelectronic leg volumetry at a single time point and over a 3 weeks' time period. However, volumetry results are biased by orthostatic and daytime-related volume changes. The bias for day-time related volume changes can be minimized by a time-correction formula.

Non-invasive monitoring of renal oxygenation using BOLD-MRI: a reproducibility study

Blood oxygenation level-dependent (BOLD) MRI was shown to allow non-invasive observation of renal oxygenation in humans. However, clinical applications of this type of functional MRI of the kidney are still limited, most likely because of difficulties in obtaining reproducible and reliable information. The aim of this study was to evaluate the reproducibility and robustness of a BOLD method applied to the kidneys and to identify systematic physiological changes potentially influencing the renal oxygenation of healthy volunteers. To measure the BOLD effect, a modified multi-echo data image combination (MEDIC) sequence was used to acquire 12 T2*-weighted images within a single breath-hold. Three identical measurements were performed on three axial and three coronal slices of right and left kidneys in 18 volunteers. The mean R2* (1/T2*) values determined in medulla and cortex showed no significant differences over three repetitions and low intra-subject coefficients of variation (CV) (3 and 4% in medulla and cortex, respectively). The average R2* values were higher in the medulla (16.15 +/- 0.11) than in the cortex (11.69 +/- 0.18) (P < 0.001). Only a minor influence of slice orientation was observed. Mean R2* values were slightly higher (3%) in the left than in the right kidney (P < 0.001). Differences between volunteers were identified (P < 0.001). Part of these differences was attributable to age-dependent R2* values, since these values increased with age when medulla (P < 0.001, r = 0.67) or cortex (P < 0.020, r = 0.42) were considered. Thus, BOLD measurements in the kidney are highly reproducible and robust. The results allow one to identify the known cortico-medullary gradient of oxygenation evidenced by the gradient of R2* values and suggest that medulla is more hypoxic in older than younger individuals. BOLD-MRI is therefore a useful tool to study sequentially and non-invasively regional oxygenation of human kidneys.

Assessing the intra- and inter-reader reliability of dynamic ultrasound images in power Doppler ultrasonography

OBJECTIVE: To assess the intra-reader and inter-reader reliabilities of interpreting ultrasonography by several experts using video clips. METHOD: 99 video clips of healthy and rheumatic joints were recorded and delivered to 17 physician sonographers in two rounds. The intra-reader and inter-reader reliabilities of interpreting the ultrasound results were calculated using a dichotomous system (normal/abnormal) and a graded semiquantitative scoring system. RESULTS: The video reading method worked well. 70% of the readers could classify at least 70% of the cases correctly as normal or abnormal. The distribution of readers answering correctly was wide. The most difficult joints to assess were the elbow, wrist, metacarpophalangeal (MCP) and knee joints. The intra-reader and inter-reader agreements on interpreting dynamic ultrasound images as normal or abnormal, as well as detecting and scoring a Doppler signal were moderate to good (kappa = 0.52-0.82). CONCLUSIONS: Dynamic image assessment (video clips) can be used as an alternative method in ultrasonography reliability studies. The intra-reader and inter-reader reliabilities of ultrasonography in dynamic image reading are acceptable, but more definitions and training are needed to improve sonographic reproducibility.

Reproducibility of dGEMRIC in assessment of hip joint cartilage: a prospective study

PURPOSE: To investigate the reproducibility of dGEMRIC in the assessment of cartilage health of the adult asymptomatic hip joint. MATERIALS AND METHODS: Fifteen asymptomatic volunteers (mean age, 26.3 years +/- 3.0) were preliminarily studied. Any volunteer that was incidentally diagnosed with damaged cartilage on MRI (n = 5) was excluded. Ten patients that had no evidence of prior cartilage damage (mean age, 26.2 years +/- 3.4) were evaluated further in this study. The reproducibility of dGEMRIC was assessed with two T1(Gd) exams performed 4 weeks apart in these volunteers. The protocol involved an initial standard MRI to confirm healthy cartilage, which was then followed by dGEMRIC. The second scan included only the repeat dGEMRIC. Region of interest (ROI) analyses for T1(Gd)-measurement was performed in seven radial reformats. Statistical analysis included the student's t-test and intra-class correlation (ICC) measurement to assess reproducibility. RESULTS: Overall 70 ROIs were studied. Mean cartilage T1(Gd) values at various loci ranged from 560.9 ms to 684.4 ms at the first set of readings and 551.5 ms to 662.2 ms in the second one. The mean difference per region of interest between the two T1(Gd)-measurements ranged from 21.4 ms (3.7%) to 45.0 ms (6.8%), which was not found to be statistically significant (P = 0.153). There was a high reproducibility detected (ICC range, 0.667-0.915). Intra- and Inter-observer analyses proved a high agreement for T1(Gd) assessment (0.973 and 0.932). CONCLUSION: We found dGEMRIC to be a reliable tool in the assessment of cartilage health status in adult hip joints.

Reproducibility of retinal thickness measurements in healthy subjects using spectralis optical coherence tomography

PURPOSE: To test the reproducibility of retinal thickness measurements in healthy volunteers of a new Frequency-domain optical coherence tomography (OCT) device (Spectralis OCT; Heidelberg Engineering, Heidelberg, Germany). DESIGN: Prospective, observational study. METHODS: Forty-one eyes of 41 healthy subjects were included into the study. Intraobserver reproducibility was tested with 20 x 15 degree raster scans consisting of 37 high-resolution line scans that were repeated three times by one examiner (M.N.M.). Mean retinal thickness was calculated for nine areas corresponding to the Early Treatment Diabetic Retinopathy Study (ETDRS) areas. Coefficients of variation (COV) were calculated. RESULTS: Retinal thickness measurements were highly reproducible for all ETDRS areas. Mean total retinal thickness was 342 +/- 15 microm. Mean foveal thickness was 286 +/- 17 microm. COVs ranged from 0.38% to 0.86%. Lowest COV was found for the temporal outer ETDRS area (area 7; COV, 0.38%). Highest COV was found for the temporal inner ETDRS area (area 3; COV, 0.86%). Mean difference between measurement 1 and 2, measurement 1 and 3, and measurement 2 and 3 for all ETDRS areas was 1.01 microm, 0.98 microm, and 0.99 microm, respectively. CONCLUSION: Spectralis OCT retinal thickness measurements in healthy volunteers showed excellent intraobserver reproducibility with virtually identical results between retinal thickness measurements performed by one operator.