Comparison among gold standard techniques used for the validation of methods for occlusal caries detection

The aim of this in vitro study was to assess the agreement among four techniques used as gold standard for the validation of methods for occlusal caries detection. Sixty-five human permanent molars were selected and one site in each occlusal surface was chosen as the test site. The teeth were cut and prepared according to each technique: stereomicroscopy without coloring (1), dye enhancement with rhodamine B (2) and fuchsine/acetic light green (3), and semi-quantitative microradiography (4). Digital photographs from each prepared tooth were assessed by three examiners for caries extension. Weighted kappa, as well as Friedman's test with multiple comparisons, was performed to compare all techniques and verify statistical significant differences. Results: kappa values varied from 0.62 to 0.78, the latter being found by both dye enhancement methods. Friedman's test showed statistical significant difference (P < 0.001) and multiple comparison identified these differences among all techniques, except between both dye enhancement methods (rhodamine B and fuchsine/acetic light green). Cross-tabulation showed that the stereomicroscopy overscored the lesions. Both dye enhancement methods showed a good agreement, while stereomicroscopy overscored the lesions. Furthermore, the outcome of caries diagnostic tests may be influenced by the validation method applied. Dye enhancement methods seem to be reliable as gold standard methods.

In Vitro and In Vivo Validation of Human and Goat Chondrocyte Labeling by Green Fluorescent Protein Lentivirus Transduction

We investigated whether human articular chondrocytes can be labeled efficiently and for long-term with a green fluorescent protein (GFP) lentivirus and whether the viral transduction would influence cell proliferation and tissue-forming capacity. The method was then applied to track goat articular chondrocytes after autologous implantation in cartilage defects. Expression of GFP in transduced chondrocytes was detected cytofluorimetrically and immunohistochemically. Chondrogenic capacity of chondrocytes was assessed by Safranin-O staining, immunostaining for type II collagen, and glycosaminoglycan content. Human articular chondrocytes were efficiently transduced with GFP lentivirus (73.4 +/- 0.5% at passage 1) and maintained the expression of GFP up to 22 weeks of in vitro culture after transduction. Upon implantation in nude mice, 12 weeks after transduction, the percentage of labeled cells (73.6 +/- 3.3%) was similar to the initial one. Importantly, viral transduction of chondrocytes did not affect the cell proliferation rate, chondrogenic differentiation, or tissue-forming capacity, either in vitro or in vivo. Goat articular chondrocytes were also efficiently transduced with GFP lentivirus (78.3 +/- 3.2%) and maintained the expression of GFP in the reparative tissue after orthotopic implantation. This study demonstrates the feasibility of efficient and relatively long-term labeling of human chondrocytes for co-culture on integration studies, and indicates the potential of this stable labeling technique for tracking animal chondrocytes for in cartilage repair studies.

Development and validation of a paediatric long-bone fracture classification. A prospective multicentre study in 13 European paediatric trauma centres

BACKGROUND: The aim of this study was to develop a child-specific classification system for long bone fractures and to examine its reliability and validity on the basis of a prospective multicentre study. METHODS: Using the sequentially developed classification system, three samples of between 30 and 185 paediatric limb fractures from a pool of 2308 fractures documented in two multicenter studies were analysed in a blinded fashion by eight orthopaedic surgeons, on a total of 5 occasions. Intra- and interobserver reliability and accuracy were calculated. RESULTS: The reliability improved with successive simplification of the classification. The final version resulted in an overall interobserver agreement of κ = 0.71 with no significant difference between experienced and less experienced raters. CONCLUSIONS: In conclusion, the evaluation of the newly proposed classification system resulted in a reliable and routinely applicable system, for which training in its proper use may further improve the reliability. It can be recommended as a useful tool for clinical practice and offers the option for developing treatment recommendations and outcome predictions in the future.

Validation of the Asthma Predictive Index and comparison with simpler clinical prediction rules

Background The loose and stringent Asthma Predictive Indices (API), developed in Tucson, are popular rules to predict asthma in preschool children. To be clinically useful, they require validation in different settings. Objective To assess the predictive performance of the API in an independent population and compare it with simpler rules based only on preschool wheeze. Methods We studied 1954 children of the population-based Leicester Respiratory Cohort, followed up from age 1 to 10 years. The API and frequency of wheeze were assessed at age 3 years, and we determined their association with asthma at ages 7 and 10 years by using logistic regression. We computed test characteristics and measures of predictive performance to validate the API and compare it with simpler rules. Results The ability of the API to predict asthma in Leicester was comparable to Tucson: for the loose API, odds ratios for asthma at age 7 years were 5.2 in Leicester (5.5 in Tucson), and positive predictive values were 26% (26%). For the stringent API, these values were 8.2 (9.8) and 40% (48%). For the simpler rule early wheeze, corresponding values were 5.4 and 21%; for early frequent wheeze, 6.7 and 36%. The discriminative ability of all prediction rules was moderate (c statistic ≤ 0.7) and overall predictive performance low (scaled Brier score < 20%). Conclusion Predictive performance of the API in Leicester, although comparable to the original study, was modest and similar to prediction based only on preschool wheeze. This highlights the need for better prediction rules.

Validation of a single item to assess daytime sleepiness for the Swiss Transplant Cohort Study

Context-Daytime sleepiness in kidney transplant recipients has emerged as a potential predictor of impaired adherence to the immunosuppressive medication regimen. Thus there is a need to assess daytime sleepiness in clinical practice and transplant registries.Objective-To evaluate the validity of a single-item measure of daytime sleepiness integrated in the Swiss Transplant Cohort Study (STCS), using the American Educational Research Association framework.Methods-Using a cross-sectional design, we enrolled a convenience sample of 926 home-dwelling kidney transplant recipients (median age, 59.69 years; 25%-75% quartile [Q25-Q75], 50.27-59.69), 63% men; median time since transplant 9.42 years (Q25-Q75, 4.93-15.85). Daytime sleepiness was assessed by using a single item from the STCS and the 8 items of the validated Epworth Sleepiness Scale. Receiver operating characteristic curve analysis was used to determine the cutoff for the STCS daytime sleepiness item against the Epworth Sleepiness Scale score.Results-Based on the receiver operating characteristic curve analysis, a score greater than 4 on the STCS daytime sleepiness item is recommended to detect daytime sleepiness. Content validity was high as all expert reviews were unanimous. Concurrent validity was moderate (Spearman ϱ, 0.531; P< .001) and convergent validity with depression and poor sleep quality although low, was significant (ϱ, 0.235; P<.001 and ϱ, 0.318, P=.002, respectively). For the group difference validity: kidney transplant recipients with moderate, severe, and extremely severe depressive symptom scores had 3.4, 4.3, and 5.9 times higher odds of having daytime sleepiness, respectively, as compared with recipients without depressive symptoms.Conclusion-The accumulated evidence provided evidence for the validity of the STCS daytime sleepiness item as a simple screening scale for daytime sleepiness.

Collateral-flow measurements in humans by myocardial contrast echocardiography: validation of coronary pressure-derived collateral-flow assessment

AIMS: Myocardial blood flow (MBF) is the gold standard to assess myocardial blood supply and, as recently shown, can be obtained by myocardial contrast echocardiography (MCE). The aims of this human study are (i) to test whether measurements of collateral-derived MBF by MCE are feasible during elective angioplasty and (ii) to validate the concept of pressure-derived collateral-flow assessment. METHODS AND RESULTS: Thirty patients with stable coronary artery disease underwent MCE of the collateral-receiving territory during and after angioplasty of 37 stenoses. MCE perfusion analysis was successful in 32 cases. MBF during and after angioplasty varied between 0.060-0.876 mL min(-1) g(-1) (0.304+/-0.196 mL min(-1) g(-1)) and 0.676-1.773 mL min(-1) g(-1) (1.207+/-0.327 mL min(-1) g(-1)), respectively. Collateral-perfusion index (CPI) is defined as the rate of MBF during and after angioplasty varied between 0.05 and 0.67 (0.26+/-0.15). During angioplasty, simultaneous measurements of mean aortic pressure, coronary wedge pressure, and central venous pressure determined the pressure-derived collateral-flow index (CFI(p)), which varied between 0.04 and 0.61 (0.23+/-0.14). Linear-regression analysis demonstrated an excellent agreement between CFI(p) and CPI (y=0.88 x +0.01; r(2)=0.92; P<0.0001). CONCLUSION: Collateral-derived MBF measurements by MCE during angioplasty are feasible and proved that the pressure-derived CFI exactly reflects collateral relative to normal myocardial perfusion in humans.

Clinical validation of electromyography and acceleromyography as sensors for muscle relaxation

BACKGROUND AND OBJECTIVE: The aim of this study was to determine which of two clinically applied methods, electromyography or acceleromyography, was less affected by external disturbances, had a higher sensitivity and which would provide the better input signal for closed loop control of muscle relaxation. METHODS: In 14 adult patients, anaesthesia was induced with intravenous opioids and propofol. The response of the thumb to ulnar nerve stimulation was recorded on the same arm. Mivacurium was used for neuromuscular blockade. Under stable conditions of relaxation, the infusion-rate was decreased and the effects of turning the hand were investigated. RESULTS: Electromyography and acceleromyography both reflected the change of the infusion rate (P = 0.015 and P < 0.001, respectively). Electromyography was significantly less affected by the hand-turn (P = 0.008) than acceleromyography. While zero counts were detected with acceleromyography, electromyography could still detect at least one count in 51.1%. CONCLUSIONS: Electromyography is more reliable for use in daily practice as it is less influenced by external disturbances than acceleromyography.

Three-dimensional imaging core laboratory of the endovascular aneurysm repair trials: validation of methodology

OBJECTIVE: The aim of this study was to establish and validate a three-dimensional imaging protocol for the assessment of Computed Tomography (CT) scans of abdominal aortic aneurysms in UK EVAR trials patients. Quality control and repeatability of anatomical measurements is important for the validity of any core laboratory. METHODS: Three different observers performed anatomical measurements on 50 preoperative CT scans of aortic aneurysms using the Vitrea 2 three-dimensional post-imaging software in a core laboratory setting. We assessed the accuracy of intra and inter observer repeatability of measurements, the time required for collection of measurements, 3 different levels of automation and 3 different automated criteria for measurement of neck length. RESULTS: None of the automated neck length measurements demonstrated sufficient accuracy and it was necessary to perform checking of the important automated landmarks. Good intra and limited inter observer agreement were achieved with three-dimensional assessment. Complete assessment of the aneurysm and iliacs took an average (SD) of 17.2 (4.1) minutes. CONCLUSIONS: Aortic aneurysm anatomy can be assessed reliably and quickly using three-dimensional assessment but for scans of limited quality, manual checking of important landmarks remains necessary. Using a set protocol, agreement between observers is satisfactory but not as good as within observers.

Validation of the LittlEARS((R)) Auditory Questionnaire in children with normal hearing

OBJECTIVES: With more children receiving cochlear implants during infancy, there is a need for validated assessments of pre-verbal and early verbal auditory skills. The LittlEARS Auditory Questionnaire is presented here as the first module of the LittlEARS test battery. The LittlEARS Auditory Questionnaire was developed and piloted to assess the auditory behaviour of normal hearing children and hearing impaired children who receive a cochlear implant or hearing aid prior to 24 months of age. This paper presents results from two studies: one validating the LittlEARS Auditory Questionnaire on children with normal hearing who are German speaking and a second validating the norm curves found after adaptation and administration of the questionnaire to children with normal hearing in 15 different languages. METHODS: Scores from a group of 218 German and Austrian children with normal hearing between 5 days and 24 months of age were used to create a norm curve. The questionnaire was adapted from the German original into English and then 15 other languages to date. Regression curves were found based on parental responses from 3309 normal hearing infants and toddlers. Curves for each language were compared to the original German validation curve. RESULTS: The results of the first study were a norm curve which reflects the age-dependence of auditory behaviour, reliability and homogeneity as a measure of auditory behaviour, and calculations of expected and critical values as a function of age. Results of the second study show that the regression curves found for all the adapted languages are essentially equal to the German norm curve, as no statistically significant differences were found. CONCLUSIONS: The LittlEARS Auditory Questionnaire is a valid, language-independent tool for assessing the early auditory behaviour of infants and toddlers with normal hearing. The results of this study suggest that the LittlEARS Auditory Questionnaire could also be very useful for documenting children's progress with their current amplification, providing evidence of the need for implantation, or highlighting the need for follow-up in other developmental areas.

Validation of the estimation of physiologic ability and surgical stress (E-PASS) score in liver surgery

BACKGROUND: The estimation of physiologic ability and surgical stress (E-PASS) has been used to produce a numerical estimate of expected mortality and morbidity after elective gastrointestinal surgery. The aim of this study was to validate E-PASS in a selected cohort of patients requiring liver resections (LR). METHODS: In this retrospective study, E-PASS predictor equations for morbidity and mortality were applied to the prospective data from 243 patients requiring LR. The observed rates were compared with predicted rates using Fisher's exact test. The discriminative capability of E-PASS was evaluated using receiver-operating characteristic (ROC) curve analysis. RESULTS: The observed and predicted overall mortality rates were both 3.3% and the morbidity rates were 31.3 and 26.9%, respectively. There was a significant difference in the comprehensive risk scores for deceased and surviving patients (p = 0.043). However, the scores for patients with or without complications were not significantly different (p = 0.120). Subsequent ROC curve analysis revealed a poor predictive accuracy for morbidity. CONCLUSIONS: The E-PASS score seems to effectively predict mortality in this specific group of patients but is a poor predictor of complications. A new modified logistic regression might be required for LR in order to better predict the postoperative outcome.

[Field validation of a real-time PCR test for the detection of Mycoplasma hyopneumoniae in nasal swabs of live pigs]

Enzootic pneumonia (EP) of pigs, caused by Mycoplasma hyopneumoniae has been a notifiable disease in Switzerland since May 2003. The diagnosis of EP has been based on multiple methods, including clinical, bacteriological and epidemiological findings as well as pathological examination of lungs (mosaic diagnosis). With the recent development of a real-time PCR (rtPCR) assay with 2 target sequences a new detection method for M. hyopneumoniae became available. This assay was tested for its applicability to nasal swab material from live animals. Pigs from 74 herds (average 10 pigs per herd) were tested. Using the mosaic diagnosis, 22 herds were classified as EP positive and 52 as EP negative. From the 730 collected swab samples we were able to demonstrate that the rtPCR test was 100% specific. In cases of cough the sensitivity on herd level of the rtPCR is 100%. On single animal level and in herds without cough the sensitivity was lower. In such cases, only a positive result would be proof for an infection with M. hyopneumoniae. Our study shows that the rtPCR on nasal swabs from live pigs allows a fast and accurate diagnosis in cases of suspected EP.

Development and validation of energy expenditure prediction models based on GT3X accelerometer data in 5- to 9-year-old children

Background: Accelerometry has been established as an objective method that can be used to assess physical activity behavior in large groups. The purpose of the current study was to provide a validated equation to translate accelerometer counts of the triaxial GT3X into energy expenditure in young children. Methods: Thirty-two children aged 5–9 years performed locomotor and play activities that are typical for their age group. Children wore a GT3X accelerometer and their energy expenditure was measured with indirect calorimetry. Twenty-one children were randomly selected to serve as development group. A cubic 2-regression model involving separate equations for locomotor and play activities was developed on the basis of model fit. It was then validated using data of the remaining children and compared with a linear 2-regression model and a linear 1-regression model. Results: All 3 regression models produced strong correlations between predicted and measured MET values. Agreement was acceptable for the cubic model and good for both linear regression approaches. Conclusions: The current linear 1-regression model provides valid estimates of energy expenditure for ActiGraph GT3X data for 5- to 9-year-old children and shows equal or better predictive validity than a cubic or a linear 2-regression model.

Prediction of 1-year mortality in patients with acute coronary syndromes undergoing percutaneous coronary intervention: validation of the logistic clinical SYNTAX (Synergy Between Percutaneous Coronary Interventions With Taxus and Cardiac Surgery) score

OBJECTIVES This study sought to validate the Logistic Clinical SYNTAX (Synergy Between Percutaneous Coronary Intervention With Taxus and Cardiac Surgery) score in patients with non-ST-segment elevation acute coronary syndromes (ACS), in order to further legitimize its clinical application. BACKGROUND The Logistic Clinical SYNTAX score allows for an individualized prediction of 1-year mortality in patients undergoing contemporary percutaneous coronary intervention. It is composed of a "Core" Model (anatomical SYNTAX score, age, creatinine clearance, and left ventricular ejection fraction), and "Extended" Model (composed of an additional 6 clinical variables), and has previously been cross validated in 7 contemporary stent trials (>6,000 patients). METHODS One-year all-cause death was analyzed in 2,627 patients undergoing percutaneous coronary intervention from the ACUITY (Acute Catheterization and Urgent Intervention Triage Strategy) trial. Mortality predictions from the Core and Extended Models were studied with respect to discrimination, that is, separation of those with and without 1-year all-cause death (assessed by the concordance [C] statistic), and calibration, that is, agreement between observed and predicted outcomes (assessed with validation plots). Decision curve analyses, which weight the harms (false positives) against benefits (true positives) of using a risk score to make mortality predictions, were undertaken to assess clinical usefulness. RESULTS In the ACUITY trial, the median SYNTAX score was 9.0 (interquartile range 5.0 to 16.0); approximately 40% of patients had 3-vessel disease, 29% diabetes, and 85% underwent drug-eluting stent implantation. Validation plots confirmed agreement between observed and predicted mortality. The Core and Extended Models demonstrated substantial improvements in the discriminative ability for 1-year all-cause death compared with the anatomical SYNTAX score in isolation (C-statistics: SYNTAX score: 0.64, 95% confidence interval [CI]: 0.56 to 0.71; Core Model: 0.74, 95% CI: 0.66 to 0.79; Extended Model: 0.77, 95% CI: 0.70 to 0.83). Decision curve analyses confirmed the increasing ability to correctly identify patients who would die at 1 year with the Extended Model versus the Core Model versus the anatomical SYNTAX score, over a wide range of thresholds for mortality risk predictions. CONCLUSIONS Compared to the anatomical SYNTAX score alone, the Core and Extended Models of the Logistic Clinical SYNTAX score more accurately predicted individual 1-year mortality in patients presenting with non-ST-segment elevation acute coronary syndromes undergoing percutaneous coronary intervention. These findings support the clinical application of the Logistic Clinical SYNTAX score.

Validation of novel 3-dimensional electrocardiographic mapping of atrial tachycardias by invasive mapping and ablation: a multicenter study

OBJECTIVES This study prospectively evaluated the role of a novel 3-dimensional, noninvasive, beat-by-beat mapping system, Electrocardiographic Mapping (ECM), in facilitating the diagnosis of atrial tachycardias (AT). BACKGROUND Conventional 12-lead electrocardiogram, a widely used noninvasive tool in clinical arrhythmia practice, has diagnostic limitations. METHODS Various AT (de novo and post-atrial fibrillation ablation) were mapped using ECM followed by standard-of-care electrophysiological mapping and ablation in 52 patients. The ECM consisted of recording body surface electrograms from a 252-electrode-vest placed on the torso combined with computed tomography-scan-based biatrial anatomy (CardioInsight Inc., Cleveland, Ohio). We evaluated the feasibility of this system in defining the mechanism of AT-macro-re-entrant (perimitral, cavotricuspid isthmus-dependent, and roof-dependent circuits) versus centrifugal (focal-source) activation-and the location of arrhythmia in centrifugal AT. The accuracy of the noninvasive diagnosis and detection of ablation targets was evaluated vis-à-vis subsequent invasive mapping and successful ablation. RESULTS Comparison between ECM and electrophysiological diagnosis could be accomplished in 48 patients (48 AT) but was not possible in 4 patients where the AT mechanism changed to another AT (n = 1), atrial fibrillation (n = 1), or sinus rhythm (n = 2) during the electrophysiological procedure. ECM correctly diagnosed AT mechanisms in 44 of 48 (92%) AT: macro-re-entry in 23 of 27; and focal-onset with centrifugal activation in 21 of 21. The region of interest for focal AT perfectly matched in 21 of 21 (100%) AT. The 2:1 ventricular conduction and low-amplitude P waves challenged the diagnosis of 4 of 27 macro-re-entrant (perimitral) AT that can be overcome by injecting atrioventricular node blockers and signal averaging, respectively. CONCLUSIONS This prospective multicenter series shows a high success rate of ECM in accurately diagnosing the mechanism of AT and the location of focal arrhythmia. Intraprocedural use of the system and its application to atrial fibrillation mapping is under way.