Development and validation of a paediatric long-bone fracture classification. A prospective multicentre study in 13 European paediatric trauma centres

BACKGROUND: The aim of this study was to develop a child-specific classification system for long bone fractures and to examine its reliability and validity on the basis of a prospective multicentre study. METHODS: Using the sequentially developed classification system, three samples of between 30 and 185 paediatric limb fractures from a pool of 2308 fractures documented in two multicenter studies were analysed in a blinded fashion by eight orthopaedic surgeons, on a total of 5 occasions. Intra- and interobserver reliability and accuracy were calculated. RESULTS: The reliability improved with successive simplification of the classification. The final version resulted in an overall interobserver agreement of κ = 0.71 with no significant difference between experienced and less experienced raters. CONCLUSIONS: In conclusion, the evaluation of the newly proposed classification system resulted in a reliable and routinely applicable system, for which training in its proper use may further improve the reliability. It can be recommended as a useful tool for clinical practice and offers the option for developing treatment recommendations and outcome predictions in the future.

Validation of the Asthma Predictive Index and comparison with simpler clinical prediction rules

Background The loose and stringent Asthma Predictive Indices (API), developed in Tucson, are popular rules to predict asthma in preschool children. To be clinically useful, they require validation in different settings. Objective To assess the predictive performance of the API in an independent population and compare it with simpler rules based only on preschool wheeze. Methods We studied 1954 children of the population-based Leicester Respiratory Cohort, followed up from age 1 to 10 years. The API and frequency of wheeze were assessed at age 3 years, and we determined their association with asthma at ages 7 and 10 years by using logistic regression. We computed test characteristics and measures of predictive performance to validate the API and compare it with simpler rules. Results The ability of the API to predict asthma in Leicester was comparable to Tucson: for the loose API, odds ratios for asthma at age 7 years were 5.2 in Leicester (5.5 in Tucson), and positive predictive values were 26% (26%). For the stringent API, these values were 8.2 (9.8) and 40% (48%). For the simpler rule early wheeze, corresponding values were 5.4 and 21%; for early frequent wheeze, 6.7 and 36%. The discriminative ability of all prediction rules was moderate (c statistic ≤ 0.7) and overall predictive performance low (scaled Brier score < 20%). Conclusion Predictive performance of the API in Leicester, although comparable to the original study, was modest and similar to prediction based only on preschool wheeze. This highlights the need for better prediction rules.

Validation of a single item to assess daytime sleepiness for the Swiss Transplant Cohort Study

Context-Daytime sleepiness in kidney transplant recipients has emerged as a potential predictor of impaired adherence to the immunosuppressive medication regimen. Thus there is a need to assess daytime sleepiness in clinical practice and transplant registries.Objective-To evaluate the validity of a single-item measure of daytime sleepiness integrated in the Swiss Transplant Cohort Study (STCS), using the American Educational Research Association framework.Methods-Using a cross-sectional design, we enrolled a convenience sample of 926 home-dwelling kidney transplant recipients (median age, 59.69 years; 25%-75% quartile [Q25-Q75], 50.27-59.69), 63% men; median time since transplant 9.42 years (Q25-Q75, 4.93-15.85). Daytime sleepiness was assessed by using a single item from the STCS and the 8 items of the validated Epworth Sleepiness Scale. Receiver operating characteristic curve analysis was used to determine the cutoff for the STCS daytime sleepiness item against the Epworth Sleepiness Scale score.Results-Based on the receiver operating characteristic curve analysis, a score greater than 4 on the STCS daytime sleepiness item is recommended to detect daytime sleepiness. Content validity was high as all expert reviews were unanimous. Concurrent validity was moderate (Spearman ϱ, 0.531; P< .001) and convergent validity with depression and poor sleep quality although low, was significant (ϱ, 0.235; P<.001 and ϱ, 0.318, P=.002, respectively). For the group difference validity: kidney transplant recipients with moderate, severe, and extremely severe depressive symptom scores had 3.4, 4.3, and 5.9 times higher odds of having daytime sleepiness, respectively, as compared with recipients without depressive symptoms.Conclusion-The accumulated evidence provided evidence for the validity of the STCS daytime sleepiness item as a simple screening scale for daytime sleepiness.

Collateral-flow measurements in humans by myocardial contrast echocardiography: validation of coronary pressure-derived collateral-flow assessment

AIMS: Myocardial blood flow (MBF) is the gold standard to assess myocardial blood supply and, as recently shown, can be obtained by myocardial contrast echocardiography (MCE). The aims of this human study are (i) to test whether measurements of collateral-derived MBF by MCE are feasible during elective angioplasty and (ii) to validate the concept of pressure-derived collateral-flow assessment. METHODS AND RESULTS: Thirty patients with stable coronary artery disease underwent MCE of the collateral-receiving territory during and after angioplasty of 37 stenoses. MCE perfusion analysis was successful in 32 cases. MBF during and after angioplasty varied between 0.060-0.876 mL min(-1) g(-1) (0.304+/-0.196 mL min(-1) g(-1)) and 0.676-1.773 mL min(-1) g(-1) (1.207+/-0.327 mL min(-1) g(-1)), respectively. Collateral-perfusion index (CPI) is defined as the rate of MBF during and after angioplasty varied between 0.05 and 0.67 (0.26+/-0.15). During angioplasty, simultaneous measurements of mean aortic pressure, coronary wedge pressure, and central venous pressure determined the pressure-derived collateral-flow index (CFI(p)), which varied between 0.04 and 0.61 (0.23+/-0.14). Linear-regression analysis demonstrated an excellent agreement between CFI(p) and CPI (y=0.88 x +0.01; r(2)=0.92; P<0.0001). CONCLUSION: Collateral-derived MBF measurements by MCE during angioplasty are feasible and proved that the pressure-derived CFI exactly reflects collateral relative to normal myocardial perfusion in humans.

Clinical validation of electromyography and acceleromyography as sensors for muscle relaxation

BACKGROUND AND OBJECTIVE: The aim of this study was to determine which of two clinically applied methods, electromyography or acceleromyography, was less affected by external disturbances, had a higher sensitivity and which would provide the better input signal for closed loop control of muscle relaxation. METHODS: In 14 adult patients, anaesthesia was induced with intravenous opioids and propofol. The response of the thumb to ulnar nerve stimulation was recorded on the same arm. Mivacurium was used for neuromuscular blockade. Under stable conditions of relaxation, the infusion-rate was decreased and the effects of turning the hand were investigated. RESULTS: Electromyography and acceleromyography both reflected the change of the infusion rate (P = 0.015 and P < 0.001, respectively). Electromyography was significantly less affected by the hand-turn (P = 0.008) than acceleromyography. While zero counts were detected with acceleromyography, electromyography could still detect at least one count in 51.1%. CONCLUSIONS: Electromyography is more reliable for use in daily practice as it is less influenced by external disturbances than acceleromyography.

Three-dimensional imaging core laboratory of the endovascular aneurysm repair trials: validation of methodology

OBJECTIVE: The aim of this study was to establish and validate a three-dimensional imaging protocol for the assessment of Computed Tomography (CT) scans of abdominal aortic aneurysms in UK EVAR trials patients. Quality control and repeatability of anatomical measurements is important for the validity of any core laboratory. METHODS: Three different observers performed anatomical measurements on 50 preoperative CT scans of aortic aneurysms using the Vitrea 2 three-dimensional post-imaging software in a core laboratory setting. We assessed the accuracy of intra and inter observer repeatability of measurements, the time required for collection of measurements, 3 different levels of automation and 3 different automated criteria for measurement of neck length. RESULTS: None of the automated neck length measurements demonstrated sufficient accuracy and it was necessary to perform checking of the important automated landmarks. Good intra and limited inter observer agreement were achieved with three-dimensional assessment. Complete assessment of the aneurysm and iliacs took an average (SD) of 17.2 (4.1) minutes. CONCLUSIONS: Aortic aneurysm anatomy can be assessed reliably and quickly using three-dimensional assessment but for scans of limited quality, manual checking of important landmarks remains necessary. Using a set protocol, agreement between observers is satisfactory but not as good as within observers.

Validation of the LittlEARS((R)) Auditory Questionnaire in children with normal hearing

OBJECTIVES: With more children receiving cochlear implants during infancy, there is a need for validated assessments of pre-verbal and early verbal auditory skills. The LittlEARS Auditory Questionnaire is presented here as the first module of the LittlEARS test battery. The LittlEARS Auditory Questionnaire was developed and piloted to assess the auditory behaviour of normal hearing children and hearing impaired children who receive a cochlear implant or hearing aid prior to 24 months of age. This paper presents results from two studies: one validating the LittlEARS Auditory Questionnaire on children with normal hearing who are German speaking and a second validating the norm curves found after adaptation and administration of the questionnaire to children with normal hearing in 15 different languages. METHODS: Scores from a group of 218 German and Austrian children with normal hearing between 5 days and 24 months of age were used to create a norm curve. The questionnaire was adapted from the German original into English and then 15 other languages to date. Regression curves were found based on parental responses from 3309 normal hearing infants and toddlers. Curves for each language were compared to the original German validation curve. RESULTS: The results of the first study were a norm curve which reflects the age-dependence of auditory behaviour, reliability and homogeneity as a measure of auditory behaviour, and calculations of expected and critical values as a function of age. Results of the second study show that the regression curves found for all the adapted languages are essentially equal to the German norm curve, as no statistically significant differences were found. CONCLUSIONS: The LittlEARS Auditory Questionnaire is a valid, language-independent tool for assessing the early auditory behaviour of infants and toddlers with normal hearing. The results of this study suggest that the LittlEARS Auditory Questionnaire could also be very useful for documenting children's progress with their current amplification, providing evidence of the need for implantation, or highlighting the need for follow-up in other developmental areas.

Validation of the estimation of physiologic ability and surgical stress (E-PASS) score in liver surgery

BACKGROUND: The estimation of physiologic ability and surgical stress (E-PASS) has been used to produce a numerical estimate of expected mortality and morbidity after elective gastrointestinal surgery. The aim of this study was to validate E-PASS in a selected cohort of patients requiring liver resections (LR). METHODS: In this retrospective study, E-PASS predictor equations for morbidity and mortality were applied to the prospective data from 243 patients requiring LR. The observed rates were compared with predicted rates using Fisher's exact test. The discriminative capability of E-PASS was evaluated using receiver-operating characteristic (ROC) curve analysis. RESULTS: The observed and predicted overall mortality rates were both 3.3% and the morbidity rates were 31.3 and 26.9%, respectively. There was a significant difference in the comprehensive risk scores for deceased and surviving patients (p = 0.043). However, the scores for patients with or without complications were not significantly different (p = 0.120). Subsequent ROC curve analysis revealed a poor predictive accuracy for morbidity. CONCLUSIONS: The E-PASS score seems to effectively predict mortality in this specific group of patients but is a poor predictor of complications. A new modified logistic regression might be required for LR in order to better predict the postoperative outcome.

[Field validation of a real-time PCR test for the detection of Mycoplasma hyopneumoniae in nasal swabs of live pigs]

Enzootic pneumonia (EP) of pigs, caused by Mycoplasma hyopneumoniae has been a notifiable disease in Switzerland since May 2003. The diagnosis of EP has been based on multiple methods, including clinical, bacteriological and epidemiological findings as well as pathological examination of lungs (mosaic diagnosis). With the recent development of a real-time PCR (rtPCR) assay with 2 target sequences a new detection method for M. hyopneumoniae became available. This assay was tested for its applicability to nasal swab material from live animals. Pigs from 74 herds (average 10 pigs per herd) were tested. Using the mosaic diagnosis, 22 herds were classified as EP positive and 52 as EP negative. From the 730 collected swab samples we were able to demonstrate that the rtPCR test was 100% specific. In cases of cough the sensitivity on herd level of the rtPCR is 100%. On single animal level and in herds without cough the sensitivity was lower. In such cases, only a positive result would be proof for an infection with M. hyopneumoniae. Our study shows that the rtPCR on nasal swabs from live pigs allows a fast and accurate diagnosis in cases of suspected EP.

Development and validation of energy expenditure prediction models based on GT3X accelerometer data in 5- to 9-year-old children

Background: Accelerometry has been established as an objective method that can be used to assess physical activity behavior in large groups. The purpose of the current study was to provide a validated equation to translate accelerometer counts of the triaxial GT3X into energy expenditure in young children. Methods: Thirty-two children aged 5–9 years performed locomotor and play activities that are typical for their age group. Children wore a GT3X accelerometer and their energy expenditure was measured with indirect calorimetry. Twenty-one children were randomly selected to serve as development group. A cubic 2-regression model involving separate equations for locomotor and play activities was developed on the basis of model fit. It was then validated using data of the remaining children and compared with a linear 2-regression model and a linear 1-regression model. Results: All 3 regression models produced strong correlations between predicted and measured MET values. Agreement was acceptable for the cubic model and good for both linear regression approaches. Conclusions: The current linear 1-regression model provides valid estimates of energy expenditure for ActiGraph GT3X data for 5- to 9-year-old children and shows equal or better predictive validity than a cubic or a linear 2-regression model.

Prediction of 1-year mortality in patients with acute coronary syndromes undergoing percutaneous coronary intervention: validation of the logistic clinical SYNTAX (Synergy Between Percutaneous Coronary Interventions With Taxus and Cardiac Surgery) score

OBJECTIVES This study sought to validate the Logistic Clinical SYNTAX (Synergy Between Percutaneous Coronary Intervention With Taxus and Cardiac Surgery) score in patients with non-ST-segment elevation acute coronary syndromes (ACS), in order to further legitimize its clinical application. BACKGROUND The Logistic Clinical SYNTAX score allows for an individualized prediction of 1-year mortality in patients undergoing contemporary percutaneous coronary intervention. It is composed of a "Core" Model (anatomical SYNTAX score, age, creatinine clearance, and left ventricular ejection fraction), and "Extended" Model (composed of an additional 6 clinical variables), and has previously been cross validated in 7 contemporary stent trials (>6,000 patients). METHODS One-year all-cause death was analyzed in 2,627 patients undergoing percutaneous coronary intervention from the ACUITY (Acute Catheterization and Urgent Intervention Triage Strategy) trial. Mortality predictions from the Core and Extended Models were studied with respect to discrimination, that is, separation of those with and without 1-year all-cause death (assessed by the concordance [C] statistic), and calibration, that is, agreement between observed and predicted outcomes (assessed with validation plots). Decision curve analyses, which weight the harms (false positives) against benefits (true positives) of using a risk score to make mortality predictions, were undertaken to assess clinical usefulness. RESULTS In the ACUITY trial, the median SYNTAX score was 9.0 (interquartile range 5.0 to 16.0); approximately 40% of patients had 3-vessel disease, 29% diabetes, and 85% underwent drug-eluting stent implantation. Validation plots confirmed agreement between observed and predicted mortality. The Core and Extended Models demonstrated substantial improvements in the discriminative ability for 1-year all-cause death compared with the anatomical SYNTAX score in isolation (C-statistics: SYNTAX score: 0.64, 95% confidence interval [CI]: 0.56 to 0.71; Core Model: 0.74, 95% CI: 0.66 to 0.79; Extended Model: 0.77, 95% CI: 0.70 to 0.83). Decision curve analyses confirmed the increasing ability to correctly identify patients who would die at 1 year with the Extended Model versus the Core Model versus the anatomical SYNTAX score, over a wide range of thresholds for mortality risk predictions. CONCLUSIONS Compared to the anatomical SYNTAX score alone, the Core and Extended Models of the Logistic Clinical SYNTAX score more accurately predicted individual 1-year mortality in patients presenting with non-ST-segment elevation acute coronary syndromes undergoing percutaneous coronary intervention. These findings support the clinical application of the Logistic Clinical SYNTAX score.

Validation of novel 3-dimensional electrocardiographic mapping of atrial tachycardias by invasive mapping and ablation: a multicenter study

OBJECTIVES This study prospectively evaluated the role of a novel 3-dimensional, noninvasive, beat-by-beat mapping system, Electrocardiographic Mapping (ECM), in facilitating the diagnosis of atrial tachycardias (AT). BACKGROUND Conventional 12-lead electrocardiogram, a widely used noninvasive tool in clinical arrhythmia practice, has diagnostic limitations. METHODS Various AT (de novo and post-atrial fibrillation ablation) were mapped using ECM followed by standard-of-care electrophysiological mapping and ablation in 52 patients. The ECM consisted of recording body surface electrograms from a 252-electrode-vest placed on the torso combined with computed tomography-scan-based biatrial anatomy (CardioInsight Inc., Cleveland, Ohio). We evaluated the feasibility of this system in defining the mechanism of AT-macro-re-entrant (perimitral, cavotricuspid isthmus-dependent, and roof-dependent circuits) versus centrifugal (focal-source) activation-and the location of arrhythmia in centrifugal AT. The accuracy of the noninvasive diagnosis and detection of ablation targets was evaluated vis-à-vis subsequent invasive mapping and successful ablation. RESULTS Comparison between ECM and electrophysiological diagnosis could be accomplished in 48 patients (48 AT) but was not possible in 4 patients where the AT mechanism changed to another AT (n = 1), atrial fibrillation (n = 1), or sinus rhythm (n = 2) during the electrophysiological procedure. ECM correctly diagnosed AT mechanisms in 44 of 48 (92%) AT: macro-re-entry in 23 of 27; and focal-onset with centrifugal activation in 21 of 21. The region of interest for focal AT perfectly matched in 21 of 21 (100%) AT. The 2:1 ventricular conduction and low-amplitude P waves challenged the diagnosis of 4 of 27 macro-re-entrant (perimitral) AT that can be overcome by injecting atrioventricular node blockers and signal averaging, respectively. CONCLUSIONS This prospective multicenter series shows a high success rate of ECM in accurately diagnosing the mechanism of AT and the location of focal arrhythmia. Intraprocedural use of the system and its application to atrial fibrillation mapping is under way.

The HeartQoL: Part II. Validation of a new core health-related quality of life questionnaire for patients with ischemic heart disease

Background: Evaluation of health-related quality of life (HRQL) is important in improving the quality of patient care. The aim of this study was to determine the psychometric properties of the HeartQoL in patients with ischemic heart disease (IHD), specifically angina, myocardial infarction (MI), or ischemic heart failure. Methods: Data for the interim validation of the HeartQoL questionnaire were collected in (a) a cross-sectional survey and (b) a prospective substudy of patients undergoing either a percutaneous coronary intervention (PCI) or referred to cardiac rehabilitation (CR) and were then analyzed to determine the reliability, validity, and responsiveness of the HeartQoL questionnaire. Results: We enrolled 6384 patients (angina, n = 2111, 33.1%; MI, n = 2351, 36.8%; heart failure, n = 1922, 30.1%) across 22 countries speaking 15 languages in the cross-sectional study and 730 patients with IHD in the prospective substudy. The HeartQoL questionnaire comprises 14-items with physical and emotional subscales and a global score (range 0–3 (poor to better HRQL). Cronbach’s α was consistently ≥0.80; convergent validity correlations between similar HeartQoL and SF-36 subscales were significant (r ≥ 0.60, p < 0.001); discriminative validity was confirmed with predictor variables: health transition, anxiety, depression, and functional status. HeartQoL score changes following either PCI or CR were significant (p < 0.001) with effect sizes ranging from 0.37–0.64. Conclusion: The HeartQoL questionnaire is reliable, valid, and responsive to change allowing clinicians and researchers to (a) assess baseline HRQL, (b) make between-diagnosis comparisons of HRQL, and (c) evaluate change in HRQL in patients with angina, MI, or heart failure with a single IHD-specific HRQL instrument.

Psychoendocrine validation of a short measure for assessment of perceived stress management skills in different non-clinical populations

BACKGROUND: We investigated the psychometric properties of a short questionnaire for combined assessment of different perceived stress management skills in the general population and tested whether scores relate to physiological stress reactivity. METHODS: For psychometric evaluation, we determined the factor structure of the questionnaire and investigated its measurement invariance in the participant groups and over time in three different independent samples representing the general population (total N=332). Reliability was tested by estimating test-retest reliability, internal consistency, and item reliabilities. We examined convergent and criterion validity using selected criterion variables. For endocrine validation, 35 healthy non-smoking and medication-free men in a laboratory study and 35 male and female employees in a workplace study underwent an acute standardized psychosocial stress task. We assessed stress management skills and measured salivary cortisol before and several times up to 60 min (workplace study) and 120 min (laboratory study) after stress. Potential confounders were controlled. RESULTS: The factor structure of the questionnaire consists of five scales reflecting acceptably distinct stress management skills such as cognitive strategies, use of social support, relaxation strategies, anger regulation, and perception of bodily tension. This factor structure was stable across participant groups and over time. Internal consistencies, item reliabilities, and test-retest reliabilities met established statistical requirements. Convergent and criterion validity were also established. In both endocrine validation studies, higher stress management skills were independently associated with lower cortisol stress reactivity (p's<.029). CONCLUSIONS: Our findings suggest that the questionnaire has good psychometric properties and that it relates to subjective psychological and objective physiological stress indicators. Therefore, the instrument seems a suitable measure for differential assessment of stress management skills in the general population.