Validation of the instability shoulder index score in a multicenter reliability study in 114 consecutive cases.

BACKGROUND: Anterior shoulder stabilization surgery with the arthroscopic Bankart procedure can have a high recurrence rate in certain patients. Identifying these patients to modify outcomes has become a focal point of research. PURPOSE: The Instability Shoulder Index Score (ISIS) was developed to predict the success of arthroscopic Bankart repair. Scores range from 0 to 10, with higher scores predicting a higher risk of recurrence after stabilization. The interobserver reliability of the score is not known. STUDY DESIGN: Cohort study (diagnosis); Level of evidence, 2. METHODS: This is a prospective multicenter (North America and Europe) study of patients suffering from shoulder instability and waiting for stabilization surgery. Five pairs of independent evaluators were asked to score patient instability severity with the ISIS. Patients also completed functional scores (Western Ontario Shoulder Instability Index [WOSI], Disabilities of the Arm, Shoulder and Hand-short version [QuickDASH], and Walch-Duplay test). Data on age, sex, number of dislocations, and type of surgery were collected. The test-retest method and intraclass correlation coefficient (ICC: >0.75 = good, >0.85 = very good, and >0.9 = excellent) were used for analysis. RESULTS: A total of 114 patients with anterior shoulder instability were included, of whom 89 (78%) were men. The mean age was 28 years. The ISIS was very reliable, with an ICC of 0.933. The mean number of dislocations per patient was higher in patients who had an ISIS of ≥6 (25 vs 14; P = .05). Patients who underwent more complex arthroscopic procedures such as Hill-Sachs remplissage or open Latarjet had higher preoperative ISIS outcomes, with a mean score of 4.8 versus 3.4, respectively (P = .002). There was no correlation between the ISIS and the quality-of-life questionnaires, with Pearson correlations all >0.05 (WOSI = 0.39; QuickDASH = 0.97; Walch-Duplay = 0.08). CONCLUSION: Our results show that the ISIS is reliable when used in a multicenter study with anterior traumatic instability populations. There was no correlation between the ISIS and the quality-of-life questionnaires, but surgical decisions reflected its increased use.

Validation of the Spanish version of the Index of Spouse Abuse

Background: Partner violence against women is a major public health problem. Although there are currently a number of validated screening and diagnostic tools that can be used to evaluate this type of violence, such tools are not available in Spain. The aim of this study is to analyze the validity and reliability of the Spanish version of the Index of Spouse Abuse (ISA). Methods: A cross-sectional study was carried out in 2005 in two health centers in Granada, Spain, in 390 women between 18 and 70 years old. Analyses of the factorial structure, internal consistency, test-retest reliability, and construct validity were conducted. Cutoff points for each subscale were also defined. For the construct validity analysis, the SF-36 perceived general health dimension, the Rosenberg Self-Esteem Scale and the Goldberg 12-item General Health Questionnaire were included. Results: The psychometric analysis shows that the instrument has good internal consistency, reproducibility, and construct validity. Conclusions: The scale is useful for the analysis of partner violence against women in both a research setting and a healthcare setting

Validation of the spanish version of the multiple sclerosis international quality of life (musiqol) questionnaire

BACKGROUND: The Multiple Sclerosis International Quality Of Life (MusiQoL) questionnaire, a 31-item, multidimensional, self-administrated questionnaire that is available in 14 languages including Spanish, has been validated using a large international sample. We investigated the validity and reliability of the Spanish version of MusiQoL in Spain. METHODS: Consecutive patients with different types and severities of multiple sclerosis (MS) were recruited from 22 centres across Spain. All patients completed the MusiQoL questionnaire, the 36-Item Short Form (SF-36) health survey, and a symptoms checklist at baseline and 21 days later. External validity, internal consistency, reliability and reproducibility were tested. RESULTS: A total of 224 Spanish patients were evaluated. Dimensions of MusiQoL generally demonstrated a high internal consistency (Cronbach's alpha: 0.70-0.92 for all but two MusiQoL domain scores). External validity testing revealed that the MusiQoL index score correlated significantly with all SF-36 dimension scores (Pearson's correlation: 0.46-0.76), reproducibility was satisfactory (intraclass correlation coefficient: 0.60-0.91), acceptability was high, and the time taken to complete the 31-item questionnaire was reasonable (mean [standard deviation]: 9.8 [11.8] minutes). CONCLUSIONS: The Spanish version of the MusiQoL questionnaire appears to be a valid and reliable instrument for measuring quality of life in patients with MS in Spain and constitutes a useful instrument to measure health-related quality of life in the clinical setting.

Accuracy profile validation of a new method for carbon monoxide measurement in the human blood using headspace-gas chromatography-mass spectrometry (HS-GC-MS).

The aim of our study was to provide an innovative headspace-gas chromatography-mass spectrometry (HS-GC-MS) method applicable for the routine determination of blood CO concentration in forensic toxicology laboratories. The main drawback of the GC/MS methods discussed in literature for CO measurement is the absence of a specific CO internal standard necessary for performing quantification. Even if stable isotope of CO is commercially available in the gaseous state, it is essential to develop a safer method to limit the manipulation of gaseous CO and to precisely control the injected amount of CO for spiking and calibration. To avoid the manipulation of a stable isotope-labeled gas, we have chosen to generate in a vial in situ, an internal labeled standard gas ((13)CO) formed by the reaction of labeled formic acid formic acid (H(13)COOH) with sulfuric acid. As sulfuric acid can also be employed to liberate the CO reagent from whole blood, the procedure allows for the liberation of CO simultaneously with the generation of (13)CO. This method allows for precise measurement of blood CO concentrations from a small amount of blood (10 μL). Finally, this method was applied to measure the CO concentration of intoxicated human blood samples from autopsies.

Validation of a new tool to assess health-related quality of life in psoriasis: the PSO-LIFE questionnaire.

BACKGROUND Several questionnaires have been used to measure health related quality of life (HRQoL) in patients with psoriasis, few have been adapted for use in Spain; none of them was developed specifically for the Spanish population. The purpose of the study was to validate and assess the sensitivity to change of a new questionnaire to measure HRQOL in patients with psoriasis (PSO-LIFE). METHODS Observational, prospective, multicenter study performed in centers around Spain. Patients with active or inactive psoriasis completed the PSO-LIFE together with other Dermatology Quality of Life Index (DLQI) and Psoriasis Disability Index (PDI). A control group of patients with urticaria or atopic dermatitis was also included. Internal consistency and test-retest reliability of the PSO-LIFE were assessed by calculating Cronbach's alpha and Intraclass Correlation Coefficient (ICC). Validity was assessed by examining factorial structure, the capacity to discriminate between groups, and correlations with other measures. Sensitivity to change was measured using effect sizes. RESULTS The final sample included for analysis consisted of 304 patients and 56 controls. Mean (SD) age of psoriasis patients was 45.3 (14.5) years compared to 38.8 (14) years for controls (p < 0.01). Cronbach's alpha for the PSO-LIFE was 0.95 and test-retest reliability using the ICC was 0.98. Factor analysis showed the questionnaire to be unidimensional. Mean (SD) PSO-LIFE scores differed between patients with psoriasis and controls (64.9 [22.5] vs 69.4 [17.3]; p < 0.05), between those with active and inactive disease (57.4 [20.4] vs 76.4 [20.6]; p < 0.01), and between those with visible and non-visible lesions (63.0 [21.9] vs. 74.8 [23.9]; p < 0.01). The correlation between PSO-LIFE and PASI scores was moderate (r = -0.43) while correlations with DLQI and PDI dimensions ranged from moderate to high (between 0.4 and 0.8). Effect size on the PSO-LIFE in patients reporting 'much improved' health status at study completion was 1.01 (large effect size). CONCLUSIONS The present results provide substantial support for the reliability, validity, and responsiveness of the PSO-LIFE questionnaire in the population for which it was designed.

Use of accuracy profile for the validation of a gas chromatography-negative chemical ionization tandem mass spectrometry method: quantification of ethyl glucuronide in hair

Introduction: Ethylglucuronide (EtG) is a direct and specific metabolite of ethanol. Its determination in hair is of increasing interest for detecting and monitoring alcohol abuse. The quantification of EtG in hair requires analytical methods showing highest sensitivity and specificity. We present a fully validated method based on gas chromatography-negative chemical ionization tandem mass spectrometry (GC-NCI-MS/MS). The method was validated using French Society of Pharmaceutical Sciences and Techniques (SFSTP) guidelines which are based on the determination of the total measurement error and accuracy profiles. Methods: Washed and powdered hair is extracted in water using an ultrasonic incubation. After purification by Oasis MAX solid phase extraction, the derivatized EtG is detected and quantified by GC-NCI-MS/MS method in the selected reaction monitoring mode. The transitions m/z 347 / 163 and m/z 347 / 119 were used for the quantification and identification of EtG. Four quality controls (QC) prepared with hair samples taken post mortem from 2 subjects with a known history of alcoholism were used. A proficiency test with 7 participating laboratories was first run to validate the EtG concentration of each QC sample. Considering the results of this test, these samples were then used as internal controls for validation of the method. Results: The mean EtG concentrations measured in the 4 QC were 259.4, 130.4, 40.8, and 8.4 pg/mg hair. Method validation has shown linearity between 8.4 and 259.4 pg/mg hair (r2 > 0.999). The lower limit of quantification was set up at 8.4 pg/mg. Repeatability and intermediate precision were found less than 13.2% for all concentrations tested. Conclusion: The method proved to be suitable for routine analysis of EtG in hair. GC-NCI-MS/MS method was then successfully applied to the analysis of EtG in hair samples collected from different alcohol consumers.

Validation of an immunochromatographic assay kit for the identification of the Mycobacterium tuberculosis complex

The performance of the immunochromatographic assay, SD BIOLINE TB Ag MPT64 RAPID®, was evaluated in Madagascar. Using mouse anti-MPT64 monoclonal antibodies for rapid discrimination between the Mycobacterium tuberculosis complex and nontuberculous mycobacteria, the kit was tested on mycobacteria and other pathogens using conventional methods as the gold standard. The results presented here indicate that this kit has excellent sensitivity (100%) and specificity (100%) compared to standard biochemical detection and can be easily used for the rapid identification of M. tuberculosis complex.

Evaluation of email alerts in practice: Part 2. Validation of the information assessment method.

RATIONALE AND OBJECTIVE:. The information assessment method (IAM) permits health professionals to systematically document the relevance, cognitive impact, use and health outcomes of information objects delivered by or retrieved from electronic knowledge resources. The companion review paper (Part 1) critically examined the literature, and proposed a 'Push-Pull-Acquisition-Cognition-Application' evaluation framework, which is operationalized by IAM. The purpose of the present paper (Part 2) is to examine the content validity of the IAM cognitive checklist when linked to email alerts. METHODS: A qualitative component of a mixed methods study was conducted with 46 doctors reading and rating research-based synopses sent on email. The unit of analysis was a doctor's explanation of a rating of one item regarding one synopsis. Interviews with participants provided 253 units that were analysed to assess concordance with item definitions. RESULTS AND CONCLUSION: The content relevance of seven items was supported. For three items, revisions were needed. Interviews suggested one new item. This study has yielded a 2008 version of IAM.

Validation of a modified fluorimetric assay for the screening of trichomonacidal drugs

A fluorimetric microassay that uses a redox dye to determine the viability of the flagellate Trichomonas vaginalis has been optimised to provide a more sensitive method to evaluate potential trichomonacidal compounds. Resazurin has been used in recent years to test drugs against different parasites, including trichomonadid protozoa; however, the reproducibility of these resazurin-based methods in our laboratory has been limited because the flagellate culture medium spontaneously reduces the resazurin. The objective of this work was to refine the fluorimetric microassay method previously developed by other research groups to reduce the fluorescence background generated by the media and increase the sensitivity of the screening assay. The experimental conditions, time of incubation, resazurin concentration and media used in the microtitre plates were adjusted. Different drug sensitivity studies against T. vaginalis were developed using the 5-nitroimidazole reference drugs, new 5-nitroindazolinones and 5-nitroindazole synthetic derivatives. Haemocytometer count results were compared with the resazurin assay using a 10% solution of 3 mM resazurin dissolved in phosphate buffered saline with glucose (1 mg/mL). The fluorimetric assay and the haemocytometer counts resulted in similar percentages of trichomonacidal activity in all the experiments, demonstrating that the fluorimetric microtitre assay has the necessary accuracy for high-throughput screening of new drugs against T. vaginalis.

Development and validation of PCR-based assays for diagnosis of American cutaneous leishmaniasis and identificatio nof the parasite species

In this study, PCR assays targeting different Leishmania heat-shock protein 70 gene (hsp70) regions, producing fragments ranging in size from 230-390 bp were developed and evaluated to determine their potential as a tool for the specific molecular diagnosis of cutaneous leishmaniasis (CL). A total of 70 Leishmania strains were analysed, including seven reference strains (RS) and 63 previously typed strains. Analysis of the RS indicated a specific region of 234 bp in the hsp70 gene as a valid target that was highly sensitive for detection of Leishmania species DNA with capacity of distinguishing all analyzed species, after polymerase chain reaction-restriction fragment length polymorfism (PCR-RFLP). This PCR assay was compared with other PCR targets used for the molecular diagnosis of leishmaniasis: hsp70 (1400-bp region), internal transcribed spacer (ITS)1 and glucose-6-phosphate dehydrogenase (G6pd). A good agreement among the methods was observed concerning the Leishmania species identification. Moreover, to evaluate the potential for molecular diagnosis, we compared the PCR targets hsp70-234 bp, ITS1, G6pd and mkDNA using a panel of 99 DNA samples from tissue fragments collected from patients with confirmed CL. Both PCR-hsp70-234 bp and PCR-ITS1 detected Leishmania DNA in more than 70% of the samples. However, using hsp70-234 bp PCR-RFLP, identification of all of the Leishmania species associated with CL in Brazil can be achieved employing a simpler and cheaper electrophoresis protocol.

Prospective, multicenter validation of prediction scores for major bleeding in elderly patients with venous thromboembolism.

BACKGROUND: The Outpatient Bleeding Risk Index (OBRI) and the Kuijer, RIETE and Kearon scores are clinical prognostic scores for bleeding in patients receiving oral anticoagulants for venous thromboembolism (VTE). We prospectively compared the performance of these scores in elderly patients with VTE. METHODS: In a prospective multicenter Swiss cohort study, we studied 663 patients aged ≥ 65 years with acute VTE. The outcome was a first major bleeding at 90 days. We classified patients into three categories of bleeding risk (low, intermediate and high) according to each score and dichotomized patients as high vs. low or intermediate risk. We calculated the area under the receiver-operating characteristic (ROC) curve, positive predictive values and likelihood ratios for each score. RESULTS: Overall, 28 out of 663 patients (4.2%, 95% confidence interval [CI] 2.8-6.0%) had a first major bleeding within 90 days. According to different scores, the rate of major bleeding varied from 1.9% to 2.1% in low-risk, from 4.2% to 5.0% in intermediate-risk and from 3.1% to 6.6% in high-risk patients. The discriminative power of the scores was poor to moderate, with areas under the ROC curve ranging from 0.49 to 0.60 (P = 0.21). The positive predictive values and positive likelihood ratios were low and varied from 3.1% to 6.6% and from 0.72 to 1.59, respectively. CONCLUSION: In elderly patients with VTE, existing bleeding risk scores do not have sufficient accuracy and power to discriminate between patients with VTE who are at a high risk of short-term major bleeding and those who are not.

Development and validation of a risk score predicting substantial weight gain over 5 years in middle-aged European men and women.

BACKGROUND Identifying individuals at high risk of excess weight gain may help targeting prevention efforts at those at risk of various metabolic diseases associated with weight gain. Our aim was to develop a risk score to identify these individuals and validate it in an external population. METHODS We used lifestyle and nutritional data from 53°758 individuals followed for a median of 5.4 years from six centers of the European Prospective Investigation into Cancer and Nutrition (EPIC) to develop a risk score to predict substantial weight gain (SWG) for the next 5 years (derivation sample). Assuming linear weight gain, SWG was defined as gaining ≥ 10% of baseline weight during follow-up. Proportional hazards models were used to identify significant predictors of SWG separately by EPIC center. Regression coefficients of predictors were pooled using random-effects meta-analysis. Pooled coefficients were used to assign weights to each predictor. The risk score was calculated as a linear combination of the predictors. External validity of the score was evaluated in nine other centers of the EPIC study (validation sample). RESULTS Our final model included age, sex, baseline weight, level of education, baseline smoking, sports activity, alcohol use, and intake of six food groups. The model's discriminatory ability measured by the area under a receiver operating characteristic curve was 0.64 (95% CI = 0.63-0.65) in the derivation sample and 0.57 (95% CI = 0.56-0.58) in the validation sample, with variation between centers. Positive and negative predictive values for the optimal cut-off value of ≥ 200 points were 9% and 96%, respectively. CONCLUSION The present risk score confidently excluded a large proportion of individuals from being at any appreciable risk to develop SWG within the next 5 years. Future studies, however, may attempt to further refine the positive prediction of the score.

Cross-validation of bioelectrical impedance analysis for the assessment of body composition in a representative sample of 6- to 13-year-old children.

BACKGROUND/OBJECTIVES: (1) To cross-validate tetra- (4-BIA) and octopolar (8-BIA) bioelectrical impedance analysis vs dual-energy X-ray absorptiometry (DXA) for the assessment of total and appendicular body composition and (2) to evaluate the accuracy of external 4-BIA algorithms for the prediction of total body composition, in a representative sample of Swiss children. SUBJECTS/METHODS: A representative sample of 333 Swiss children aged 6-13 years from the Kinder-Sportstudie (KISS) (ISRCTN15360785). Whole-body fat-free mass (FFM) and appendicular lean tissue mass were measured with DXA. Body resistance (R) was measured at 50 kHz with 4-BIA and segmental body resistance at 5, 50, 250 and 500 kHz with 8-BIA. The resistance index (RI) was calculated as height(2)/R. Selection of predictors (gender, age, weight, RI4 and RI8) for BIA algorithms was performed using bootstrapped stepwise linear regression on 1000 samples. We calculated 95% confidence intervals (CI) of regression coefficients and measures of model fit using bootstrap analysis. Limits of agreement were used as measures of interchangeability of BIA with DXA. RESULTS: 8-BIA was more accurate than 4-BIA for the assessment of FFM (root mean square error (RMSE)=0.90 (95% CI 0.82-0.98) vs 1.12 kg (1.01-1.24); limits of agreement 1.80 to -1.80 kg vs 2.24 to -2.24 kg). 8-BIA also gave accurate estimates of appendicular body composition, with RMSE < or = 0.10 kg for arms and < or = 0.24 kg for legs. All external 4-BIA algorithms performed poorly with substantial negative proportional bias (r> or = 0.48, P<0.001). CONCLUSIONS: In a representative sample of young Swiss children (1) 8-BIA was superior to 4-BIA for the prediction of FFM, (2) external 4-BIA algorithms gave biased predictions of FFM and (3) 8-BIA was an accurate predictor of segmental body composition.

The MicroArray Quality Control (MAQC)-II study of common practices for the development and validation of microarray-based predictive models.

Gene expression data from microarrays are being applied to predict preclinical and clinical endpoints, but the reliability of these predictions has not been established. In the MAQC-II project, 36 independent teams analyzed six microarray data sets to generate predictive models for classifying a sample with respect to one of 13 endpoints indicative of lung or liver toxicity in rodents, or of breast cancer, multiple myeloma or neuroblastoma in humans. In total, >30,000 models were built using many combinations of analytical methods. The teams generated predictive models without knowing the biological meaning of some of the endpoints and, to mimic clinical reality, tested the models on data that had not been used for training. We found that model performance depended largely on the endpoint and team proficiency and that different approaches generated models of similar performance. The conclusions and recommendations from MAQC-II should be useful for regulatory agencies, study committees and independent investigators that evaluate methods for global gene expression analysis.

Transcultural adaptation and validation of the "Hip and Knee" questionnaire into Spanish.

BACKGROUND The purpose of the present study is to translate and validate the "Hip and Knee Outcomes Questionnaire", developed in English, into Spanish. The 'Hip and Knee Outcomes Questionnaire is a questionnaire planned to evaluate the impact in quality of life of any problem related to the human musculoskeletal system. 10 scientific associations developed it. METHODS The questionnaire underwent a validated translation/retro-translation process. Patients undergoing primary knee arthroplasty, before and six months postoperative, tested the final version in Spanish. Psychometric properties of feasibility, reliability, validity and sensitivity to change were assessed. Convergent validity with SF-36 and WOMAC questionnaires was evaluated. RESULTS 316 patients were included. Feasibility: a high number of missing items in questions 3, 4 and 5 were observed. The number of patients with a missing item was 171 (51.35%) in the preoperative visit and 139 (44.0%) at the postoperative. Internal validity: revision of coefficients in the item-rest correlation recommended removing question 6 during the preoperative visit (coefficient <0.20). Convergent validity: coefficients of correlation with WOMAC and SF-36 scales confirm the questionnaire's validity. Sensitivity to change: statistically significant differences were found between the mean scores of the first visit compared to the postoperative. CONCLUSION The proposed translation to Spanish of the 'Hip and Knee Questionnaire' is found to be reliable, valid and sensible to changes produced at the clinical practice of patients undergoing primary knee arthroplasty. However, some changes at the completion instructions are recommended. LEVEL OF EVIDENCE Level I. Prognostic study.