Use of accuracy profile for the validation of a gas chromatography-negative chemical ionization tandem mass spectrometry method: quantification of ethyl glucuronide in hair

Introduction: Ethylglucuronide (EtG) is a direct and specific metabolite of ethanol. Its determination in hair is of increasing interest for detecting and monitoring alcohol abuse. The quantification of EtG in hair requires analytical methods showing highest sensitivity and specificity. We present a fully validated method based on gas chromatography-negative chemical ionization tandem mass spectrometry (GC-NCI-MS/MS). The method was validated using French Society of Pharmaceutical Sciences and Techniques (SFSTP) guidelines which are based on the determination of the total measurement error and accuracy profiles. Methods: Washed and powdered hair is extracted in water using an ultrasonic incubation. After purification by Oasis MAX solid phase extraction, the derivatized EtG is detected and quantified by GC-NCI-MS/MS method in the selected reaction monitoring mode. The transitions m/z 347 / 163 and m/z 347 / 119 were used for the quantification and identification of EtG. Four quality controls (QC) prepared with hair samples taken post mortem from 2 subjects with a known history of alcoholism were used. A proficiency test with 7 participating laboratories was first run to validate the EtG concentration of each QC sample. Considering the results of this test, these samples were then used as internal controls for validation of the method. Results: The mean EtG concentrations measured in the 4 QC were 259.4, 130.4, 40.8, and 8.4 pg/mg hair. Method validation has shown linearity between 8.4 and 259.4 pg/mg hair (r2 > 0.999). The lower limit of quantification was set up at 8.4 pg/mg. Repeatability and intermediate precision were found less than 13.2% for all concentrations tested. Conclusion: The method proved to be suitable for routine analysis of EtG in hair. GC-NCI-MS/MS method was then successfully applied to the analysis of EtG in hair samples collected from different alcohol consumers.

Evaluation of email alerts in practice: Part 2. Validation of the information assessment method.

RATIONALE AND OBJECTIVE:. The information assessment method (IAM) permits health professionals to systematically document the relevance, cognitive impact, use and health outcomes of information objects delivered by or retrieved from electronic knowledge resources. The companion review paper (Part 1) critically examined the literature, and proposed a 'Push-Pull-Acquisition-Cognition-Application' evaluation framework, which is operationalized by IAM. The purpose of the present paper (Part 2) is to examine the content validity of the IAM cognitive checklist when linked to email alerts. METHODS: A qualitative component of a mixed methods study was conducted with 46 doctors reading and rating research-based synopses sent on email. The unit of analysis was a doctor's explanation of a rating of one item regarding one synopsis. Interviews with participants provided 253 units that were analysed to assess concordance with item definitions. RESULTS AND CONCLUSION: The content relevance of seven items was supported. For three items, revisions were needed. Interviews suggested one new item. This study has yielded a 2008 version of IAM.

Prospective, multicenter validation of prediction scores for major bleeding in elderly patients with venous thromboembolism.

BACKGROUND: The Outpatient Bleeding Risk Index (OBRI) and the Kuijer, RIETE and Kearon scores are clinical prognostic scores for bleeding in patients receiving oral anticoagulants for venous thromboembolism (VTE). We prospectively compared the performance of these scores in elderly patients with VTE. METHODS: In a prospective multicenter Swiss cohort study, we studied 663 patients aged ≥ 65 years with acute VTE. The outcome was a first major bleeding at 90 days. We classified patients into three categories of bleeding risk (low, intermediate and high) according to each score and dichotomized patients as high vs. low or intermediate risk. We calculated the area under the receiver-operating characteristic (ROC) curve, positive predictive values and likelihood ratios for each score. RESULTS: Overall, 28 out of 663 patients (4.2%, 95% confidence interval [CI] 2.8-6.0%) had a first major bleeding within 90 days. According to different scores, the rate of major bleeding varied from 1.9% to 2.1% in low-risk, from 4.2% to 5.0% in intermediate-risk and from 3.1% to 6.6% in high-risk patients. The discriminative power of the scores was poor to moderate, with areas under the ROC curve ranging from 0.49 to 0.60 (P = 0.21). The positive predictive values and positive likelihood ratios were low and varied from 3.1% to 6.6% and from 0.72 to 1.59, respectively. CONCLUSION: In elderly patients with VTE, existing bleeding risk scores do not have sufficient accuracy and power to discriminate between patients with VTE who are at a high risk of short-term major bleeding and those who are not.

Cross-validation of bioelectrical impedance analysis for the assessment of body composition in a representative sample of 6- to 13-year-old children.

BACKGROUND/OBJECTIVES: (1) To cross-validate tetra- (4-BIA) and octopolar (8-BIA) bioelectrical impedance analysis vs dual-energy X-ray absorptiometry (DXA) for the assessment of total and appendicular body composition and (2) to evaluate the accuracy of external 4-BIA algorithms for the prediction of total body composition, in a representative sample of Swiss children. SUBJECTS/METHODS: A representative sample of 333 Swiss children aged 6-13 years from the Kinder-Sportstudie (KISS) (ISRCTN15360785). Whole-body fat-free mass (FFM) and appendicular lean tissue mass were measured with DXA. Body resistance (R) was measured at 50 kHz with 4-BIA and segmental body resistance at 5, 50, 250 and 500 kHz with 8-BIA. The resistance index (RI) was calculated as height(2)/R. Selection of predictors (gender, age, weight, RI4 and RI8) for BIA algorithms was performed using bootstrapped stepwise linear regression on 1000 samples. We calculated 95% confidence intervals (CI) of regression coefficients and measures of model fit using bootstrap analysis. Limits of agreement were used as measures of interchangeability of BIA with DXA. RESULTS: 8-BIA was more accurate than 4-BIA for the assessment of FFM (root mean square error (RMSE)=0.90 (95% CI 0.82-0.98) vs 1.12 kg (1.01-1.24); limits of agreement 1.80 to -1.80 kg vs 2.24 to -2.24 kg). 8-BIA also gave accurate estimates of appendicular body composition, with RMSE < or = 0.10 kg for arms and < or = 0.24 kg for legs. All external 4-BIA algorithms performed poorly with substantial negative proportional bias (r> or = 0.48, P<0.001). CONCLUSIONS: In a representative sample of young Swiss children (1) 8-BIA was superior to 4-BIA for the prediction of FFM, (2) external 4-BIA algorithms gave biased predictions of FFM and (3) 8-BIA was an accurate predictor of segmental body composition.

The MicroArray Quality Control (MAQC)-II study of common practices for the development and validation of microarray-based predictive models.

Gene expression data from microarrays are being applied to predict preclinical and clinical endpoints, but the reliability of these predictions has not been established. In the MAQC-II project, 36 independent teams analyzed six microarray data sets to generate predictive models for classifying a sample with respect to one of 13 endpoints indicative of lung or liver toxicity in rodents, or of breast cancer, multiple myeloma or neuroblastoma in humans. In total, >30,000 models were built using many combinations of analytical methods. The teams generated predictive models without knowing the biological meaning of some of the endpoints and, to mimic clinical reality, tested the models on data that had not been used for training. We found that model performance depended largely on the endpoint and team proficiency and that different approaches generated models of similar performance. The conclusions and recommendations from MAQC-II should be useful for regulatory agencies, study committees and independent investigators that evaluate methods for global gene expression analysis.

Development and validation of a self-report version of the Spinal Cord Independence Measure (SCIM III).

Study design:Cross-sectional validation study.Objectives:To develop and validate a self-report version of the Spinal Cord Independence Measure (SCIM III).Setting:Two SCI rehabilitation facilities in Switzerland.Methods:SCIM III comprises 19 questions on daily tasks with a total score between 0 and 100 and subscales for 'self-care', 'respiration & sphincter management' and 'mobility'. A self-report version (SCIM-SR) was developed by expert discussions and pretests in individuals with spinal cord injury (SCI) using a German translation. A convenience sample of 99 inpatients with SCI was recruited. SCIM-SR data were analyzed together with SCIM III data obtained from attending health professionals.Results:High correlations between SCIM III and SCIM-SR were observed. Pearson's r for the total score was 0.87 (95% confidence interval (CI) 0.82-0.91), for the subscales self-care 0.87 (0.81-0.91); respiration & sphincter management 0.81 (0.73-0.87); and mobility 0.87 (0.82-0.91). Intraclass correlations were: total score 0.90 (95% CI 0.85-0.93); self-care 0.86 (0.79-0.90); respiration & sphincter management 0.80 (0.71-0.86); and mobility 0.83 (0.76-0.89). Bland-Altman plots showed that patients rated their functioning higher than professionals, in particular for mobility. The mean difference between SCIM-SR and SCIM III for the total score was 5.14 (point estimate 95% CI 2.95-7.34), self-care 0.89 (0.19-1.59), respiration & sphincter management 1.05 (0.18-2.28 ) and mobility 3.49 (2.44-4.54). Particularly patients readmitted because of pressure sores rated their independence higher than attending professionals.Conclusion:Our results support the criterion validity of SCIM-SR. The self-report version may facilitate long-term evaluations of independence in persons with SCI in their home situation.

Validation française de l'échelle d'expérience temporelle du plaisir [Validation of the Temporal Experience of Pleasure Scale (TEPS) in a French-speaking environment.]

INTRODUCTION: Anhedonia is defined as a diminished capacity to experience pleasant emotion and is commonly included among the negative symptoms of schizophrenia. However, if patients report experiencing a lower level of pleasure than controls, they report experiencing as much pleasure as controls with online measurements of emotion. OBJECTIVE: The Temporal Experience of Pleasure Scale (TEPS) measures pleasure experienced in the moment and in anticipation of future activities. The TEPS is an 18-item self-report measurement of anticipatory (10 items) and consummatory (eight items) pleasure. The goal of this paper is to assess the psychometric characteristics of the French translation of this scale. METHODS: A control sample was composed of 60 women and 22 men, with a mean age of 38.1 years (S.D.: 10.8). Thirty-six were without qualification and 46 with qualified professional diploma. A sample of 21 patients meeting DSM IV-TR criteria for schizophrenia was recruited among the community psychiatry service of the department of psychiatry in Lausanne. They were five women and 16 men; mean age was of 34.1 years (S.D.: 7.5). Ten obtained a professional qualification and 11 were without qualification. None worked in competitive employment. Their mean dose of chlorpromazine equivalent was 431mg (S.D.: 259). All patients were on atypical antipsychotics. The control sample fulfilled the TEPS and the Physical Anhedonia Scale (PAS). The patient sample fulfilled the TEPS and was independently rated on the Calgary Depression Scale and the Scale for Assessment of Negative Symptoms. For comparison with controls, patients were matched on age, sex and professional qualification. This required the supplementary recruitment of two control subjects. RESULTS: Results with the control sample indicate that the TEPS presents an acceptable internal validity with Crombach alphas of 0.84 for the total scale, 0.74 for the anticipatory pleasure scale and 0.79 for the consummatory pleasure scale. The confirmatory factor analysis indicated that the model is well adapted to our data (chi(2)/dl=1.333; df=134; p<0.0006; root mean square residual, RMSEA=0.064). External validity measured with the PAS showed R=-0.27 (p<0.05) for the consummatory scale and R=-0.26 for the total score. Comparisons between patients and matched controls indicated that patients were significantly lower than control on anticipatory pleasure (t=2.7, df(40), 2-tailed p=0.01; cohen's d=0.83) and on total score of the TEPS (t=2.8, df (40), 2-tailed p=0.01; cohen's d=0.87). The two samples did not differ on consummatory pleasure. The anticipatory pleasure factor and the total TEPS showed significant negative correlation with the SANS anhedonia, respectively R=-0.78 (p<0.01) for the anticipatory factor and R=-0.61 (p<0.01) for the total TEPS. There was also a negative correlation between the anticipatory factor and the SANS avolition of R=-0.50 (p<0.05). These correlations were maintained, with partial correlations controlling for depression and chlorpromazine equivalents. CONCLUSION: The results of this validation show that the French version of the TEPS has psychometric characteristics similar to the original version. These results highlight the discrepancy between results of direct or indirect report of experienced pleasure in patients with schizophrenia. Patients may have difficulties in anticipating the pleasure of future enjoyable activities, but not in experiencing pleasure once in an enjoyable activity. Medication and depression do not seems to modify our results, but this should be better controlled in a longitudinal study. The anticipatory versus consummatory pleasure distinction appears to be useful for the development of new psychosocial interventions, tailored to improve desire in patients suffering from schizophrenia. Major limitations of the study are the small size of patient sample and the under representation of men in the control sample.

Validation française d'un questionnaire de stress post-traumatique destiné aux parents d'enfants présentant un risque périnatal élevé = French validation of the "Perinatal PTSD Questionnaire" assessing parent's posttraumatic stress reactions following the birth of a high risk infant.

(from the journal abstract) Objectives: The birth of a high risk infant--such as a very or extremely premature infant--can represent an important traumatic experience for parents. R. DeMier, M. Hynan et al's "Perinatal PTSD Questionnaire" aims at exploring, retrospectively, parent's posttraumatic stress reactions following the birth of a high risk infant. This paper describes the French validation of this questionnaire. Methods: Fifty-two families with a very or extremely premature infant and 25 families with a full term infant responded to the "Perinatal PTSD Questionnaire" and the "Impact of Event Scale" when children were 18 months old. Results: Parents of high risk infants can present posttraumatic stress reactions such as intrusion, avoidance or arousal symptoms. The French version of the "Perinatal PTSD Questionnaire" has satisfactory psychometric properties. Conclusions: As posttraumatic reactions are not directly related to objective descriptions of the stressful event, it may be essential to the liaison child psychiatrist to consider individual posttraumatic reactions in order to optimise preventive intervention with the parents. A questionnaire should not replace a clinical interview, however it may represent a useful screening tool. Also, this questionnaire should be useful for research purposes. (PsycINFO Database Record (c) 2005 APA, all rights reserved)

Validation of the potentially avoidable hospital readmission rate as a routine indicator of the quality of hospital care

BACKGROUND: The hospital readmission rate has been proposed as an important outcome indicator computable from routine statistics. However, most commonly used measures raise conceptual issues. OBJECTIVES: We sought to evaluate the usefulness of the computerized algorithm for identifying avoidable readmissions on the basis of minimum bias, criterion validity, and measurement precision. RESEARCH DESIGN AND SUBJECTS: A total of 131,809 hospitalizations of patients discharged alive from 49 hospitals were used to compare the predictive performance of risk adjustment methods. A subset of a random sample of 570 medical records of discharge/readmission pairs in 12 hospitals were reviewed to estimate the predictive value of the screening of potentially avoidable readmissions. MEASURES: Potentially avoidable readmissions, defined as readmissions related to a condition of the previous hospitalization and not expected as part of a program of care and occurring within 30 days after the previous discharge, were identified by a computerized algorithm. Unavoidable readmissions were considered as censored events. RESULTS: A total of 5.2% of hospitalizations were followed by a potentially avoidable readmission, 17% of them in a different hospital. The predictive value of the screen was 78%; 27% of screened readmissions were judged clearly avoidable. The correlation between the hospital rate of clearly avoidable readmission and all readmissions rate, potentially avoidable readmissions rate or the ratio of observed to expected readmissions were respectively 0.42, 0.56 and 0.66. Adjustment models using clinical information performed better. CONCLUSION: Adjusted rates of potentially avoidable readmissions are scientifically sound enough to warrant their inclusion in hospital quality surveillance.

Carotid-Subclavian Artery Index : Validation of an Echocardiographic Index to Detect Coarctation : P67

Introduction: Due to patency of the arterial duct and the parallel circulation during the fetal life, coarctation remains a difficult diagnosis prenatally and even shortly after birth. Fisrtly, our study aimed to assess accuracy of a new cardiographie index based on morphologie measurements of the distal aortic arch, the Carotid-Subclavian Artery Index (CSA Index), the ratio of the distal transverse aortic arch diameter to the distance between the left carotid artery and the left subclavian artery, in detecting coarctation in newborns, infants and children, independently of other cardiac lesions. Secondly, to assess the additive value of another morphologie index in predicting coarctation, the 1/0 ratio, the ratio of isthmus to descending aorta diameter. Methods: It is a retrospective cohort study in a tertiary care children's hospital. Offline echocardiographic measurements of great vessels and aortic arch dimensions were done in 69 patients with coarctation. We calculate their CSA index, and their 1/0 ratio. Values of CSA Index and 1/0 ratio from coarctation group were compared with those from a normal local control population. Results: 69 echocardiograms from patients with coarctation were analysed. Compared with controls, patients with coarctation had a significantly lower CSA index (0.88 ±0.49 vs 2.65 ±0.82, p <0.0001) and 1/0 ratio. The same significant difference was observed, independently of age and other associated defects, even complex ones. CSA Index confirmed its good sensitivity and specificity (99% and 96% respectively). This was not improved by adding the I/D ratio. Conclusions: An abnormal CSA index is highly suggestive of coarctation independently of age, of the presence of a patent ductus arteriosus or of other cardiac defects. The addition of another anatomie index, the I/D ratio, was not helpful in our study.

Validation of methane measurement using headspace-GC-MS and quantification by a stable isotope-labeled internal standard generated in situ.

A previous study has shown the possibility to identify methane (CH4 ) using headspace-GC-MS and quantify it with a stable isotope as internal standard. The main drawback of the GC-MS methods discussed in literature for CH4 measurement is the absence of a specific internal standard necessary to perform quantification. However, it becomes essential to develop a safer method to limit the manipulation of gaseous CH4 and to precisely control the injected amount of gas for spiking and calibration by comparison with external calibration. To avoid the manipulation of a stable isotope-labeled gas, we have chosen to generate a labeled gas as an internal standard in a vial on the basis of the formation of CH4 by the reaction of Grignard reagent methylmagnesium chloride with deuterated water. This method allows precise measurement of CH4 concentrations in gaseous sample as well as in a solid or a liquid sample after a thermodesorption step in a headspace vial. A full accuracy profile validation of this method is then presented.

Development and validation of a clinical decision rule for the diagnosis of influenza.

INTRODUCTION: A clinical decision rule to improve the accuracy of a diagnosis of influenza could help clinicians avoid unnecessary use of diagnostic tests and treatments. Our objective was to develop and validate a simple clinical decision rule for diagnosis of influenza. METHODS: We combined data from 2 studies of influenza diagnosis in adult outpatients with suspected influenza: one set in California and one in Switzerland. Patients in both studies underwent a structured history and physical examination and had a reference standard test for influenza (polymerase chain reaction or culture). We randomly divided the dataset into derivation and validation groups and then evaluated simple heuristics and decision rules from previous studies and 3 rules based on our own multivariate analysis. Cutpoints for stratification of risk groups in each model were determined using the derivation group before evaluating them in the validation group. For each decision rule, the positive predictive value and likelihood ratio for influenza in low-, moderate-, and high-risk groups, and the percentage of patients allocated to each risk group, were reported. RESULTS: The simple heuristics (fever and cough; fever, cough, and acute onset) were helpful when positive but not when negative. The most useful and accurate clinical rule assigned 2 points for fever plus cough, 2 points for myalgias, and 1 point each for duration <48 hours and chills or sweats. The risk of influenza was 8% for 0 to 2 points, 30% for 3 points, and 59% for 4 to 6 points; the rule performed similarly in derivation and validation groups. Approximately two-thirds of patients fell into the low- or high-risk group and would not require further diagnostic testing. CONCLUSION: A simple, valid clinical rule can be used to guide point-of-care testing and empiric therapy for patients with suspected influenza.

French version validation of the psychotic symptom rating scales (PSYRATS) for outpatients with persistent psychotic symptoms.

ABSTRACT: BACKGROUND: Most scales that assess the presence and severity of psychotic symptoms often measure a broad range of experiences and behaviours, something that restricts the detailed measurement of specific symptoms such as delusions or hallucinations. The Psychotic Symptom Rating Scales (PSYRATS) is a clinical assessment tool that focuses on the detailed measurement of these core symptoms. The goal of this study was to examine the psychometric properties of the French version of the PSYRATS. METHODS: A sample of 103 outpatients suffering from schizophrenia or schizoaffective disorders and presenting persistent psychotic symptoms over the previous three months was assessed using the PSYRATS. Seventy-five sample participants were also assessed with the Positive And Negative Syndrome Scale (PANSS). RESULTS: ICCs were superior to .90 for all items of the PSYRATS. Factor analysis replicated the factorial structure of the original version of the delusions scale. Similar to previous replications, the factor structure of the hallucinations scale was partially replicated. Convergent validity indicated that some specific PSYRATS items do not correlate with the PANSS delusions or hallucinations. The distress items of the PSYRATS are negatively correlated with the grandiosity scale of the PANSS. CONCLUSIONS: The results of this study are limited by the relatively small sample size as well as the selection of participants with persistent symptoms. The French version of the PSYRATS partially replicates previously published results. Differences in factor structure of the hallucinations scale might be explained by greater variability of its elements. The future development of the scale should take into account the presence of grandiosity in order to better capture details of the psychotic experience.

Quality assessment of cardiovascular magnetic resonance in the setting of the European CMR registry: description and validation of standardized criteria.

BACKGROUND: Cardiovascular magnetic resonance (CMR) has become an important diagnostic imaging modality in cardiovascular medicine. However, insufficient image quality may compromise its diagnostic accuracy. We aimed to describe and validate standardized criteria to evaluate a) cine steady-state free precession (SSFP), b) late gadolinium enhancement (LGE), and c) stress first-pass perfusion images. These criteria will serve for quality assessment in the setting of the Euro-CMR registry. METHODS: Thirty-five qualitative criteria were defined (scores 0-3) with lower scores indicating better image quality. In addition, quantitative parameters were measured yielding 2 additional quality criteria, i.e. signal-to-noise ratio (SNR) of non-infarcted myocardium (as a measure of correct signal nulling of healthy myocardium) for LGE and % signal increase during contrast medium first-pass for perfusion images. These qualitative and quantitative criteria were assessed in a total of 90 patients (60 patients scanned at our own institution at 1.5T (n=30) and 3T (n=30) and in 30 patients randomly chosen from the Euro-CMR registry examined at 1.5T). Analyses were performed by 2 SCMR level-3 experts, 1 trained study nurse, and 1 trained medical student. RESULTS: The global quality score was 6.7±4.6 (n=90, mean of 4 observers, maximum possible score 64), range 6.4-6.9 (p=0.76 between observers). It ranged from 4.0-4.3 for 1.5T (p=0.96 between observers), from 5.9-6.9 for 3T (p=0.33 between observers), and from 8.6-10.3 for the Euro-CMR cases (p=0.40 between observers). The inter- (n=4) and intra-observer (n=2) agreement for the global quality score, i.e. the percentage of assignments to the same quality tertile ranged from 80% to 88% and from 90% to 98%, respectively. The agreement for the quantitative assessment for LGE images (scores 0-2 for SNR <2, 2-5, >5, respectively) ranged from 78-84% for the entire population, and 70-93% at 1.5T, 64-88% at 3T, and 72-90% for the Euro-CMR cases. The agreement for perfusion images (scores 0-2 for %SI increase >200%, 100%-200%,<100%, respectively) ranged from 81-91% for the entire population, and 76-100% at 1.5T, 67-96% at 3T, and 62-90% for the Euro-CMR registry cases. The intra-class correlation coefficient for the global quality score was 0.83. CONCLUSIONS: The described criteria for the assessment of CMR image quality are robust with a good inter- and intra-observer agreement. Further research is needed to define the impact of image quality on the diagnostic and prognostic yield of CMR studies.