The MicroArray Quality Control (MAQC)-II study of common practices for the development and validation of microarray-based predictive models.

Gene expression data from microarrays are being applied to predict preclinical and clinical endpoints, but the reliability of these predictions has not been established. In the MAQC-II project, 36 independent teams analyzed six microarray data sets to generate predictive models for classifying a sample with respect to one of 13 endpoints indicative of lung or liver toxicity in rodents, or of breast cancer, multiple myeloma or neuroblastoma in humans. In total, >30,000 models were built using many combinations of analytical methods. The teams generated predictive models without knowing the biological meaning of some of the endpoints and, to mimic clinical reality, tested the models on data that had not been used for training. We found that model performance depended largely on the endpoint and team proficiency and that different approaches generated models of similar performance. The conclusions and recommendations from MAQC-II should be useful for regulatory agencies, study committees and independent investigators that evaluate methods for global gene expression analysis.

Transcultural adaptation and validation of the "Hip and Knee" questionnaire into Spanish.

BACKGROUND The purpose of the present study is to translate and validate the "Hip and Knee Outcomes Questionnaire", developed in English, into Spanish. The 'Hip and Knee Outcomes Questionnaire is a questionnaire planned to evaluate the impact in quality of life of any problem related to the human musculoskeletal system. 10 scientific associations developed it. METHODS The questionnaire underwent a validated translation/retro-translation process. Patients undergoing primary knee arthroplasty, before and six months postoperative, tested the final version in Spanish. Psychometric properties of feasibility, reliability, validity and sensitivity to change were assessed. Convergent validity with SF-36 and WOMAC questionnaires was evaluated. RESULTS 316 patients were included. Feasibility: a high number of missing items in questions 3, 4 and 5 were observed. The number of patients with a missing item was 171 (51.35%) in the preoperative visit and 139 (44.0%) at the postoperative. Internal validity: revision of coefficients in the item-rest correlation recommended removing question 6 during the preoperative visit (coefficient <0.20). Convergent validity: coefficients of correlation with WOMAC and SF-36 scales confirm the questionnaire's validity. Sensitivity to change: statistically significant differences were found between the mean scores of the first visit compared to the postoperative. CONCLUSION The proposed translation to Spanish of the 'Hip and Knee Questionnaire' is found to be reliable, valid and sensible to changes produced at the clinical practice of patients undergoing primary knee arthroplasty. However, some changes at the completion instructions are recommended. LEVEL OF EVIDENCE Level I. Prognostic study.

Development and validation of a self-report version of the Spinal Cord Independence Measure (SCIM III).

Study design:Cross-sectional validation study.Objectives:To develop and validate a self-report version of the Spinal Cord Independence Measure (SCIM III).Setting:Two SCI rehabilitation facilities in Switzerland.Methods:SCIM III comprises 19 questions on daily tasks with a total score between 0 and 100 and subscales for 'self-care', 'respiration & sphincter management' and 'mobility'. A self-report version (SCIM-SR) was developed by expert discussions and pretests in individuals with spinal cord injury (SCI) using a German translation. A convenience sample of 99 inpatients with SCI was recruited. SCIM-SR data were analyzed together with SCIM III data obtained from attending health professionals.Results:High correlations between SCIM III and SCIM-SR were observed. Pearson's r for the total score was 0.87 (95% confidence interval (CI) 0.82-0.91), for the subscales self-care 0.87 (0.81-0.91); respiration & sphincter management 0.81 (0.73-0.87); and mobility 0.87 (0.82-0.91). Intraclass correlations were: total score 0.90 (95% CI 0.85-0.93); self-care 0.86 (0.79-0.90); respiration & sphincter management 0.80 (0.71-0.86); and mobility 0.83 (0.76-0.89). Bland-Altman plots showed that patients rated their functioning higher than professionals, in particular for mobility. The mean difference between SCIM-SR and SCIM III for the total score was 5.14 (point estimate 95% CI 2.95-7.34), self-care 0.89 (0.19-1.59), respiration & sphincter management 1.05 (0.18-2.28 ) and mobility 3.49 (2.44-4.54). Particularly patients readmitted because of pressure sores rated their independence higher than attending professionals.Conclusion:Our results support the criterion validity of SCIM-SR. The self-report version may facilitate long-term evaluations of independence in persons with SCI in their home situation.

Feasibility and clinical outcomes when using practice guidelines for evaluation of fever in returning travelers and migrants : a validation study.

BACKGROUND: Practice guidelines for examining febrile patients presenting upon returning from the tropics were developed to assist primary care physicians in decision making. Because of the low level of evidence available in this field, there was a need to validate them and assess their feasibility in the context they have been designed for. OBJECTIVES: The objectives of the study were to (1) evaluate physicians' adherence to recommendations; (2) investigate reasons for non-adherence; and (3) ensure good clinical outcome of patients, the ultimate goal being to improve the quality of the guidelines, in particular to tailor them for the needs of the target audience and population. METHODS: Physicians consulting the guidelines on the Internet (www.fevertravel.ch) were invited to participate in the study. Navigation through the decision chart was automatically recorded, including diagnostic tests performed, initial and final diagnoses, and clinical outcomes. The reasons for non-adherence were investigated and qualitative feedback was collected. RESULTS: A total of 539 physician/patient pairs were included in this study. Full adherence to guidelines was observed in 29% of the cases. Figure-specific adherence rate was 54.8%. The main reasons for non-adherence were as follows: no repetition of malaria tests (111/352) and no presumptive antibiotic treatment for febrile diarrhea (64/153) or abdominal pain without leukocytosis (46/101). Overall, 20% of diversions from guidelines were considered reasonable because there was an alternative presumptive diagnosis or the symptoms were mild, which means that the corrected adherence rate per case was 40.6% and corrected adherence per figure was 61.7%. No death was recorded and all complications could be attributed to the underlying illness rather than to adherence to guidelines. CONCLUSIONS: These guidelines proved to be feasible, useful, and leading to good clinical outcomes. Almost one third of physicians strictly adhered to the guidelines. Other physicians used the guidelines not to forget specific diagnoses but finally diverged from the proposed attitudes. These diversions should be scrutinized for further refinement of the guidelines to better fit to physician and patient needs.

SGP-1: prediction and validation of homologous genes based on sequence alignments

Conventional methods of gene prediction rely on the recognition of DNA-sequence signals, the coding potential or the comparison of a genomic sequence with a cDNA, EST, or protein database. Reasons for limited accuracy in many circumstances are species-specific training and the incompleteness of reference databases. Lately, comparative genome analysis has attracted increasing attention. Several analysis tools that are based on human/mouse comparisons are already available. Here, we present a program for the prediction of protein-coding genes, termed SGP-1 (Syntenic Gene Prediction), which is based on the similarity of homologous genomic sequences. In contrast to most existing tools, the accuracy of SGP-1 depends little on species-specific properties such as codon usage or the nucleotide distribution. SGP-1 may therefore be applied to nonstandard model organisms in vertebrates as well as in plants, without the need for extensive parameter training. In addition to predicting genes in large-scale genomic sequences, the program may be useful to validate gene structure annotations from databases. To this end, SGP-1 output also contains comparisons between predicted and annotated gene structures in HTML format. The program can be accessed via a Web server at http://soft.ice.mpg.de/sgp-1. The source code, written in ANSI C, is available on request from the authors.

Development and validation of AMANDA, a new algorithm for selecting highly relevant regions in Molecular Interaction Fields

Descriptors based on Molecular Interaction Fields (MIF) are highly suitable for drug discovery, but their size (thousands of variables) often limits their application in practice. Here we describe a simple and fast computational method that extracts from a MIF a handful of highly informative points (hot spots) which summarize the most relevant information. The method was specifically developed for drug discovery, is fast, and does not require human supervision, being suitable for its application on very large series of compounds. The quality of the results has been tested by running the method on the ligand structure of a large number of ligand-receptor complexes and then comparing the position of the selected hot spots with actual atoms of the receptor. As an additional test, the hot spots obtained with the novel method were used to obtain GRIND-like molecular descriptors which were compared with the original GRIND. In both cases the results show that the novel method is highly suitable for describing ligand-receptor interactions and compares favorably with other state-of-the-art methods.

Evaluation of Different Methods to Calculate Heavy-Truck VMT, Final Report, December 2004

Reliable estimates of heavy-truck volumes are important in a number of transportation applications. Estimates of truck volumes are necessary for pavement design and pavement management. Truck volumes are important in traffic safety. The number of trucks on the road also influences roadway capacity and traffic operations. Additionally, heavy vehicles pollute at higher rates than passenger vehicles. Consequently, reliable estimates of heavy-truck vehicle miles traveled (VMT) are important in creating accurate inventories of on-road emissions. This research evaluated three different methods to calculate heavy-truck annual average daily traffic (AADT) which can subsequently be used to estimate vehicle miles traveled (VMT). Traffic data from continuous count stations provided by the Iowa DOT were used to estimate AADT for two different truck groups (single-unit and multi-unit) using the three methods. The first method developed monthly and daily expansion factors for each truck group. The second and third methods created general expansion factors for all vehicles. Accuracy of the three methods was compared using n-fold cross-validation. In n-fold cross-validation, data are split into n partitions, and data from the nth partition are used to validate the remaining data. A comparison of the accuracy of the three methods was made using the estimates of prediction error obtained from cross-validation. The prediction error was determined by averaging the squared error between the estimated AADT and the actual AADT. Overall, the prediction error was the lowest for the method that developed expansion factors separately for the different truck groups for both single- and multi-unit trucks. This indicates that use of expansion factors specific to heavy trucks results in better estimates of AADT, and, subsequently, VMT, than using aggregate expansion factors and applying a percentage of trucks. Monthly, daily, and weekly traffic patterns were also evaluated. Significant variation exists in the temporal and seasonal patterns of heavy trucks as compared to passenger vehicles. This suggests that the use of aggregate expansion factors fails to adequately describe truck travel patterns.

Validation française de l'échelle d'expérience temporelle du plaisir [Validation of the Temporal Experience of Pleasure Scale (TEPS) in a French-speaking environment.]

INTRODUCTION: Anhedonia is defined as a diminished capacity to experience pleasant emotion and is commonly included among the negative symptoms of schizophrenia. However, if patients report experiencing a lower level of pleasure than controls, they report experiencing as much pleasure as controls with online measurements of emotion. OBJECTIVE: The Temporal Experience of Pleasure Scale (TEPS) measures pleasure experienced in the moment and in anticipation of future activities. The TEPS is an 18-item self-report measurement of anticipatory (10 items) and consummatory (eight items) pleasure. The goal of this paper is to assess the psychometric characteristics of the French translation of this scale. METHODS: A control sample was composed of 60 women and 22 men, with a mean age of 38.1 years (S.D.: 10.8). Thirty-six were without qualification and 46 with qualified professional diploma. A sample of 21 patients meeting DSM IV-TR criteria for schizophrenia was recruited among the community psychiatry service of the department of psychiatry in Lausanne. They were five women and 16 men; mean age was of 34.1 years (S.D.: 7.5). Ten obtained a professional qualification and 11 were without qualification. None worked in competitive employment. Their mean dose of chlorpromazine equivalent was 431mg (S.D.: 259). All patients were on atypical antipsychotics. The control sample fulfilled the TEPS and the Physical Anhedonia Scale (PAS). The patient sample fulfilled the TEPS and was independently rated on the Calgary Depression Scale and the Scale for Assessment of Negative Symptoms. For comparison with controls, patients were matched on age, sex and professional qualification. This required the supplementary recruitment of two control subjects. RESULTS: Results with the control sample indicate that the TEPS presents an acceptable internal validity with Crombach alphas of 0.84 for the total scale, 0.74 for the anticipatory pleasure scale and 0.79 for the consummatory pleasure scale. The confirmatory factor analysis indicated that the model is well adapted to our data (chi(2)/dl=1.333; df=134; p<0.0006; root mean square residual, RMSEA=0.064). External validity measured with the PAS showed R=-0.27 (p<0.05) for the consummatory scale and R=-0.26 for the total score. Comparisons between patients and matched controls indicated that patients were significantly lower than control on anticipatory pleasure (t=2.7, df(40), 2-tailed p=0.01; cohen's d=0.83) and on total score of the TEPS (t=2.8, df (40), 2-tailed p=0.01; cohen's d=0.87). The two samples did not differ on consummatory pleasure. The anticipatory pleasure factor and the total TEPS showed significant negative correlation with the SANS anhedonia, respectively R=-0.78 (p<0.01) for the anticipatory factor and R=-0.61 (p<0.01) for the total TEPS. There was also a negative correlation between the anticipatory factor and the SANS avolition of R=-0.50 (p<0.05). These correlations were maintained, with partial correlations controlling for depression and chlorpromazine equivalents. CONCLUSION: The results of this validation show that the French version of the TEPS has psychometric characteristics similar to the original version. These results highlight the discrepancy between results of direct or indirect report of experienced pleasure in patients with schizophrenia. Patients may have difficulties in anticipating the pleasure of future enjoyable activities, but not in experiencing pleasure once in an enjoyable activity. Medication and depression do not seems to modify our results, but this should be better controlled in a longitudinal study. The anticipatory versus consummatory pleasure distinction appears to be useful for the development of new psychosocial interventions, tailored to improve desire in patients suffering from schizophrenia. Major limitations of the study are the small size of patient sample and the under representation of men in the control sample.

Validation française d'un questionnaire de stress post-traumatique destiné aux parents d'enfants présentant un risque périnatal élevé = French validation of the "Perinatal PTSD Questionnaire" assessing parent's posttraumatic stress reactions following the birth of a high risk infant.

(from the journal abstract) Objectives: The birth of a high risk infant--such as a very or extremely premature infant--can represent an important traumatic experience for parents. R. DeMier, M. Hynan et al's "Perinatal PTSD Questionnaire" aims at exploring, retrospectively, parent's posttraumatic stress reactions following the birth of a high risk infant. This paper describes the French validation of this questionnaire. Methods: Fifty-two families with a very or extremely premature infant and 25 families with a full term infant responded to the "Perinatal PTSD Questionnaire" and the "Impact of Event Scale" when children were 18 months old. Results: Parents of high risk infants can present posttraumatic stress reactions such as intrusion, avoidance or arousal symptoms. The French version of the "Perinatal PTSD Questionnaire" has satisfactory psychometric properties. Conclusions: As posttraumatic reactions are not directly related to objective descriptions of the stressful event, it may be essential to the liaison child psychiatrist to consider individual posttraumatic reactions in order to optimise preventive intervention with the parents. A questionnaire should not replace a clinical interview, however it may represent a useful screening tool. Also, this questionnaire should be useful for research purposes. (PsycINFO Database Record (c) 2005 APA, all rights reserved)

Rehabilitation of Concrete Pavements Utilizing Rebblization and Crack and Seat Methods, June 2005

Deterioration in portland cement concrete (PCC) pavements can occur due to distresses caused by a combination of traffic loads and weather conditions. Hot mix asphalt (HMA) overlay is the most commonly used rehabilitation technique for such deteriorated PCC pavements. However, the performance of these HMA overlaid pavements is hindered due to the occurrence of reflective cracking, resulting in significant reduction of pavement serviceability. Various fractured slab techniques, including rubblization, crack and seat, and break and seat are used to minimize reflective cracking by reducing the slab action. However, the design of structural overlay thickness for cracked and seated and rubblized pavements is difficult as the resulting structure is neither a “true” rigid pavement nor a “true” flexible pavement. Existing design methodologies use the empirical procedures based on the AASHO Road Test conducted in 1961. But, the AASHO Road Test did not employ any fractured slab technique, and there are numerous limitations associated with extrapolating its results to HMA overlay thickness design for fractured PCC pavements. The main objective of this project is to develop a mechanistic-empirical (ME) design approach for the HMA overlay thickness design for fractured PCC pavements. In this design procedure, failure criteria such as the tensile strain at the bottom of HMA layer and the vertical compressive strain on the surface of subgrade are used to consider HMA fatigue and subgrade rutting, respectively. The developed ME design system is also implemented in a Visual Basic computer program. A partial validation of the design method with reference to an instrumented trial project (IA-141, Polk County) in Iowa is provided in this report. Tensile strain values at the bottom of the HMA layer collected from the FWD testing at this project site are in agreement with the results obtained from the developed computer program.

Quantification of myocardial blood flow with 82Rb positron emission tomography: clinical validation with 15O-water.

PURPOSE: Quantification of myocardial blood flow (MBF) with generator-produced (82)Rb is an attractive alternative for centres without an on-site cyclotron. Our aim was to validate (82)Rb-measured MBF in relation to that measured using (15)O-water, as a tracer 100% of which can be extracted from the circulation even at high flow rates, in healthy control subject and patients with mild coronary artery disease (CAD). METHODS: MBF was measured at rest and during adenosine-induced hyperaemia with (82)Rb and (15)O-water PET in 33 participants (22 control subjects, aged 30 ± 13 years; 11 CAD patients without transmural infarction, aged 60 ± 13 years). A one-tissue compartment (82)Rb model with ventricular spillover correction was used. The (82)Rb flow-dependent extraction rate was derived from (15)O-water measurements in a subset of 11 control subjects. Myocardial flow reserve (MFR) was defined as the hyperaemic/rest MBF. Pearson's correlation r, Bland-Altman 95% limits of agreement (LoA), and Lin's concordance correlation ρ (c) (measuring both precision and accuracy) were used. RESULTS: Over the entire MBF range (0.66-4.7 ml/min/g), concordance was excellent for MBF (r = 0.90, [(82)Rb-(15)O-water] mean difference ± SD = 0.04 ± 0.66 ml/min/g, LoA = -1.26 to 1.33 ml/min/g, ρ(c) = 0.88) and MFR (range 1.79-5.81, r = 0.83, mean difference = 0.14 ± 0.58, LoA = -0.99 to 1.28, ρ(c) = 0.82). Hyperaemic MBF was reduced in CAD patients compared with the subset of 11 control subjects (2.53 ± 0.74 vs. 3.62 ± 0.68 ml/min/g, p = 0.002, for (15)O-water; 2.53 ± 1.01 vs. 3.82 ± 1.21 ml/min/g, p = 0.013, for (82)Rb) and this was paralleled by a lower MFR (2.65 ± 0.62 vs. 3.79 ± 0.98, p = 0.004, for (15)O-water; 2.85 ± 0.91 vs. 3.88 ± 0.91, p = 0.012, for (82)Rb). Myocardial perfusion was homogeneous in 1,114 of 1,122 segments (99.3%) and there were no differences in MBF among the coronary artery territories (p > 0.31). CONCLUSION: Quantification of MBF with (82)Rb with a newly derived correction for the nonlinear extraction function was validated against MBF measured using (15)O-water in control subjects and patients with mild CAD, where it was found to be accurate at high flow rates. (82)Rb-derived MBF estimates seem robust for clinical research, advancing a step further towards its implementation in clinical routine.

Validation of the potentially avoidable hospital readmission rate as a routine indicator of the quality of hospital care

BACKGROUND: The hospital readmission rate has been proposed as an important outcome indicator computable from routine statistics. However, most commonly used measures raise conceptual issues. OBJECTIVES: We sought to evaluate the usefulness of the computerized algorithm for identifying avoidable readmissions on the basis of minimum bias, criterion validity, and measurement precision. RESEARCH DESIGN AND SUBJECTS: A total of 131,809 hospitalizations of patients discharged alive from 49 hospitals were used to compare the predictive performance of risk adjustment methods. A subset of a random sample of 570 medical records of discharge/readmission pairs in 12 hospitals were reviewed to estimate the predictive value of the screening of potentially avoidable readmissions. MEASURES: Potentially avoidable readmissions, defined as readmissions related to a condition of the previous hospitalization and not expected as part of a program of care and occurring within 30 days after the previous discharge, were identified by a computerized algorithm. Unavoidable readmissions were considered as censored events. RESULTS: A total of 5.2% of hospitalizations were followed by a potentially avoidable readmission, 17% of them in a different hospital. The predictive value of the screen was 78%; 27% of screened readmissions were judged clearly avoidable. The correlation between the hospital rate of clearly avoidable readmission and all readmissions rate, potentially avoidable readmissions rate or the ratio of observed to expected readmissions were respectively 0.42, 0.56 and 0.66. Adjustment models using clinical information performed better. CONCLUSION: Adjusted rates of potentially avoidable readmissions are scientifically sound enough to warrant their inclusion in hospital quality surveillance.

Carotid-Subclavian Artery Index : Validation of an Echocardiographic Index to Detect Coarctation : P67

Introduction: Due to patency of the arterial duct and the parallel circulation during the fetal life, coarctation remains a difficult diagnosis prenatally and even shortly after birth. Fisrtly, our study aimed to assess accuracy of a new cardiographie index based on morphologie measurements of the distal aortic arch, the Carotid-Subclavian Artery Index (CSA Index), the ratio of the distal transverse aortic arch diameter to the distance between the left carotid artery and the left subclavian artery, in detecting coarctation in newborns, infants and children, independently of other cardiac lesions. Secondly, to assess the additive value of another morphologie index in predicting coarctation, the 1/0 ratio, the ratio of isthmus to descending aorta diameter. Methods: It is a retrospective cohort study in a tertiary care children's hospital. Offline echocardiographic measurements of great vessels and aortic arch dimensions were done in 69 patients with coarctation. We calculate their CSA index, and their 1/0 ratio. Values of CSA Index and 1/0 ratio from coarctation group were compared with those from a normal local control population. Results: 69 echocardiograms from patients with coarctation were analysed. Compared with controls, patients with coarctation had a significantly lower CSA index (0.88 ±0.49 vs 2.65 ±0.82, p <0.0001) and 1/0 ratio. The same significant difference was observed, independently of age and other associated defects, even complex ones. CSA Index confirmed its good sensitivity and specificity (99% and 96% respectively). This was not improved by adding the I/D ratio. Conclusions: An abnormal CSA index is highly suggestive of coarctation independently of age, of the presence of a patent ductus arteriosus or of other cardiac defects. The addition of another anatomie index, the I/D ratio, was not helpful in our study.

Simultaneous determination of antidementia drugs by HPLC-MS: validation data of the method and plasma level determinations in 300 patients

Aims: A rapid and simple HPLC-MS method was developed for the simultaneousdetermination of antidementia drugs, including donepezil, galantamine, rivastigmineand its major metabolite NAP 226 - 90, and memantine, for TherapeuticDrug Monitoring (TDM). In the elderly population treated with antidementiadrugs, the presence of several comorbidities, drug interactions resulting frompolypharmacy, and variations in drug metabolism and elimination, are possiblefactors leading to the observed high interindividual variability in plasma levels.Although evidence for the benefit of TDM for antidementia drugs still remains tobe demonstrated, an individually adapted dosage through TDM might contributeto minimize the risk of adverse reactions and to increase the probability of efficienttherapeutic response. Methods: A solid-phase extraction procedure with amixed-mode cation exchange sorbent was used to isolate the drugs from 0.5 mL ofplasma. The compounds were analyzed on a reverse-phase column with a gradientelution consisting of an ammonium acetate buffer at pH 9.3 and acetonitrile anddetected by mass spectrometry in the single ion monitoring mode. Isotope-labeledinternal standards were used for quantification where possible. The validatedmethod was used to measure the plasma levels of antidementia drugs in 300patients treated with these drugs. Results: The method was validated accordingto international standards of validation, including the assessment of the trueness(-8 - 11 %), the imprecision (repeatability: 1-5%, intermediate imprecision:2 - 9 %), selectivity and matrix effects variability (less than 6 %). Furthermore,short and long-term stability of the analytes in plasma was ascertained. Themethod proved to be robust in the calibrated ranges of 1 - 300 ng/mL for rivastigmineand memantine and 2 - 300 mg/mL for donepezil, galantamine and NAP226 - 90. We recently published a full description of the method (1). We found ahigh interindividual variability in plasma levels of these drugs in a study populationof 300 patients. The plasma level measurements, with some preliminaryclinical and pharmacogenetic results, will be presented. Conclusion: A simpleLC-MS method was developed for plasma level determination of antidementiadrugs which was successfully used in a clinical study with 300 patients.