The interrater reliability of the pulmonary embolism severity index

RésuméLe PESI (Pulmonary Embolism Severity Index) est un score clinique pronostique s'appliquant à des patients présentant un diagnostic d'embolie pulmonaire. Notre objectif était de démontrer la reproductibilité de ce score entre différents médecins chez des patients présentant une embolie pulmonaire. Nous avons donc identifié, de façon prospective, des patients présentant une embolie pulmonaire nouvellement diagnostiquée aux urgences d'un Hôpital Universitaire (CHUV, Lausanne). Pour tous ces patients, le médecin assistant en charge ainsi que le chef de clinique superviseur ont individuellement collecté les différentes variables permettant d'établir le score selon le PESI. Ils ont, ensuite, de façon indépendante, classifié les patients dans 5 classes de risque (1-V) ainsi qu'en deux groupes à bas risque versus haut risque, respectivement les classes i-ll et les classes III à V.Nous avons examiné la reproductibilité des données entre deux groupes de médecins (médecins assistants vs chefs de clinique), pour chacune des variables constituant le PESI, pour le score total en points, pour l'attribution aux 5 classes de risque ainsi que pour la classification en deux groupes à haut risque versus bas risque. Cette évaluation de la reproductibilité des résultats obtenus par les différents médecins s'est basée sur le calcul du Kappa (K) ainsi sur les Coefficients de Corrélation Intra-classe (ICC).Parmi les 48 patients présentant une Embolie Pulmonaire inclus dans notre étude, les coefficients de reproductibilité entre médecins assistants et chefs de clinique étaient supérieurs à 0.60 pour 10 des 11 variables du PESI. La reproductibilité entre les 2 groupes de médecins, pour le total des points, pour l'attribution à une classe de risque I à V, ainsi que pour la classification en bas versus haut risque était presque parfaite.Nos résultats démontrent la haute reproductibilité du PESI, et appuient donc l'intérêt de son utilisation pour la stratification du risque chez des patients présentant une embolie pulmonaire.

Reliability of P-drive in occupational therapy following a short training session: A promising instrument measuring seniors' on-road driving competencies

Introduction Occupational therapists could play an important role in facilitating driving cessation for ageing drivers. This, however, requires an easy-to-learn, standardised on-road evaluation method. This study therefore investigates whether use of P-drive' could be reliably taught to occupational therapists via a short half-day training session. Method Using the English 26-item version of P-drive, two occupational therapists evaluated the driving ability of 24 home-dwelling drivers aged 70 years or over on a standardised on-road route. Experienced driving instructors' on-road, subjective evaluations were then compared with P-drive scores. Results Following a short half-day training session, P-drive was shown to have almost perfect between-rater reliability (ICC2,1=0.950, 95% CI 0.889 to 0.978). Reliability was stable across sessions including the training phase even if occupational therapists seemed to become slightly less severe in their ratings with experience. P-drive's score was related to the driving instructors' subjective evaluations of driving skills in a non-linear manner (R-2=0.445, p=0.021). Conclusion P-drive is a reliable instrument that can easily be taught to occupational therapists and implemented as a way of standardising the on-road driving test.

Inter-rater Reliability of Criteria-Based Content Analysis of Children's Statements of Abuse.

The evaluation of children's statements of sexual abuse cases in forensic cases is critically important and must and reliable. Criteria-based content analysis (CBCA) is the main component of the statement validity assessment (SVA), which is the most frequently used approach in this setting. This study investigated the inter-rater reliability (IRR) of CBCA in a forensic context. Three independent raters evaluated the transcripts of 95 statements of sexual abuse. IRR was calculated for each criterion, total score, and overall evaluation. The IRR was variable for the criteria, with several being unsatisfactory. But high IRR was found for the total CBCA scores (Kendall's W = 0.84) and for overall evaluation (Kendall's W = 0.65). Despite some shortcomings, SVA remains a robust method to be used in the comprehensive evaluation of children's statements of sexual abuse in the forensic setting. However, the low IRR of some CBCA criteria could justify some technical improvements.

Reliability of maximal grip strength measurements and grip strength recovery following a stroke.

STUDY DESIGN: Clinical measurement. PURPOSE: The test-retest reliability of maximal grip strength measurements (MGSM) is examined in subjects for 12 weeks post-stroke together with maximal grip strength recovery and the maximal-grip and upper-extremity strength measurements' relationship with capacity and performance test scores. METHODS: A Jamar dynamometer and the Motricity Index (MI) were used for strength measurements. The Chedoke Arm and Hand Activity Inventory and ABILHAND questionnaire for evaluating capacities and performances. RESULTS: MGSM were reliable (Intraclass Correlation Coefficients = 0.97-0.99, Minimal Detectable Differences = 2.73-4.68 kg). Among the 34 participants, 47% did not have a measurable grip strength one week post-stroke but 50% of these recovered some strength within the first eight weeks. The MGSM and MI scores were correlated with scores of tests of capacity and performance (Spearman's Rank Correlation Coefficients = 0.69-0.94). CONCLUSIONS: MGSM are reliable in the first weeks after a stroke. LEVEL OF EVIDENCE: N/A.

Towards a global criteria based framework for the sustainability assessment of bioethanol supply chains: application to the Swiss dilemma : is local produced bioethanol more sustainable than bioethanol imported from Brazil?

Biofuels are considered as a promising substitute for fossil fuels when considering the possible reduction of greenhouse gases emissions. However limiting their impacts on potential benefits for reducing climate change is shortsighted. Global sustainability assessments are necessary to determine the sustainability of supply chains. We propose a new global criterion based framework enabling a comprehensive international comparison of bioethanol supply chains. The interest of this framework is that the selection of the sustainability indicators is qualified on three criterions: relevance, reliability and adaptability to the local context. Sustainability issues have been handled along environmental, social and economical issues. This new framework has been applied for a specific issue: from a Swiss perspective, is locally produced bioethanol in Switzerland more sustainable than imported from Brazil? Thanks to this framework integrating local context in its indicator definition, Brazilian production of bioethanol is shown as energy efficient and economically interesting for Brazil. From a strictly economic point of view, bioethanol production within Switzerland is not justified for Swiss consumption and questionable for the environmental issue. The social dimension is delicate to assess due to the lack of reliable data and is strongly linked to the agricultural policy in both countries. There is a need of establishing minimum sustainability criteria for imported bioethanol to avoid unwanted negative or leakage effects.

Reliability and validity of the Alcohol Use Disorders Identification Test (AUDIT) imbedded within a general health risk screening questionnaire: results of a survey in 332 primary care patients.

BACKGROUND: Self-administered, general health risk screening questionnaires that are administered while patients wait in the doctor's office may be a reasonable and timesaving approach to address the requirements of preventive medicine in a typical 10-min medical visit. The psychometric characteristics of the Alcohol Use Disorders Identification Test (AUDIT) incorporated within a health questionnaire (H-AUDIT) have not been examined. METHODS: The reliability and validity of the self-administered AUDIT were compared between the H-AUDIT and the AUDIT used as a single scale (S-AUDIT) in 332 primary care patients. RESULTS: No major demographic or alcohol use characteristics were found between the 166 subjects who completed the H-AUDIT and the 166 individuals who completed the S-AUDIT. The test-retest reliability of the 166 subjects who completed the H-AUDIT [estimated by Spearman correlation coefficient at a 6-week interval (0.88), internal consistency (total correlation coefficients for all items ranged from 0.38 to 0.69; Cronbach alpha index 0.85), and the sensitivity and specificity of the H-AUDIT were used to identify at-risk drinkers' areas under receiver operating characteristic (0.77) and alcohol-dependent subjects' areas under receiver operating characteristic (0.89)] was similar to the same measurements obtained with the 166 individuals who completed the S-AUDIT. CONCLUSIONS: The AUDIT incorporated in a health risk screening questionnaire is a reliable and valid self-administered instrument to identify at-risk drinkers and alcohol-dependent individuals in primary care settings.

The Identity Style Inventory (ISI-3) and the Utrecht-Management of Identity Commitments Scale (U-MICS): Factor structure, reliability, and convergent validity in French-speaking college students

The purpose of this study was to evaluate the factor structure and the reliability of the French versions of the Identity Style Inventory (ISI-3) and the Utrecht-Management of Identity Commitments Scale (U-MICS) in a sample of college students (N = 457, 18 to 25 years old). Confirmatory factor analyses confirmed the hypothesized three-factor solution of the ISI-3 identity styles (i.e. informational, normative, and diffuse-avoidant styles), the one-factor solution of the ISI-3 identity commitment, and the three-factor structure of the U-MICS (i.e. commitment, in-depth exploration, and reconsideration of commitment). Additionally, theoretically consistent and meaningful associations among the ISI-3, U-MICS, and Ego Identity Process Questionnaire (EIPQ) confirmed convergent validity. Overall, the results of the present study indicate that the French versions of the ISI-3 and UMICS are useful instruments for assessing identity styles and processes, and provide additional support to the cross-cultural validity of these tools.

Validation of the instability shoulder index score in a multicenter reliability study in 114 consecutive cases.

BACKGROUND: Anterior shoulder stabilization surgery with the arthroscopic Bankart procedure can have a high recurrence rate in certain patients. Identifying these patients to modify outcomes has become a focal point of research. PURPOSE: The Instability Shoulder Index Score (ISIS) was developed to predict the success of arthroscopic Bankart repair. Scores range from 0 to 10, with higher scores predicting a higher risk of recurrence after stabilization. The interobserver reliability of the score is not known. STUDY DESIGN: Cohort study (diagnosis); Level of evidence, 2. METHODS: This is a prospective multicenter (North America and Europe) study of patients suffering from shoulder instability and waiting for stabilization surgery. Five pairs of independent evaluators were asked to score patient instability severity with the ISIS. Patients also completed functional scores (Western Ontario Shoulder Instability Index [WOSI], Disabilities of the Arm, Shoulder and Hand-short version [QuickDASH], and Walch-Duplay test). Data on age, sex, number of dislocations, and type of surgery were collected. The test-retest method and intraclass correlation coefficient (ICC: >0.75 = good, >0.85 = very good, and >0.9 = excellent) were used for analysis. RESULTS: A total of 114 patients with anterior shoulder instability were included, of whom 89 (78%) were men. The mean age was 28 years. The ISIS was very reliable, with an ICC of 0.933. The mean number of dislocations per patient was higher in patients who had an ISIS of ≥6 (25 vs 14; P = .05). Patients who underwent more complex arthroscopic procedures such as Hill-Sachs remplissage or open Latarjet had higher preoperative ISIS outcomes, with a mean score of 4.8 versus 3.4, respectively (P = .002). There was no correlation between the ISIS and the quality-of-life questionnaires, with Pearson correlations all >0.05 (WOSI = 0.39; QuickDASH = 0.97; Walch-Duplay = 0.08). CONCLUSION: Our results show that the ISIS is reliable when used in a multicenter study with anterior traumatic instability populations. There was no correlation between the ISIS and the quality-of-life questionnaires, but surgical decisions reflected its increased use.

Reliability and validity of physiological data obtained within a cycle-run transition test in age-group triathletes.

This study examined the validity and reliability of a sequential "Run-Bike-Run" test (RBR) in age-group triathletes. Eight Olympic distance (OD) specialists (age 30.0 ± 2.0 years, mass 75.6 ± 1.6 kg, run VO2max 63.8 ± 1.9 ml· kg(-1)· min(-1), cycle VO2peak 56.7 ± 5.1 ml· kg(-1)· min(-1)) performed four trials over 10 days. Trial 1 (TRVO2max) was an incremental treadmill running test. Trials 2 and 3 (RBR1 and RBR2) involved: 1) a 7-min run at 15 km· h(-1) (R1) plus a 1-min transition to 2) cycling to fatigue (2 W· kg(-1) body mass then 30 W each 3 min); 3) 10-min cycling at 3 W· kg(-1) (Bsubmax); another 1-min transition and 4) a second 7-min run at 15 km· h(-1) (R2). Trial 4 (TT) was a 30-min cycle - 20-min run time trial. No significant differences in absolute oxygen uptake (VO2), heart rate (HR), or blood lactate concentration ([BLA]) were evidenced between RBR1 and RBR2. For all measured physiological variables, the limits of agreement were similar, and the mean differences were physiologically unimportant, between trials. Low levels of test-retest error (i.e. ICC <0.8, CV<10%) were observed for most (logged) measurements. However [BLA] post R1 (ICC 0.87, CV 25.1%), [BLA] post Bsubmax (ICC 0.99, CV 16.31) and [BLA] post R2 (ICC 0.51, CV 22.9%) were least reliable. These error ranges may help coaches detect real changes in training status over time. Moreover, RBR test variables can be used to predict discipline specific and overall TT performance. Cycle VO2peak, cycle peak power output, and the change between R1 and R2 (deltaR1R2) in [BLA] were most highly related to overall TT distance (r = 0.89, p < 0. 01; r = 0.94, p < 0.02; r = 0.86, p < 0.05, respectively). The percentage of TR VO2max at 15 km· h(-1), and deltaR1R2 HR, were also related to run TT distance (r = -0.83 and 0.86, both p < 0.05).

Computer-aided volume measurement of posttraumatic orbits reconstructed with AO titanium mesh plates: accuracy and reliability

PURPOSE: To prospectively evaluate the accuracy and reliability of "freehand" posttraumatic orbital wall reconstruction with AO (Arbeitsgemeinschaft Osteosynthese) titanium mesh plates by using computer-aided volumetric measurement of the bony orbits. METHODS: Bony orbital volume was measured in 12 patients from coronal CT scan slices using OsiriX Medical Image software. After defining the volumetric limits of the orbit, the segmentation of the bony orbital region of interest of each single slice was performed. At the end of the segmentation process, all regions of interest were grouped and the volume was computed. The same procedure was performed on both orbits, and thereafter the volume of the contralateral uninjured orbit was used as a control for comparison. RESULTS: In all patients, the volume data of the reconstructed orbit fitted that of the contralateral uninjured orbit with accuracy to within 1.85 cm3 (7%). CONCLUSIONS: This preliminary study has demonstrated that posttraumatic orbital wall reconstruction using "freehand" bending and placement of AO titanium mesh plates results in a high success rate in re-establishing preoperative bony volume, which closely approximates that of the contralateral uninjured orbit.

The fourth extracellular loop of the alpha subunit of Na,K-ATPase. Functional evidence for close proximity with the second extracellular loop.

Na,K-ATPase is the main active transport system that maintains the large gradients of Na(+) and K(+) across the plasma membrane of animal cells. The crystal structure of a K(+)-occluding conformation of this protein has been recently published, but the movements of its different domains allowing for the cation pumping mechanism are not yet known. The structure of many more conformations is known for the related calcium ATPase SERCA, but the reliability of homology modeling is poor for several domains with low sequence identity, in particular the extracellular loops. To better define the structure of the large fourth extracellular loop between the seventh and eighth transmembrane segments of the alpha subunit, we have studied the formation of a disulfide bond between pairs of cysteine residues introduced by site-directed mutagenesis in the second and the fourth extracellular loop. We found a specific pair of cysteine positions (Y308C and D884C) for which extracellular treatment with an oxidizing agent inhibited the Na,K pump function, which could be rapidly restored by a reducing agent. The formation of the disulfide bond occurred preferentially under the E2-P conformation of Na,K-ATPase, in the absence of extracellular cations. Using recently published crystal structure and a distance constraint reproducing the existence of disulfide bond, we performed an extensive conformational space search using simulated annealing and showed that the Tyr(308) and Asp(884) residues can be in close proximity, and simultaneously, the SYGQ motif of the fourth extracellular loop, known to interact with the extracellular domain of the beta subunit, can be exposed to the exterior of the protein and can easily interact with the beta subunit.

Validation of the IMPACT-III quality of life questionnaire in Swiss children with inflammatory bowel disease.

BACKGROUND AND AIMS: Inflammatory bowel disease (IBD) frequently manifests during childhood and adolescence. For providing and understanding a comprehensive picture of a patients' health status, health-related quality of life (HRQoL) instruments are an essential complement to clinical symptoms and functional limitations. Currently, the IMPACT-III questionnaire is one of the most frequently used disease-specific HRQoL instrument among patients with IBD. However, there is a lack of studies examining the validation and reliability of this instrument. METHODS: 146 paediatric IBD patients from the multicenter Swiss IBD paediatric cohort study database were included in the study. Medical and laboratory data were extracted from the hospital records. HRQoL data were assessed by means of standardized questionnaires filled out by the patients in a face-to-face interview. RESULTS: The original six IMPACT-III domain scales could not be replicated in the current sample. A principal component analysis with the extraction of four factor scores revealed the most robust solution. The four factors indicated good internal reliability (Cronbach's alpha=.64-.86), good concurrent validity measured by correlations with the generic KIDSCREEN-27 scales and excellent discriminant validity for the dimension of physical functioning measured by HRQoL differences for active and inactive severity groups (p<.001, d=1.04). CONCLUSIONS: This study with Swiss children with IBD indicates good validity and reliability for the IMPACT-III questionnaire. However, our findings suggest a slightly different factor structure than originally proposed. The IMPACT-III questionnaire can be recommended for its use in clinical practice. The factor structure should be further examined in other samples.

Choline-PET in prostate cancer management: The point of view of the radiation oncologist.

Among PET radiotracers, FDG seems to be quite accepted as an accurate oncology diagnostic tool, frequently helpful also in the evaluation of treatment response and in radiation therapy treatment planning for several cancer sites. To the contrary, the reliability of Choline as a tracer for prostate cancer (PC) still remains an object of debate for clinicians, including radiation oncologists. This review focuses on the available data about the potential impact of Choline-PET in the daily clinical practice of radiation oncologists managing PC patients. In summary, routine Choline-PET is not indicated for initial local T staging, but it seems better than conventional imaging for nodal staging and for all patients with suspected metastases. In these settings, Choline-PET showed the potential to change patient management. A critical limit remains spatial resolution, limiting the accuracy and reliability for small lesions. After a PSA rise, the problem of the trigger PSA value remains crucial. Indeed, the overall detection rate of Choline-PET is significantly increased when the trigger PSA, or the doubling time, increases, but higher PSA levels are often a sign of metastatic spread, a contraindication for potentially curable local treatments such as radiation therapy. Even if several published data seem to be promising, the current role of PET in treatment planning in PC patients to be irradiated still remains under investigation. Based on available literature data, all these issues are addressed and discussed in this review.