Validation of the instability shoulder index score in a multicenter reliability study in 114 consecutive cases.

BACKGROUND: Anterior shoulder stabilization surgery with the arthroscopic Bankart procedure can have a high recurrence rate in certain patients. Identifying these patients to modify outcomes has become a focal point of research. PURPOSE: The Instability Shoulder Index Score (ISIS) was developed to predict the success of arthroscopic Bankart repair. Scores range from 0 to 10, with higher scores predicting a higher risk of recurrence after stabilization. The interobserver reliability of the score is not known. STUDY DESIGN: Cohort study (diagnosis); Level of evidence, 2. METHODS: This is a prospective multicenter (North America and Europe) study of patients suffering from shoulder instability and waiting for stabilization surgery. Five pairs of independent evaluators were asked to score patient instability severity with the ISIS. Patients also completed functional scores (Western Ontario Shoulder Instability Index [WOSI], Disabilities of the Arm, Shoulder and Hand-short version [QuickDASH], and Walch-Duplay test). Data on age, sex, number of dislocations, and type of surgery were collected. The test-retest method and intraclass correlation coefficient (ICC: >0.75 = good, >0.85 = very good, and >0.9 = excellent) were used for analysis. RESULTS: A total of 114 patients with anterior shoulder instability were included, of whom 89 (78%) were men. The mean age was 28 years. The ISIS was very reliable, with an ICC of 0.933. The mean number of dislocations per patient was higher in patients who had an ISIS of ≥6 (25 vs 14; P = .05). Patients who underwent more complex arthroscopic procedures such as Hill-Sachs remplissage or open Latarjet had higher preoperative ISIS outcomes, with a mean score of 4.8 versus 3.4, respectively (P = .002). There was no correlation between the ISIS and the quality-of-life questionnaires, with Pearson correlations all >0.05 (WOSI = 0.39; QuickDASH = 0.97; Walch-Duplay = 0.08). CONCLUSION: Our results show that the ISIS is reliable when used in a multicenter study with anterior traumatic instability populations. There was no correlation between the ISIS and the quality-of-life questionnaires, but surgical decisions reflected its increased use.

Reliability and validity of the cross-culturally adapted French version of the Core Outcome Measures Index (COMI) in patients with low back pain.

PURPOSE: To conduct a cross-cultural adaptation of the Core Outcome Measures Index (COMI) into French according to established guidelines. METHODS: Seventy outpatients with chronic low back pain were recruited from six spine centres in Switzerland and France. They completed the newly translated COMI, and the Roland Morris disability (RMQ), Dallas Pain (DPQ), adjectival pain rating scale, WHO Quality of Life, and EuroQoL-5D questionnaires. After ~14 days RMQ and COMI were completed again to assess reproducibility; a transition question (7-point Likert scale; "very much worse" through "no change" to "very much better") indicated any change in status since the first questionnaire. RESULTS: COMI whole scores displayed no floor effects and just 1.5% ceiling effects. The scores for the individual COMI items correlated with their corresponding full-length reference questionnaire with varying strengths of correlation (0.33-0.84, P < 0.05). COMI whole scores showed a very good correlation with the "multidimensional" DPQ global score (Rho = 0.71). 55 patients (79%) returned a second questionnaire with no/minimal change in their back status. The reproducibility of individual COMI 5-point items was good, with test-retest differences within one grade ranging from 89% for 'social/work disability' to 98% for 'symptom-specific well-being'. The intraclass correlation coefficient for the COMI whole score was 0.85 (95% CI 0.76-0.91). CONCLUSIONS: In conclusion, the French version of this short, multidimensional questionnaire showed good psychometric properties, comparable to those reported for German and Spanish versions. The French COMI represents a valuable tool for future multicentre clinical studies and surgical registries (e.g. SSE Spine Tango) in French-speaking countries.

The interrater reliability of the pulmonary embolism severity index

RésuméLe PESI (Pulmonary Embolism Severity Index) est un score clinique pronostique s'appliquant à des patients présentant un diagnostic d'embolie pulmonaire. Notre objectif était de démontrer la reproductibilité de ce score entre différents médecins chez des patients présentant une embolie pulmonaire. Nous avons donc identifié, de façon prospective, des patients présentant une embolie pulmonaire nouvellement diagnostiquée aux urgences d'un Hôpital Universitaire (CHUV, Lausanne). Pour tous ces patients, le médecin assistant en charge ainsi que le chef de clinique superviseur ont individuellement collecté les différentes variables permettant d'établir le score selon le PESI. Ils ont, ensuite, de façon indépendante, classifié les patients dans 5 classes de risque (1-V) ainsi qu'en deux groupes à bas risque versus haut risque, respectivement les classes i-ll et les classes III à V.Nous avons examiné la reproductibilité des données entre deux groupes de médecins (médecins assistants vs chefs de clinique), pour chacune des variables constituant le PESI, pour le score total en points, pour l'attribution aux 5 classes de risque ainsi que pour la classification en deux groupes à haut risque versus bas risque. Cette évaluation de la reproductibilité des résultats obtenus par les différents médecins s'est basée sur le calcul du Kappa (K) ainsi sur les Coefficients de Corrélation Intra-classe (ICC).Parmi les 48 patients présentant une Embolie Pulmonaire inclus dans notre étude, les coefficients de reproductibilité entre médecins assistants et chefs de clinique étaient supérieurs à 0.60 pour 10 des 11 variables du PESI. La reproductibilité entre les 2 groupes de médecins, pour le total des points, pour l'attribution à une classe de risque I à V, ainsi que pour la classification en bas versus haut risque était presque parfaite.Nos résultats démontrent la haute reproductibilité du PESI, et appuient donc l'intérêt de son utilisation pour la stratification du risque chez des patients présentant une embolie pulmonaire.

A psychometric analysis of reliability and validity of the index of learning styles (ILS)

Prior literature showed that Felder and Silverman learning styles model (FSLSM) was widely adopted to cater to individual styles of learners whether in traditional or Technology Enhanced Learning (TEL). In order to infer this model, the Index of Learning Styles (ILS) instrument was proposed. This research aims to analyse the soundness of this instrument in an Arabic sample. Data were integrated from different courses and years. A total of 259 engineering students participated voluntarily in the study. The reliability was analysed by applying internal construct reliability, inter-scale correlation, and total item correlation. The construct validity was also considered by running factor analysis. The overall results indicated that the reliability and validity of perception and input dimensions were moderately supported, whereas processing and understanding dimensions showed low internal-construct consistency and their items were weakly loaded in the associated constructs. Generally, the instrument needs further effort to improve its soundness. However, considering the consistency of the produced results of engineering students irrespective of cross-cultural differences, it can be adopted to diagnose learning styles.

The reliability of experts' opinions in constructing a composite environmental index: The case of ESI 2005

The complexity of the environment demands a well-constructed composite environmental index (CEI) to provide a useful tool to draw attention to environmental conditions and trends for policy purposes. Among the common difficulties in constructing a proper CEI are uncertainties due to the selection of the most representative underlying variables or indicators. A degree of uncertainty accompanies experts' judgments, and to deal with vague, subjective or inconsistent information, logic other than classic is required. This study analyzes a procedure that uses different experts' opinions in constructing a CEI. with the use of paraconsistent annotated logic. For this, a sensitivity analysis of the Environmental Sustainability Index (ESI 2005) was used as an example to assess the reliability of experts' opinions. The uncertainty due to the disagreement in experts' opinions clearly indicates that the forms we presently use to measure and monitor the actual environment are insufficient, that is, there is a lack of a "science of sustainability". (C) 2009 Elsevier Ltd. All rights reserved.

Severity of temporomandibular disorders in women: validity and reliability of the Fonseca Anamnestic Index

The aim of this study was to assess the validity and reliability of the Fonseca Anamnestic Index (IAF), used to assess the severity of temporomandibular disorders, applied to Brazilian women. We used a probabilistic sampling design. The participants were 700 women over 18 years of age, living in the city of Araraquara (SP). The IAF questionnaire was applied by telephone interviews. We conducted Confirmatory Factor Analysis (CFA) using Chi-Square Over Degrees of Freedom (χ2/df), Comparative Fit Index (CFI), Tucker-Lewis Index (TLI), and Root Mean Square Error of Approximation (RMSEA) as goodness of fit indices. We calculated the convergent validity, the average variance extracted (AVE) and the composite reliability (CR). Internal consistency was assessed by Cronbach's alpha coefficient (α).The factorial weights of questions 8 and 10 were below the adequate values. Thus, we refined the original model and these questions were excluded. The resulting factorial model showed appropriate goodness of fit to the sample (χ2/df = 3.319, CFI = 0.978, TLI = 0.967, RMSEA = 0.058). The convergent validity (AVE = 0.513, CR = 0.878) and internal consistency (α = 0.745) were adequate. The reduced IAF version showed adequate validity and reliability in a sample of Brazilian women.

Cross-cultural adaptation and assessment of the reliability and validity of the Core Outcome Measures Index (COMI) for the Brazilian-Portuguese language

The use of patient-orientated questionnaires is of utmost importance in assessing the outcome of spine surgery. Standardisation, using a common set of outcome measures, is essential to aid comparisons across studies/in registries. The Core Outcome Measures Index (COMI) is a short, multidimensional outcome instrument validated for patients with spinal disorders. This study aimed to produce a Brazilian-Portuguese version of the COMI. A cross-cultural adaptation of the COMI into Brazilian-Portuguese was carried out using established guidelines. 104 outpatients with chronic LBP (> 3 months) were recruited from a Public Health Spine Medical Care Centre. They completed a questionnaire booklet containing the newly translated COMI, and other validated symptom-specific questionnaires: Oswestry Disability Index (ODI) and Roland Morris disability scale (RM), and a pain visual analogue scale. All patients completed a second questionnaire within 7-10 days to assess reproducibility. The COMI summary score displayed minimal floor and ceiling effects. On re-test, the responses for each individual domain of the COMI were within 1 category in 98% patients for the domain 'function', 96% for 'symptom-specific well-being', 97% for 'general quality of life', 99% for 'social disability' and 100% for 'work disability'. The intraclass correlation coefficients (ICC2,1) for COMI pain and COMI summary scores were 0.91-0.96, which compared favourably with the corresponding values for the RM (ICC, 0.99) and ODI (ICC, 0.98). The standard error of measurement for the COMI was 0.6, giving a "minimum detectable change" (MDC95%) of approximately 1.7 points i.e., the minimum change to be considered "real change" beyond measurement error. The COMI scores correlated as hypothesised (Rho, 0.4-0.8) with the other symptom-specific questionnaires. The reproducibility of the Brazilian-Portuguese version of the COMI was comparable to that of other language versions. The COMI scores correlated in the expected manner with existing but longer symptom-specific questionnaires suggesting good convergent validity for the COMI. The Brazilian-Portuguese COMI represents a valuable tool for Brazilian study-centres in future multicentre clinical studies and surgical registries.

The inter-rater reliability of the Pulmonary Embolism Severity Index

The Pulmonary Embolism Severity Index (PESI) is a validated clinical prognostic model for patients with acute pulmonary embolism (PE). Our goal was to assess the PESI's inter-rater reliability in patients diagnosed with PE. We prospectively identified consecutive patients diagnosed with PE in the emergency department of a Swiss teaching hospital. For all patients, resident and attending physician raters independently collected the 11 PESI variables. The raters then calculated the PESI total point score and classified patients into one of five PESI risk classes (I-V) and as low (risk classes I/II) versus higher-risk (risk classes III-V). We examined the inter-rater reliability for each of the 11 PESI variables, the PESI total point score, assignment to each of the five PESI risk classes, and classification of patients as low versus higher-risk using kappa ( ) and intra-class correlation coefficients (ICC). Among 48 consecutive patients with an objective diagnosis of PE, reliability coefficients between resident and attending physician raters were > 0.60 for 10 of the 11 variables comprising the PESI. The inter-rater reliability for the PESI total point score (ICC: 0.89, 95% CI: 0.81-0.94), PESI risk class assignment ( : 0.81, 95% CI: 0.66-0.94), and the classification of patients as low versus higher-risk ( : 0.92, 95% CI: 0.72-0.98) was near perfect. Our results demonstrate the high reproducibility of the PESI, supporting the use of the PESI for risk stratification of patients with PE.

The making of index numbers; a study of their varieties, tests, and reliability,

"Selected bibliography": p. 519-520.

The reliability and validity of the Therapeutic activity index

Purpose To assess the psychometric properties of the Simplified Therapeutic Intervention Scoring System (TISS 28) scale. Materials and Methods A prospective observational design was used. Patients were recruited from a medical-surgical intensive care unit (ICU) and 4 rehabilitation wards of 2 university-affiliated hospitals in Hong Kong. Results Data necessary for the calculation of the TISS 28, the Therapeutic Intervention Scoring System (TISS 76), and severity of illness scoring system (Simplified Acute Physiology Score [SAPS II]) were recorded for each patient during the first 24 hours after his/her admission to an ICU. A significant positive correlation was found between the TISS 76 and the TISS 28 scores as well as the TISS 28 and the SAPS II scores. There was a significant difference between the TISS 28 scores among ICU patients and patients in rehabilitation wards. A significant correlation was found between the TISS 28 scores of the first and second set of TISS 28 scores. Conclusions Although the findings supported the validity and reliability of the TISS 28, there were limitations of the TISS 28 in measuring nursing workload in ICUs. Hence, continued amendment and validation of the TISS 28 on larger samples in different ICUs would be required so as to provide clinical nurses with a valid and reliable assessment of nursing workload.

Validação da Body Appreciation Scale (BAS), Life Satisfaction Index for the Third Age (LSITA) e do Aging Perception Questionnaire (APQ) para a língua portuguesa no Brasil : um estudo em idosos brasileiros

Universidade Estadual de Campinas . Faculdade de Educação Física

Reliability and discriminatory power of methods for dental plaque quantification

OBJECTIVE: This in situ study evaluated the discriminatory power and reliability of methods of dental plaque quantification and the relationship between visual indices (VI) and fluorescence camera (FC) to detect plaque. MATERIAL AND METHODS: Six volunteers used palatal appliances with six bovine enamel blocks presenting different stages of plaque accumulation. The presence of plaque with and without disclosing was assessed using VI. Images were obtained with FC and digital camera in both conditions. The area covered by plaque was assessed. Examinations were done by two independent examiners. Data were analyzed by Kruskal-Wallis and Kappa tests to compare different conditions of samples and to assess the inter-examiner reproducibility. RESULTS: Some methods presented adequate reproducibility. The Turesky index and the assessment of area covered by disclosed plaque in the FC images presented the highest discriminatory powers. CONCLUSION: The Turesky index and images with FC with disclosing present good reliability and discriminatory power in quantifying dental plaque.

A study of the validity and reliability of the Brazilian version of the Body Shape Questionnaire (BSQ) among adolescents

OBJECTIVES: to produce evidence of the validity and reliability of the Body Shape Questionnaire (BSQ) - a tool for measuring an individual's attitude towards his or her body image. METHODS: the study covered 386 young people of both sexes aged between 10 and 18 from a private school and used self-applied questionnaires and anthropometric evaluation. It evaluated the internal consistency, the discriminant validity for differences from the means, according to nutritional status (underweight, eutrophic, overweight and obese), the concurrent validity by way of Spearman's correlation coefficient between the scale and the Body Mass Index (BMI), the waist-hip circumference ratio (WHR) and the waist circumference (WC). Reliability was tested using Wilcoxon's Test, the intraclass correlation coefficient and the Bland-Altman figures. RESULTS: the BSQ displayed good internal consistency (±=0.96) and was capable of discriminating among the total population, boys and girls, according to nutritional status (p<0.001). It correlated with the BMI (r=0.41; p<0.001), WHR (r=-0.10; p=0.043) and WC (r=0.24; p<0.001) and its reliability was confirmed by intraclass correlation (r=0.91; p<0.001) for the total population. The questionnaire was easy to understand and could be completed quickly. CONCLUSIONS: the BSQ presented good results, thereby providing evidence of its validity and reliability. It is therefore recommended for evaluation of body image attitudes among adolescents.

Validity and reliability of self-reported weight and height measures for the diagnoses of adolescent's nutritional status

OBJETIVO: Avaliar a validade do peso, estatura e Índice de Massa Corporal (IMC) referidos e sua confiabilidade para o diagnóstico do estado nutricional de adolescentes de Piracicaba. MÉTODOS: Participaram do estudo 360 adolescentes de ambos os sexos, de escolas públicas de Piracicaba, com idade entre 10 e 15 anos. Os adolescentes auto-relataram seu peso e estatura, sendo esses valores obtidos por medidas diretas, logo em seguida, pelos entrevistadores. A validade do IMC referido foi calculada segundo índices de sensibilidade, especificidade e valor preditivo positivo (VPP). Avaliou-se a concordância entre as categorias de IMC obtido por meio das medidas referidas e aferidas a partir do coeficiente kappa ponderado, coeficiente de correlação de Lin. e gráficos de Bland e Altman e Lin. RESULTADOS: Verificou-se que tanto os meninos quanto as meninas subestimaram o peso (-1,0 meninas e meninos) e a estatura (meninas -1,2 e meninos -0,8) (p < 0,001). Os valores de IMC aferidos e referidos apresentaram uma concordância moderada. A sensibilidade do IMC referido para classificar os indivíduos obesos foi maior para os meninos (87,5%), enquanto a especificidade foi maior para as meninas (92,7%). O VPP foi elevado somente para a classificação da eutrofia. CONCLUSÕES: As medidas referidas de peso e estatura de adolescentes não representam medidas válidas e, portanto, não devem ser usadas em substituição aos valores mensurados. Além disso, verificou-se que 10% dos meninos obesos e 40% das meninas obesas poderiam permanecer não identificados utilizando-se as medidas auto-referidas, confirmando a baixa validade das medidas auto-referidas.

A simple procedure for reliability assessment of thin composite plates against buckling

In some circumstances ice floes may be modeled as beams. In general this modeling supposes constant thickness, which contradicts field observations. Action of currents, wind and the sequence of contacts, causes thickness to vary. Here this effect is taken into consideration on the modeling of the behavior of ice hitting inclined walls of offshore platforms. For this purpose, the boundary value problem is first equated. The set of equations so obtained is then transformed into a system of equations, that is then solved numerically. For this sake an implicit solution is developed, using a shooting method, with the accompanying Jacobian. In-plane coupling and the dependency of the boundary terms on deformation, make the problem non-linear and the development particular. Deformation and internal resultants are then computed for harmonic forms of beam profile. Forms of giving some additional generality to the problem are discussed.