Inter-rater reliability study of the modified Oxford Grading Scale and the Peritron manometer

Objective To evaluate the inter-rater reliability of the modified Oxford Grading Scale and the Peritron manometer. Design All participants were evaluated twice, first by one examiner and 30 days later by a second examiner. Measurements of vaginal squeeze pressure were compared with the results from the palpation test. Participants Nineteen women with a mean age of 23.7 years (range 21 to 28 years). Results Inter-rater reliability for vaginal palpation was fair (kappa = 0.33, 95% confidence interval 0.09 to 0.57). Using the Peritron manometer, the difference between examiners was less than 10 cmH(2)O in 11 of the 19 (58%) cases. The palpation test did not differentiate between weak, moderate, good and strong muscle contractions. This study found fair inter-rater reliability for the modified Oxford Grading Scale and moderate inter-rater reliability for the Peritron manometer. Conclusions The inter-rater reliability of vaginal squeeze pressure measurement using the Peritron manometer is acceptable and can be used in re-evaluations performed by different examiners in clinical practice. However, for research purposes, the ideal situation would be for a single examiner to assess and re-assess the subject. Vaginal palpation is important in the clinical assessment of correctness of a pelvic floor muscle contraction, but this study does not support the use of the modified Oxford Grading Scale as a reliable and valid method to measure and differentiate pelvic floor muscle strength. (C) 2010 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Validity and reliability of the Structured Clinical Interview for Mood Spectrum: Brazilian version (SCIMOODS-VB)

OBJECTIVE: The aim of this study was to translate the Structured Clinical Interview for Mood Spectrum into Brazilian Portuguese, measuring its reliability, validity, and defining scores for bipolar disorders. METHOD: Questionnaire was translated (into Brazilian Portuguese) and back-translated into English. Sample consisted of 47 subjects with bipolar disorder, 47 with major depressive disorder, 18 with schizophrenia and 22 controls. Inter-rater reliability was tested in 20 subjects with bipolar disorder and MDD. Internal consistency was measured using the Kuder Richardson formula. Forward stepwise discriminant analysis was performed. Scores were compared between groups; manic (M), depressive (D) and total (T) threshold scores were calculated through receiver operating characteristic (ROC) curves. RESULTS: Kuder Richardson coefficients were between 0.86 and 0.94. Intraclass correlation coefficient was 0.96 (CI 95 % 0.93-0.97). Subjects with bipolar disorder had higher M and T, and similar D scores, when compared to major depressive disorder (ANOVA, p < 0.001). The sub-domains that best discriminated unipolar and bipolar subjects were manic energy and manic mood. M had the best area under the curve (0.909), and values of M equal to or greater than 30 yielded 91.5% sensitivity and 74.5% specificity. CONCLUSION: Structured Clinical Interview for Mood Spectrum has good reliability and validity. Cut-off of 30 best differentiates subjects with bipolar disorder vs. unipolar depression. A cutoff score of 30 or higher in the mania sub-domain is appropriate to help make a distinction between subjects with bipolar disorder and those with unipolar depression.

Portuguese version of the Delirium Rating Scale-Revised-98: reliability and validity

Objective To assess the validity and the reliability of the Portuguese version of the Delirium Rating Scale-Revised-98 (DRS-R-98). Methods The scale was translated into Portuguese and back-translated into English. After assessing its face validity, five diagnostic groups (n = 64; delirium, depression, dementia, schizophrenia and others) were evaluated by two independent researchers blinded to the diagnosis. Diagnosis and severity of delirium as measured by the DRS-R-98 were compared to clinical diagnosis, Mini-Mental State Exam, Confusion Assessment Method, and Clinical Global Impressions scale (CGI). Results Mean and rnedian DRS-R-98 total scores significantly distinguished delirium from the other groups (p < 0.001). Inter-rater reliability (ICC between 0.9 and 1) and internal consistency (alpha = 0.91) were very high. DRS-R-98 severity scores correlated highly with the CGI. Mean DRS-R-98 severity scores during delirium differed significantly (p < 0.01) from the post-treatment values. The area under the curve established by ROC analysis was 0.99 and using the cut-off Value of 20 the scale showed sensitivity and specificity of 92.6% and 94.6%, respectively. Conclusion The Portuguese version of the DRS-R-98 is a valid and reliable measure of delirium that distinguishes delirium from other disorders and is sensitive to change in delirium severity, which may be of great value for longitudinal studies. Copyright (c) 2007 John Wiley & Sons, Ltd.

Intra- and inter-observer reliability of MRI examination of intervertebral disc abnormalities in patients with cervical myelopathy

Purpose: Intervertebral cervical disc herniation (CDH) is a relatively common disorder that can coexist with degenerative changes to worsen cervicogenic myelopathy. Despite the frequent disc abnormalities found in asymptomatic populations, magnetic resonance imaging (MRI) is considered excellent at detecting cervical spine myelopathy (CSM) associated with disc abnormality. The objective of this study was to investigate the intra- and inter-observer reliability of MRI detection of CSM in subjects who also had co-existing intervertebral disc abnormalities. Materials and methods: Seven experienced radiologists reviewed twice the MRI of 10 patients with clinically and/or imaging determined myelopathy. MRI assessment was performed individually, with and without operational guidelines. A Fleiss Kappa statistic was used to evaluate the intra- and inter-observer agreement. Results: The study found high intra-observer percent agreement but relatively low Kappa values on selected variables. Inter-observer reliability was also low and neither observation was improved with operational guidelines. We believe that those low values may be associated with the base rate problem of Kappa. Conclusion: In conclusion, this study demonstrated high intra-observer percent agreement in MR examination for intervertebral disc abnormalities in patients with underlying cervical myelopathy, but differing levels of intra- and inter-observer Kappa agreement among seven radiologists. (c) 2007 Elsevier Ireland Ltd. All rights reserved.

Intra and inter-examiner reliability of the subacromial impingement index

The present study aimed to assess the reliability of intra and inter-examiner subacromial impingement index (SII) measures obtained from radiographs. Thirty-six individuals were enrolled and divided into two groups: control group, composed of 18 volunteers in good general health without shoulder problems, and a group of 18 patients with subacromial impingement syndrome (SIS). Radiographic images were taken with the dominant upper limb in neutral rotation, while the volunteers held their arm at 90A degrees of abduction in the frontal plane. The beam of radiation at 30A degrees craniocaudal inclination was used to provide an antero-posterior image view. Three blinded examiners each performed three measurements from the subacromial space (SS) and the anatomical neck of the humerus (NH). The SII was calculated as the ratio of the SS and the NH measures. The mean values of SII were compared using t-tests. The intra-class correlation coefficient (ICC) was used to assess intra- and inter-examiner reliability of the measures. The mean values of SII were greater for the control group (0.12) than for the SIS group (0.08; p = 0.0071). SII measurements showed excellent intra (0.96-0.99) and inter-examiner reliability (0.94) for both the control and SIS group. The results of this study show the potential use of the SII; a greater mean value for the control group compared to the SIS group and excellent reliability for intra- and inter-examiner measurement. Validation studies of the index should be conducted to correlate the index with clinical findings from subacromial impingement syndrome.

Comparison between the reliability levels of manual palpation and pressure pain threshold in children who reported orofacial pain

The aim of this study was to compare the intra-and inter-rater reliability of pressure pain threshold (PPT) and manual palpation (MP) of orofacial structures in symptomatic and symptom-free children for temporomandibular disorders (TMD). Fourteen children reporting pain in masticatory muscles or the temporomandibular joint and 16 symptom-free children were randomly assessed on three different occasions: by rater-1 in the first and third session and by rater-2 in the second session. The trained raters applied algometry and MP as recommended by the Research Diagnostic Criteria for TMD. Intraclass correlation coefficients and the Kappa statistic were used to assess the levels of reliability of PPT and MP, respectively. Excellent intra-and inter-rater reliability levels were observed for PPT values at most of the examined sites for symptom-free children and excellent and moderate reliability levels for children reporting pain. For MP, moderate and poor intra-rater and inter-rater reliability levels were observed for most sites in both groups. Algometry showed higher reliability levels for both groups of children and is recommended for pain assessment in children in association with MP. (C) 2010 Elsevier Ltd. All rights reserved.

Preliminary Reliability and Repeatability of the Brazilian Version of the Revised Knox Preschool Play Scale

The aim of this study was to create an adaptation of the Revised Knox Preschool Play Scale (RKPPS) for the Brazilian population, as well as to apply the instrument with statistical analysis to verify the preliminary intra-rater and inter-rater reliability and repeatability of the instrument. The instructions presented by Beaton et al. regarding adaptation of instruments were followed to perform a cross-cultural adaptation of the RKPPS. A preliminary test of the Portuguese version was performed on 18 children with no motor, cognitive or sensory impairment. The video recordings of this administration were analysed on two separate occasions by two examiners within a 5-month interval, using the scores suggested by Pfeifer. The Spearman`s test was used in the statistical analysis of the obtained data. The author of the RKPPS agreed with the small necessary cultural adaptations. The Spearman test revealed a high correlation coefficient and good significance levels for both intra- and inter-raters values. This study demonstrated the reliability and repeatability of the Brazilian version of the RKPPS. This is a preliminary study and further studies are needed in order to validate the scale to be administered in the Brazilian population. Copyright (C) 2010 John Wiley & Sons, Ltd.

Cross-cultural adaptation and reliability of Child-Initiated Pretend Play Assessment (ChIPPA)

Background. Play is an indication of a children`s development. Purpose. Organize a culturally adapt the Child-Initiated Pretend Play Assessment to Brazilian population. Method. Translation and cultural adaptation procedures consisted of translation, synthesis, back translation, author`s approval, and pretest of the assessment. For the pretest, 14 typically developing children were assessed. Was evaluated the use of play materials, duration of the assessment, and reliability. Findings. Play materials and duration of the assessment were appropriate for Brazilian children. Analysis of intra-rater reliability showed good agreement ranging from 0.90 to 1.00. Inter-rater reliability showed good to moderate agreement for five items ranging from 0.76 to 0.59. Four items showed chance to poor agreement (rho = -0.13 to 0.50). Implications. Results of the pretest indicate the Brazilian version of the ChIPPA is potentially useful for Brazilian children. ChIPPA training in Portuguese in Brazil with play observation feedback is recommended to improve inter-rater reliability.

Validation of the University of Sao Paolo Sensory Phenomena Scale: Initial Psychometric Properties

Introduction: Although obsessions and compulsions comprise the main features of obsessive-compulsive disorder (OCD), many patients report that their compulsions are preceded by a sense of ""incompleteness"" or other unpleasant feelings such as premonitory urges or a need perform action`s until feeling ""just right."" These manifestations have been characterized as Sensory Phenomena (SP). The current study presents initial psychometric data for a new scale designed to measure SP. Methods: Seventy-six adult OCD subjects were probed twice. Patients were assessed with an open clinical interview (considered as the ""gold standard"") and with the following standardized instruments: Structured Clinical Interview for Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition Axis I Disorders, Yale-Brown Obsessive-Compulsive Scale, Dimensional Yale-Brown Obsessive-Compulsive Scale, Yale Global Tic Severity Scale, Beck Anxiety Inventory, and Beck Depression Inventory. Results: SP were present in 51 OCD patients (67.1%). Tics were present in 16 (21.1%) of the overall sample. The presence of SP was significantly higher in early-onset OCD patients. There were no significant differences in the presence of SP according to comorbidity with tics or gender. The comparison between the results from the open clinical interviews and the University of Sao Paulo Sensory Phenomena Scale (USP-SPS) showed an excellent concordance between them, with no significant differences between interviewers. The inter-rater reliability between the expert raters for the USP-SPS was high, with K=.92. The Pearson correlation coefficient between the SP severity scores given by the two raters was .89. Conclusion: Preliminary results suggest that the USP-SPS is a valid and reliable instrument for assessing the presence and severity of SP in OCD subjects. CNS Spectr. 2009;14(6):315-323

An MRI-based approach for the measurement of the dorsolateral prefrontal cortex in humans

The dorsolateral prefrontal cortex (DLPFC) has been implicated in the pathophysiology of mental disorders. Previous region-of-interest MRI studies that attempted to delineate this region adopted various landmarks and measurement techniques, with inconsistent results. We developed a new region-of-interest measurement method to obtain morphometric data of this region from structural MRI scans, taking into account knowledge from cytoarchitectonic postmortem studies and the large inter-individual variability of this region. MRI scans of 10 subjects were obtained, and DLPFC tracing was performed in the coronal plane by two independent raters using the semi-automated software Brains2. The intra-class correlation coefficients between two independent raters were 0.94 for the left DLPFC and 0.93 for the right DLPFC. The mean +/- S.D. DLPFC volumes were 9.23 +/- 2.35 ml for the left hemisphere and 8.20 +/- 2.08 ml for the right hemisphere. Our proposed method has high inter-rater reliability and is easy to implement, permitting the standardized measurement of this region for clinical research applications. (C) 2009 Elsevier Ireland Ltd. All rights reserved.

Study of the psychometric qualities of the Brief Social Phobia Scale (BSPS) in Brazilian university students

Purpose: To perform a psychometric analysis of the Brazilian version of the Brief Social Phobia Scale (BSPS). Materials and methods: Hundred and seventy-eight university students of both genders aged on average 21.2 years and identified as Social Anxiety Disorder (SAD) cases and non-cases was studied, with the structured clinical interview for DSM-IV being used as a parameter. The different instruments were applied in an individual manner in the presence of a rater and of an observer. Results: The BSPS showed adequate internal consistency (0.48-0.88) and concurrent and divergent validity with the Beck Anxiety Inventory (BAI) (0.21-0.62), Social Phobia Inventory (0.24-0.82) and Self Statements During Public Speaking Scale (SSPS) (0.23-0.31). Discriminative validity revealed a sensitivity of 0.88-0.90 and a specificity of 0.81(0.83 for cut-off notes of 18/19. Factorial analysis demonstrated the presence of six factors that jointly explained 71.79% of data variance. Construct validity indicated some limits of the scale regarding the diagnosis of SAD. Inter-rater reliability was strong (0.86-1.00, p < 0.001). Conclusions: The BSPS is adequate for use with university students, although further studies in different cultures, samples and contexts are still necessary. (C) 2009 Elsevier Masson SAS. All rights reserved.

Inter- and intra-tester reliability of clinical measurement to determine medio-lateral patellar position using a pachymeter or visual assessment

The aim was to investigate inter-tester and intra-tester reliability and parallel reliability between a visual assessment method and a method using a pachymeter for locating the mid-point of the patella in determining the medial/lateral patella orientation. Fifteen asymptomatic subjects were assessed and the mid-point of the patella was determined by both methods on two separate occasions two weeks apart. Inter-tester reliability was obtained by ANOVA and by intraclass correlation coefficient (ICC); intra-tester reliability was obtained by a paired t-test and ICC; and parallel reliability was obtained by Pearson`s Correlation and ICC, for the measurement on the first and second evaluations. There was acceptable inter-tester agreement (p = 0.490) and reliability for the visual inspection (ICC = 0.747) and for the pachymeter (ICC = 0.716) at the second evaluation. The inter-tester reliability in the first evaluation was unacceptable (visual ICC = 0.604; pachymeter ICC = 0.612). Although there was statistical similarity between measurements for the first and second evaluations for all testers, intra-tester reliability was not acceptable for both methods: visual (examiner 1 ICC = 0.175; examiner 2 ICC = 0.189; examiner 3 ICC = 0.155) and pachymeter (examiner 1 ICC = 0.214; examiner 2 ICC = 0.246; examiner 3 ICC = 0.069). Parallel reliability gave a perfect correlation at the first evaluation (r=0.828; p<0.001) and at the second (r=0.756; p<0.001) and reliability was between acceptable and very good (ICC = [0.748-0.813]). Both visual and pachymeter methods provide reliable and similar medial/lateral patella orientation and are reliable between different examiners, but the results between the two assessments at 2 weeks` interval demonstrated an unacceptable reliability. (C) 2009 Elsevier B.V. All rights reserved.

Validity and reliability of methods for the detection of secondary caries around amalgam restorations in primary teeth

Secondary caries has been reported as the main reason for restoration replacement. The aim of this in vitro study was to evaluate the performance of different methods - visual inspection, laser fluorescence (DIAGNOdent), radiography and tactile examination - for secondary caries detection in primary molars restored with amalgam. Fifty-four primary molars were photographed and 73 suspect sites adjacent to amalgam restorations were selected. Two examiners evaluated independently these sites using all methods. Agreement between examiners was assessed by the Kappa test. To validate the methods, a caries-detector dye was used after restoration removal. The best cut-off points for the sample were found by a Receiver Operator Characteristic (ROC) analysis, and the area under the ROC curve (Az), and the sensitivity, specificity and accuracy of the methods were calculated for enamel (D2) and dentine (D3) thresholds. These parameters were found for each method and then compared by the McNemar test. The tactile examination and visual inspection presented the highest inter-examiner agreement for the D2 and D3 thresholds, respectively. The visual inspection also showed better performance than the other methods for both thresholds (Az = 0.861 and Az = 0.841, respectively). In conclusion, the visual inspection presented the best performance for detecting enamel and dentin secondary caries in primary teeth restored with amalgam.

Reliability and discriminatory power of methods for dental plaque quantification

OBJECTIVE: This in situ study evaluated the discriminatory power and reliability of methods of dental plaque quantification and the relationship between visual indices (VI) and fluorescence camera (FC) to detect plaque. MATERIAL AND METHODS: Six volunteers used palatal appliances with six bovine enamel blocks presenting different stages of plaque accumulation. The presence of plaque with and without disclosing was assessed using VI. Images were obtained with FC and digital camera in both conditions. The area covered by plaque was assessed. Examinations were done by two independent examiners. Data were analyzed by Kruskal-Wallis and Kappa tests to compare different conditions of samples and to assess the inter-examiner reproducibility. RESULTS: Some methods presented adequate reproducibility. The Turesky index and the assessment of area covered by disclosed plaque in the FC images presented the highest discriminatory powers. CONCLUSION: The Turesky index and images with FC with disclosing present good reliability and discriminatory power in quantifying dental plaque.

Reproducibility, reliability and validity of measurements obtained from Cecile3 digital models

The aim of this study was to determine the reproducibility, reliability and validity of measurements in digital models compared to plaster models. Fifteen pairs of plaster models were obtained from orthodontic patients with permanent dentition before treatment. These were digitized to be evaluated with the program Cécile3 v2.554.2 beta. Two examiners measured three times the mesiodistal width of all the teeth present, intercanine, interpremolar and intermolar distances, overjet and overbite. The plaster models were measured using a digital vernier. The t-Student test for paired samples and interclass correlation coefficient (ICC) were used for statistical analysis. The ICC of the digital models were 0.84 ± 0.15 (intra-examiner) and 0.80 ± 0.19 (inter-examiner). The average mean difference of the digital models was 0.23 ± 0.14 and 0.24 ± 0.11 for each examiner, respectively. When the two types of measurements were compared, the values obtained from the digital models were lower than those obtained from the plaster models (p < 0.05), although the differences were considered clinically insignificant (differences < 0.1 mm). The Cécile digital models are a clinically acceptable alternative for use in Orthodontics.