Inter- and intra-tester reliability of clinical measurement to determine medio-lateral patellar position using a pachymeter or visual assessment

The aim was to investigate inter-tester and intra-tester reliability and parallel reliability between a visual assessment method and a method using a pachymeter for locating the mid-point of the patella in determining the medial/lateral patella orientation. Fifteen asymptomatic subjects were assessed and the mid-point of the patella was determined by both methods on two separate occasions two weeks apart. Inter-tester reliability was obtained by ANOVA and by intraclass correlation coefficient (ICC); intra-tester reliability was obtained by a paired t-test and ICC; and parallel reliability was obtained by Pearson`s Correlation and ICC, for the measurement on the first and second evaluations. There was acceptable inter-tester agreement (p = 0.490) and reliability for the visual inspection (ICC = 0.747) and for the pachymeter (ICC = 0.716) at the second evaluation. The inter-tester reliability in the first evaluation was unacceptable (visual ICC = 0.604; pachymeter ICC = 0.612). Although there was statistical similarity between measurements for the first and second evaluations for all testers, intra-tester reliability was not acceptable for both methods: visual (examiner 1 ICC = 0.175; examiner 2 ICC = 0.189; examiner 3 ICC = 0.155) and pachymeter (examiner 1 ICC = 0.214; examiner 2 ICC = 0.246; examiner 3 ICC = 0.069). Parallel reliability gave a perfect correlation at the first evaluation (r=0.828; p<0.001) and at the second (r=0.756; p<0.001) and reliability was between acceptable and very good (ICC = [0.748-0.813]). Both visual and pachymeter methods provide reliable and similar medial/lateral patella orientation and are reliable between different examiners, but the results between the two assessments at 2 weeks` interval demonstrated an unacceptable reliability. (C) 2009 Elsevier B.V. All rights reserved.

The Fast Alcohol Screening Test (FAST) is as Good as the AUDIT to Screen Alcohol Use Disorders

This study was aimed at assessing the psychometric qualities of the fast alcohol screening test (FAST), and at comparing these qualities to those of the alcohol use disorders identification test (AUDIT) in three samples of Brazilian adults: (i) subjects attended at an emergency department (530); (ii) patients from a psychosocial care center (40); and (iii) university students (429). The structured clinical interview for diagnosis (SCID)-IV was used as gold standard. The FAST demonstrated high test-retest and interrater reliability coefficients, as well as high predictive and concurrent validity values. The results attest the validity and reliability of the Brazilian version of the FAST for the screening of indicators of alcohol abuse and dependence.

Preliminary Reliability and Repeatability of the Brazilian Version of the Revised Knox Preschool Play Scale

The aim of this study was to create an adaptation of the Revised Knox Preschool Play Scale (RKPPS) for the Brazilian population, as well as to apply the instrument with statistical analysis to verify the preliminary intra-rater and inter-rater reliability and repeatability of the instrument. The instructions presented by Beaton et al. regarding adaptation of instruments were followed to perform a cross-cultural adaptation of the RKPPS. A preliminary test of the Portuguese version was performed on 18 children with no motor, cognitive or sensory impairment. The video recordings of this administration were analysed on two separate occasions by two examiners within a 5-month interval, using the scores suggested by Pfeifer. The Spearman`s test was used in the statistical analysis of the obtained data. The author of the RKPPS agreed with the small necessary cultural adaptations. The Spearman test revealed a high correlation coefficient and good significance levels for both intra- and inter-raters values. This study demonstrated the reliability and repeatability of the Brazilian version of the RKPPS. This is a preliminary study and further studies are needed in order to validate the scale to be administered in the Brazilian population. Copyright (C) 2010 John Wiley & Sons, Ltd.

Psychometric qualities of the Brazilian versions of the Fagerstrom Test for Nicotine Dependence and the Heaviness of Smoking Index

This study examined the psychometric properties of the Brazilian versions of the Fagerstrom Test for Nicotine Dependence (FTND) and the Heaviness of Smoking Index (HSI). The test-retest reliability of the FTND was assessed in a sample of 61 smoking university students, with a 15-day interval between assessments. The interrater reliability was examined in 30 smoking patients of a psychosocial care center for alcohol and drug users (PCC-AD). The reliability coefficient was estimated by the kappa and intraclass correlation coefficients. The predictive validity, internal consistency, and factor structure of the FTND and the HSI were evaluated by factor analysis in 271 smokers treated at an emergency unit and at the PCC-AD. The gold standard was the nicotine dependence criteria of DSM-IV, as assessed by the Structured Clinical Interview for DSM-IV. The FTND showed high reliability, with correlation coefficients of .92 for test-retest reliability and .99 for interrater reliability. Both the FTND and the HSI presented high levels of sensitivity and specificity. The internal consistency evaluation yielded a Cronbach`s alpha coefficient of .83 for the FTND and of .56 for the HSI. An exploratory factor analysis found 2 factors in the FTND, which were validated by a confirmatory factor analysis. The results obtained in this study confirm the validity and reliability of the Brazilian versions of the FTND and the HSI.

Expanded protocol of orofacial myofunctional evaluation with scores: Validity and reliability

Objective: Clinical evaluation of the stomatognathic system is indispensable for the diagnosis of orofacial myofunctional disorders. In order to obtain a more precise diagnosis, the protocol of orofacial myofunctional evaluation with scores (OMES protocol) (Int. J. Pediatr. Otorhinolaryngol. 72 (2008) 367-375) was expanded in terms of number of items and scale amplitude. The proposal of this study is to describe the expanded OMES protocol (OMES-E) for the evaluation of children. Validity of the protocol, reliability of the examiners and agreement between them were analyzed, as also were the sensitivity, specificity and predictive values of the instrument. Methods: The sample consisted of videorecorded images of 50 children, 25 boys (mean age = 8.4 years, SD = 1.8) and 25 girls (mean age = 8.2 years, SD = 1.7) selected at random from 200 samples. Three speech therapists prepared for orofacial myofunctional evaluation participated as examiners (E). The OMES and OMES-E protocols were used for evaluation on different days. E1 evaluated all images, E2 analyzed children with recordings from 1 to 25 and E3 analyzed children with recordings from 26 to 50. The validity of OMES-E was analyzed by comparing the instrument to the OMES protocol using the Pearson correlation test complemented with the split-half reliability test (p < 0.05). The linear weighted Kappa coefficient of agreement (Kw`), the sensitivity, specificity and predictive values and the prevalence of OMD were calculated. Results: There was a statistically significant correlation between the OMES and OMES-E protocols (0.79 > r < 0.94, p < 0.01) and a significant test-retest correlation with the OMES-E (0.75 > r < 0.86, p < 0.01), with a reliability range of 0.86-0.93. The correlation and reliability coefficients between examiners were: E1 x E2 (r = 0.74, 0.84), E1 x E3 (r = 0.70, 0.83) (p < 0.01). Kw` coefficients with moderate and good strength predominated. The OMES-E protocol presented mean sensitivity = 0.91, specificity = 0.77, positive predictive value = 0.87 and negative predictive value = 0.85. The mean prevalence of OMD was 0.58. Conclusion: The OMES-E protocol is valid and reliable for orofacial myofunctional evaluation. (C) 2010 Elsevier Ireland Ltd. All rights reserved.

Inter-rater reliability study of the modified Oxford Grading Scale and the Peritron manometer

Objective To evaluate the inter-rater reliability of the modified Oxford Grading Scale and the Peritron manometer. Design All participants were evaluated twice, first by one examiner and 30 days later by a second examiner. Measurements of vaginal squeeze pressure were compared with the results from the palpation test. Participants Nineteen women with a mean age of 23.7 years (range 21 to 28 years). Results Inter-rater reliability for vaginal palpation was fair (kappa = 0.33, 95% confidence interval 0.09 to 0.57). Using the Peritron manometer, the difference between examiners was less than 10 cmH(2)O in 11 of the 19 (58%) cases. The palpation test did not differentiate between weak, moderate, good and strong muscle contractions. This study found fair inter-rater reliability for the modified Oxford Grading Scale and moderate inter-rater reliability for the Peritron manometer. Conclusions The inter-rater reliability of vaginal squeeze pressure measurement using the Peritron manometer is acceptable and can be used in re-evaluations performed by different examiners in clinical practice. However, for research purposes, the ideal situation would be for a single examiner to assess and re-assess the subject. Vaginal palpation is important in the clinical assessment of correctness of a pelvic floor muscle contraction, but this study does not support the use of the modified Oxford Grading Scale as a reliable and valid method to measure and differentiate pelvic floor muscle strength. (C) 2010 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Slow crack growth and reliability of dental ceramics

Objective. To determine the slow crack growth (SCG) and Weibull parameters of five dental ceramics: a vitreous porcelain (V), a leucite-based porcelain (D), a leucite-based glass-ceramic (E1), a lithium disilicate glass-ceramic (E2) and a glass-infiltrated alumina composite (IC). Methods. Eighty disks (empty set 12mm x 1.1mm thick) of each material were constructed according to manufacturers` recommendations and polished. The stress corrosion susceptibility coefficient (n) was obtained by dynamic fatigue test, and specimens were tested in biaxial flexure at five stress rates immersed in artificial saliva at 37 degrees C. Weibull parameters were calculated for the 30 specimens tested at 1MPa/s in artificial saliva at 37 degrees C. The 80 specimens were distributed as follows: 10 for each stress rate (10(-2), 10(-1), 10(1), 10(2) MPa/s), 10 for inert strength (10(2) MPa/s, silicon oil) and 30 for 10(0) MPa/s. Fractographic analysis was also performed to investigate the fracture origin. Results. E2 showed the lowest slow crack growth susceptibility coefficient (17.2), followed by D (20.4) and V (26.3). E1 and IC presented the highest n values (30.1 and 31.1, respectively). Porcelain V presented the lowest Weibull modulus (5.2). All other materials showed similar Weibull modulus values, ranging from 9.4 to 11.7. Fractographic analysis indicated that for porcelain D, glass-ceramics E1 and E2, and composite IC crack deflection was the main toughening mechanism. Significance. This study provides a detailed microstructural and slow crack growth characterization of widely used dental ceramics. This is important from a clinical standpoint to assist the clinician in choosing the best ceramic material for each situation as well as predicting its clinical longevity. It also can be helpful in developing new materials for dental prostheses. (c) 2010 Academy of Dental Materials. Published by Elsevier Ltd. All rights reserved.

Monolithic CAD/CAM Lithium Disilicate Versus Veneered Y-TZP Crowns: Comparison of Failure Modes and Reliability After Fatigue

Purpose: The aim of this research was to evaluate the fatigue behavior and reliability of monolithic computer-aided design/computer-assisted manufacture (CAD/CAM) lithium disilicate and hand-layer-veneered zirconia all-ceramic crowns. Materials and Methods: A CAD-based mandibular molar crown preparation, fabricated using rapid prototyping, served as the master die. Fully anatomically shaped monolithic lithium disilicate crowns (IPS e.max CAD, n = 19) and hand-layer-veneered zirconia-based crowns (IPS e.max ZirCAD/Ceram, n = 21) were designed and milled using a CAD/CAM system. Crowns were cemented on aged dentinlike composite dies with resin cement. Crowns were exposed to mouth-motion fatigue by sliding a WC-indenter (r = 3.18 mm) 0.7 mm lingually down the distobuccal cusp using three different step-stress profiles until failure occurred. Failure was designated as a large chip or fracture through the crown. If no failures occurred at high loads (> 900 N), the test method was changed to staircase r ratio fatigue. Stress level probability curves and reliability were calculated. Results: Hand-layer-veneered zirconia crowns revealed veneer chipping and had a reliability of < 0.01 (0.03 to 0.00, two-sided 90% confidence bounds) for a mission of 100,000 cycles and a 200-N load. None of the fully anatomically shaped CAD/CAM-fabricated monolithic lithium disilicate crowns failed during step-stress mouth-motion fatigue (180,000 cycles, 900 N). CAD/CAM lithium disilicate crowns also survived r ratio fatigue (1,000,000 cycles, 100 to 1,000 N). There appears to be a threshold for damage/bulk fracture for the lithium disilicate ceramic in the range of 1,100 to 1,200 N. Conclusion: Based on present fatigue findings, the application of CAD/CAM lithium disilicate ceramic in a monolithic/fully anatomical configuration resulted in fatigue-resistant crowns, whereas hand-layer-veneered zirconia crowns revealed a high susceptibility to mouth-motion cyclic loading with early veneer failures. Int J Prosthodont 2010; 23: 434-442.

Reliability of the input-output properties of the cortico-spinal pathway obtained from transcranial magnetic and electrical stimulation

The purpose of this experiment was to assess the test-retest reliability of input-output parameters of the cortico-spinal pathway derived from transcranial magnetic (TMS) and electrical (TES) stimulation at rest and during muscle contraction. Motor evoked potentials (MEPs) were recorded from the first dorsal interosseous muscle of eight individuals on three separate days. The intensity of TMS at rest was varied from 5% below threshold to the maximal output of the stimulator. During trials in which the muscle was active, TMS and TES intensities were selected that elicited MEPs of between 150 and 300 X at rest. MEPs were evoked while the participants exerted torques up to 50% of their maximum capacity. The relationship between MEP size and stimulus intensity at rest was sigmoidal (R-2 = 0.97). Intra-class correlation coefficients (ICC) ranged between 0.47 and 0.81 for the parameters of the sigmoid function. For the active trials, the slope and intercept of regression equations of MEP size on level of background contraction were obtained more reliably for TES (ICC = 0.63 and 0.78, respectively) than for TMS (ICC = 0.50 and 0.53, respectively), These results suggest that input-output parameters of the cortico-spinal pathway may be reliably obtained via transcranial stimulation during longitudinal investigations of cortico-spinal plasticity. (C) 2001 Elsevier Science B.V. All rights reserved.

Extensive multiple test centre evaluation of the VecTest malaria antigen panel assay

To determine which species and populations of Anopheles transmit malaria in any given situation, immunological assays for malaria sporozoite antigen can replace traditional microscopical examination of freshly dissected Anopheles. We developed a wicking assay for use with mosquitoes that identifies the presence or absence of specific peptide epitopes of circumsporozoite (CS) protein of Plasmodium falciparum and two strains of Plasmodium vivax (variants 210 and 247). The resulting assay (VecTest(TM) Malaria) is a rapid, one-step procedure using a 'dipstick' test strip capable of detecting and distinguishing between P. falciparum and P. vivax infections in mosquitoes. The objective of the present study was to test the efficacy, sensitivity, stability and field-user acceptability of this wicking dipstick assay. In collaboration with 16 test centres world-wide, we evaluated more than 40 000 units of this assay, comparing it to the standard CS ELISA. The 'VecTest(TM) Malaria' was found to show 92% sensitivity and 98.1% specificity, with 97.8% accuracy overall. In accelerated storage tests, the dipsticks remained stable for >15 weeks in dry conditions up to 45degreesC and in humid conditions up to 37degreesC. Evidently, this quick and easy dipstick test performs at an acceptable level of reliability and offers practical advantages for field workers needing to make rapid surveys of malaria vectors.

Relationship between cranio-cervical flexion range of motion and pressure change during the cranio-cervical flexion test

The purpose of this study was to quantify the sagittal angular displacement of the head (cranio-cervical flexion) for the five incremental stages of the cranio-cervical flexion test (CCFT). Range of cranio-cervical flexion during the CCFT was measured using a digital imaging method in 20 healthy volunteer subjects. The intra- and inter-rater reliability of the digital imaging technique for the assessment of this movement were also examined. The results of this study demonstrated a linear relationship between the incremental pressure targets of the CCFT and the percentages of full range cranio-cervical flexion range of motion (ROM) measured in the supine lying position of the test using a digital imaging technique. A mean of 22.9% full range cranio-cervical flexion was used to reach the first pressure target of the CCFT followed by linear increments up to 76.6% for the last stage of the test. An increasing amount of cranio-cervical flexion ROM was used to achieve the five successive stages of the CCFT reflecting an increasing contractile demand on the deep cervical flexor muscles. Excellent inter-rater (ICC = 0.994) and intra-rater reliability (ICC = 0.988-0.998) were demonstrated for the angular measurements using this digital imaging technique. (C) 2003 Elsevier Science Ltd. All rights reserved.

The reliability of video based time motion analysis

Time motion analysis is extensively used to assess the demands of team sports. At present there is only limited information on the reliability of measurements using this analysis tool. The aim of this study was to establish the reliability of an individual observer's time motion analysis of rugby union. Ten elite level rugby players were individually tracked in Southern Hemisphere Super 12 matches using a digital video camera. The video footage was subsequently analysed by a single researcher on two occasions one month apart. The test-retest reliability was quantified as the typical error of measurement (TEM) and rated as either good (10% TEM). The total time spent in the individual movements of walking, jogging, striding, sprinting, static exertion and being stationary had moderate to poor reliability (5.8-11.1% TEM). The frequency of individual movements had good to poor reliability (4.3-13.6% TEM), while the mean duration of individual movements had moderate reliability (7.1-9.3% TEM). For the individual observer in the present investigation, time motion analysis was shown to be moderately reliable as an evaluation tool for examining the movement patterns of players in competitive rugby. These reliability values should be considered when assessing the movement patterns of rugby players within competition.

Reliability of moderate-intensity and vigorous physical activity stage of change measures for young adults

Background. The purpose of this study was to examine the reliability of stage of change (SOC) measures for moderate-intensity and vigorous physical activity in two separate samples of young adults. Staging measures have focused on vigorous exercise, but current public health guidelines emphasize moderate-intensity activity. Method. For college students in the USA (n = 105) and in Australia (n = 123), SOC was assessed separately on two occasions for moderate-intensity activity and for vigorous activity. Test-retest repeatability was determined, using Cohen's kappa coefficient. Results. In both samples, the reliability scores for the moderate-intensity physical activity staging measure were lower than the scores for the vigorous exercise staging measure. Weighted kappa values for the moderate-intensity staging measure were in the fair to good range for both studies (0.50 and 0.45); for the vigorous staging measure kappa values were excellent and fair to good (0.76 and 0.72). Conclusions. There is a need to standardize and improve methods for staging moderate-intensity activity, given that such measures are used in public health interventions targeting HEPA (health-enhancing physical activity). (C) 2003 American Health Foundation and Elsevier Science (USA). All rights reserved.

The need for standardized tests to evaluate the reliability of data transport in wireless medical systems

Wireless medical systems are comprised of four stages, namely the medical device, the data transport, the data collection and the data evaluation stages. Whereas the performance of the first stage is highly regulated, the others are not. This paper concentrates on the data transport stage and argues that it is necessary to establish standardized tests to be used by medical device manufacturers to provide comparable results concerning the communication performance of the wireless networks used to transport medical data. Besides, it suggests test parameters and procedures to be used to produce comparable communication performance results.

Hybrid fuzzy Monte Carlo technique for reliability assessment in transmission power systems

This paper proposes a new methodology to reduce the probability of occurring states that cause load curtailment, while minimizing the involved costs to achieve that reduction. The methodology is supported by a hybrid method based on Fuzzy Set and Monte Carlo Simulation to catch both randomness and fuzziness of component outage parameters of transmission power system. The novelty of this research work consists in proposing two fundamentals approaches: 1) a global steady approach which deals with building the model of a faulted transmission power system aiming at minimizing the unavailability corresponding to each faulted component in transmission power system. This, results in the minimal global cost investment for the faulted components in a system states sample of the transmission network; 2) a dynamic iterative approach that checks individually the investment’s effect on the transmission network. A case study using the Reliability Test System (RTS) 1996 IEEE 24 Buses is presented to illustrate in detail the application of the proposed methodology.