26 resultados para RELIABILITY ANALYSIS
em BORIS: Bern Open Repository and Information System - Berna - Suiça
Evaluation of perpendicular reflection intensity for assessment of caries lesion activity/inactivity
Resumo:
The aim of this study was to evaluate, using visual assessment, an experimental optical sensor measuring perpendicular reflection intensity (PRI) as an indicator of enamel caries lesion activity/inactivity. Forty teeth with either an active or an inactive enamel lesion were selected from a pool of extracted teeth. Each tooth was cut into halves, with a clinically sound half and a half with a non-cavitated enamel lesion. After gentle plaque removal, the teeth were kept moistened. The lesions were then photographed and a defined measuring site per lesion was chosen and indicated with an arrow on a printout. Independently, the chosen site was visually assessed for lesion activity, and its glossiness was measured with PRI assessment. Surface roughness (SR) was assessed with optical profilometry using a confocal microscope. Visual assessment and PRI were repeated after several weeks and a reliability analysis was performed. For enamel lesions visually scored as active versus inactive, significantly different values were obtained with both PRI and SR. PRI values of the clinically sound control surfaces were significantly different only from active lesions. Generally, inactive lesions had the same glossiness and the same roughness as the sound control surfaces. The reliabilities for visual assessment (? = 0.89) and for PRI (ICC = 0.86) were high. It is concluded that, within the limits of this study, PRI can be regarded as a promising tool for quantitative enamel lesion activity assessment. There is scope and potential for the PRI device to be considerably improved for in vivo use.
Resumo:
Purpose: To assess possible association between intrinsic structural damage and clinical disability by correlating spinal cord diffusion-tensor (DT) imaging data with electrophysiological parameters in patients with a diagnosis of multiple sclerosis (MS). Materials and Methods: This study was approved by the local ethical committee according to the declaration of Helsinki and written informed consent was obtained. DT images and T1- and T2-weighted images of the spinal cord were acquired in 28 healthy volunteers and 41 MS patients. Fractional anisotropy (FA) and apparent diffusion coefficients were evaluated in normal-appearing white matter (NAWM) at the cervical level and were correlated with motor-evoked potentials (n = 34). Asymmetry index was calculated for FA values with corresponding left and right regions of interest as percentage of the absolute difference between these values relative to the sum of the respective FA values. Statistical analysis included Spearman rank correlations, Mann-Whitney test, and reliability analysis. Results: Healthy volunteers had low asymmetry index (1.5%-2.2%). In MS patients, structural abnormalities were reflected by asymmetric decrease of FA (asymmetry index: 3.6%; P = .15). Frequently asymmetrically affected among MS patients was left and right central motor conduction time (CMCT) to abductor digiti minimi muscle (ADMM) (asymmetry index, 15%-16%) and tibialis anterior muscle (TAM) (asymmetry index, 9.5%-14.1%). Statistically significant correlations of functional (ie, electrophysiological) and structural (ie, DT imaging) asymmetries were found (P = .005 for CMCT to ADMM; P = .007 for CMCT to TAM) for the cervical lateral funiculi, which comprise the crossed pyramidal tract. Interobserver reliability for DT imaging measurements was excellent (78%-87%). Conclusion: DT imaging revealed asymmetric anatomic changes in spinal cord NAWM, which corresponded to asymmetric electrophysiological deficits for both arms and legs, and reflected a specific structure-function relationship in the human spinal cord. © RSNA, 2013.
Resumo:
In der vorliegenden Arbeit werden Entwicklung und Validierung eines Fragebogens zur umfassenden Erfassung der Achtsamkeit, des Comprehensive Inventory of Mindfulness Experiences (CHIME), beschrieben. An einer Allgemeinbevölkerungs-Stichprobe (N = 298) und einer Stichprobe von TeilnehmerInnen an MBSR-Kursen (N = 161) wurde die Faktorenstruktur des CHIME ermittelt und seine Reliabilität und Validität geprüft. Faktorenanalytische Verfahren ergaben eine achtfaktorielle Struktur. Die Struktur wurde in einer zusätzlichen konfirmatorischen Stichprobe (N = 202) überprüft. Der Fragebogen sowie seine Unterskalen weisen gute Reliabilitätswerte auf (interne Konsistenz und Retest-Reliabilität). Analysen zur Messinvarianz der einzelnen Items über Gruppen, die sich bezüglich Meditationserfahrung, Alter, Geschlecht und Symptombelastung unterschieden, zeigten keine systematischen Unterschiede im Verständnis der Items. Die Kennwerte zur Konstrukt-, Kriterium-, und inkrementellen Validität sowie zur Veränderungssensitivität waren alle mindestens zufriedenstellend. Mit dem CHIME steht somit ein Fragebogen mit guten psychometrischen Eigenschaften zur Selbsteinschätzung der Achtsamkeit zur Verfügung. Der CHIME basiert auf allen in den aktuellen Instrumenten enthaltenen Aspekten des Achtsamkeitskonstrukts.
Resumo:
Introduction: Measuring trait mindfulness and change in mindfulness may be a crucial prerequisite for the evaluation and further development of mindfulness based interventions for the treatment of mental disorders. This endeavour is nontrivial as current measures cover varying aspects and mindfulness and may have problems regarding validity. This presentation describes the development and validation of a questionnaire for the comprehensive assessment of mindfulness: the Comprehensive Inventory of Mindfulness Experiences (CHIME). Method: The factor structure, reliability, and validity of the CHIME were established in a community sample (N = 298) and a sample of MBSR group participants (N = 161). Results: Factor-analytical procedures supported an eight-factor structure. The structure was tested in a further confirmatory sample (N = 202). The questionnaire and its subscales exhibited good reliability (internal consistency and retest-reliability). Analysis of the measurement invariance of the single items over groups differing in age, gender, meditation experience, and symptom load pointed to the absence of systematic differences in the items' semantic understanding. Parameters reflecting construct validity, criterion validity, and incremental validity as well as change sensitivity were all at least satisfactory. Conclusions: The CHIME is a self-report measure with favorable psychometric properties based on all aspects of mindfulness that are included in current mindfulness scales. This scale may be helpful in the evaluation and further development of mindfulness based interventions.
Resumo:
BACKGROUND: High intercoder reliability (ICR) is required in qualitative content analysis for assuring quality when more than one coder is involved in data analysis. The literature is short of standardized procedures for ICR procedures in qualitative content analysis. OBJECTIVE: To illustrate how ICR assessment can be used to improve codings in qualitative content analysis. METHODS: Key steps of the procedure are presented, drawing on data from a qualitative study on patients' perspectives on low back pain. RESULTS: First, a coding scheme was developed using a comprehensive inductive and deductive approach. Second, 10 transcripts were coded independently by two researchers, and ICR was calculated. A resulting kappa value of .67 can be regarded as satisfactory to solid. Moreover, varying agreement rates helped to identify problems in the coding scheme. Low agreement rates, for instance, indicated that respective codes were defined too broadly and would need clarification. In a third step, the results of the analysis were used to improve the coding scheme, leading to consistent and high-quality results. DISCUSSION: The quantitative approach of ICR assessment is a viable instrument for quality assurance in qualitative content analysis. Kappa values and close inspection of agreement rates help to estimate and increase quality of codings. This approach facilitates good practice in coding and enhances credibility of analysis, especially when large samples are interviewed, different coders are involved, and quantitative results are presented.
Resumo:
Recent studies have shown that the nociceptive withdrawal reflex threshold (NWR-T) and the electrical pain threshold (EP-T) are reliable measures in pain-free populations. However, it is necessary to investigate the reliability of these measures in patients with chronic pain in order to translate these techniques from laboratory to clinic. The aims of this study were to determine the test-retest reliability of the NWR-T and EP-T after single and repeated (temporal summation) electrical stimulation in a group of patients with chronic low back pain, and to investigate the association between the NWR-T and the EP-T. To this end, 25 patients with chronic pain participated in three identical sessions, separated by 1 week in average, in which the NWR-T and the EP-T to single and repeated stimulation were measured. Test-retest reliability was assessed using intra-class correlation coefficient (ICC), coefficient of variation (CV), and Bland-Altman analysis. The association between the thresholds was assessed using the coefficient of determination (r (2)). The results showed good-to-excellent reliability for both NWR-T and EP-T in all cases, with average ICC values ranging 0.76-0.90 and average CV values ranging 12.0-17.7%. The association between thresholds was better after repeated stimulation than after single stimulation, with average r (2) values of 0.83 and 0.56, respectively. In conclusion, the NWR-T and the EP-T are reliable assessment tools for assessing the sensitivity of spinal nociceptive pathways in patients with chronic pain.
Resumo:
Objectives To examine the extent of multiplicity of data in trial reports and to assess the impact of multiplicity on meta-analysis results. Design Empirical study on a cohort of Cochrane systematic reviews. Data sources All Cochrane systematic reviews published from issue 3 in 2006 to issue 2 in 2007 that presented a result as a standardised mean difference (SMD). We retrieved trial reports contributing to the first SMD result in each review, and downloaded review protocols. We used these SMDs to identify a specific outcome for each meta-analysis from its protocol. Review methods Reviews were eligible if SMD results were based on two to ten randomised trials and if protocols described the outcome. We excluded reviews if they only presented results of subgroup analyses. Based on review protocols and index outcomes, two observers independently extracted the data necessary to calculate SMDs from the original trial reports for any intervention group, time point, or outcome measure compatible with the protocol. From the extracted data, we used Monte Carlo simulations to calculate all possible SMDs for every meta-analysis. Results We identified 19 eligible meta-analyses (including 83 trials). Published review protocols often lacked information about which data to choose. Twenty-four (29%) trials reported data for multiple intervention groups, 30 (36%) reported data for multiple time points, and 29 (35%) reported the index outcome measured on multiple scales. In 18 meta-analyses, we found multiplicity of data in at least one trial report; the median difference between the smallest and largest SMD results within a meta-analysis was 0.40 standard deviation units (range 0.04 to 0.91). Conclusions Multiplicity of data can affect the findings of systematic reviews and meta-analyses. To reduce the risk of bias, reviews and meta-analyses should comply with prespecified protocols that clearly identify time points, intervention groups, and scales of interest.
Resumo:
At the research reactor Forschungs-Neutronenquelle Heinz Maier-Leibnitz (FRM II) a new Prompt Gamma-ray Activation Analysis (PGAA) facility was installed. The instrument was originally built and operating at the spallation source at the Paul Scherrer Institute in Switzerland. After a careful re-design in 2004–2006, the new PGAA instrument was ready for operation at FRM II. In this paper the main characteristics and the current operation conditions of the facility are described. The neutron flux at the sample position can reach up 6.07×1010 [cm−2 s−1], thus the optimisation of some parameters, e.g. the beam background, was necessary in order to achieve a satisfactory analytical sensitivity for routine measurements. Once the optimal conditions were reached, detection limits and sensitivities for some elements, like for example H, B, C, Si, or Pb, were calculated and compared with other PGAA facilities. A standard reference material was also measured in order to show the reliability of the analysis under different conditions at this instrument.
Resumo:
This paper presents the German version of the Short Understanding of Substance Abuse Scale (SUSS) [Humphreys et al.: Psychol Addict Behav 1996;10:38-44], the Verstandnis von Storungen durch Substanzkonsum (VSS), and evaluates its psychometric properties. The VSS assesses clinicians' beliefs about the nature and treatment of substance use disorders, particularly their endorsement of psychosocial and disease orientation. The VSS was administered to 160 treatment staff members at 12 substance use disorder treatment programs in the German-speaking part of Switzerland. Because the confirmatory factor analysis of the VSS did not completely replicate the factorial structure of the SUSS, an exploratory factor analysis was undertaken. This analysis identified two factors: the Psychosocial model factor and a slightly different Disease model factor. The VSS Disease and Psychosocial subscales showed convergent and discriminant validity, as well as sufficient reliability.
Resumo:
OBJECT: In this study, 1H magnetic resonance (MR) spectroscopy was prospectively tested as a reliable method for presurgical grading of neuroepithelial brain tumors. METHODS: Using a database of tumor spectra obtained in patients with histologically confirmed diagnoses, 94 consecutive untreated patients were studied using single-voxel 1H spectroscopy (point-resolved spectroscopy; TE 135 msec, TE 135 msec, TR 1500 msec). A total of 90 tumor spectra obtained in patients with diagnostic 1H MR spectroscopy examinations were analyzed using commercially available software (MRUI/VARPRO) and classified using linear discriminant analysis as World Health Organization (WHO) Grade I/II, WHO Grade III, or WHO Grade IV lesions. In all cases, the classification results were matched with histopathological diagnoses that were made according to the WHO classification criteria after serial stereotactic biopsy procedures or open surgery. Histopathological studies revealed 30 Grade I/II tumors, 29 Grade III tumors, and 31 Grade IV tumors. The reliability of the histological diagnoses was validated considering a minimum postsurgical follow-up period of 12 months (range 12-37 months). Classifications based on spectroscopic data yielded 31 tumors in Grade I/II, 32 in Grade III, and 27 in Grade IV. Incorrect classifications included two Grade II tumors, one of which was identified as Grade III and one as Grade IV; two Grade III tumors identified as Grade II; two Grade III lesions identified as Grade IV; and six Grade IV tumors identified as Grade III. Furthermore, one glioblastoma (WHO Grade IV) was classified as WHO Grade I/II. This represents an overall success rate of 86%, and a 95% success rate in differentiating low-grade from high-grade tumors. CONCLUSIONS: The authors conclude that in vivo 1H MR spectroscopy is a reliable technique for grading neuroepithelial brain tumors.
Resumo:
The purpose of this study was to validate the accuracy, consistency, and reproducibility/reliability of a new method for correction of pelvic tilt and rotation of radiographic hip parameters for pincer type of femoroacetabular impingement on an anteroposterior pelvic radiograph. Thirty cadaver hips and 100 randomized, blinded AP pelvic radiographs were used for investigation. To detect the software accuracy, the calculated femoral head coverage and classic hip parameters determined with our software were compared to reference measurements based on CT scans or conventional radiographs in a neutral orientation as gold standard. To investigate software consistency, differences among the different parameters for each cadaver pelvis were calculated when reckoned back from a random to the neutral orientation. Intra- and interobserver comparisons were used to analyze the reliability and reproducibility of all parameters. All but two parameters showed a good-to-very good accuracy with the reference measurements. No relevant systematic errors were detected in the Bland-Altman analysis. Software consistency was good-to-very good for all parameters. A good-to-very good reliability and reproducibility was found for a substantial number of the evaluated radiographic acetabular parameters. The software appears to be an accurate, consistent, reliable, and reproducible method for analysis of acetabular pathomorphologies.
Resumo:
Methodological evaluation of the proteomic analysis of cardiovascular-tissue material has been performed with a special emphasis on establishing examinations that allow reliable quantitative analysis of silver-stained readouts. Reliability, reproducibility, robustness and linearity were addressed and clarified. In addition, several types of normalization procedures were evaluated and new approaches are proposed. It has been found that the silver-stained readout offers a convenient approach for quantitation if a linear range for gel loading is defined. In addition, a broad range of a 10-fold input (loading 20-200 microg per gel) fulfills the linearity criteria, although at the lowest input (20 microg) a portion of protein species will remain undetected. The method is reliable and reproducible within a range of 65-200 microg input. The normalization procedure using the sum of all spot intensities from a silver-stained 2D pattern has been shown to be less reliable than other approaches, namely, normalization through median or through involvement of interquartile range. A special refinement of the normalization through virtual segmentation of pattern, and calculation of normalization factor for each stratum provides highly satisfactory results. The presented results not only provide evidence for the usefulness of silver-stained gels for quantitative evaluation, but they are directly applicable to the research endeavor of monitoring alterations in cardiovascular pathophysiology.
Resumo:
The study analyses the location of impacted maxillary canines and factors influencing root resorptions of adjacent teeth using cone-beam computed tomography (CBCT). In addition, the interrater reliability between observers of two different dental specialties for radiographic parameters will be evaluated. CBCT images of patients who were referred for radiographic localization of impacted maxillary canines and/or suspicion of root resorptions of adjacent teeth were included. The study analysed the exact three-dimensional location of the impacted canines in the anterior maxilla, frequency and extent of root resorptions, and potential influencing factors. To assess interrater agreement, Cohen's correlation parameters were calculated. This study comprises 113 patients with CBCT scans, and 134 impacted canines were analysed retrospectively. In the patients evaluated, 69 impacted canines were located palatally (51.49 per cent), 41 labially (30.60 per cent), and 24 (17.91 per cent) in the middle of the alveolar process. Root resorptions were found in 34 lateral incisors (25.37 per cent), 7 central incisors (5.22 per cent), 6 first premolars (4.48 per cent), and 1 second premolar (0.75 per cent). There was a significant correlation between root resorptions on adjacent teeth and localization of the impacted canine in relation to the bone, as well as vertical localization of the canine. Interrater agreement showed values of 0.546-0.877. CBCT provides accurate information about location of the impacted canine and prevalence and degree of root resorption of neighbouring teeth with high interrater correlation. This information is of great importance for surgeons and orthodontists for accurate diagnostics and interdisciplinary treatment planning.
Resumo:
Background: The design of Virtual Patients (VPs) is essential. So far there are no validated evaluation instruments for VP design published. Summary of work: We examined three sources of validity evidence of an instrument to be filled out by students aimed at measuring the quality of VPs with a special emphasis on fostering clinical reasoning: (1) Content was examined based on theory of clinical reasoning and an international VP expert team. (2) Response process was explored in think aloud pilot studies with students and content analysis of free text questions accompanying each item of the instrument. (3) Internal structure was assessed by confirmatory factor analysis (CFA) using 2547 student evaluations and reliability was examined utilizing generalizability analysis. Summary of results: Content analysis was supported by theory underlying Gruppen and Frohna’s clinical reasoning model on which the instrument is based and an international VP expert team. The pilot study and analysis of free text comments supported the validity of the instrument. The CFA indicated that a three factor model comprising 6 items showed a good fit with the data. Alpha coefficients per factor were 0,74 - 0,82. The findings of the generalizability studies indicated that 40-200 student responses are needed in order to obtain reliable data on one VP. Conclusions: The described instrument has the potential to provide faculty with reliable and valid information about VP design. Take-home messages: We present a short instrument which can be of help in evaluating the design of VPs.
Resumo:
The isotopic abundance of 85Kr in the atmosphere, currently at the level of 10−11, has increased by orders of magnitude since the dawn of nuclear age. With a half-life of 10.76 years, 85Kr is of great interest as tracers for environmental samples such as air, groundwater and ice. Atom Trap Trace Analysis (ATTA) is an emerging method for the analysis of rare krypton isotopes at isotopic abundance levels as low as 10−14 using krypton gas samples of a few micro-liters. Both the reliability and reproducibility of the method are examined in the present study by an inter-comparison among different instruments. The 85Kr/Kr ratios of 12 samples, in the range of 10−13 to 10−10, are measured independently in three laboratories: a low-level counting laboratory in Bern, Switzerland, and two ATTA laboratories, one in Hefei, China, and another in Argonne, USA. The results are in agreement at the precision level of 5%.