Reliability and validity of self-reported burnout in college students: A cross randomized comparison of paper-and-pencil vs. online administration

Internet data collection is becoming increasingly popular in all research fields dealing with human perceptions, behaviors and opinions. Advantages of internet data collection, when compared to the traditional paper-and-pencil format, include reduced costs, automatic database creation, and the absence of researcher-related bias effects, such as availability and complete anonymity. However, the validity and reliability of internet gathered data must be established, in comparison to the usual paper-and-pencil accepted formats, before an inferential analysis can be done. In this study, we compared questionnaire data gathered from the internet with that from the traditional paper-and-pencil in a sample of college students. The questionnaires used were the Maslach Burnout Inventory - Student Survey (MBI-SS), the Oldenburg Burnout Inventory (OBI-SS) and the Copenhagen Burnout Inventory (CBI-SS). Data was gathered through a within-subject cross randomized and counterbalanced design, on both internet and paper-and-pencil formats. The results showed no interference in the application order, and a good reliability for both formats. However, concordance between answers was generally higher in the paper-and-pencil format than on the internet. The factorial structure was invariant in the three burnout inventories. Data gathered in this study supports the Internet as a convenient, user-friendly, comfortable and secure data gathering method which does not affect the accepted factorial structures existent in the paper format of the three burnout inventories used. (C) 2011 Elsevier Ltd. All rights reserved.

The Neuropsychiatric Inventory-Clinician rating scale (NPI-C): Reliability and validity of a revised assessment of neuropsychiatric symptoms in dementia

Background: Neuropsychiatric symptoms (NPS) affect almost all patients with dementia and are a major focus of study and treatment. Accurate assessment of NPS through valid, sensitive and reliable measures is crucial. Although current NPS measures have many strengths, they also have some limitations (e.g. acquisition of data is limited to informants or caregivers as respondents, limited depth of items specific to moderate dementia). Therefore, we developed a revised version of the NPI, known as the NPI-C. The NPI-C includes expanded domains and items, and a clinician-rating methodology. This study evaluated the reliability and convergent validity of the NPI-C at ten international sites (seven languages). Methods: Face validity for 78 new items was obtained through a Delphi panel. A total of 128 dyads (caregivers/patients) from three severity categories of dementia (mild = 58, moderate = 49, severe = 21) were interviewed separately by two trained raters using two rating methods: the original NPI interview and a clinician-rated method. Rater 1 also administered four additional, established measures: the Apathy Evaluation Scale, the Brief Psychiatric Rating Scale, the Cohen-Mansfield Agitation Index, and the Cornell Scale for Depression in Dementia. Intraclass correlations were used to determine inter-rater reliability. Pearson correlations between the four relevant NPI-C domains and their corresponding outside measures were used for convergent validity. Results: Inter-rater reliability was strong for most items. Convergent validity was moderate (apathy and agitation) to strong (hallucinations and delusions; agitation and aberrant vocalization; and depression) for clinician ratings in NPI-C domains. Conclusion: Overall, the NPI-C shows promise as a versatile tool which can accurately measure NPS and which uses a uniform scale system to facilitate data comparisons across studies. Copyright © 2010 International Psychogeriatric Association.

Effect of microthread presence and restoration design (screw versus cemented) in dental implant reliability and failure modes

Objectives: This study evaluated the reliability and failure modes of implants with a microthreaded or smooth design at the crestal region, restored with screwed or cemented crowns. The postulated null hypothesis was that the presence of microthreads in the implant cervical region would not result in different reliability and strength to failure than smooth design, regardless of fixation method, when subjected to step-stress accelerated life-testing (SSALT) in water. Materials and methods: Eighty four dental implants (3.3 × 10 mm) were divided into four groups (n = 21) according to implant macrogeometric design at the crestal region and crown fixation method: Microthreads Screwed (MS); Smooth Screwed (SS); Microthreads Cemented (MC), and Smooth Cemented (SC). The abutments were torqued to the implants and standardized maxillary central incisor metallic crowns were cemented (MC, SC) or screwed (MS, SS) and subjected to SSALT in water. The probability of failure versus cycles (90% two-sided confidence intervals) was calculated and plotted using a power law relationship for damage accumulation. Reliability for a mission of 50,000 cycles at 150 N (90% 2-sided confidence intervals) was calculated. Differences between final failure loads during fatigue for each group were assessed by Kruskal-Wallis along with Benferroni's post hoc tests. Polarized-light and scanning electron microscopes were used for failure analyses. Results: The Beta (β) value (confidence interval range) derived from use level probability Weibull calculation of 1.30 (0.76-2.22), 1.17 (0.70-1.96), 1.12 (0.71-1.76), and 0.52 (0.30-0.89) for groups MC, SC, MS, and SS respectively, indicated that fatigue was an accelerating factor for all groups, except for SS. The calculated reliability was higher for SC (99%) compared to MC (87%). No difference was observed between screwed restorations (MS - 29%, SS - 43%). Failure involved abutment screw fracture for all groups. The cemented groups (MC, SC) presented more abutment and implant fractures. Significantly higher load to fracture values were observed for SC and MC relative to MS and SS (P < 0.001). Conclusion: Since reliability and strength to failure was higher for SC than for MC, our postulated null hypothesis was rejected. © 2012 John Wiley & Sons A/S.

Reliability and failure modes of internal conical dental implant connections

Objective: Biological and mechanical implant-abutment connection complications and failures are still present in clinical practice, frequently compromising oral function. The purpose of this study was to evaluate the reliability and failure modes of anterior single-unit restorations in internal conical interface (ICI) implants using step-stress accelerated life testing (SSALT). Materials and methods: Forty-two ICI implants were distributed in two groups (n = 21 each): group AT-OsseoSpeed™ TX (Astra Tech, Waltham, MA, USA); group SV-Duocon System Line, Morse Taper (Signo Vinces Ltda., Campo Largo, PR, Brazil). The corresponding abutments were screwed to the implants and standardized maxillary central incisor metal crowns were cemented and subjected to SSALT in water. Use-level probability Weibull curves and reliability for a mission of 50,000 cycles at 200 N were calculated. Differences between groups were assessed by Kruskal-Wallis along with Bonferroni's post-hoc tests. Polarized-light and scanning electron microscopes were used for failure analyses. Results: The Beta (β) value derived from use level probability Weibull calculation was 1.62 (1.01-2.58) for group AT and 2.56 (1.76-3.74) for group SV, indicating that fatigue was an accelerating factor for failure of both groups. The reliability for group AT was 0.95 and for group SV was 0.88. Kruskal-Wallis along with Bonferroni's post-hoc tests showed no significant difference between the groups tested (P > 0.27). In all specimens of both groups, the chief failure mode was abutment fracture at the conical joint region and screw fracture at neck's region. Conclusions: Reliability was not different between investigated ICI connections supporting maxillary incisor crowns. Failure modes were similar. © 2012 John Wiley & Sons A/S.

The Brazilian version of the Neuropsychiatric Inventory-Clinician rating scale (NPI-C): Reliability and validity in dementia

ABSTRACT Background: Patients with dementia may be unable to describe their symptoms, and caregivers frequently suffer emotional burden that can interfere with judgment of the patient's behavior. The Neuropsychiatric Inventory-Clinician rating scale (NPI-C) was therefore developed as a comprehensive and versatile instrument to assess and accurately measure neuropsychiatric symptoms (NPS) in dementia, thereby using information from caregiver and patient interviews, and any other relevant available data. The present study is a follow-up to the original, cross-national NPI-C validation, evaluating the reliability and concurrent validity of the NPI-C in quantifying psychopathological symptoms in dementia in a large Brazilian cohort. Methods: Two blinded raters evaluated 312 participants (156 patient-knowledgeable informant dyads) using the NPI-C for a total of 624 observations in five Brazilian centers. Inter-rater reliability was determined through intraclass correlation coefficients for the NPI-C domains and the traditional NPI. Convergent validity included correlations of specific domains of the NPI-C with the Brief Psychiatric Rating Scale (BPRS), the Cohen-Mansfield Agitation Index (CMAI), the Cornell Scale for Depression in Dementia (CSDD), and the Apathy Inventory (AI). Results: Inter-rater reliability was strong for all NPI-C domains. There were high correlations between NPI-C/delusions and BPRS, NPI-C/apathy-indifference with the AI, NPI-C/depression-dysphoria with the CSDD, NPI-C/agitation with the CMAI, and NPI-C/aggression with the CMAI. There was moderate correlation between the NPI-C/aberrant vocalizations and CMAI and the NPI-C/hallucinations with the BPRS. Conclusion: The NPI-C is a comprehensive tool that provides accurate measurement of NPS in dementia with high concurrent validity and inter-rater reliability in the Brazilian setting. In addition to universal assessment, the NPI-C can be completed by individual domains. © International Psychogeriatric Association 2013.

Influence of abutment-to-fixture design on reliability and failure mode of all-ceramic crown systems

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Temporomandibular disorders among Brazilian adolescents: reliability and validity of a screening questionnaire

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Reliability and differentiation capability of dynamic and static kinematic measurements of rearfoot eversion in patellofemoral pain

Excessive rearfoot eversion is thought to be a risk factor for patellofemoral pain development, due to the kinesiological relationship with ascendant adaptations. Individuals with patellofemoral pain are often diagnosed through static clinical tests, in scientific studies and clinical practice. However, the adaptations seem to appear in dynamic conditions. Performing static vs. dynamic evaluations of widely used measures would add to the knowledge in this area. Thus, the aim of this study was to determine the reliability and differentiation capability of three rearfoot eversion measures: rearfoot range of motion, static clinical test and static measurement using a three-dimensional system. A total of 29 individuals with patellofemoral pain and 25 control individuals (18-30 years) participated in this study. Each subject underwent three-dimensional motion analysis during stair climbing and static clinical tests. Intraclass correlation coefficient and standard error measurements were performed to verify the reliability of the variables and receiver operating characteristic curves to show the diagnostic accuracy of each variable. In addition, analyses of variance were performed to identify differences between groups. Rearfoot range of motion demonstrated higher diagnostic accuracy (an area under the curve score of 0.72) than static measures and was able to differentiate the groups. Only the static clinical test presented poor and moderate reliability. Other variables presented high to very high values. Rearfoot range of motion was the variable that presented the best results in terms of reliability and differentiation capability. Static variables do not seem to be related to patellofemoral pain and have low accuracy values.

Cross-cultural adaptation and assessment of the reliability and validity of the Core Outcome Measures Index (COMI) for the Brazilian-Portuguese language

The use of patient-orientated questionnaires is of utmost importance in assessing the outcome of spine surgery. Standardisation, using a common set of outcome measures, is essential to aid comparisons across studies/in registries. The Core Outcome Measures Index (COMI) is a short, multidimensional outcome instrument validated for patients with spinal disorders. This study aimed to produce a Brazilian-Portuguese version of the COMI. A cross-cultural adaptation of the COMI into Brazilian-Portuguese was carried out using established guidelines. 104 outpatients with chronic LBP (> 3 months) were recruited from a Public Health Spine Medical Care Centre. They completed a questionnaire booklet containing the newly translated COMI, and other validated symptom-specific questionnaires: Oswestry Disability Index (ODI) and Roland Morris disability scale (RM), and a pain visual analogue scale. All patients completed a second questionnaire within 7-10 days to assess reproducibility. The COMI summary score displayed minimal floor and ceiling effects. On re-test, the responses for each individual domain of the COMI were within 1 category in 98% patients for the domain 'function', 96% for 'symptom-specific well-being', 97% for 'general quality of life', 99% for 'social disability' and 100% for 'work disability'. The intraclass correlation coefficients (ICC2,1) for COMI pain and COMI summary scores were 0.91-0.96, which compared favourably with the corresponding values for the RM (ICC, 0.99) and ODI (ICC, 0.98). The standard error of measurement for the COMI was 0.6, giving a "minimum detectable change" (MDC95%) of approximately 1.7 points i.e., the minimum change to be considered "real change" beyond measurement error. The COMI scores correlated as hypothesised (Rho, 0.4-0.8) with the other symptom-specific questionnaires. The reproducibility of the Brazilian-Portuguese version of the COMI was comparable to that of other language versions. The COMI scores correlated in the expected manner with existing but longer symptom-specific questionnaires suggesting good convergent validity for the COMI. The Brazilian-Portuguese COMI represents a valuable tool for Brazilian study-centres in future multicentre clinical studies and surgical registries.

Delineation of vertebral area on the coronal plane using three-dimensional ultrasonography advanced volume contrast imaging (VCI) Omni view: intrarater reliability and agreement using standard mouse, high definition mouse, and pen-tablet

Objective: To assess the fetal lumbosacral spine by three-dimensional (3D) ultrasonography using volume contrast imaging (VCI) omni view method and compare reproducibility and agreement between three different measurement techniques: standard mouse, high definition mouse and pen-tablet. Methods: A comparative and prospective study with 40 pregnant women between 20 and 34+6 weeks was realized. 3D volume datasets of the fetal spine were acquired using a convex transabdominal transducer. Starting scan plane was the coronal section of fetal lumbosacral spine by VCI-C function. Omni view manual trace was selected and a parallel plane of fetal spine was drawn including interest region. Intraclass correlation coefficient (ICC) was used for reproducibility analysis. The relative difference between three used techniques was compared by chi-square test and Fischer test. Results: Pen-tablet showed better reliability (ICC = 0.987). In the relative proportion of differences, this was significantly higher for the pen-tablet (82.14%; p < 0.01). In paired comparison, the relative difference was significantly greater for the pen-tablet (p < 0.01). Conclusion: The pen-tablet showed to be the most reproductive and concordant method in the measurement of body vertebral area of fetal lumbosacral spine by 3D ultrasonography using the VCI.

Reliability and construct validity of the karate-specific aerobic test

Chaabene, H, Hachana, Y, Franchini, E, Mkaouer, B, Montassar, M, and Chamari, K. Reliability and construct validity of the karate-specific aerobic test. J Strength Cond Res 26(12): 3454-3460, 2012-The aim of this study was to examine absolute and relative reliabilities and external responsiveness of the Karate-specific aerobic test (KSAT). This study comprised 43 male karatekas, 19 of them participated in the first study to establish test-retest reliability and 40, selected on the bases of their karate experience and level of practice, participated in the second study to identify external responsiveness of the KSAT. The latter group was divided into 2 categories: national-level group (G(n)) and regional-level group (Gr). Analysis showed excellent test-retest reliability of time to exhaustion (TE), with intraclass correlation coefficient ICC(3,1) >0.90, standard error of measurement (SEM) <5%: (3.2%) and mean difference (bias) +/- the 95% limits of agreement: -9.5 +/- 78.8 seconds. There was a significant difference between test-retest session in peak lactate concentration (Peak [La]) (9.12 +/- 2.59 vs. 8.05 +/- 2.67 mmol.L-1; p < 0.05) but not in peak heart rate (HRpeak) and rating of perceived exertion (RPE) (196 +/- 9 vs. 194 +/- 9 b.min(-1) and 7.6 +/- 0.93 vs. 7.8 +/- 1.15; p > 0.05), respectively. National-level karate athletes (1,032 +/- 101 seconds) were better than regional level (841 +/- 134 seconds) on TE performance during KSAT (p < 0.001). Thus, KSAT provided good external responsiveness. The area under the receiver operator characteristics curve was >0.70 (0.86; confidence interval 95%: 0.72-0.95). Significant difference was detected in Peak [La] between national- (6.09 +/- 1.78 mmol.L-1) and regional-level (8.48 +/- 2.63 mmol.L-1) groups, but not in HRpeak (194 +/- 8 vs. 195 +/- 8 b.min(-1)) and RPE (7.57 +/- 1.15 vs. 7.42 +/- 1.1), respectively. The result of this study indicates that KSAT provides excellent absolute and relative reliabilities. The KSAT can effectively distinguish karate athletes of different competitive levels. Thus, the KSAT may be suitable for field assessment of aerobic fitness of karate practitioners.

Reliability and validity of spirituality questionnaire by Parsian and Dunning in the Spanish version

The aim of this methodological study was to translate, culturally adapt and assess the internal consistency and validity of the Spanish version of the "Spirituality Questionnaire". The sample comprised 204 young people between 18 and 25 years of age from two universities in Bogota. Cronbach's Alpha was used for reliability, while groups of experts and young people were used for construct validity. The reliability score of the total instrument was 0.88. The overall index of content validity corresponded to 0.90. Exploratory factor analysis showed that four factors explain 52.60% of the variance. The originally proposed theoretical model was confirmed and, in two dimensions, a different structure was proposed. In conclusion, the instrument "Spirituality Questionnaire" by Parsian and Dunning is reliable and valid in the Spanish version.

Biometry and fetal weight estimation by two-dimensional and three-dimensional ultrasonography: an intraobserver and interobserver reliability and agreement study

Objective To evaluate and compare the intraobserver and interobserver reliability and agreement for the biparietal diameter (BPD), abdominal circumference (AC), femur length (FL) and estimated fetal weight (EFW) obtained by two-dimensional ultrasound (2D-US) and three-dimensional ultrasound (3D-US). Methods Singleton pregnant women between 24 and 40 weeks were invited to participate in this study. They were examined using 2D-US in a blinded manner, twice by one observer, intercalated by a scan by a second observer, to determine BPD, AC and FL. In each of the three examinations, three 3D-US datasets (head, abdomen and thigh) were acquired for measurements of the same parameters. We determined EFW using Hadlock's formula. Systematic errors between 3D-US and 2D-US were examined using the paired t-test. Reliability and agreement were assessed by intraclass correlation coefficients (ICCs), limits of agreement (LoA), SD of differences and proportion of differences below arbitrary points. Results We evaluated 102 singleton pregnancies. No significant systematic error between 2D-US and 3D-US was observed. The ICC values were higher for 3D-US in both intra- and interobserver evaluations; however, only for FL was there no overlap in the 95% CI. The LoA values were wider for 2D-US, suggesting that random errors were smaller when using 3D-US. Additionally, we observed that the SD values determined from 3D-US differences were smaller than those obtained for 2D-US. Higher proportions of differences were below the arbitrarily defined cut-off points when using 3D-US. Conclusion 3D-US improved the reliability and agreement of fetal measurements and EFW compared with 2D-US.

GRBAS and Cape-V Scales: High Reliability and Consensus When Applied at Different Times

Objectives. To evaluate whether the overall dysphonia grade, roughness, breathiness, asthenia, and strain (GRBAS) scale, and the Consensus Auditory Perceptual Evaluation-Voice (CAPE-V) scale show the same reliability and consensus when applied to the same vocal sample at different times. Study Design. Observational cross-sectional study. Methods. Sixty subjects had their voices recorded according to the tasks proposed in the CAPE-V scale. Vowels /a/ and /i/ were sustained between 3 and 5 seconds. Reproduction of six sentences and spontaneous speech from the request "Tell me about your voice" were analyzed. For the analysis of the GRBAS scale, the sustained vowel and reading tasks of the sentences was used. Auditory-perceptual voice analyses were conducted by three expert speech therapists with more than 5 years of experience and familiar with both the scales. Results. A strong correlation was observed in the intrajudge consensus analysis, both for the GRBAS scale as well as for CAPE-V, with intraclass coefficient values ranging from 0.923 to 0.985. A high degree of correlation between the general GRBAS and CAPE-V grades (coefficient = 0.842) was observed, with similarities in the grades of dysphonia distribution in both scales. The evaluators indicated a mild difficulty in applying the GRBAS scale and low to mild difficulty in applying the CAPE-V scale. The three evaluators agreed when indicating the GRBAS scale as the fastest and the CAPE-V scale as the most sensitive, especially for detecting small changes in voice. Conclusions. The two scales are reliable and are indicated for use in analyzing voice quality.

Reliability and consistency affect the integration of visual depth cues

Abstract Originalsprache (englisch) Visual perception relies on a two-dimensional projection of the viewed scene on the retinas of both eyes. Thus, visual depth has to be reconstructed from a number of different cues that are subsequently integrated to obtain robust depth percepts. Existing models of sensory integration are mainly based on the reliabilities of individual cues and disregard potential cue interactions. In the current study, an extended Bayesian model is proposed that takes into account both cue reliability and consistency. Four experiments were carried out to test this model's predictions. Observers had to judge visual displays of hemi-cylinders with an elliptical cross section, which were constructed to allow for an orthogonal variation of several competing depth cues. In Experiment 1 and 2, observers estimated the cylinder's depth as defined by shading, texture, and motion gradients. The degree of consistency among these cues was systematically varied. It turned out that the extended Bayesian model provided a better fit to the empirical data compared to the traditional model which disregards covariations among cues. To circumvent the potentially problematic assessment of single-cue reliabilities, Experiment 3 used a multiple-observation task, which allowed for estimating perceptual weights from multiple-cue stimuli. Using the same multiple-observation task, the integration of stereoscopic disparity, shading, and texture gradients was examined in Experiment 4. It turned out that less reliable cues were downweighted in the combined percept. Moreover, a specific influence of cue consistency was revealed. Shading and disparity seemed to be processed interactively while other cue combinations could be well described by additive integration rules. These results suggest that cue combination in visual depth perception is highly flexible and depends on single-cue properties as well as on interrelations among cues. The extension of the traditional cue combination model is defended in terms of the necessity for robust perception in ecologically valid environments and the current findings are discussed in the light of emerging computational theories and neuroscientific approaches.