Reliability and validity of scores on scales to measure managerial aspirations

The present investigation assessed the reliability and validity of the scores of a subjective measure of desired aspirations and a behavioral measure of enacted aspirations. A sample of 5,655 employees was randomly split into two halves. Principal components analysis on Sample 1, followed by confirmatory factor analysis on Sample 2, confirmed the desired and enacted scales as distinct but related measures of managerial aspirations. The desired and enacted scales had satisfactory levels of internal consistency and temporal stability over a 1-year period. Relationships between the measures of desired and enacted managerial aspirations and both attitudinal and behavioral criteria, measured concurrently and 1 year later, provided preliminary support for convergent and discriminant validity for our sample. Desired aspirations demonstrated stronger validity than enacted aspirations. Although further examination of the psychometric properties of the scales is warranted, the present findings provide promising support for their validity and reliability for our sample.

Brazilian version of the Functional Assessment Measure: cross-cultural adaptation and reliability evaluation

The objective of this prospective study was to perform a cross-cultural adaptation of the Functional Assessment Measure (FAM) into Brazilian Portuguese, and to assess the test-retest reliability. The instrument was translated, back-translated, pretested, and reviewed by a committee. The Brazilian version was assessed in 61 brain-injury patients. Intrarater and interrater reliability was verified by a test-retest procedure (intraclass correlation). Intrarater reliability was moderate-to-excellent; interrater reliability was moderate-to-excellent, with the exception of one item. The Brazilian version of the FAM has acceptable test-retest reliability. Results suggest the use of the Brazilian version of the FAM in the Brazilian population, for disability evaluation and outcome assessment. Further research is required to evaluate the psychometric properties of the scale. International Journal of Rehabilitation Research 34:89-91 (C) 2011 Wolters Kluwer Health vertical bar Lippincott Williams & Wilkins.

A reliability-based measure of robustness for concrete structures subjected to corrosion

This work is a contribution to the definition and assessment of structural robustness. Special emphasis is given to reliability of reinforced concrete structures under corrosion of longitudinal reinforcement. On this communication several authors’ proposals in order to define and measure structural robustness are analyzed and discussed. The probabilistic based robustness index is defined, considering the reliability index decreasing for all possible damage levels. Damage is considered as the corrosion level of the longitudinal reinforcement in terms of rebar weight loss. Damage produces changes in both cross sectional area of rebar and bond strength. The proposed methodology is illustrated by means of an application example. In order to consider the impact of reinforcement corrosion on failure probability growth, an advanced methodology based on the strong discontinuities approach and an isotropic continuum damage model for concrete is adopted. The methodology consist on a two-step analysis: on the first step an analysis of the cross section is performed in order to capture phenomena such as expansion of the reinforcement due to the corrosion products accumulation and damage and cracking in the reinforcement surrounding concrete; on the second step a 2D deteriorated structural model is built with the results obtained on the first step of the analysis. The referred methodology combined with a Monte Carlo simulation is then used to compute the failure probability and the reliability index of the structure for different corrosion levels. Finally, structural robustness is assessed using the proposed probabilistic index.

Reliability of a new measure of motoneuron excitability

Objectlve:--This study examined the intraclass reliability· of different measures of the excitability of the Hoffmann reflex, derived from stimulus-response curves. The slope of the regression line of the H-reflex stimulus-response curve advocated by Funase et al. (1994) was also compared to the peak of the first derivative of the H-reflex stimulus-response curve (dHIdVmax), a new measure introduced in this investigation. A secondary purpose was to explore the possibility of mood as a covariate when measuring excitability of the H-reflex arc. Methods: The H-reflex amplitude at a stimulus intensity corresponding to 5% of the maximum M-wave (Mmax) is an established measure that was used as an additional basis of comparison. The H-reflex was elicited in the soleus for 24 subjects (12 males and 12 females) on five separate days. Vibration was applied to the Achilles tendon prior to stimulation to test the sensitivity of the measures on test day four. The means of five evoked potentials at each gradually increasing intensity, from below H-reflex threshold to above Mmax, were used to create both the H-reflex and M-wave stimulus response curves for each subject across test days. The mood of the subjects was assessed using the Subjective Exercise Experience Scale (SEES) prior to the stimulation protocol each day. Results: There was a modest decrease in all H-reflex measures from the first to third test day, but it was non-significant (P's>0.05). All measures of the H-reflex exhibited a profound reduction following vibration on test day four, and then returned to baseline levels on test day five (P's<0.05). The intraclass correlation coefficient (ICC) for H-reflex amplitude at 5% of Mmax was 0.85. The ICC for the slope of the regression line was 0.79 while it was 0.89 for dH/dVmax. Maximum M-wave amplitude had an ICC of 0.96 attesting to careful methodological controls. The SEES subscales of fatigue and psychological well-being remained unchanged IV across the five days. The psychological distress subscale (PO.05). Conclusions: The peak of the first derivative of the H-reflex stimulus-response curve (dH/dVmax) was shown to have comparable reliability and sensitivity to other more established measures of excitability. Psychological distress and the amplitude of the H-reflex at 5% Mmax follow similar trends across days, however there was no significant correlation between the two measures. Significance: The proposed method appears to be a more robust measure ofH-reflex excitability than the other methods tested. As such it would be an advantageous method to apply in clinical and investigative settings. Additionally, the results suggest that the relationship between psychological distress and H-reflex amplitude should be investigated further.

Reliability, construct and criterion validity of the KIDSCREEN-10 score: a short measure for children and adolescents' well-being and health-related quality of life

Background To assess the criterion and construct validity of the KIDSCREEN-10 well-being and health-related quality of life (HRQoL) score, a short version of the KIDSCREEN-52 and KIDSCREEN-27 instruments. Methods The child self-report and parent report versions of the KIDSCREEN-10 were tested in a sample of 22,830 European children and adolescents aged 8–18 and their parents (n = 16,237). Correlation with the KIDSCREEN-52 and associations with other generic HRQoL measures, physical and mental health, and socioeconomic status were examined. Score differences by age, gender, and country were investigated. Results Correlations between the 10-item KIDSCREEN score and KIDSCREEN-52 scales ranged from r = 0.24 to 0.72 (r = 0.27–0.72) for the self-report version (proxy-report version). Coefficients below r = 0.5 were observed for the KIDSCREEN-52 dimensions Financial Resources and Being Bullied only. Cronbach alpha was 0.82 (0.78), test–retest reliability was ICC = 0.70 (0.67) for the self- (proxy-)report version. Correlations between other children self-completed HRQoL questionnaires and KIDSCREEN-10 ranged from r = 0.43 to r = 0.63 for the KIDSCREEN children self-report and r = 0.22–0.40 for the KIDSCREEN parent proxy report. Known group differences in HRQoL between physically/mentally healthy and ill children were observed in the KIDSCREEN-10 self and proxy scores. Associations with self-reported psychosomatic complaints were r = −0.52 (−0.36) for the KIDSCREEN-10 self-report (proxy-report). Statistically significant differences in KIDSCREEN-10 self and proxy scores were found by socioeconomic status, age, and gender. Conclusions Our results indicate that the KIDSCREEN-10 provides a valid measure of a general HRQoL factor in children and adolescents, but the instrument does not represent well most of the single dimensions of the original KIDSCREEN-52. Test–retest reliability was slightly below a priori defined thresholds.

Validity and reliability of a measure of Latina mother's nutritional self-efficacy

Background. Not only has obesity played a role in Texas adults but it is also becoming a large issue among low-income Latino children. In Latino children between 2-5 years of age, the Pediatric Nutrition Surveillance data in 1997 found the prevalence of obesity was 12 percent, highest among all ethnic groups. Children learn what and how to eat from their environment. Despite many mothers being working mothers they are still the principal caregivers and source of influence on their toddler's diet. Self-efficacy, a concept created by Albert Bandura, one's belief that one is capable of performing a behavior needed to reach an intended goal, is increasingly becoming important in nutrition and health education. This study is important to understand the degree of impact that a mother's self-efficacy will have on a child's diet. This is useful knowing if influencing a mother's self-efficacy could improve a child's diet to prevent certain public health issues such as obesity and diabetes. The purpose of this study was to examine nutrition self-efficacy of Latina mothers, focusing on sweets and beverage and if their self-efficacy impacted their child's diet. Methods. The data was collected during July-September 2008. Mothers were recruited from two federally qualified San Antonio health centers. In order to qualify, participants had to be Hispanic with children of toddler age. Mothers were informed of incentives available upon completion. The interview consisted of demographic info, a set of five self-efficacy questions repeated at completion, testing reliability and a 24-hour food recall diary asked of the participant's child's diet. Results. There were 225 mothers who participated between both clinics. The Crohnbach alpha scores for the two different times the self-efficacy questions were asked were .44 corresponding to the first time and .49 for the second time. The three most common beverages reported were milk, juice, and water. The mothers who met or gave their child more milk than recommended by the scientific community, 800mg of calcium/3 cups (24oz) set, had a higher self-efficacy score than those who did not meet the standard at all. Mothers who gave their children more juice than the standard recommends, 4-6oz for children 1-6 years of age, had slightly higher self-efficacy scores than mother's who simply met the standard. In general, the lower the mother's self-efficacy, the more sweets they gave their child and vice versa. Conclusion. This study's Kappa values were adequate and this research showed that Latina mothers did in fact have high self-efficacy. In general some of the children's diets did not reflect the current scientific nutrition recommendations. In order to improve self-efficacy and have an impact on children's diets, the scientific community has a responsibility to make recommendations that are easily understood and can be put into practice. The public health community needs to ensure that we encourage those we serve to be more active in their health and educate them about what constitutes good health and nutrition for both themselves and their children.^

An examination of the cross-cultural reliability and construct validity of a measure of loneliness

Loneliness is a pervasive, rather common experience in American culture, particularly notable among adolescents. However, the phenomenon is not well documented in the cross-cultural psychiatric literature. For psychiatric epidemiology to encompass a wide array of psychopathologic phenomena, it is important to develop useful measures to characterize and classify both non-clinical and clinical dysfunction in diverse subgroups and cultures.^ The goal of this research was to examine the cross-cultural reliability and construct validity of a scale designed to measure loneliness. The Roberts Loneliness Scale (RLS-8) was administered to 4,060 adolescents ages 10-19 years enrolled in high schools along either side of the Texas-Tamaulipas border region between the U.S. and Mexico. Data collected in 1988 from a study focusing on substance use and psychological distress among adolescents in these regions were used to examine the operating characteristics of the RLS-8. A sample stratified by nationality and language, age, gender, and grade was used for analysis.^ Results indicated that in general the RLS-8 has moderate reliability in the U.S. sample, but not in the Mexican sample. Validity analyses demonstrated that there was evidence for convergent validity of the RLS-8 in the U.S. sample, but none in the Mexican sample. Discriminant validity of the measures in neither sample could be established. Based on the factor structure of the RLS-8, two subscales were created and analyzed for construct validity. Evidence for convergent validity was established for both subscales in both national samples. However, the discriminant validity of the measure remains unsubstantiated in both national samples. Also, the dimensionality of the scale is unresolved.^ One primary goal for future cross-cultural research would be to develop and test better defined culture-specific models of loneliness within the two cultures. From such scientific endeavor, measures of loneliness can be developed or reconstructed to classify the phenomenon in the same manner across cultures. Since estimates of prevalence and incidence are contingent upon reliable and valid screening or diagnostic measures, this objective would serve as an important foundation for future psychiatric epidemiologic inquiry into loneliness. ^

Reliability of a measure of prediagnosis physical activity for cancer survivors

Purpose: This study was conducted to examine the test-retest reliability of a measure of prediagnosis physical activity participation administered to colorecial cancer survivors recruited from a population-based state cancer registry. Methods: A total of 112 participants completed two telephone interviews. I month apart, reporting usual weekly physical activity in the year before their cancer diagnosis. Intraclass correlation coefficients (ICC) and standard en-or of measurement (SEM) were used to describe the test-retest reliability of the measure across the sample: the Bland-Altman approach was used to describe reliability at the individual level. The test-retest reliability for categorized total physical activity (active, insufficiently active, sedentary) was assessed using the kappa statistic. Results: When the complete sample was considered, the ICC ranged from 0.40 (95% Cl: 0.24, 0.55) for vigorous gardening to 0.77 (95% Cl: 0.68, 0.84) for moderate physical activity. The SEM, however, were large. indicating high measurement error. The Bland-Altman plots indicated that the reproducibility of data decreases as the aniount of physical activity reported each week increases The kappa coefficient for the categorized data was 0.62 (95% Cl: 0.48, 0.76). Conclusion: Overall. the results indicated low levels of repeatability for this measure of historical physical activity. Categorizing participants as active, insufficiently active, or sedentary provides a higher level of test-retest reliability.

The MacDQoL individualized measure of the impact of macular degeneration on quality of life: reliability and responsiveness

PURPOSE: To investigate the MacDQoL test-retest reliability and sensitivity to change in vision over a period of one year in a sample of patients with age-related macular degeneration (AMD). DESIGN: A prospective, observational study. METHOD: Patients with AMD from an ophthalmologist's list (n = 135) completed the MacDQoL questionnaire by telephone interview and underwent a vision assessment on two occasions, one year apart. RESULTS: Among participants whose vision was stable over one year (n = 87), MacDQoL scores at baseline and follow-up were highly correlated (r = 0.95; P < .0001). Twelve of the 22 scale items had intraclass correlations of >.80; only two were correlated <.7. There was no difference between baseline and follow-up scores (P = .85), indicating excellent test-retest reliability. Poorer quality of life (QoL) at follow-up, measured by the MacDQoL present QoL overview item, was associated with deterioration in both the better eye and binocular distance visual acuity [VA] (r = 0.29; P = .001, r = 0.21; P = .016, respectively; n = 135). There was a positive correlation between deterioration in the Mac. DQoL average weighted impact score and deterioration in both binocular near VA and reading speed (r = 0.20; P = .019, r = 0.18; P = .041, respectively; n = 135). CONCLUSION: The MacDQoL has excellent test-retest reliability. Its sensitivity to change in vision status was demonstrated in correlational analyses. The measure indicates that the negative impact of AMD on QoL increases with increasing severity of visual impairment.

Developing a reliable audit instrument to measure the physical environment for physical activity

Background: The physical environment plays an important role in influencing participation in physical activity, although which factors of the physical environment have the greatest effect on patterns of activity remain to be determined. We describe the development of a comprehensive instrument to measure the physical environmental factors that may influence walking and cycling in local neighborhoods and report on its reliability. Methods: Following consultation with experts from a variety of fields and a literature search, we developed a Systematic Pedestrian and Cycling Environmental Scan (SPACES) instrument and used it to collect data over a total of 1987 kilometers of roads in metropolitan Perth, Western Australia. The audit instrument is available from the first author on request. Additional environmental information was collected using desktop methods and geographic information systems (GIS) technology. We assessed inter- and intra-rater reliability of the instrument among the 16 observers who collected the data. Results: The observers reported that the audit instrument was easy to use. Both inter- and intra-rater reliability of the environmental scan instrument were generally high. Conclusions: Our instrument provides a reliable, practical, and easy to-use method for collecting detailed street-level data on physical environmental factors that are potential influences on walking in local neighborhoods.

Portuguese version of the Delirium Rating Scale-Revised-98: reliability and validity

Objective To assess the validity and the reliability of the Portuguese version of the Delirium Rating Scale-Revised-98 (DRS-R-98). Methods The scale was translated into Portuguese and back-translated into English. After assessing its face validity, five diagnostic groups (n = 64; delirium, depression, dementia, schizophrenia and others) were evaluated by two independent researchers blinded to the diagnosis. Diagnosis and severity of delirium as measured by the DRS-R-98 were compared to clinical diagnosis, Mini-Mental State Exam, Confusion Assessment Method, and Clinical Global Impressions scale (CGI). Results Mean and rnedian DRS-R-98 total scores significantly distinguished delirium from the other groups (p < 0.001). Inter-rater reliability (ICC between 0.9 and 1) and internal consistency (alpha = 0.91) were very high. DRS-R-98 severity scores correlated highly with the CGI. Mean DRS-R-98 severity scores during delirium differed significantly (p < 0.01) from the post-treatment values. The area under the curve established by ROC analysis was 0.99 and using the cut-off Value of 20 the scale showed sensitivity and specificity of 92.6% and 94.6%, respectively. Conclusion The Portuguese version of the DRS-R-98 is a valid and reliable measure of delirium that distinguishes delirium from other disorders and is sensitive to change in delirium severity, which may be of great value for longitudinal studies. Copyright (c) 2007 John Wiley & Sons, Ltd.

Cross-cultural Adaptation, Reliability and Validity of the DAFS-R in a Sample of Brazilian Older Adults

The Direct Assessment of Functional Status-Revised (DAFS-R) is an instrument developed to objectively measure functional capacities required for independent living. The objective of this study was to translate and culturally adapt the DAFS-R for Brazilian Portuguese (DAFS-BR) and to evaluate its reliability and validity. The DAFS-BR was administered to 89 older patients classified previously as normal controls, mild cognitive impairment (MCI) and Alzheimer`s disease (AD). The results indicated good internal consistency (Cronbach`s alpha = 0.78) in the total sample. The DAFS-BR showed high interobserver reliability (0.996; p < .001) as well as test-retest stability over 1-week interval (0.995; p < .001). Correlation between the DAFS-BR total score and the Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE) was moderate and significant (r = -.65, p < .001) in the total sample, whereas it did not reach statistical significance within each diagnostic group. Receiver operating characteristic curve analyses suggested that DAFS-BR has good sensitivity and specificity to identify MCI and AD. Results suggest that DAFS-BR can document degrees of severity of functional impairment among Brazilian older adults.

A standardized measurement technique may improve the reliability of measurements of endometrial thickness and volume

Objective To investigate whether standardization of the multiplanar view (SMV) when evaluating the uterus using three-dimensional ultrasonography (3D-US) improves intra-and interobserver reliability and agreement with regard to endometrial measurement. Methods Two-dimensional (2D) and 3D-US was used to measure endometrial thickness by two observers in 30 women undergoing assisted reproduction treatment. Endometrial volume was measured with Virtual Organ Computer-aided AnaLysis (VOCAL (TM)) in the longitudinal (A) and coronal (C) planes using an unmodified multiplanar view (UMV) and a standardized multiplanar view (SMV). Measurement reliability was evaluated by intraclass correlation coefficient (ICC) and agreement was examined using Bland-Altman plots with limits of agreement (LoA). The ease of outlining the endometrial-myometrial interface was compared between the A-and C-planes using subjective assessment. Results Endometrial volume measurements using the SMV and A-plane were more reliable (intra-and interobserver ICCs, 0.979 and 0.975, respectively) than were measurements of endometrial thickness using 2D-US (intra-and interobserver ICCs, 0.742 and 0.702, respectively) or 3D-US (intra-and interobserver ICCs, 0.890 and 0.784, respectively). The LoAs were narrower for SMV than for UMV. Reliability and agreement were not much different between the A- and C-planes. However the observers agreed that delineating the endometrial-myometrial interface using the A-plane was easier (first and second observer, 50.0 and 46.7%, respectively) or `comparable` (50 and 53.3%, respectively), but never more difficult than using the C-plane. Conclusions Endometrial volume measurements are more reliable than endometrial thickness measurements and are best performed using SMV and the A-plane. Copyright (C) 2011 ISUOG. Published by John Wiley & Sons, Ltd.

Inter-rater reliability study of the modified Oxford Grading Scale and the Peritron manometer

Objective To evaluate the inter-rater reliability of the modified Oxford Grading Scale and the Peritron manometer. Design All participants were evaluated twice, first by one examiner and 30 days later by a second examiner. Measurements of vaginal squeeze pressure were compared with the results from the palpation test. Participants Nineteen women with a mean age of 23.7 years (range 21 to 28 years). Results Inter-rater reliability for vaginal palpation was fair (kappa = 0.33, 95% confidence interval 0.09 to 0.57). Using the Peritron manometer, the difference between examiners was less than 10 cmH(2)O in 11 of the 19 (58%) cases. The palpation test did not differentiate between weak, moderate, good and strong muscle contractions. This study found fair inter-rater reliability for the modified Oxford Grading Scale and moderate inter-rater reliability for the Peritron manometer. Conclusions The inter-rater reliability of vaginal squeeze pressure measurement using the Peritron manometer is acceptable and can be used in re-evaluations performed by different examiners in clinical practice. However, for research purposes, the ideal situation would be for a single examiner to assess and re-assess the subject. Vaginal palpation is important in the clinical assessment of correctness of a pelvic floor muscle contraction, but this study does not support the use of the modified Oxford Grading Scale as a reliable and valid method to measure and differentiate pelvic floor muscle strength. (C) 2010 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.