The validity and 4-year test-retest reliability of the Brazilian version of the Eating Attitudes Test-26

In a cross-sectional study conducted four years ago to assess the validity of the Brazilian version of the Eating Attitudes Test-26 (EAT-26) for the identification of abnormal eating behaviors in a population of young females in Southern Brazil, 56 women presented abnormal eating behavior as indicated by the EAT-26 and the Edinburgh Bulimic Investigation Test. They were each matched for age and neighborhood to two normal controls (N = 112) and were re-assessed four years later with the two screening questionnaires plus the Composite International Diagnostic Interview (CIDI). The EAT results were then compared to diagnoses originating from the CIDI. To evaluate the temporal stability of the two screening questionnaires, a test-retest design was applied to estimate kappa coefficients for individual items. Given the prevalence of eating disorders of 6.2%, the CIDI psychiatry interview was applied to 161 women. Of these, 0.6% exhibited anorexia nervosa and 5.6%, bulimia nervosa (10 positive cases). The validity coefficients of the EAT were: 40% sensitivity, 84% specificity, and 14% positive predictive value. Cronbach's coefficient was 0.75. For each EAT item, the kappa index was not higher than 0.344 and the correlation coefficient was lower than 0.488. We conclude that the EAT-26 exhibited low validity coefficients for sensitivity and positive predictive value, and showed a poor temporal stability. It is reasonable to assume that these results were not influenced by the low prevalence of eating disorders in the community. Thus, the results cast doubts on the ability of the EAT-26 test to identify cases of abnormal eating behaviors in this population.

Reliability of a questionnaire on substance use among adolescent students, Brazil

OBJECTIVE: To analyze reliability of a self-applied questionnaire on substance use and misuse among adolescent students. METHODS: Two cross-sectional studies were carried out for the instrument test-retest. The sample comprised male and female students aged 1119 years from public and private schools (elementary, middle, and high school students) in the city of Salvador, Northeastern Brazil, in 2006. A total of 591 questionnaires were applied in the test and 467 in the retest. Descriptive statistics, the Kappa index, Cronbach's alpha and intraclass correlation were estimated. RESULTS: The prevalence of substance use/misuse was similar in both test and retest. Sociodemographic variables showed a "moderate" to "almost perfect" agreement for the Kappa index, and a "satisfactory" (>0.75) consistency for Cronbach's alpha and intraclass correlation. The age which psychoactive substances (tobacco, alcohol, and cannabis) were first used and chronological age were similar in both studies. Test-retest reliability was found to be a good indicator of students' age of initiation and their patterns of substance use. CONCLUSIONS: The questionnaire reliability was found to be satisfactory in the population studied.

Content validity and reliability of test of gross motor development in Chilean children

ABSTRACT OBJECTIVE To validate a Spanish version of the Test of Gross Motor Development (TGMD-2) for the Chilean population. METHODS Descriptive, transversal, non-experimental validity and reliability study. Four translators, three experts and 92 Chilean children, from five to 10 years, students from a primary school in Santiago, Chile, have participated. The Committee of Experts has carried out translation, back-translation and revision processes to determine the translinguistic equivalence and content validity of the test, using the content validity index in 2013. In addition, a pilot implementation was achieved to determine test reliability in Spanish, by using the intraclass correlation coefficient and Bland-Altman method. We evaluated whether the results presented significant differences by replacing the bat with a racket, using T-test. RESULTS We obtained a content validity index higher than 0.80 for language clarity and relevance of the TGMD-2 for children. There were significant differences in the object control subtest when comparing the results with bat and racket. The intraclass correlation coefficient for reliability inter-rater, intra-rater and test-retest reliability was greater than 0.80 in all cases. CONCLUSIONS The TGMD-2 has appropriate content validity to be applied in the Chilean population. The reliability of this test is within the appropriate parameters and its use could be recommended in this population after the establishment of normative data, setting a further precedent for the validation in other Latin American countries.

A questionnaire to evaluate the impact of chronic diseases: validated translation and Illness Effects Questionnaire (IEQ) reliability study

INTRODUCTION: Patients' perception about their health condition, mainly involving chronic diseases, has been investigated in many studies and it has been associated to depression, compliance with the treatment, quality of life and prognosis. The Illness Effects Questionnaire (IEQ) is a tool which makes the standardized evaluation of patients' perception about their illness possible, so that it is brief and accessible to the different clinical settings. This work aims to begin the transcultural adaptation of the IEQ to Brazil through the validated translation and the reliability study. METHODS: The back-translation method and the test-retest reliability study were used in a sample of 30 adult patients under chronic hemodialysis. The reliability indexes were estimated using the Pearson, Spearman, Weighted Kappa and Cronbach's alpha coefficients. RESULTS: The semantic equivalence was reached through the validated translation. In this study, the reliability indexes obtained were respectively: 0.85 and 0.75 (p < 0.001); 0.68 and 0.92 (p < 0.0001). DISCUSSION: The reliability indexes obtained attest to the stability of responses in both evaluations. Additional procedures are necessary for the transcultural adaptation of the IEQ to be complete. CONCLUSION: The results indicate the translation validity and the reliability of the Brazilian version of the IEQ for the sample studied.

Reliability and validity of the interactive observation scale for psychiatric inpatients applied by nursing aides in daily ward practice

The main characteristic of the nursing Interactive Observation Scale for Psychiatric Inpatients (IOSPI) is the necessity of interaction between raters and patients during assessment. The aim of this study was to evaluate the reliability and validity of the scale in the "real" world of daily ward practice and to determine whether the IOSPI can increase the interaction time between raters and patients and influence the raters' opinion about mental illness. All inpatients of a general university hospital psychiatric ward were assessed daily over a period of two months by 9 nursing aides during the morning and afternoon shifts, with 273 pairs of daily observations. Once a week the patients were interviewed by a psychiatrist who filled in the Brief Psychiatric Rating Scale (BPRS). The IOSPI total score was found to show significant test-retest reliability (interclass correlation coefficient = 0.83) and significant correlation with the BPRS total score (r = 0.69), meeting the criteria of concurrent validity. The instrument can also discriminate between patients in need of further inpatient treatment from those about to be discharged (negative predictive value for discharge = 0.91). Using this scale, the interaction time between nursing aides and patients increased significantly (t = 2.93, P<0.05) and their opinion about the mental illness changed. The "social restrictiveness" factor of the opinion scale about mental illness showed a significant reduction (t = 4.27, P<0.01) and the "interpersonal etiology" factor tended to increase (t = 1.98, P = 0.08). The IOSPI was confirmed as a reliable and valid scale and as an efficient tool to stimulate the therapeutic attitudes of the nursing staff.

The development of a scale to measure concepts of schizophrenia: experience among Brazilian psychiatrists

INTRODUCTION: Among psychiatric disorders schizophrenia is often said to be the condition with the most disputed definition.The Bleulerian and Schneiderian approaches have given rise to diagnostic formulations that have varied with time and place. Controversies over the concept of schizophrenia were examined within European/North American settings in the early 1970s but little has since been reported on the views of psychiatrists in developing countries. In Brazil both concepts are referred to in the literature. A scale was developed to measure adherence to Bleulerian and Schneiderian concepts among psychiatrists working in S. Paulo. METHODOLOGY: A self-reported questionnaire comprising seventeen visual analogue-scale statements related to Bleulerian and Schneiderian definitions of Shizophrenia, plus sociodemographic and training characteristics, was distributed to a non-randomised sample of 150 psychiatrists. The two sub-scales were assessed by psychometric methods for internal consistency, sub-scale structure and test-retest reliability. Items selected according to internal consistency were examined by a two-factor model exploratory factor analysis. Intraclass correlation coefficients described the stability of the scale. RESULTS: Replies were received from 117 psychiatrists (mean age 36 (SD 7.9)), 74% of whom were made and 26% female. The Schneiderian scale showed better overall internal consistency than the Bleulerian scale. Intra-class correlation coefficients for test-retest comparisons were between 0.5 and 0.7 for Schneiderian items and 0.2 and 0.7 for Bleulerian items. There was no negative association between Bleulerian and Schneiderian scale scores, suggesting that respondents may hold both concepts. Place of training was significantly associated with the respondent's opinion; disagreement with a Bleulerian standpoint predominated for those trained at the University of S. Paulo. CONCLUSIONS: The less satisfactory reliability for the Bleulerian sub-scale limits confidence in the whole scale but on the other hand this questionnaire contributes to the understanding of the controversy over Bleulerian and Schneiderian models for conceptualisation of schizophrenia, the former requiring more inference and therefore being prone to unreliability.

Climacteric symptoms and quality of life: validity of women's health questionnaire

OBJECTIVE: To evaluate the reliability and validity of the Portuguese version of the Women's Health Questionnaire. METHODS: In order to evaluate the Women's Health Questionnaire (WHQ), an analytical cross-sectional study was carried out at the women's menopause outpatient clinic of a university hospital in São Paulo, Brazil. There were studied 87 women in perimenopause or menopause, defined as experiencing at least one year's absence of menstrual flow. The following variables were collected: demographic data, clinical variables (Kupperman index and correlate numeric scale) and quality of life indexes (SF-36 and utility). RESULTS: The WHQ proved to be a questionnaire easily translated into Portuguese and well-adjusted to Brazilian women. The internal consistency of the overall WHQ was excellent (Cronbach alpha =0.83; 95% CI: 0.71-0.91). Test-retest reliability was also excellent (intraclass correlation coefficient [ICC]=0.92; 95% IC: 0.86-0.96) and had good absolute agreement (0.84; 95% CI: 0.71-0.92). A satisfactory clinical validity was observed. The construct validity was corroborated by clear associations with others scales. A good index of responsiveness after the intervention was reached. CONCLUSIONS: The Portuguese version of the WHQ is of easy and fast administration and understanding. Its measuring properties were related, allowing its use in the evaluation of Brazilian climacteric women's quality of life for various purposes.

Development and validation of the Portuguese version of the WHOQOL-OLD module

OBJECTIVE: The increasing proportion of older adults in the general population and the specific characteristics of this age group show the need for the development of specific instruments to measure quality of life in older adults. The study aimed at describing the development and validation of the Portuguese version of the World Health Organization Quality of Life for Older Persons (WHOQOL-OLD) module. METHODS: The WHOQOL-OLD instrument was administered in a sample of 424 older adults in the city of Porto Alegre, Southern Brazil, in 2005. The questionnaire comprises 24 items divided into six facets: sensory abilities; autonomy; past, present and future activities; social participation; death and dying; and intimacy. Besides the WHOQOL-OLD module, the WHOQOL-BREF, BDI and BHS instruments were also applied. The instrument's internal consistency was assessed using Cronbach's alpha coefficient. RESULTS: The instrument showed adequate internal consistency (Cronbach's coefficients ranging from 0.71 to 0.88), discriminant validity (p<0.01), concurrent validity (correlation coefficients ranging from -0.61 to -0.50) and test-retest reliability (correlation coefficients ranging from 0.58 to 0.82). Findings concerning criterion validity need further studies. CONCLUSIONS: The WHOQOL-Old module is a useful alternative with good psychometric performance in the investigation of quality of life in older adults.

Explicit discrimination and health: development and psychometric properties of an assessment instrument

OBJECTIVE: To develop an instrument to assess discrimination effects on health outcomes and behaviors, capable of distinguishing harmful differential treatment effects from their interpretation as discriminatory events. METHODS: Successive versions of an instrument were developed based on a systematic review of instruments assessing racial discrimination, focus groups and review by a panel comprising seven experts. The instrument was refined using cognitive interviews and pilot-testing. The final version of the instrument was administered to 424 undergraduate college students in the city of Rio de Janeiro, Southeastern Brazil, in 2010. Structural dimensionality, two types of reliability and construct validity were analyzed. RESULTS: Exploratory factor analysis corroborated the hypothesis of the instrument's unidimensionality, and seven experts verified its face and content validity. The internal consistency was 0.8, and test-retest reliability was higher than 0.5 for 14 out of 18 items. The overall score was higher among socially disadvantaged individuals and correlated with adverse health behaviors/conditions, particularly when differential treatments were attributed to discrimination. CONCLUSIONS: These findings indicate the validity and reliability of the instrument developed. The proposed instrument enables the investigation of novel aspects of the relationship between discrimination and health.

Short Assessment of Health Literacy for Portuguese-speaking Adults

OBJECTIVE: To develop and validate a short health literacy assessment tool for Portuguese-speaking adults. METHODS: The Short Assessment of Health Literacy for Portuguese-speaking Adults is an assessment tool which consists of 50 items that assess an individual's ability to correctly pronounce and understand common medical terms. We evaluated the instrument's psychometric properties in a convenience sample of 226 Brazilian older adults. Construct validity was assessed by correlating the tool scores with years of schooling, self-reported literacy, and global cognitive functioning. Discrimination validity was assessed by testing the tool's accuracy in detecting inadequate health literacy, defined as failure to fully understand standard medical prescriptions. RESULTS: Moderate to high correlations were found in the assessment of construct validity (Spearman's coefficients ranging from 0.63 to 0.76). The instrument showed adequate internal consistency (Cronbach's alpha=0.93) and adequate test-retest reliability (intraclass correlation coefficient=0.95). The area under the receiver operating characteristic curve for detection of inadequate health literacy was 0.82. A version consisting of 18 items was tested and showed similar psychometric properties. CONCLUSIONS: The instrument developed showed good validity and reliability in a sample of Brazilian older adults. It can be used in research and clinical settings for screening inadequate health literacy.

Brazilian version of the Quality of Care Scale: the perspective of people with disabilities

OBJECTIVE To analyze evidence of the validity and reliability of a Brazilian Portuguese version of the Quality of Care Scale from the perspective of people with physical and intellectual disabilities.METHODS There were 162 people with physical disabilities and 156 with intellectual disabilities from Porto Alegre and metropolitan region, who participated in the study in 2008. Classical psychometrics was used to independently analyze the two samples. Hypotheses for evidence of criterion validity (concurrent type) were tested with the Mann-Whitney test for non-normal distributions. Principal components analysis was used to explore factorial models. Evidence of reliability was calculated with Cronbach alpha for the scales and subscales. Test-retest reliability was analyzed for individuals with intellectual disabilities through intra-class correlation coefficient and the Willcoxon test.RESULTS The principal components in the group with physical disabilities replicated the original model presented as a solution to the international project data. Evidence of discriminant validity and test-retest reliability was found.CONCLUSIONS The transcultural factor model found within the international sample project seems appropriate for the samples investigated in this study, especially the physical disabilities group. Depression, pain, satisfaction with life and disability may play a mediating role in the evaluation of quality of care. Additional research is needed to add to evidence of the validity of the instruments.

Evaluating the use of in-store measures in retail food stores and restaurants in Brazil

ABSTRACTOBJECTIVE To assess inter-rater reliability, test-retest reliability, and construct validity of retail food store, open-air food market, and restaurant observation tools adapted to the Brazilian urban context.METHODS This study is part of a cross-sectional observation survey conducted in 13 districts across the city of Sao Paulo, Brazil in 2010-2011. Food store and restaurant observational tools were developed based on previously available tools, and then tested it. They included measures on the availability, variety, quality, pricing, and promotion of fruits and vegetables and ultra-processed foods. We used Kappa statistics and intra-class correlation coefficients to assess inter-rater and test-retest reliabilities in samples of 142 restaurants, 97 retail food stores (including open-air food markets), and of 62 restaurants and 45 retail food stores (including open-air food markets), respectively. Construct validity as the tool’s abilities to discriminate based on store types and different income contexts were assessed in the entire sample: 305 retail food stores, 8 fruits and vegetable markets, and 472 restaurants.RESULTS Inter-rater and test-retest reliability were generally high, with most Kappa values greater than 0.70 (range 0.49-1.00). Both tools discriminated between store types and neighborhoods with different median income. Fruits and vegetables were more likely to be found in middle to higher-income neighborhoods, while soda, fruit-flavored drink mixes, cookies, and chips were cheaper and more likely to be found in lower-income neighborhoods.CONCLUSIONS The measures were reliable and able to reveal significant differences across store types and different contexts. Although some items may require revision, results suggest that the tools may be used to reliably measure the food stores and restaurant food environment in urban settings of middle-income countries. Such studies can help .inform health promotion interventions and policies in these contexts.

Validation of the Disordered Eating Attitude Scale for adolescents

ABSTRACT Objective To perform the psychometric evaluation of the Disordered Eating Attitude Scale (DEAS) for adolescents. Methods Sample consisted of 1,119 Brazilian adolescents (12-18 years old; 59.6% female) studying at technical schools in São Paulo state-Brazil, who answered an online survey with the DEAS, the Eating Attitude Test (EAT-26), and the Restraint Scale (RS). The internal consistency of the DEAS was assessed using Cronbach’s alpha. The convergent validity of DEAS was evaluated by means of Pearson’s coefficient correlation with EAT-26 and RS. The test-retest reliability was evaluated using a sub-sample of 61 adolescents. Known-groups validity was determined by comparing female student mean scores with scores of 33 female adolescents with eating disorders. Results The reliability of the DEAS was 0.79. EAT-26 and RS scores were positively correlated with DEAS scores (EAT: 0.78 for females and 0.59 for males, p < 0.001; RS: 0.63 for females and 0.48 for males, p < 0.001). The DEAS total and subscale scores differentiated students and patients with eating disorders (p < 0.001). The intra-class correlation coefficient for test-retest reliability was 0.87. Conclusion Results indicate that the DEAS adolescent version showed good internal consistency, convergent validity, known-groups validity, and test-retest reliability, suggesting its potential in identifying disordered eating attitudes among adolescents. It could also be helpful in identifying adolescents at risk from eating disorders, assisting in prevention programs.

Validation of a Brazilian Portuguese Version of the Walking Estimated-Limitation Calculated by History (WELCH)

Abstract Background: The Walking Estimated-Limitation Calculated by History (WELCH) questionnaire has been proposed to evaluate walking impairment in patients with intermittent claudication (IC), presenting satisfactory psychometric properties. However, a Brazilian Portuguese version of the questionnaire is unavailable, limiting its application in Brazilian patients. Objective: To analyze the psychometric properties of a translated Brazilian Portuguese version of the WELCH in Brazilian patients with IC. Methods: Eighty-four patients with IC participated in the study. After translation and back-translation, carried out by two independent translators, the concurrent validity of the WELCH was analyzed by correlating the questionnaire scores with the walking capacity assessed with the Gardner treadmill test. To determine the reliability of the WELCH, internal consistency and test–retest reliability with a seven-day interval between the two questionnaire applications were calculated. Results: There were significant correlations between the WELCH score and the claudication onset distance (r = 0.64, p = 0.01) and total walking distance (r = 0.61, p = 0.01). The internal consistency was 0.84 and the intraclass correlation coefficient between questionnaire evaluations was 0.84. There were no differences in WELCH scores between the two questionnaire applications. Conclusion: The Brazilian Portuguese version of the WELCH presents adequate validity and reliability indicators, which support its application to Brazilian patients with IC.

Evaluation of the Primary Care in leprosy control: proposal of an instrument for users

Objective Developing an instrument to evaluate the performance of primary health care in the leprosy control actions, from the perspective of users and do the face and content validation. Method This is a methodological study carried out in four stages: development of instrument, face and content validation, pre-test, and analysis of test-retest reliability. Results The initial instrument submitted to the judgment of 15 experts was composed of 157 items. The face and content validation and pre-test of instrument were essential for the exclusion of items and adjustment of instrument to evaluate the object under study. In the analysis of test-retest reliability, the instrument proved to be reliable. Conclusion The instrument is considered adequate, but further studies are needed to test the psychometric properties.