Cross-cultural validity of the demand-control questionnaire: Swedish and Brazilian workers

OBJECTIVE To evaluate the cross-cultural validity of the Demand-Control Questionnaire, comparing the original Swedish questionnaire with the Brazilian version. METHODS We compared data from 362 Swedish and 399 Brazilian health workers. Confirmatory and exploratory factor analyses were performed to test structural validity, using the robust weighted least squares mean and variance-adjusted (WLSMV) estimator. Construct validity, using hypotheses testing, was evaluated through the inspection of the mean score distribution of the scale dimensions according to sociodemographic and social support at work variables. RESULTS The confirmatory and exploratory factor analyses supported the instrument in three dimensions (for Swedish and Brazilians): psychological demands, skill discretion and decision authority. The best-fit model was achieved by including an error correlation between work fast and work intensely (psychological demands) and removing the item repetitive work (skill discretion). Hypotheses testing showed that workers with university degree had higher scores on skill discretion and decision authority and those with high levels of Social Support at Work had lower scores on psychological demands and higher scores on decision authority. CONCLUSIONS The results supported the equivalent dimensional structures across the two culturally different work contexts. Skill discretion and decision authority formed two distinct dimensions and the item repetitive work should be removed.

Validity and reliability of a health care service evaluation instrument for tuberculosis

OBJECTIVE To evaluate the validity and reliability of an instrument that evaluates the structure of primary health care units for the treatment of tuberculosis.METHODS This cross-sectional study used simple random sampling and evaluated 1,037 health care professionals from five Brazilian municipalities (Natal, state of Rio Grande do Norte; Cabedelo, state of Paraíba; Foz do Iguaçu, state of Parana; Sao José do Rio Preto, state of Sao Paulo, and Uberaba, state of Minas Gerais) in 2011. Structural indicators were identified and validated, considering different methods of organization of the health care system in the municipalities of different population sizes. Each structure represented the organization of health care services and contained the resources available for the execution of health care services: physical resources (equipment, consumables, and facilities); human resources (number and qualification); and resources for maintenance of the existing infrastructure and technology (deemed as the organization of health care services). The statistical analyses used in the validation process included reliability analysis, exploratory factor analysis, and confirmatory factor analysis.RESULTS The validation process indicated the retention of five factors, with 85.9% of the total variance explained, internal consistency between 0.6460 and 0.7802, and quality of fit of the confirmatory factor analysis of 0.995 using the goodness-of-fit index. The retained factors comprised five structural indicators: professionals involved in the care of tuberculosis patients, training, access to recording instruments, availability of supplies, and coordination of health care services with other levels of care. Availability of supplies had the best performance and the lowest coefficient of variation among the services evaluated. The indicators of assessment of human resources and coordination with other levels of care had satisfactory performance, but the latter showed the highest coefficient of variation. The performance of the indicators “training” and “access to recording instruments” was inferior to that of other indicators.CONCLUSIONS The instrument showed feasibility of application and potential to assess the structure of primary health care units for the treatment of tuberculosis.

Validity of self-reported weight: a study of urban brazilian adults

In order to evaluate the validity of self-reported weight for use in obesity prevalence surveys, self-reported weight was compared to measured weight for 659 adults living in the Porto Alegre county, RS Brazil in 1986-87, both weights being obtained by a technician in the individual's home on the same visit. The mean difference between self-reported and measured weight was small (-0.06 +/- 3.16 kg; mean +/- standard deviation), and the correlation between reported and measured weight was high (r=0.97). Sixty-two percent of participants reported their weight with an error of < 2 kg, 87% with an error of < 4 kg, and 95% with an error of < 6 kg. Underweight individuals overestimated their weight, while obese individuals underestimated theirs (p<0.05). Men tended to overestimate their weight and women underestimate theirs, this difference between sexes being statistically significant (p=0.04). The overall prevalence of underweight (body mass index < 20) by reported weight was 11%, by measured weight 13%; the overall prevalence of obesity (body mass index > 30) by reported weight was 10%, by measured weight 11%. Thus, the validity of reported weight is acceptable for surveys of the prevalence of ponderosity in similar settings.

Factorial validity of the Maslach Burnout Inventory (MBI-HSS) among Spanish professionals

OBJECTIVE: To assess the factorial validity and internal consistency of the Maslach Burnout Inventory (MBI-HSS). METHODS: In a sample consisting of 705 Spanish professionals from diverse occupational sectors (health, education, police and so one), seven plausible factorial models hypothesized were compared using LISREL 8. RESULTS: The four-factor oblique solution and the three-factor oblique solution showed the best and similar fit. Deletion of Item 12 and Item 16, taking into consideration the suggestions in the manual, improved the goodness of fit for both models. The four-factor oblique model suggests that, in addition to Emotional Exhaustion (EE) and Depersonalization (DP), Personal Accomplishment (PA) consists of two components labeled here Self-Competence (Items 4, 7, 17, and 21) and the Existential Component (Items 9, 12, 18, and 19). However, the alpha coefficient was relatively low for the Self-Competence component, suggesting that it is more suitable to estimate the syndrome as a threedimensional construct. The Cronbach's alpha was satisfactory for PA (alpha =.71) and EE (alpha =.85), and moderate for DP (alpha =.58). CONCLUSIONS: The results show that the MBI-HSS offers factorial validity and its scales present internal consistency to evaluate the quality of working life for Spanish professionals.

Climacteric symptoms and quality of life: validity of women's health questionnaire

OBJECTIVE: To evaluate the reliability and validity of the Portuguese version of the Women's Health Questionnaire. METHODS: In order to evaluate the Women's Health Questionnaire (WHQ), an analytical cross-sectional study was carried out at the women's menopause outpatient clinic of a university hospital in São Paulo, Brazil. There were studied 87 women in perimenopause or menopause, defined as experiencing at least one year's absence of menstrual flow. The following variables were collected: demographic data, clinical variables (Kupperman index and correlate numeric scale) and quality of life indexes (SF-36 and utility). RESULTS: The WHQ proved to be a questionnaire easily translated into Portuguese and well-adjusted to Brazilian women. The internal consistency of the overall WHQ was excellent (Cronbach alpha =0.83; 95% CI: 0.71-0.91). Test-retest reliability was also excellent (intraclass correlation coefficient [ICC]=0.92; 95% IC: 0.86-0.96) and had good absolute agreement (0.84; 95% CI: 0.71-0.92). A satisfactory clinical validity was observed. The construct validity was corroborated by clear associations with others scales. A good index of responsiveness after the intervention was reached. CONCLUSIONS: The Portuguese version of the WHQ is of easy and fast administration and understanding. Its measuring properties were related, allowing its use in the evaluation of Brazilian climacteric women's quality of life for various purposes.

Validity of the Brazilian version of WHOQOL-BREF in depressed patients using Rasch modelling

OBJECTIVE: To assess the validity of the Brazilian version of the World Health Organization Quality of Life Instrument - Abbreviated version (WHOQOL-BREF) in adults with major depression, using Rasch modelling. METHODS: Study analyzing data from the baseline sample of the Longitudinal Investigation of Depression Outcomes in Brazil, including a total of 208 patients with major depression recruited in a primary care service in Porto Alegre (Southern Brazil), in 1999. The Center for Epidemiological Studies Depression Scale was used to assess intensity of depression; the WHOQOL-BREF to assess generic quality of life; and the Composite International Diagnostic Interview version 2.1 for the diagnosis of depression. RESULTS: In the Rasch analysis, the four domains of WHOQOL-BREF showed appropriate fit to this model. Some items needed adjustments: four items were rescored (pain, finances, services, and transport); two items (work and activity) were identified as having dependency of responses, and one item was deleted (sleep) due to multidimensionality. CONCLUSIONS: The validation of the WHOQOL-BREF Brazilian version using Rasch analysis complements previous validation studies, evidencing the robustness of this instrument as a generic cross-cultural quality of life measure.

Validity of self-reported hearing loss in adults: performance of three single questions

OBJECTIVE: To estimate the validity of three single questions used to assess self-reported hearing loss as compared to pure-tone audiometry in an adult population. METHODS: A validity study was performed with a random sub-sample of 188 subjects aged 30 to 65 years, drawn from the fourth wave of a population-based cohort study carried out in Salvador, Northeastern Brazil. Data were collected in household visits using questionnaires. Three questions were used to separately assess self-reported hearing loss: Q1, "Do you feel you have a hearing loss?"; Q2, "In general, would you say your hearing is 'excellent,' 'very good,' 'good,' 'fair,' 'poor'?"; Q3, "Currently, do you think you can hear 'the same as before', 'less than before only in the right ear', 'less than before only in the left ear', 'less than before in both ears'?". Measures of accuracy were estimated through seven measures including Youden index. Responses to each question were compared to the results of pure-tone audiometry to estimate accuracy measures. RESULTS: The estimated sensitivity and specificity were 79.6%, 77.4% for Q1; 66.9%, 85.1% for Q2; and 81.5%, 76.4% for Q3, respectively. The Youden index ranged from 51.9% (Q2) to 57.0% (Q1) and 57.9% (Q3). CONCLUSIONS: Each of all three questions provides responses accurate enough to support their use to assess self-reported hearing loss in epidemiological studies with adult populations when pure-tone audiometry is not feasible.

Explicit discrimination and health: development and psychometric properties of an assessment instrument

OBJECTIVE: To develop an instrument to assess discrimination effects on health outcomes and behaviors, capable of distinguishing harmful differential treatment effects from their interpretation as discriminatory events. METHODS: Successive versions of an instrument were developed based on a systematic review of instruments assessing racial discrimination, focus groups and review by a panel comprising seven experts. The instrument was refined using cognitive interviews and pilot-testing. The final version of the instrument was administered to 424 undergraduate college students in the city of Rio de Janeiro, Southeastern Brazil, in 2010. Structural dimensionality, two types of reliability and construct validity were analyzed. RESULTS: Exploratory factor analysis corroborated the hypothesis of the instrument's unidimensionality, and seven experts verified its face and content validity. The internal consistency was 0.8, and test-retest reliability was higher than 0.5 for 14 out of 18 items. The overall score was higher among socially disadvantaged individuals and correlated with adverse health behaviors/conditions, particularly when differential treatments were attributed to discrimination. CONCLUSIONS: These findings indicate the validity and reliability of the instrument developed. The proposed instrument enables the investigation of novel aspects of the relationship between discrimination and health.

Convergent validity between SF-36 and WHOQOL-BREF in older adults

OBJECTIVE : To compare the reliability and convergent validity of instruments assessing quality of life in Brazilian older adults. METHODS : Cross-sectional study of 278 literate, community-dwelling older adults attending a municipal university for the elderly in Sao Carlos, SP, Southeastern Brazil between 2006 and 2008. The Brazilian versions of the SF-36 and WHOQOL-BREF instruments to assess quality of life were compared. Cronbach’s alpha coefficient was used to estimate reliability and Pearson’s correlation for comparison between the two scales. RESULTS : Most of participants were women (87.8%) with a mean age of 63.83±7.22 years. Both scales showed an acceptable internal consistency – WHOQOL-BREF Cronbach’s alpha was 0.832 and SF-36 was 0.868. There was a weak (r ≤ 0.6) correlation between the related fields in the two questionnaires. CONCLUSIONS : The SF-36 and WHOQOL-BREF are reliable instruments for clinical and research uses in Brazilian older women. To select one, researchers should consider which aspects of quality of life they aim to capture because of weak convergent validity signs. This study’s results indicate that WHOQOL-BREF may be more relevant to evaluate changes in the quality of life of older women because it prioritizes responses to the aging process and avoids focusing on impairment.

Validity and reliability of the Questionnaire for Compliance with Standard Precaution

ABSTRACT OBJECTIVE : To evaluate the validity and reliability of the Questionnaire for Compliance with Standard Precaution for nurses. METHODS : This methodological study was conducted with 121 nurses from health care facilities in Sao Paulo's countryside, who were represented by two high-complexity and by three average-complexity health care facilities. Internal consistency was calculated using Cronbach's alpha and stability was calculated by the intraclass correlation coefficient, through test-retest. Convergent, discriminant, and known-groups construct validity techniques were conducted. RESULTS : The questionnaire was found to be reliable (Cronbach's alpha: 0.80; intraclass correlation coefficient: (0.97) In regards to the convergent and discriminant construct validity, strong correlation was found between compliance to standard precautions, the perception of a safe environment, and the smaller perception of obstacles to follow such precautions (r = 0.614 and r = 0.537, respectively). The nurses who were trained on the standard precautions and worked on the health care facilities of higher complexity were shown to comply more (p = 0.028 and p = 0.006, respectively). CONCLUSIONS : The Brazilian version of the Questionnaire for Compliance with Standard Precaution was shown to be valid and reliable. Further investigation must be conducted with nurse samples that are more representative of the Brazilian reality. The use of the questionnaire may support the creation of educational measures considering the possible gaps that can be identified, focusing on the workers' health and on the patients' safety.

Content validity and reliability of test of gross motor development in Chilean children

ABSTRACT OBJECTIVE To validate a Spanish version of the Test of Gross Motor Development (TGMD-2) for the Chilean population. METHODS Descriptive, transversal, non-experimental validity and reliability study. Four translators, three experts and 92 Chilean children, from five to 10 years, students from a primary school in Santiago, Chile, have participated. The Committee of Experts has carried out translation, back-translation and revision processes to determine the translinguistic equivalence and content validity of the test, using the content validity index in 2013. In addition, a pilot implementation was achieved to determine test reliability in Spanish, by using the intraclass correlation coefficient and Bland-Altman method. We evaluated whether the results presented significant differences by replacing the bat with a racket, using T-test. RESULTS We obtained a content validity index higher than 0.80 for language clarity and relevance of the TGMD-2 for children. There were significant differences in the object control subtest when comparing the results with bat and racket. The intraclass correlation coefficient for reliability inter-rater, intra-rater and test-retest reliability was greater than 0.80 in all cases. CONCLUSIONS The TGMD-2 has appropriate content validity to be applied in the Chilean population. The reliability of this test is within the appropriate parameters and its use could be recommended in this population after the establishment of normative data, setting a further precedent for the validation in other Latin American countries.

Validation of an instrument to evaluate health promotion at schools

ABSTRACT OBJECTIVE To validate an instrument designed to assess health promotion in the school environment. METHODS A questionnaire, based on guidelines from the World Health Organization and in line with the Brazilian school health context, was developed to validate the research instrument. There were 60 items in the instrument that included 40 questions for the school manager and 20 items with direct observations made by the interviewer. The items’ content validation was performed using the Delphi technique, with the instrument being applied in 53 schools from two medium-sized cities in the South region of Brazil. Reliability (Cronbach’s alpha and split-half) and validity (principal component analysis) analyses were performed. RESULTS The final instrument remained composed of 28 items, distributed into three dimensions: pedagogical, structural and relational. The resulting components showed good factorial loads (> 0.4) and acceptable reliability (> 0.6) for most items. The pedagogical dimension identifies educational activities regarding drugs and sexuality, violence and prejudice, auto care and peace and quality of life. The structural dimension is comprised of access, sanitary structure, and conservation and equipment. The relational dimension includes relationships within the school and with the community. CONCLUSIONS The proposed instrument presents satisfactory validity and reliability values, which include aspects relevant to promote health in schools. Its use allows the description of the health promotion conditions to which students from each educational institution are exposed. Because this instrument includes items directly observed by the investigator, it should only be used during periods when there are full and regular activities at the school in question.

Validity of selected clinical signs and symptoms in diagnosis of Schistosoma mansoni infection

Sensitivity, specificity and positive predictive values of selected clinical signs and symptoms in the diagnosis of Schistosoma mansoni infection were evaluated in 403 individuals (69% of inhabitants over 1 year of age) in an endemic area in Brazil (Divino). Highest sensitivity (13%) was found for blood in stools. Specificity over 90% was found for blood in stools, palpable liver with normal consistency and palpable hardened liver at middle clavicular (MCL) or middle sternal lines (MSL). Hardened liver at MSL (83%) or MCL (75%), and blood in stools (78%) presented higher positive predictive values for S. mansoni infection, while palpable liver with normal consistency at MCL (45%) or MSL (48%) presented smaller values. Enlarged liver without specification of its consistency has been traditionally used as an indicator of the infection in areas where malaria or Kalazar are not endemic. Our results demonstrate that the probability that a person with blood in stools or hardened palpable liver is infected is higher than among those with palpable liver with normal consistency.

Antibodies against non-structural c100/3 and structural core antigen of hepatitis C virus (HCV) in hemodialysis patients

Two groups of patients undergoing hemodialysis (HD) maintenance were evaluated for their antibody response to non-structural c100/3 protein and structural core protein of hepatitis C virus (HCV). Forty-six patients (Group 1) never presented liver abnormalities during HD treatment, while 52 patients (Group 2) had either current or prior liver enzyme elevations. Prevalence rates of 32.6% and 41.3% were found for anti-c100/3 and anti-HCV core antibodies, respectively, in patients with silent infections (Group 1). The rate of anti-c100/3 in patients of Group 2 was 71.15% and reached 86.5% for anti-HCV core antibodies. The recognition of anti-c100/3 and anti-core antibodies was significantly higher in Group 2 than in Group 1. A line immunoassay composed of structural and non-structural peptides was used as a confirmation assay. HBV infection, measured by the presence of anti-HBc antibodies, was observed in 39.8% of the patients. Six were HBsAg chronic carriers and 13 had naturally acquired anti-HBs antibodies. The duration of HD treatment was correlated with anti-HCV positivity. A high prevalence of 96.7% (Group 2) was found in patients who underwent more than 5 years of treatment. Our results suggest that anti-HCV core ELISA is more accurate for detecting HCV infection than anti-c100/3. Although the risk associated with the duration of HD treatment and blood transfusion was high, additional factors such as a significant non-transfusional spread of HCV seems to play a role as well. The identification of infective patients by more sensitive methods for HCV genome detection should help to control the transmission of HCV in the unit under study.