The development of a scale to measure concepts of schizophrenia: experience among Brazilian psychiatrists

INTRODUCTION: Among psychiatric disorders schizophrenia is often said to be the condition with the most disputed definition.The Bleulerian and Schneiderian approaches have given rise to diagnostic formulations that have varied with time and place. Controversies over the concept of schizophrenia were examined within European/North American settings in the early 1970s but little has since been reported on the views of psychiatrists in developing countries. In Brazil both concepts are referred to in the literature. A scale was developed to measure adherence to Bleulerian and Schneiderian concepts among psychiatrists working in S. Paulo. METHODOLOGY: A self-reported questionnaire comprising seventeen visual analogue-scale statements related to Bleulerian and Schneiderian definitions of Shizophrenia, plus sociodemographic and training characteristics, was distributed to a non-randomised sample of 150 psychiatrists. The two sub-scales were assessed by psychometric methods for internal consistency, sub-scale structure and test-retest reliability. Items selected according to internal consistency were examined by a two-factor model exploratory factor analysis. Intraclass correlation coefficients described the stability of the scale. RESULTS: Replies were received from 117 psychiatrists (mean age 36 (SD 7.9)), 74% of whom were made and 26% female. The Schneiderian scale showed better overall internal consistency than the Bleulerian scale. Intra-class correlation coefficients for test-retest comparisons were between 0.5 and 0.7 for Schneiderian items and 0.2 and 0.7 for Bleulerian items. There was no negative association between Bleulerian and Schneiderian scale scores, suggesting that respondents may hold both concepts. Place of training was significantly associated with the respondent's opinion; disagreement with a Bleulerian standpoint predominated for those trained at the University of S. Paulo. CONCLUSIONS: The less satisfactory reliability for the Bleulerian sub-scale limits confidence in the whole scale but on the other hand this questionnaire contributes to the understanding of the controversy over Bleulerian and Schneiderian models for conceptualisation of schizophrenia, the former requiring more inference and therefore being prone to unreliability.

Personal and Social Performance (PSP) scale for patients with schizophrenia: translation to Portuguese, cross-cultural adaptation and interrater reliability

INTRODUCTION: Schizophrenia is a chronic mental disorder associated with impairment in social functioning. The most widely used scale to measure social functioning is the GAF (Global Assessment of Functioning), but it has the disadvantage of measuring at the same time symptoms and functioning, as described in its anchors. OBJECTIVES:Translation and cultural adaptation of the PSP, proposing a final version in Portuguese for use in Brazil. METHODS: We performed five steps: 1) translation; 2) back translation; 3) formal assessment of semantic equivalence; 4) debriefing; 5) analysis by experts. Interrater reliability (Intraclass correlation, ICC) between two raters was also measured. RESULTS: The final version was applied by two independent investigators in 18 adults with schizophrenia (DSM-IV-TR). The interrater reliability (ICC) was 0.812 (p < 0.001). CONCLUSION: The translation and adaptation of the PSP had an adequate level of semantic equivalence between the Portuguese version and the original English version. There were no difficulties related to understanding the content expressed in the translated texts and terms. Its application was easy and it showed a good interrater reliability. The PSP is a valid instrument for the measurement of personal and social functioning in schizophrenia.

Reproducibility and Reliability of the Quality of Life Questionnaire in Patients With Atrial Fibrillation

Abstract Background: Studies have shown the impact of atrial fibrillation (AF) on the patients' quality of life. Specific questionnaires enable the evaluation of relevant events. We previously developed a questionnaire to assess the quality of life of patients with AF (AFQLQ version 1), which was reviewed in this study, and new domains were added. Objective: To demonstrate the reproducibility of the AFQLQ version 2 (AFQLQ v.2), which included the domains of fatigue, illness perception and well-being. Methods: We applied 160 questionnaires (AFQLQ v.2 and SF-36) to 40 patients, at baseline and 15 days after, to measure inter- and intraobserver reproducibility. The analysis of quality of life stability was determined by test-retest, applying the Bartko intraclass correlation coefficient (ICC). Internal consistency was assessed by Cronbach's alpha test. Results: The total score of the test-retest (n = 40) had an ICC of 0.98 in the AFQLQ v.2, and of 0.94 in the SF36. In assessing the intra- and interobserver reproducibility of the AFQLQ v.2, the ICC reliability was 0.98 and 0.97, respectively. The internal consistency had a Cronbach's alpha coefficient of 0.82, compatible with good agreement of the AFQLQ v.2. Conclusion: The AFQLQ v.2 performed better than its previous version. Similarly, the domains added contributed to make it more comprehensive and robust to assess the quality of life of patients with AF.

Impact of the disease: acceptability, ceiling and floor effects and reliability of an instrument on heart failure

This study evaluated the acceptability, ceiling/floor effects, and the reliability of the instrument for measuring the Impact of the Disease on the Daily Life of Patients with Valvular Disease (IDCV) when applied to 135 patients with heart failure (HF). Acceptability was evaluated by the percentage of unanswered items and by the proportion of patients who responded to all items; the ceiling/floor effects by the percentage of patients who scored in the top of 10% best and worst results of the scale, respectively. Reliability was estimated by internal consistency (Cronbach's alpha coefficient) and stability of the measure (intraclass correlation coefficient - ICC). All patients responded to all items. Ceiling/floor effects evidenced were of moderate magnitude. The Cronbach's alpha was satisfactory for the majority of the domains and ICC> 0.90 in all the domains. The IDCV proved to be an easy to understand questionnaire, with evidence of reliability in patients with HF.

Reliability and validity of heart rate variability threshold assessment during an incremental shuttle-walk test in middle-aged and older adults

Studies on the assessment of heart rate variability threshold (HRVT) during walking are scarce. We determined the reliability and validity of HRVT assessment during the incremental shuttle walk test (ISWT) in healthy subjects. Thirty-one participants aged 57 ± 9 years (17 females) performed 3 ISWTs. During the 1st and 2nd ISWTs, instantaneous heart rate variability was calculated every 30 s and HRVT was measured. Walking velocity at HRVT in these tests (WV-HRVT1 and WV-HRVT2) was registered. During the 3rd ISWT, physiological responses were assessed. The ventilatory equivalents were used to determine ventilatory threshold (VT) and the WV at VT (WV-VT) was recorded. The difference between WV-HRVT1 and WV-HRVT2 was not statistically significant (median and interquartile range = 4.8; 4.8 to 5.4 vs4.8; 4.2 to 5.4 km/h); the correlation between WV-HRVT1 and WV-HRVT2 was significant (r = 0.84); the intraclass correlation coefficient was high (0.92; 0.82 to 0.96), and the agreement was acceptable (-0.08 km/h; -0.92 to 0.87). The difference between WV-VT and WV-HRVT2 was not statistically significant (4.8; 4.8 to 5.4 vs 4.8; 4.2 to 5.4 km/h) and the agreement was acceptable (0.04 km/h; -1.28 to 1.36). HRVT assessment during walking is a reliable measure and permits the estimation of VT in adults. We suggest the use of the ISWT for the assessment of exercise capacity in middle-aged and older adults.

Reliability of self-reported weight and height among State bank employees

INTRODUCTION: Self-reported weight and height were compared with direct measurements in order to evaluate the agreement between the two sources. METHOD: Data were obtained from a cross-sectional study on health status from a probabilistic sample of 1,183 employees of a bank, in Rio de Janeiro State, Brazil. Direct measurements were made of 322 employees. Differences between the two sources were evaluated using mean differences, limits of agreement and intraclass correlation coefficient (ICC). RESULTS AND CONCLUSIONS: Men and women tended to underestimate their weight while differences between self-reported and measured height were insignificant. Body mass index (BMI) mean differences were smaller than those observed for weight. ICC was over 0.98 for weight and 0.95 for BMI, expressing close agreement. Combining a graphical method with ICC may be useful in pilot studies to detect populational groups capable of providing reliable information on weight and height, thus minimizing resources needed for field work.

Development and validation of the Portuguese version of the WHOQOL-OLD module

OBJECTIVE: The increasing proportion of older adults in the general population and the specific characteristics of this age group show the need for the development of specific instruments to measure quality of life in older adults. The study aimed at describing the development and validation of the Portuguese version of the World Health Organization Quality of Life for Older Persons (WHOQOL-OLD) module. METHODS: The WHOQOL-OLD instrument was administered in a sample of 424 older adults in the city of Porto Alegre, Southern Brazil, in 2005. The questionnaire comprises 24 items divided into six facets: sensory abilities; autonomy; past, present and future activities; social participation; death and dying; and intimacy. Besides the WHOQOL-OLD module, the WHOQOL-BREF, BDI and BHS instruments were also applied. The instrument's internal consistency was assessed using Cronbach's alpha coefficient. RESULTS: The instrument showed adequate internal consistency (Cronbach's coefficients ranging from 0.71 to 0.88), discriminant validity (p<0.01), concurrent validity (correlation coefficients ranging from -0.61 to -0.50) and test-retest reliability (correlation coefficients ranging from 0.58 to 0.82). Findings concerning criterion validity need further studies. CONCLUSIONS: The WHOQOL-Old module is a useful alternative with good psychometric performance in the investigation of quality of life in older adults.

Reliability of a questionnaire on substance use among adolescent students, Brazil

OBJECTIVE: To analyze reliability of a self-applied questionnaire on substance use and misuse among adolescent students. METHODS: Two cross-sectional studies were carried out for the instrument test-retest. The sample comprised male and female students aged 1119 years from public and private schools (elementary, middle, and high school students) in the city of Salvador, Northeastern Brazil, in 2006. A total of 591 questionnaires were applied in the test and 467 in the retest. Descriptive statistics, the Kappa index, Cronbach's alpha and intraclass correlation were estimated. RESULTS: The prevalence of substance use/misuse was similar in both test and retest. Sociodemographic variables showed a "moderate" to "almost perfect" agreement for the Kappa index, and a "satisfactory" (>0.75) consistency for Cronbach's alpha and intraclass correlation. The age which psychoactive substances (tobacco, alcohol, and cannabis) were first used and chronological age were similar in both studies. Test-retest reliability was found to be a good indicator of students' age of initiation and their patterns of substance use. CONCLUSIONS: The questionnaire reliability was found to be satisfactory in the population studied.

Use of accelerometry to measure physical activity in adults and the elderly

OBJECTIVE: To review the use of accelerometry as an objective measure of physical activity in adults and elderly people. METHODS: A systematic review of studies on the use of accelerometty as an objective measure to assess physical activity in adults were examined in PubMed Central, Web of Knowledge, EBSCO and Medline databases from March 29 to April 15, 2010. The following keywords were used: "accelerometry," "accelerometer," "physical activity," "PA," "patterns," "levels," "adults," "older adults," and "elderly," either alone or in combination using "AND" or "OR." The reference lists of the articles retrieved were examined to capture any other potentially relevant article. Of 899 studies initially identified, only 18 were fully reviewed, and their outcome measures abstracted and analyzed. RESULTS: Eleven studies were conducted in North America (United States), five in Europe, one in Africa (Cameroon) and one in Australia. Very few enrolled older people, and only one study reported the season or time of year when data was collected. The articles selected had different methods, analyses, and results, which prevented comparison between studies. CONCLUSIONS: There is a need to standardize study methods for data reporting to allow comparisons of results across studies and monitor changes in populations. These data can help design more adequate strategies for monitoring and promotion of physical activity.

Cut-off point for WHOQOL-bref as a measure of quality of life of older adults

OBJECTIVE To propose a cut-off for the World Health Organization Quality of Life-Bref (WHOQOL-bref) as a predictor of quality of life in older adults. METHODS Cross-sectional study with 391 older adults registered in the Northwest Health District in Belo Horizonte, MG, Southeastern Brazil, between October 8, 2010 and May 23, 2011. The older adults’ quality of life was measured using the WHOQOL-bref. The analysis was rationalized by outlining two extreme and simultaneous groups according to perceived quality of life and satisfaction with health (quality of life good/satisfactory – good or very good self-reported quality of life and being satisfied or very satisfied with health – G5; and poor/very poor quality of life – poor or very poor self-reported quality of life and feeling dissatisfied or very dissatisfied with health – G6). A Receiver-Operating Characteristic curve (ROC) was created to assess the diagnostic ability of different cut-off points of the WHOQOL-bref. RESULTS ROC curve analysis indicated a critical value 60 as the optimal cut-off point for assessing perceived quality of life and satisfaction with health. The area under the curve was 0.758, with a sensitivity of 76.8% and specificity of 63.8% for a cut-off of ≥ 60 for overall quality of life (G5) and sensitivity 95.0% and specificity of 54.4% for a cut-off of < 60 for overall quality of life (G6). CONCLUSIONS Diagnostic interpretation of the ROC curve revealed that cut-off < 60 for overall quality of life obtained excellent sensitivity and negative predictive value for tracking older adults with probable worse quality of life and dissatisfied with health.

Validity and reliability of a health care service evaluation instrument for tuberculosis

OBJECTIVE To evaluate the validity and reliability of an instrument that evaluates the structure of primary health care units for the treatment of tuberculosis.METHODS This cross-sectional study used simple random sampling and evaluated 1,037 health care professionals from five Brazilian municipalities (Natal, state of Rio Grande do Norte; Cabedelo, state of Paraíba; Foz do Iguaçu, state of Parana; Sao José do Rio Preto, state of Sao Paulo, and Uberaba, state of Minas Gerais) in 2011. Structural indicators were identified and validated, considering different methods of organization of the health care system in the municipalities of different population sizes. Each structure represented the organization of health care services and contained the resources available for the execution of health care services: physical resources (equipment, consumables, and facilities); human resources (number and qualification); and resources for maintenance of the existing infrastructure and technology (deemed as the organization of health care services). The statistical analyses used in the validation process included reliability analysis, exploratory factor analysis, and confirmatory factor analysis.RESULTS The validation process indicated the retention of five factors, with 85.9% of the total variance explained, internal consistency between 0.6460 and 0.7802, and quality of fit of the confirmatory factor analysis of 0.995 using the goodness-of-fit index. The retained factors comprised five structural indicators: professionals involved in the care of tuberculosis patients, training, access to recording instruments, availability of supplies, and coordination of health care services with other levels of care. Availability of supplies had the best performance and the lowest coefficient of variation among the services evaluated. The indicators of assessment of human resources and coordination with other levels of care had satisfactory performance, but the latter showed the highest coefficient of variation. The performance of the indicators “training” and “access to recording instruments” was inferior to that of other indicators.CONCLUSIONS The instrument showed feasibility of application and potential to assess the structure of primary health care units for the treatment of tuberculosis.

Evaluating the use of in-store measures in retail food stores and restaurants in Brazil

ABSTRACTOBJECTIVE To assess inter-rater reliability, test-retest reliability, and construct validity of retail food store, open-air food market, and restaurant observation tools adapted to the Brazilian urban context.METHODS This study is part of a cross-sectional observation survey conducted in 13 districts across the city of Sao Paulo, Brazil in 2010-2011. Food store and restaurant observational tools were developed based on previously available tools, and then tested it. They included measures on the availability, variety, quality, pricing, and promotion of fruits and vegetables and ultra-processed foods. We used Kappa statistics and intra-class correlation coefficients to assess inter-rater and test-retest reliabilities in samples of 142 restaurants, 97 retail food stores (including open-air food markets), and of 62 restaurants and 45 retail food stores (including open-air food markets), respectively. Construct validity as the tool’s abilities to discriminate based on store types and different income contexts were assessed in the entire sample: 305 retail food stores, 8 fruits and vegetable markets, and 472 restaurants.RESULTS Inter-rater and test-retest reliability were generally high, with most Kappa values greater than 0.70 (range 0.49-1.00). Both tools discriminated between store types and neighborhoods with different median income. Fruits and vegetables were more likely to be found in middle to higher-income neighborhoods, while soda, fruit-flavored drink mixes, cookies, and chips were cheaper and more likely to be found in lower-income neighborhoods.CONCLUSIONS The measures were reliable and able to reveal significant differences across store types and different contexts. Although some items may require revision, results suggest that the tools may be used to reliably measure the food stores and restaurant food environment in urban settings of middle-income countries. Such studies can help .inform health promotion interventions and policies in these contexts.

Validity and reliability of the Questionnaire for Compliance with Standard Precaution

ABSTRACT OBJECTIVE : To evaluate the validity and reliability of the Questionnaire for Compliance with Standard Precaution for nurses. METHODS : This methodological study was conducted with 121 nurses from health care facilities in Sao Paulo's countryside, who were represented by two high-complexity and by three average-complexity health care facilities. Internal consistency was calculated using Cronbach's alpha and stability was calculated by the intraclass correlation coefficient, through test-retest. Convergent, discriminant, and known-groups construct validity techniques were conducted. RESULTS : The questionnaire was found to be reliable (Cronbach's alpha: 0.80; intraclass correlation coefficient: (0.97) In regards to the convergent and discriminant construct validity, strong correlation was found between compliance to standard precautions, the perception of a safe environment, and the smaller perception of obstacles to follow such precautions (r = 0.614 and r = 0.537, respectively). The nurses who were trained on the standard precautions and worked on the health care facilities of higher complexity were shown to comply more (p = 0.028 and p = 0.006, respectively). CONCLUSIONS : The Brazilian version of the Questionnaire for Compliance with Standard Precaution was shown to be valid and reliable. Further investigation must be conducted with nurse samples that are more representative of the Brazilian reality. The use of the questionnaire may support the creation of educational measures considering the possible gaps that can be identified, focusing on the workers' health and on the patients' safety.

Content validity and reliability of test of gross motor development in Chilean children

ABSTRACT OBJECTIVE To validate a Spanish version of the Test of Gross Motor Development (TGMD-2) for the Chilean population. METHODS Descriptive, transversal, non-experimental validity and reliability study. Four translators, three experts and 92 Chilean children, from five to 10 years, students from a primary school in Santiago, Chile, have participated. The Committee of Experts has carried out translation, back-translation and revision processes to determine the translinguistic equivalence and content validity of the test, using the content validity index in 2013. In addition, a pilot implementation was achieved to determine test reliability in Spanish, by using the intraclass correlation coefficient and Bland-Altman method. We evaluated whether the results presented significant differences by replacing the bat with a racket, using T-test. RESULTS We obtained a content validity index higher than 0.80 for language clarity and relevance of the TGMD-2 for children. There were significant differences in the object control subtest when comparing the results with bat and racket. The intraclass correlation coefficient for reliability inter-rater, intra-rater and test-retest reliability was greater than 0.80 in all cases. CONCLUSIONS The TGMD-2 has appropriate content validity to be applied in the Chilean population. The reliability of this test is within the appropriate parameters and its use could be recommended in this population after the establishment of normative data, setting a further precedent for the validation in other Latin American countries.

Evaluation of efficacy, reliability, and tolerability of sibutramine in obese patients, with an echocardiographic study

This is a double-blind, placebo-controlled study of the efficacy, safety, and tolerability of sibutramine in the management of obese patients for a 6-month period. METHOD: Sixty-one obese patients (BMI >30, <40 kg/m2), aged 18-65 years were evaluated. In the first phase of the study (30 days), the patients were given a placebo. We monitored compliance with a low-calorie diet (1200 kcal/day) and to the placebo. In the next stage, the double-blind phase (6 months), we compared placebo and sibutramine (10 mg/day). The criteria for evaluating efficacy were weight loss, reduction in body mass index (BMI), and abdominal and hip circumferences. Tolerability was assessed based on reported side effects, variation in arterial blood pressure and heart rate, metabolic profile (fasting glucose, total cholesterol and its fractions, and triglycerides), laboratory tests (renal and hepatic functions), and flow Doppler echocardiogram. RESULTS: We observed a greater weight loss (7.3 kg, 8% vs 2.6 kg, 2.8%) and a reduction in body mass index (7.4% vs 2.1%) in the sibutramine group than in the placebo group. Classifying the patients into 4 subgroups according to weight loss (weight gain, loss <5%, loss of 5% to 9.9%, and loss >10%), we observed a weight loss of >5% in 40% of the patients on sibutramine compared with 12.9% in the placebo group. We also detected weight gain in 45.2% of the placebo group compared to 20% in the sibutramine group. The sibutramine group showed improvement in HDL- cholesterol values (increased by 17%) and triglyceride values (decreased by 12.8%). This group also showed an increase in systolic blood pressure (6.7%, 5 mmHg). There were no changes in echocardiograms comparing the beginning and end of follow-up, and side effects did not lead to discontinuation of treatment. DISCUSSION: Sibutramine proved to be effective for weight loss providing an 8% loss of the initial weight. Compliance to prolonged treatment was good, and side effects did not result in discontinuation of treatment. These data confirmed the good efficacy, tolerability, and safety profiles of sibutramine for treatment of obesity.