Psychometric properties of assessment instruments for autism spectrum disorder: a systematic review of Brazilian studies

Objective To systematically review the scientific literature on the psychometric properties of international instruments for the assessment of autism spectrum disorder (ASD) in the Brazilian population. Methods A search of bibliographic references was conducted in six electronic databases: PsycINFO, PubMed, IndexPsi, Lilacs, Capes (theses and dissertations) and SciELO. The studies were selected by two independent researchers. Results The procedure identified 11 studies of the Brazilian population that encompassed six ASD assessment tools. Given the information provided, the adaptation of the M-CHAT, a screening instrument, was the best conducted. All steps of the adaptation process were described and the changes made to the final version of the instrument were presented, which was not addressed in other studies. In terms of reliability, all of the instruments that assessed internal consistency showed adequate values. In addition, the ADI-R and the CARS adaptations also satisfactorily contemplated inter-rater reliability and test-retest indices, respectively. Finally, all studies aiming to validate instruments showed evidence of validity and sensitivity, and specificity values above 0.90 were observed in the ASQ, ADI-R and ABC. Conclusion Considering both the psychometric aspects and the copyright information, the screening instrument that currently appears to be best indicated for clinical and research use is the M-CHAT. It was also noticed that there are still no specific ASD diagnostic tools available for use in Brazil. This lack of diagnostic instruments consists in a critical situation for the improvement of clinical practice and the development of research in this area.

Investigation of cognition in schizophrenia: psychometric properties of instruments for assessing working memory updating

Objective This study describes the development of two updating measures of working memory (WM): Letter Updating Test (LUT) and Word Updating Test (WUT). Methods In stage 1, items were created and the instruments were assessed by experts and laymen. In stage 2, tests were given to 15 patients with schizophrenia and 15 paired controls. All were able to understand and respond to the instruments. In stage 3, 141 patients with schizophrenia and 119 healthy controls aged 18 to 60 took part; they were assessed on WM, processing speed (PS) and functional outcome. Results The results showed adequate rates of internal consistency for both measures developed, for both the total sample and each group separately, as well as evidence of convergent validity, discriminant validity and sensitivity to differentiate performance among the groups. Principal component analysis yielded two components, one for updating tests and other for PS measures, indicating factorial validity. Positive and significant, yet low, correlations were found with functionality measures. Conclusion These results provide adequate psychometric parameters for the measures developed, applicable to cognitive research settings in schizophrenia.

Measuring Instruments In Cardiology Adapted Into Portuguese Language Of Brazil: A Systematic Review

This was a systematic review aimed at identifying and characterizing measuring instruments, developed in the context of cardiology, which were adapted into Portuguese language of Brazil. Systematic searches were performed in six databases. Information extracted included cultural adaptation process and measurement properties. To assess the methodological quality of studies, criteria based on international guidelines for cultural adaptation of instruments were used. Among the 114 articles found, 14 were eligible for review. Of these, most evaluated quality of life (35.7%) and health knowledge/learning (28.6%). Most studies followed all stages of the adaptation process recommended in the literature. With respect to measurement properties, internal consistency, verified by Cronbach’s alpha, was the property reported in the majority of the studies, as well as construct and criterion validity. This study is expected to provide to the scientific community a critical evaluation of adapted questionnaires available in the context of cardiology.


Management of basic health units in municipalities of different size: profile and management instruments

Objective To identify the characteristics of managers and their use of management instruments in primary care and to analyze differences in these features among municipalities of different sizes. Method The present cross-sectional descriptive study was conducted at 108 basic health units from 21 municipalities in northern Paraná, Brazil. The data were collected using a semi-structured questionnaire during the second half of 2010. Results Most managers had graduate degrees and were female and nurses. The managers from the small municipalities were younger, their payment was lower, and they had less work experience. The use of management instruments was expressive for both the organization and work management; however, the instruments were used less in the small municipalities. Conclusion The managers were committed to their role; it is recommended that policies and guidance should be formulated at the federal and state levels to support small municipalities.

Use of patients’ classification instruments: analysis of the brazilian production of knowledge

Objective To analyze the production of scientific knowledge about the use of patients’ classification instruments in care and management practice in Brazil. Method Integrative literature review with databases search in: Latin American and Caribbean Literature on Health Sciences (LILACS), Medical Literature Analysis and Retrieval System on-line (MEDLINE), Cumulative Index to Nursing and Allied Health Literature (CINAHL) and SCOPUS, between January 2002 through December 2013. Results 1,194 studies were found, 31 met the inclusion criteria. We observed a higher number of studies in the category care plans and workload (n=15), followed by the category evaluation of psychometric properties (n=14). Conclusion Brazilian knowledge production has not yet investigated some purposes of using instruments for classifying patients in professional nursing practice. The identification of unexplored areas can guide future research on the topic.


Developmental norms for eight instruments used in the neuropsychological assessment of children: studies in Brazil

Norms for a battery of instruments, including Denckla's and Garfield's tests of Motor Persistence, Benton's Right-Left Discrimination, two recall modalities (Immediate and Delayed) of the Bender Test, Wechsler's Digit Span, the Color Span Test and the Human Figure Drawing Test, were developed for the neuropsychological assessment of children in the greater Rio de Janeiro area. Additionally, the behavior of each child was assessed with the Composite Teacher Rating Scale (Brito GNO and Pinto RCA (1991) Journal of Clinical and Experimental Neuropsychology, 13: 417-418). A total of 398 children (199 boys and 199 girls balanced for age) with a mean age of 9.3 years (SD = 2.8), who were attending a public school in Niterói, were the subjects of this study. Gender and age had significant effects on performance which depended on the instrument. Nonachievers performed worse than achievers in most neuropsychological tests. Comparison of our data to the available counterparts in the United States revealed that American children outperformed Brazilian children on the Right-Left Discrimination, Forward Digit Span, Color Span and Human Figure Drawing Tests. Further analysis showed that the neurobehavioral data consist of different factorial dimensions, including Human Body Representation, Motor Persistence of the Legs, Orbito-Orobuccal Motor Persistence, Attention-Memory, Visuospatial Memory, Neuropsychomotor Speed, Hyperactivity-Inattention, and Anxiety-Negative Socialization. We conclude that gender and age should be taken into account when using the normative data for most of the instruments studied in the present report. Furthermore, we stress the need for major changes in the Brazilian public school system in order to foster the development of secondary cognitive abilities in our children

When emergent countries reform global governance of climate change: Brazil under Lula

Due to its recent economic success, Brazil is considered an emerging country, but is it an emerging power concerning global environmental governance? This article argues that although Brazil has a sui generis profile, it can only be considered an emerging power in some environmental regimes, such as global climate change. Thus, international relations theory needs more analytical instruments to assess the impact of emerging powers in global environmental governance

Security issues during Lula's administration: from the reactive to the assertive approach

Brazil's security agenda during Lula's administration was not homogeneous through the two mandates: the first tenure (2002-2006) revealed a reactive approach towards security topics, while the second one (2006-2010) was more assertive. More specifically, the shift occurred in terms of both its geographical scope - once it incorporated global issues in a more systematic way -, and instruments through which the security agenda was exercised, given the multilateral initiative of Unasur's CDS

Budgeting and resource allocation in universities: a public choice approach

The calls for colleges and universities to improve their productivity are coming thick and fast in Brazil. Many studies are suggesting evaluation systems and external criteria to control the quality of teaching and research in universities. Since universities and colleges are not profit-oriented organizations (considering only the legitimate and serious research and teaching organizations, of course), the traditional microeconomics and administrative variables used to measure efficiency do not have any direct function. An alternative would be to create an "as if" market control system to evaluate performance in universities and colleges. Internal budget and resources allocation mechanism can be used as incentive instruments to improve quality and productivity. It will be the main issue of this article.

O planejamento econômico no Brasil: considerações críticas

In the past thirty years, a series of plans have been developed by successive Brazilian governments in a continuing effort to maximize the nation's resources for economic and social growth. This planning history has been quantitatively rich but qualitatively poor. The disjunction has stimulated Professor Mello e Souza to address himself to the problem of national planning and to offer some criticisms of Brazilian planning experience. Though political instability has obviously been a factor promoting discontinuity, his criticisms are aimed at the attitudes and strategic concepts which have sought to link planning to national goals and administration. He criticizes the fascination with techniques and plans to the exclusion of proper diagnosis of the socio-political reality, developing instruments to coordinate and carry out objectives, and creating an administrative structure centralized enough to make national decisions and decentralized enough to perform on the basis of those decisions. Thus, fixed, quantified objectives abound while the problem of functioning mechanisms for the coordinated, rational use of resources has been left unattended. Although his interest and criticism are focused on the process and experience of national planning, he recognized variation in the level and results of Brazilian planning. National plans have failed due to faulty conception of the function of planning. Sectorial plans, save in the sector of the petroleum industry under government responsibility, ha e not succeeded in overcoming the problems of formulation and execution thereby repeating old technical errors. Planning for the private sector has a somewhat brighter history due to the use of Grupos Executivos which has enabled the planning process to transcend the formalism and tradition-bound attitudes of the regular bureaucracy. Regional planning offers two relatively successful experiences, Sudene and the strategy of the regionally oriented autarchy. Thus, planning history in Brazil is not entirely black but a certain shade of grey. The major part of the article, however, is devoted to a descriptive analysis of the national planning experience. The plans included in this analysis are: The Works and Equipment Plan (POE); The Health, Food, Transportation and Energy Plan (Salte); The Program of Goals; The Trienal Plan of Economic and Social Development; and the Plan of Governmental Economic Action (Paeg). Using these five plans for his historical experience the author sets out a series of errors of formulation and execution by which he analyzes that experience. With respect to formulation, he speaks of a lack of elaboration of programs and projects, of coordination among diverse goals, and of provision of qualified staff and techniques. He mentions the absence of the definition of resources necessary to the financing of the plan and the inadequate quantification of sectorial and national goals due to the lack of reliable statistical information. Finally, he notes the failure to coordinate the annual budget with the multi-year plans. He sees the problems of execution as beginning in the absence of coordination between the various sectors of the public administration, the failure to develop an operative system of decentralization, the absence of any system of financial and fiscal control over execution, the difficulties imposed by the system of public accounting, and the absence of an adequate program of allocation for the liberation of resources. He ends by pointing to the failure to develop and use an integrated system of political economic tools in a mode compatible with the objective of the plans. The body of the article analyzes national planning experience in Brazil using these lists of errors as rough model of criticism. Several conclusions emerge from this analysis with regard to planning in Brazil and in developing countries, in general. Plans have generally been of little avail in Brazil because of the lack of a continuous, bureaucratized (in the Weberian sense) planning organization set in an instrumentally suitable administrative structure and based on thorough diagnoses of socio-economic conditions and problems. Plans have become the justification for planning. Planning has come to be conceived as a rational method of orienting the process of decisions through the establishment of a precise and quantified relation between means and ends. But this conception has led to a planning history rimmed with frustration, and failure, because of its rigidity in the face of flexible and changing reality. Rather, he suggests a conception of planning which understands it "as a rational process of formulating decisions about the policy, economy, and society whose only demand is that of managing the instrumentarium in a harmonious and integrated form in order to reach explicit, but not quantified ends". He calls this "planning without plans": the establishment of broad-scale tendencies through diagnosis whose implementation is carried out through an adjustable, coherent instrumentarium of political-economic tools. Administration according to a plan of multiple, integrated goals is a sound procedure if the nation's administrative machinery contains the technical development needed to control the multiple variables linked to any situation of socio-economic change. Brazil does not possess this level of refinement and any strategy of planning relevant to its problems must recognize this. The reforms which have been attempted fail to make this recognition as is true of the conception of planning informing the Brazilian experience. Therefore, unworkable plans, ill-diagnosed with little or no supportive instrumentarium or flexibility have been Brazil's legacy. This legacy seems likely to continue until the conception of planning comes to live in the reality of Brazil.

Detection of psychiatric morbidity in the primary medical care setting in Brazil

The aims of this study were a) to assess the ability of primary care doctors to make accurate ratings of psychiatric disturbance and b) to evaluate the use of a case-finding questionnaire in the detection of psychiatric morbidity. The estudy took place in three primary care clinics in the city of São Paulo, Brazil, during a six-month survey. A time sample of consecutive adult attenders were asked to complete a case-finding questionnaire for psychiatric disorders (the Self Report Questionnaire - SRQ) and a subsample were selected for a semi-structured psychiatric interview (the Clinical Interview Schedule - CIS). At the end of the consultation the primary care doctors were asked to assess, in a standardized way, the presence or absence of psychiatric disorder; these assessments were then compared with that ratings obtained in the psychiatric interview. A considerable proportion of minor psychiatric morbidity remained undetected by the three primary care doctors: the hidden morbidity ranged from 22% to 79%. When these were compared to those of the case-finding questionnaire, they were consistently lower, indicating that the use of these instruments can enhance the recognition of psychiatric disorders in primary care settings. Four strategies for adopting the questionnaire are described, and some of the clinical consequences of its use are discussed.

Metodological issues in measuring the detection of emotional disorders by primary care physicians: a review of the literature

A series of studies in the field of Epidemiological Psychiatry have been performed over the last two decades, and these have focused on the ability of primary care physicians to detect emotional disorders in the patients that attend their practices. The scientific methodology utilized in these studies is the subject of this review, which contains a discussion concerning: a) interviewer awareness bias; b) accuracy of the instruments and c) medical and psychological concepts involved in defining minor emotional disorders. Suggestions for change in the methodology are made in each of the sections of the review.

Health, sleep and lack of time: relations to domestic and paid work in nurses

OBJECTIVE: To assess whether reported morbidity and complaints of lack of time and sleep are associated with the burden of professional work and housework among nurses. METHODS: A cross-sectional exploratory study was carried out among female nurses and nurse assistants (N=206) of a public hospital in Rio de Janeiro, Brazil. Data were collected by means of a questionnaire. The prevalence ratio and 95% confidence intervals were estimated. RESULTS: Mean duration of professional work and housework time was 40.4 and 31.6 hours/week, respectively. Long professional working time (over 44 hours/week) were associated with mild emotional disorders (PR=1.37; 95% CI: 1.05-1.80), complaints of lack of time for resting/leisure (PR=1.61; 95% CI: 1.31-1.97), housework (PR=1.48; 95% CI: 1.12-1.97), and childcare (PR=1.99; 95% CI: 1.51-2.63). Long housework time (over 28 hours/week) was associated with lower prevalence of lack of time for childcare (PR=0.62; 95% CI: 0.46-0.84). High housework load was associated with lack of personal time and complaints of varicose veins (PR=1.31; 95% CI: 1.14-1.50 and PR=1.31; 95% CI: 1.08-1.58, respectively). Complaints of varicose veins were also frequent among female nurses with a total work load above 84 hours (PR=1.30; 95% CI: 1.05-1.61), though this group has shown a lower prevalence of arterial hypertension and recurrent headaches (PR=0.35; 95% CI: 0.15-0.83 and PR=0.53; 95% CI: 0.32-0.89, respectively). CONCLUSIONS: Results suggest that both professional and home environments are relevant in the evaluation of work overload on nurses' health and their family and social life. It is stressed the need for instruments for analyzing total workload among female populations.

Autonomy of long-stay psychiatric inpatients

OBJECTIVE: To assess personal autonomy of long-stay psychiatric inpatients, to identify those patients who could be discharged and to evaluate the impact of sociodemographic variables, social functioning, and physical disabilities on their autonomy was also assessed. METHODS: A total of 584 long-stay individuals of a psychiatric hospital (96% of the hospital population) in Southern Brazil was assessed between July and August 2002. The following instruments, adapted to the Brazilian reality, were used: independent living skills survey, social behavioral schedule, and questionnaire for assessing physical disability. RESULTS: Patients showed severe impairment of their personal autonomy, especially concerning money management, work-related skills and leisure, food preparation, and use of transportation. Autonomy deterioration was associated with length of stay (OR=1.02), greater physical disability (OR=1.54; p=0.01), and male gender (OR=3.11; p<0.001). The risk estimate of autonomy deterioration was 23 times greater among those individuals with severe impairment of social functioning (95% CI: 10.67-49.24). CONCLUSIONS: In-patients studied showed serious impairment of autonomy. While planning these patients' discharge their deficits should be taken into consideration. Assessment of patients' ability to function and to be autonomous helps in identifying their needs for care and to evaluate their actual possibilities of social reinsertion.