A Construção do processo democrático de auto-avaliação institutucional na UNESP

O desenvolvimento de um processo democrático de avaliação institucional na UNESP, uma universidade multi-campus, envolveu três desafios: garantir o envolvimento de grupos representativos da comunidade no processo de avaliação; atribuir poder e responsabilidade a cada setor acadêmico e administrativo no processo de avaliação; criar uma cultura de auto-avaliação e reflexão que possibilitasse debate crítico e auto-gestão dos projetos acadêmicos. Com base nos termos de referência estabelecidos pela comunidade a CPA desenvolveu uma metodologia de avaliação democrática e investigativa, orientada para a auto-gestão e de natureza quali-quantitativa. Fundamentada em três enfoques teóricos de avaliação, o democrático, o de tomada de decisão e o crítico o processo envolveu três funções: a diagnóstica, a formativo-reflexiva e a de revisão crítica. Atualmente os usos dos resultados da avaliação para orientar políticas e decisões acadêmicas, especialmente nos cursos de graduação, evidenciam avanços no processo de internalização de cultura de avaliação orientada para auto-gestão.

Evaluation of a workplace alcohol and other drug policy

BACKGROUND The current impetus for developing alcohol and/or other drugs (AODs) workplace policies in Australia is to reduce workplace AOD impairment, improve safety, and prevent AOD-related injury in the workplace. For these policies to be effective, they need to be informed by scientific evidence. Evidence to inform the development and implementation of effective workplace AOD policies is currently lacking. There does not currently appear to be conclusive evidence for the effectiveness of workplace AOD policies in reducing impairment and preventing AOD-related injury. There is also no apparent evidence regarding which factors facilitate or impede the success of an AOD policy, or whether, for example, unsuccessful policy outcomes were due to poor policy or merely poor implementation of the policy. It was the aim of this research to undertake a process, impact, and outcome evaluation of a workplace AOD policy, and to contribute to the body of knowledge on the development and implementation of effective workplace AOD policies. METHODS The research setting was a state-based power-generating industry in Australia between May 2008 and May 2010. Participants for the process evaluation study were individuals who were integral to either the development or the implementation of the workplace AOD policy, or both of these processes (key informants), and comprised the majority of individuals who were involved in the process of developing and/or implementing the workplace AOD policy. The sample represented the two main groups of interest—management and union delegates/employee representatives—from all three of the participating organisations. For the impact and outcome evaluation studies, the population included all employees from the three participating organisations, and participants were all employees who consented to participate in the study and who completed both the pre-and post-policy implementation questionnaires. Qualitative methods in the form of interviews with key stakeholders were used to evaluate the process of developing and implementing the workplace AOD policy. In order to evaluate the impact of the policy with regard to the risk factors for workplace AOD impairment, and the outcome of the policy in terms of reducing workplace AOD impairment, quantitative methods in the form of a non-randomised single group pre- and post-test design were used. Changes from Time 1 (pre) to Time 2 (post) in the risk factors for workplace AOD impairment, and changes in the behaviour of interest—(self-reported) workplace AOD impairment—were measured. An integration of the findings from the process, impact, and outcome evaluation studies was undertaken using a combination of qualitative and quantitative methods. RESULTS For the process evaluation study Study respondents indicated that their policy was developed in the context of comparable industries across Australia developing workplace AOD policies, and that this was mainly out of concern for the deleterious health and safety impacts of workplace AOD impairment. Results from the process evaluation study also indicated that in developing and implementing the workplace AOD policy, there were mainly ‗winners', in terms of health and safety in the workplace. While there were some components of the development and implementation of the policy that were better done than others, and the process was expensive and took a long time, there were, overall, few unanticipated consequences to implementing the policy and it was reported to be thorough and of a high standard. Findings also indicated that overall the policy was developed and implemented according to best-practice in that: consultation during the policy development phase (with all the main stakeholders) was extensive; the policy was comprehensive; there was universal application of the policy to all employees; changes in the workplace (with regard to the policy) were gradual; and, the policy was publicised appropriately. Furthermore, study participants' responses indicated that the role of an independent external expert, who was trusted by all stakeholders, was integral to the success of the policy. For the impact and outcome evaluation studies Notwithstanding the limitations of pre- and post-test study designs with regard to attributing cause to the intervention, the findings from the impact evaluation study indicated that following policy implementation, statistically significant positive changes with regard to workplace AOD impairment were recorded for the following variables (risk factors for workplace AOD impairment): Knowledge; Attitudes; Perceived Behavioural Control; Perceptions of the Certainty of being punished for coming to work impaired by AODs; Perceptions of the Swiftness of punishment for coming to work impaired by AODs; and Direct and Indirect Experience with Punishment Avoidance for workplace AOD impairment. There were, however, no statistically significant positive changes following policy implementation for Behavioural Intentions, Subjective Norms, and Perceptions of the Severity of punishment for workplace AOD impairment. With regard to the outcome evaluation, there was a statistically significant reduction in self-reported workplace AOD impairment following the implementation of the policy. As with the impact evaluation, these findings need to be interpreted in light of the limitations of the study design in being able to attribute cause to the intervention alone. The findings from the outcome evaluation study also showed that while a positive change in self-reported workplace AOD impairment following implementation of the policy did not appear to be related to gender, age group, or employment type, it did appear to be related to levels of employee general alcohol use, cannabis use, site type, and employment role. Integration of the process, impact, and outcome evaluation studies There appeared to be qualitative support for the relationship between the process of developing and implementing the policy, and the impact of the policy in changing the risk factors for workplace AOD impairment. That is, overall the workplace AOD policy was developed and implemented well and, following its implementation, there were positive changes in the majority of measured risk factors for workplace AOD impairment. Quantitative findings lend further support for a relationship between the process and impact of the policy, in that there was a statistically significant association between employee perceived fidelity of the policy (related to the process of the policy) and positive changes in some risk factors for workplace AOD impairment (representing the impact of the policy). Findings also indicated support for the relationship between the impact of the policy in changing the risk factors for workplace AOD impairment and the outcome of the policy in reducing workplace AOD impairment: positive changes in the risk factors for workplace AOD impairment (impact) were related to positive changes in self reported workplace AOD impairment (representing the main goal and outcome of the policy). CONCLUSIONS The findings from the research indicate support for the conclusion that the policy was appropriately implemented and that it achieved its objectives and main goal. The Doctoral research findings also addressed a number of gaps in the literature on workplace AOD impairment, namely: the likely effectiveness of AOD policies for reducing AOD impairment in the workplace, which factors in the development and implementation of a workplace AOD policy are likely to facilitate or impede the effectiveness of the policy to reduce workplace AOD impairment, and which employee groups are less likely to respond well to policies of this type. The findings from this research not only represent an example of translational, applied research—through the evaluation of the study industry's policy—but also add to the body of knowledge on workplace AOD policies and provide policy-makers with evidence which may be useful in the development and implementation of effective workplace AOD policies. Importantly, the findings espouse the importance of scientific evidence in the development, implementation, and evaluation of workplace AOD policies.

Comparative evaluation of serologic tests for celiac disease: a European initiative toward standardization.

BACKGROUND: Serologic methods have been used widely to test for celiac disease and have gained importance in diagnostic definition and in new epidemiologic findings. However, there is no standardization, and there are no reference protocols and materials. METHODS: The European working group on Serological Screening for Celiac Disease has defined robust noncommercial test protocols for immunoglobulin (Ig)G and IgA gliadin antibodies and for IgA autoantibodies against endomysium and tissue transglutaminase. Standard curves were linear in the decisive range, and intra-assay variation coefficients were less than 5% to 10%. Calibration was performed with a group reference serum. Joint cutoff limits were used. Seven laboratories took part in the final collaborative study on 252 randomized sera classified by histology (103 pediatric and adult patients with active celiac disease, 89 disease control subjects, and 60 blood donors). RESULTS: IgA autoantibodies against endomysium and tissue transglutaminase rendered superior sensitivity (90% and 93%, respectively) and specificity (99% and 95%, respectively) over IgA and IgG gliadin antibodies. Tissue transglutaminase antibody testing showed superior receiver operating characteristic performance compared with gliadin antibodies. The K values for interlaboratory reproducibility showed superiority for IgA endomysium (0.93) in comparison with tissue transglutaminase antibodies (0.83) and gliadin antibodies (0.82 for IgG, 0.62 for IgA). CONCLUSIONS: Basic criteria of standardization and quality assessment must be fulfilled by any given test protocol proposed for serologic investigation of celiac disease. The working group has produced robust test protocols and reference materials available for standardization to further improve reliability of serologic testing for celiac disease.

The Paediatric Rheumatology International Trials Organisation provisional criteria for the evaluation of response to therapy in juvenile dermatomyositis.

Objective To develop a provisional definition for the evaluation of response to therapy in juvenile dermatomyositis (DM) based on the Paediatric Rheumatology International Trials Organisation juvenile DM core set of variables. Methods Thirty-seven experienced pediatric rheumatologists from 27 countries achieved consensus on 128 difficult patient profiles as clinically improved or not improved using a stepwise approach (patient's rating, statistical analysis, definition selection). Using the physicians' consensus ratings as the “gold standard measure,” chi-square, sensitivity, specificity, false-positive and-negative rates, area under the receiver operating characteristic curve, and kappa agreement for candidate definitions of improvement were calculated. Definitions with kappa values >0.8 were multiplied by the face validity score to select the top definitions. Results The top definition of improvement was at least 20% improvement from baseline in 3 of 6 core set variables with no more than 1 of the remaining worsening by more than 30%, which cannot be muscle strength. The second-highest scoring definition was at least 20% improvement from baseline in 3 of 6 core set variables with no more than 2 of the remaining worsening by more than 25%, which cannot be muscle strength (definition P1 selected by the International Myositis Assessment and Clinical Studies group). The third is similar to the second with the maximum amount of worsening set to 30%. This indicates convergent validity of the process. Conclusion We propose a provisional data-driven definition of improvement that reflects well the consensus rating of experienced clinicians, which incorporates clinically meaningful change in core set variables in a composite end point for the evaluation of global response to therapy in juvenile DM.

Longitudinal evaluation of sleep-related breathing disorders in an orthodontic population

Introduction: Les troubles respiratoires du sommeil (TRS), qui représentent une préoccupation croissante pour la santé, ont des effets significatifs sur la santé, le comportement et la performance académique chez l’enfant. Les malformations craniofaciales, l’hypertrophie adéno-amygdalienne et l'obésité, représentent des facteurs de risque importants dans le développement de cette condition. Les symptômes des TRS ont été étudiés dans une étude prospective chez les enfants et adolescents durant leur traitement orthodontique dans un milieu universitaire. Cette étude a cherché à décrire la prévalence et les facteurs de risque principaux des TRS, ainsi que l'impact des différentes interventions orthodontiques sur les symptômes TRS. Matériel et méthodes: dans une étude cohorte prospective, un groupe de 168 sujets âgés de 12 à 21 ans ont été soumis, quatre ans après la prise de données initiale, à un examen craniofacial en plus d'être administré des questionnaires qui ont recueilli des données sur la situation socio-démographique, le bruxisme et les troubles d’ATM, le sommeil et le comportement diurne, et les facteurs neuropsychologiques. Résultats: l'indice de masse corporelle a été augmenté mais est demeurée dans la même catégorie aux deux moments de l'enquête. Il ya eu une augmentation du serrement des dents et des symptômes de l'ATM, une diminution de la taille des amygdales, et une augmentation de la somnolence diurne. La prévalence des TRS n'a pas changé entre l’étude initiale et l’étude de suivi. Aucune intervention orthodontique s'est avérée avoir un effet cliniquement significatif sur les voies aériennes supérieures. Conclusions: la prévalence des symptômes TRS était constante par rapport aux valeurs de base pour la population étudiée, mais a augmenté si rapportée à la population générale. Les traitements orthodontiques ne montrent aucun effet sur les TRS. Mots-clés : apnée du sommeil, craniofacial, prévalence, ronflement, traitement orthodontique, voies aériennes supérieures

Morphological and functional evaluation of distal esophagus of rabbits submitted to esophageal infusion with caustic soda

A ingestão de substâncias cáusticas constitui importante situação de emergência, tendo em vista a gravidade de suas seqüelas. OBJETIVO: Estudar as alterações morfológicas e funcionais do esôfago de coelhos submetidos à infusão esofágica com soda cáustica (NaOH). MÉTODOS: 88 coelhos foram divididos em 4 grupos: G1 (n=22) foi submetido à infusão esofágica com água destilada; G2, G3 e G4 foram submetidos a infusão esofágica com NaOH a 2%, 4% e 6%, respectivamente. Alterações morfológicas foram estudadas em 12 animais de cada grupo e as alterações manométricas, nos 10 animais restantes. Foram feitas análises do esfíncter inferior do esôfago (EIE), número e amplitude das contrações no terço distal do esôfago. Estes estudos foram realizados antes (momento 1 - M1) e aos 30 minutos, 6 horas e 24 horas após a infusão esofágica (momentos M2, M3 e M4, respectivamente). RESULTADOS: Avaliação macroscópica: G1 - sem alterações; G2 - edema, hiperemia e descamação; G3 - aumento do calibre do esôfago, úlceras, descamação da mucosa; G4 - lesões semelhantes as do G3, porém mais intensas, áreas de extensa hemorragia. Avaliação funcional: a pressão no EIE foi mais elevada em M2 no grupo 2; o número das contrações no terço distal do esôfago foi menor em G3 e G4, e a amplitude das contrações foi menor em G4. CONCLUSÕES: 1) a infusão esofágica com NaOH constitui excelente modelo experimental de esofagite cáustica no coelho; 2) a infusão esofágica com NaOH causa lesões na parede do esôfago, com gravidade proporcional a concentração da solução; 3) a infusão causou espasmo do EIE em M2 e redução do número e amplitude das contrações no terço distal do esôfago.

Validity of the 'protocol of oro-facial myofunctional evaluation with scores' for young and adult subjects

The aims of this study were to analyse the validity, sensitivity and specificity of the protocol of oro-facial myofunctional evaluation with scores (OMES) for oro-facial myofunctional disorder (OMD) diagnosis in young and adult subjects. Eighty subjects were examined. The OMES was validated against the Nordic Orofacial Test-Screening (NOT-S) protocol (criterion validity) (Spearman correlation test). The construct validity was tested by analysis of the ability of the OMES (i) to differentiate healthy subjects (n = 22) from temporomandibular disorder (TMD) patients (n = 22), which frequently have OMD (MannWhitney test) and (ii) to measure the changes that occurred in a subgroup with TMD between the period before and after oro-facial myofunctional therapy (T group, n = 15) (Wilcoxon test). Two speech therapists trained with the OMES participated as examiners (E). There was a statistically significant correlation between the OMES and NOT-S protocols, which was negative because the two scales are inverse (r = -0.86, P < 0.01). There was a significant difference between the healthy and TMD subjects regarding the oro-facial myofunctional status (OMES total score, P = 0.003). After therapy, the T group showed improvement in the oro-facial myofunctional status (OMES total score, P = 0.001). Inter- and intra-examiner agreement was moderate, and the reliability coefficients ranged from good to excellent. The OMES protocol presented mean sensitivity and specificity = 0.80, positive predictive value = 0.76 and negative predictive value = 0.84. Conclusion: The OMES protocol is valid and reliable for clinical evaluation of young and adult subjects, among them patients with TMD.

Effects of a health advocacy program to promote physical activity and nutrition behaviors among adolescents: An evaluation of the Young Leaders for Healthy Change program

Background. This study was designed to evaluate the effects of the Young Leaders for Healthy Change program, an internet-delivered program in the school setting that emphasized health advocacy skills-development, on nutrition and physical activity behaviors among older adolescents (13–18 years). The program consisted of online curricular modules, training modules, social media, peer and parental support, and a community service project. Module content was developed based on Social Cognitive Theory and known determinants of behavior for older adolescents. ^ Methods. Of the 283 students who participated in the fall 2011 YL program, 38 students participated in at least ten of the 12 weeks and were eligible for this study. This study used a single group-only pretest/posttest evaluation design. Participants were 68% female, 58% white/Caucasian, 74% 10th or 11th graders, and 89% mostly A and/or B students. The primary behavioral outcomes for this analysis were participation in 60-minutes of physical activity per day, 20-minutes of vigorous- or moderate- intensity physical activity (MVPA) participation per day, television and computer time, fruit and vegetable (FV) intake, sugar-sweetened beverage intake, and consumption of breakfast, home-cooked meals, and fast food. Other outcomes included knowledge, beliefs, and attitudes related to healthy eating, physical activity, and advocacy skills. ^ Findings. Among the 38 participants, no significant changes in any variables were observed. However, among those who did not previously meet behavioral goals there was an 89% increase in students who participated in more than 20 minutes of MVPA per day and a 58% increase in students who ate home-cooked meals 5–7 days per week. The majority of participants met program goals related to knowledge, beliefs, and attitudes prior to the start of the program. Participants reported either maintaining or improving to the goal at posttest for all items except FV intake knowledge, taste and affordability of healthy foods, interest in teaching others about being healthy, and ease of finding ways to advocate in the community. ^ Conclusions. The results of this evaluation indicated that promoting healthy behaviors requires different strategies than maintaining healthy behaviors among high school students. In the school setting, programs need to target the promotion and maintenance of health behaviors to engage all students who participate in the program as part of a class or club activity. Tailoring the program using screening and modifying strategies to meet the needs of all students may increase the potential reach of the program. The Transtheoretical Model may provide information on how to develop a tailored program. Additional research on how to utilize the constructs of TTM effectively among high school students needs to be conducted. Further evaluation studies should employ a more expansive evaluation to assess the long-term effectiveness of health advocacy programming.^

Integrated studies for the evaluation of conservation treatments on buildings materials from archaeological sites: application to the case of Merida (Spain)

The application of conservation treatments, such as consolidation and protection ones, has been demonstrated ineffective in many cases, and even harmful. Evaluation studies should be a mandatory task, ideally before and after the intervention, but both tasks are complex and unusual in the case of archaeological heritage. This study is mainly focused on analyzing changes in petrophysical properties of stone material from archaeological sites of Merida (Spain), evaluating, both on site and in laboratory, effects derived from different conservation treatments applied in past interventions, throughout the integration of different non-destructive techniques (NDT) and portable devices of analysis available at the Institute of Geosciences (CSIC,UCM). These techniques allow, not only assessment of effectiveness and alteration processes, but also monitoring durability of treatments, focused mainly on 1996 intervention in the case of Roman Theater, as well as different punctual interventions from the 90?s until date in the House of Mitreo. Studies carried out on archaeological sites of Merida permit us to compare outcomes and also check limitations in the use of those equipments. In this paper we discuss about the use of some techniques, their integration and limits, for the assessment of conservation treatments, showing some examples of Merida?s case study.

Integrated studies for the evaluation of conservation treatments on stone material from archaeological sites. Application to the case of Mérida (Spain)

In recent decades archaeological sites have been subject of many interventions. The application of conservation treatments, such us consolidation and protection ones by means of using, for instance, synthetic resins or organosilicic compounds, has been demonstrated inadequate in many cases, and even harmful for the heritage materials [1]. Evaluation studies should be a mandatory task, ideally before and after the intervention, but both tasks are complex and unusual in the case of archaeological heritage. Moreover, there is a general lack of knowledge in the mid and long term effects of these treatments, and how to act when these have resulted in deterioration of the original material. Remains of Roman Augusta Emerita, located in Merida (Spain), have gone through many interventions since the first archaeological campaign, in 1910. Some of them have demonstrated already to be harmful [2], others, more recent, must be evaluated in order to determine its effectiveness and durability, considering that many of these treatments are currently still applied. For this purpose a range of parameters has been measured such as color, surface hardness and roughness, mechanical or hydric properties, porosity, etc. on the original material (granite, marble and mortars mainly), and then the transformations of those same parameters analyzed after treatment, both in situ, in places where a intervention is documented, and in the laboratory, in samples. The study is being conducted both in the laboratory (Petrophysics Laboratory within IGEO) and in situ, on selected archaeological sites of Mérida (Theater and House of Mitreo). The comparison of results in untreated and treated areas of the site, and in treated-untreated samples, allows the distinction of variables that affect the interaction between products and stone material, issues such us effectiveness and durability of treatment and its validation or dismissal.

Integrated Studies for the Evaluation of Conservation Treatments on Stone Material from Archaeological Sites. Application to the Case of Merida (Spain)

The application of conservation treatments, such as consolidation and protection ones, has been demonstrated ineffective in many cases, and even harmful. Evaluation studies should be a mandatory task, ideally before and after the intervention, but both tasks are complex and unusual in the case of archaeological heritage. This study is mainly focused on analyzing changes in petrophysical properties of stone material from archaeological sites of Merida (Spain), evaluating, both on site and in laboratory, effects derived from different conservation treatments applied in past interventions, throughout the integration of different non-destructive techniques (NDT) and portable devices of analysis available at the Institute of Geosciences (CSIC,UCM). These techniques allow, not only assessment of effectiveness and alteration processes, but also monitoring durability of treatments, focused mainly on 1996 intervention in the case of Roman Theater, as well as different punctual interventions from the 90’s until date in the House of Mitreo. Studies carried out on archaeological sites of Merida permit us to compare outcomes and also check limitations in the use of those equipments. In this paper we discuss about the use of some techniques, their integration and limits, for the assessment of conservation treatments, showing some examples of Merida’s case study.

Recommended reporting standards for test accuracy studies of infectious diseases of finfish, amphibians, molluscs and crustaceans: the STRADAS-aquatic checklist

Complete and transparent reporting of key elements of diagnostic accuracy studies for infectious diseases in cultured and wild aquatic animals benefits end-users of these tests, enabling the rational design of surveillance programs, the assessment of test results from clinical cases and comparisons of diagnostic test performance. Based on deficiencies in the Standards for Reporting of Diagnostic Accuracy (STARD) guidelines identified in a prior finfish study (Gardner et al. 2014), we adapted the Standards for Reporting of Animal Diagnostic Accuracy Studies—paratuberculosis (STRADAS-paraTB) checklist of 25 reporting items to increase their relevance to finfish, amphibians, molluscs, and crustaceans and provided examples and explanations for each item. The checklist, known as STRADAS-aquatic, was developed and refined by an expert group of 14 transdisciplinary scientists with experience in test evaluation studies using field and experimental samples, in operation of reference laboratories for aquatic animal pathogens, and in development of international aquatic animal health policy. The main changes to the STRADAS-paraTB checklist were to nomenclature related to the species, the addition of guidelines for experimental challenge studies, and the designation of some items as relevant only to experimental studies and ante-mortem tests. We believe that adoption of these guidelines will improve reporting of primary studies of test accuracy for aquatic animal diseases and facilitate assessment of their fitness-for-purpose. Given the importance of diagnostic tests to underpin the Sanitary and Phytosanitary agreement of the World Trade Organization, the principles outlined in this paper should be applied to other World Organisation for Animal Health (OIE)-relevant species.

Case management educational intervention with public health nurses : cluster randomized controlled trial

Aim: This paper is a report of a study conducted to determine the effectiveness of a community case management collaborative education intervention in terms of satisfaction, learning and performance among public health nurses. Background: Previous evaluation studies of case management continuing professional education often failed to demonstrate effectiveness across a range of outcomes and had methodological weaknesses such as small convenience samples and lack of control groups. Method: A cluster randomised controlled trial was conducted between September 2005 and February 2006. Ten health centre clusters (5 control, 5 intervention) recruited 163 public health nurses in Taiwan to the trial. After pre-tests for baseline measurements, public health nurses in intervention centres received an educational intervention of four half-day workshops. Post-tests for both groups were conducted after the intervention. Two-way repeated measures analysis of variance was performed to evaluate the effect of the intervention on target outcomes. Results: A total of 161 participants completed the pre- and post-intervention measurements. This was almost a 99% response rate. Results revealed that 97% of those in the experimental group were satisfied with the programme. There were statistically significant differences between the two groups in knowledge (p = 0.001), confidence in case management skills (p = 0.001), preparedness for case manager role activities (p = 0.001), self-reported frequency in using skills (p = 0.001), and role activities (p = 0.004). Conclusion: Collaboration between academic and clinical nurses is an effective strategy to prepare nurses for rapidly-changing roles.