Strategies towards evaluation beyond scientific impact

Various research fields, like organic agricultural research, are dedicated to solving real-world problems and contributing to sustainable development. Therefore, systems research and the application of interdisciplinary and transdisciplinary approaches are increasingly endorsed. However, research performance depends not only on self-conception, but also on framework conditions of the scientific system, which are not always of benefit to such research fields. Recently, science and its framework conditions have been under increasing scrutiny as regards their ability to serve societal benefit. This provides opportunities for (organic) agricultural research to engage in the development of a research system that will serve its needs. This article focuses on possible strategies for facilitating a balanced research evaluation that recognises scientific quality as well as societal relevance and applicability. These strategies are (a) to strengthen the general support for evaluation beyond scientific impact, and (b) to provide accessible data for such evaluations. Synergies of interest are found between open access movements and research communities focusing on global challenges and sustainability. As both are committed to increasing the societal benefit of science, they may support evaluation criteria such as knowledge production and dissemination tailored to societal needs, and the use of open access. Additional synergies exist between all those who scrutinise current research evaluation systems for their ability to serve scientific quality, which is also a precondition for societal benefit. Here, digital communication technologies provide opportunities to increase effectiveness, transparency, fairness and plurality in the dissemination of scientific results, quality assurance and reputation. Furthermore, funders may support transdisciplinary approaches and open access and improve data availability for evaluation beyond scientific impact. If they begin to use current research information systems that include societal impact data while reducing the requirements for narrative reports, documentation burdens on researchers may be relieved, with the funders themselves acting as data providers for researchers, institutions and tailored dissemination beyond academia.

A quantitative and qualitative evaluation of reports of clinical trials published in six Brazilian dental journals indexed in the Scientific Electronic Library Online (SciELO)

Introduction: Open access publishing is becoming increasingly popular within the biomedical sciences. SciELO, the Scientific Electronic Library Online, is a digital library covering a selected collection of Brazilian scientific journals many of which provide open access to full-text articles. This library includes a number of dental journals some of which may include reports of clinical trials in English, Portuguese and/or Spanish. Thus, SciELO could play an important role as a source of evidence for dental healthcare interventions especially if it yields a sizeable number of high quality reports. Objective: The aim of this study was to identify reports of clinical trials by handsearching of dental journals that are accessible through SciELO, and to assess the overall quality of these reports. Material and methods: Electronic versions of six Brazilian dental Journals indexed in SciELO were handsearched at www.scielo.br in September 2008. Reports of clinical trials were identified and classified as controlled clinical trials (CCTs - prospective, experimental studies comparing 2 or more healthcare interventions in human beings) or randomized controlled trials (RCTs - a random allocation method is clearly reported), according to Cochrane eligibility criteria. Criteria to assess methodological quality included: method of randomization, concealment of treatment allocation, blinded outcome assessment, handling of withdrawals and losses and whether an intention-to-treat analysis had been carried out. Results: The search retrieved 33 CCTs and 43 RCTs. A majority of the reports provided no description of either the method of randomization (75.3%) or concealment of the allocation sequence (84.2%). Participants and outcome assessors were reported as blinded in only 31.2% of the reports. Withdrawals and losses were only clearly described in 6.5% of the reports and none mentioned an intention-to-treat analysis or any similar procedure. Conclusions: The results of this study indicate that a substantial number of reports of trials and systematic reviews are available in the dental journals listed in SciELO, and that these could provide valuable evidence for clinical decision making. However, it is clear that the quality of a number of these reports is of some concern and that improvement in the conduct and reporting of these trials could be achieved if authors adhered to internationally accepted guidelines, e. g. the CONSORT statement.

Scientific article in vitro evaluation of the influence of air abrasion on detection of occlusal caries lesions in primary teeth

The purpose of this study was to assess the influence of cleaning pits and fissures with an aluminum oxide air abrasion system on the detection of occlusal caries in primary teeth using laser fluorescence (LF) and visual examination. Methods: The sample comprised 65 pit and fissure sites on extracted primary teeth suspected to be carious. The sites were submitted to 2 visual examinations (examiner JAR) and 2 LF readings (examiner TMV). Next, the occlusal surfaces were air-abraded and re-examined thereafter using both methods. The teeth were sectioned, and the histological analysis of the sites with a stereoscopic magnifying lens at X32 magnifi cation was used as the gold standard. Results: Cohen's kappa statistic for LF and visual examination were, respectively, 0.282/0.884 before and 0.896/0.905 after air abrasion. LF showed a sensitivity of 0.28 increasing to 0.49 and a specifi city of 0.50 increasing to 0.92. Visual examination showed sensitivity of 0.78 and specifi city of 0.73. Both increased after air abrasion. Conclusion: The findings suggest that cleaning pits and fissures with aluminum oxide air abrasion increased the accuracy of LF and visual examination for detection of occlusal caries in primary teeth.

Scientific research output evaluation of professors of Sao Paulo State University, Marilia/SP

In this work, an analysis of scientific bibliographic productivity was made using the Faculdade de Filosofia e Ciencias, Universidade Estadual Paulista (FFC-UNESP) as example. It is composed by nine departments which offer altogether nine undergraduate courses: 1) Archival, 2) Library, 3) Speech Therapy, 4) Pedagogy, 5) International Relations, 6) Physiotherapy, 7) Occupational Therapy, 8) Philosophy, 9) Social Sciences and six graduate programs leading to M. S. and Ph.D. degrees. Moreover, when analyzing the different courses of FFC-UNESP, they represent typical academic organization in Brazil and Latin America and could be taken as a model for analyzing other Brazilian research institutions. Using data retrieved from the Lattes Plataform database (Curriculum Lattes) we have quantitatively the scientific productivity percentage of professors at UNESP. We observed that bibliometric evaluations using the Curriculum Lattes (CL) showed that the professors published papers in journal are not indexed by ISI and SCOPUS. This analysis was made using: 1) the total number of papers (indexed in Curriculum Lattes database), 2) the number of papers indexed by Thomson ISI Web of Science database and SCOPUS database, and 3) the Hirsch (h-index) by ISI and SCOPUS. Bibliometric evaluations of departments showed a better performance of Political Science and Economics Department when compared to others departments, in relation total number of papers (indexed in Curriculum Lattes database). We also analyzed the academic advisory (Master's Thesis and Ph. D. Thesis) by nine departments of FFC/UNESP. The Administration and School Supervision Department presented a higher academic advisory (concluded and current) when compared to the others departments.

Byssinosis [microform] : evaluation of scientific and technical issues : hearing before the Subcommittee on Investigations and Oversight of the Committee on Science and Technology, U.S. House of Representatives, Ninety-seventh Congress, second session, September 22, 1982.

"No. 166."

Scientific validity of polygraph testing : a research review and evaluation.

Mode of access: Internet.

A new inhight on the Portuguese traditional sweets as cultural identity: a scientific approach towards evaluation of texture in Castanhas de Ovos de Viseu

The importance of the gastronomic heritage of any people is unquestionable and Portugal is particularly rich when it comes to sweets. Hence, the objective of this work was to give a contribution colour and texture, due to their importance for consumer acceptance. The samples were bought from a pastry in Viseu and produced according to the traditional recipe. Colour evaluation was made by a colorimeter and textural analysis by a texturometer. The results obtained allowed concluding that there were differences between the top burned area and the non-burned areas, as well as when comparing the ruffled with unruffled samples either regarding colour and also texture. The burned area was darker, with a more intense red and less yellow. As to texture, the ruffles samples were harder than the unruffled samples.

Evaluation of simulated bone lesion in the head of the mandible by using multislice computed tomography

Conventional radiography has shown limitation in acquiring image of the ATM region, thus, computed tomography (CT) scanning has been the best option to the present date for diagnosis, surgical planning and treatment of bone lesions, owing to its specific properties. OBJECTIVE: The aim of the study was to evaluate images of simulated bone lesions at the head of the mandible by multislice CT. MATERIAL AND METHODS: Spherical lesions were made with dental spherical drills (sizes 1, 3, and 6) and were evaluated by using multislice CT (64 rows), by two observers in two different occasions, deploying two protocols: axial, coronal, and sagittal images, and parasagittal images for pole visualization (anterior, lateral, posterior, medial and superior). Acquired images were then compared with those lesions in the dry mandible (gold standard) to evaluate the specificity and sensibility of both protocols. Statistical methods included: Kappa statistics, validity test and chi-square test. Results demonstrated the advantage of associating axial, coronal, and sagittal slices with parasagittal slices for lesion detection at the head of the mandible. RESULTS: There was no statistically significant difference between the types of protocols regarding a particular localization of lesions at the poles. CONCLUSIONS: Protocols for the assessment of the head of the mandible were established to improve the visualization of alterations of each of the poles of the mandible's head. The anterior and posterior poles were better visualized in lateral-medial planes while lateral, medial and superior poles were better visualized in the anterior-posterior plane.

Pitfalls of artificial grouping and stratification of scientific journals based on their Impact Factor: a case study in Brazilian Zoology

The present contribution explores the impact of the QUALIS metric system for academic evaluation implemented by CAPES (Coordination for the Development of Personnel in Higher Education) upon Brazilian Zoological research. The QUALIS system is based on the grouping and ranking of scientific journals according to their Impact Factor (IF). We examined two main points implied by this system, namely: 1) its reliability as a guideline for authors; 2) if Zoology possesses the same publication profile as Botany and Oceanography, three fields of knowledge grouped by CAPES under the subarea "BOZ" for purposes of evaluation. Additionally, we tested CAPES' recent suggestion that the area of Ecology would represent a fourth field of research compatible with the former three. Our results indicate that this system of classification is inappropriate as a guideline for publication improvement, with approximately one third of the journals changing their strata between years. We also demonstrate that the citation profile of Zoology is distinct from those of Botany and Oceanography. Finally, we show that Ecology shows an IF that is significantly different from those of Botany, Oceanography, and Zoology, and that grouping these fields together would be particularly detrimental to Zoology. We conclude that the use of only one parameter of analysis for the stratification of journals, i.e., the Impact Factor calculated for a comparatively small number of journals, fails to evaluate with accuracy the pattern of publication present in Zoology, Botany, and Oceanography. While such simplified procedure might appeals to our sense of objectivity, it dismisses any real attempt to evaluate with clarity the merit embedded in at least three very distinct aspects of scientific practice, namely: productivity, quality, and specificity.

Evaluation of gastrointestinal motility in awake rats: a learning exercise for undergraduate biomedical students

Souza MA, Souza MH, Palheta RC Jr, Cruz PR, Medeiros BA, Rola FH, Magalhaes PJ, Troncon LE, Santos AA. Evaluation of gastrointestinal motility in awake rats: a learning exercise for undergraduate biomedical students. Adv Physiol Educ 33: 343-348, 2009; doi: 10.1152/advan.90176.2008.-Current medical curricula devote scarce time for practical activities on digestive physiology, despite frequent misconceptions about dyspepsia and dysmotility phenomena. Thus, we designed a hands-on activity followed by a small-group discussion on gut motility. Male awake rats were randomly submitted to insulin, control, or hypertonic protocols. Insulin and control rats were gavage fed with 5% glucose solution, whereas hypertonic-fed rats were gavage fed with 50% glucose solution. Insulin treatment was performed 30 min before a meal. All meals (1.5 ml) contained an equal mass of phenol red dye. After 10, 15, or 20 min of meal gavage, rats were euthanized. Each subset consisted of six to eight rats. Dye recovery in the stomach and proximal, middle, and distal small intestine was measured by spectrophotometry, a safe and reliable method that can be performed by minimally trained students. In a separate group of rats, we used the same protocols except that the test meal contained (99m)Tc as a marker. Compared with control, the hypertonic meal delayed gastric emptying and gastrointestinal transit, whereas insulinic hypoglycemia accelerated them. The session helped engage our undergraduate students in observing and analyzing gut motor behavior. In conclusion, the fractional dye retention test can be used as a teaching tool to strengthen the understanding of basic physiopathological features of gastrointestinal motility.

Evaluation of pain before and after vaginal delivery

Purpose: The objective of this Pilot Study was to determine pain characteristics of pregnant women immediately before and after childbirth by vaginal delivery and to compare them with the pain intensity reported by physicians. Methods: We evaluated 20 Brazilian women between September and December 2007 with the WHOQOL-Bref instrument, VAS, McGill Pain Questionnaire, and Anxiety Adapted Scale. We interviewed the obstetrician with the VAS about the patient`s pain, Data were analyzed with the chi-square test. Results: Mean age was 22.35 years (SD = 6.24, range 15-39 years). It was necessary to use oxytocin in 15 (75%) patients, which had no correlation with anxiety degree. Higher intensity of pain (p < 0.05) and higher anxiety index (p < 0.05) were more common in women in the first pregnancy. Conclusions: Higher pain intensity was associated with higher anxiety levels (p < 0.05). Around half of the obstetricians` VAS scores were lower than the VAS scores of women, and probably pain at labor was underestimated and not controlled. Higher indices of anxiety and pain were associated, and were more frequent in women in the first pregnancy.

2D evaluation of crack openings using smeared and embedded crack models

This work deals with the determination of crack openings in 2D reinforced concrete structures using the Finite Element Method with a smeared rotating crack model or an embedded crack model In the smeared crack model, the strong discontinuity associated with the crack is spread throughout the finite element As is well known, the continuity of the displacement field assumed for these models is incompatible with the actual discontinuity However, this type of model has been used extensively due to the relative computational simplicity it provides by treating cracks in a continuum framework, as well as the reportedly good predictions of reinforced concrete members` structural behavior On the other hand, by enriching the displacement field within each finite element crossed by the crack path, the embedded crack model is able to describe the effects of actual discontinuities (cracks) This paper presents a comparative study of the abilities of these 2D models in predicting the mechanical behavior of reinforced concrete structures Structural responses are compared with experimental results from the literature, including crack patterns, crack openings and rebar stresses predicted by both models