The modest but growing Brazilian presence in psychiatric, psychobiological and mental health research: assessment of the 1998-2002 period

The objective of the present survey was to assess the Brazilian scientific production in psychiatry, psychobiology, and mental health during the 1998-2002 period. The universities' graduate programs concentrate the vast majority of the scientific production in Brazil. We assessed the annual reports from the graduate programs to the Brazilian Ministry of Education concerning master's and doctoral theses and the articles published in journals indexed by the Institute of Scientific Information (ISI). There are nine Master's and Doctoral graduate programs dedicated to research in psychiatry, neuropsychiatry, psychobiology, and mental health in the country, seven being located in southern states. During the 5-year period, from 1998 to 2002, 186 students received their doctorate degree (37/year). The programs published 637 articles in journals indexed by ISI, the majority of them in journals with an impact factor higher than 2. The research advisors' productivity varied among graduate programs, ranging from 0.6 to 2.0 articles per year in ISI-indexed journals. Despite the substantial barriers faced by the Brazilian scientific community (mainly financial and writing difficulties), Brazil's scientific mental health production is on the rise. The number of articles published in ISI-indexed journals has doubled without a significant increase in the number of graduate theses, suggesting that there was an improvement in both the quality of the scientific production and the productivity of the graduate programs. Based on these data, it is reasonable to predict a tendency to an increase in production over the next few years.

Health, education and community: Assets and needs of a small urban community in north east Tamaulipas, Mexico: A community based participatory research assessment

This study explored the health, education, social assets, needs, attitudes, and behaviors of residents of Ferrocarril #4, a small urban community in Tamaulipas, Mexico. A collaborative Participatory Action Research approach was used to emphasize community involvement. Using Triangulation to ensure validity, qualitative methods included key informant in depth interviews, participant observation and participatory discussion groups with women and men. A personal interview with a probability sample of women was done. The median age of interviewees was 37 years. The majority was married or had a partner. Over half of respondents completed grades 6-9. Employed women (25%) earned a median weekly salary equivalent to ∼56 USD. Women with health insurance (67.7%) were covered mainly through Social Security and Seguro Popular. One in 5 reported bad health. Barriers to care were primarily money and transportation. To improve health care, women wanted a full service clinic in or close to the community and affordable health care. Socially, 28% of respondents had no close friends in the community and most did not participate in beneficial community activities. Many women did not socialize with others and help from neighbors was situational. Primary school teachers lacked parental support and it interfered with classroom efforts. Healthy community discussion groups focused on personal and environmental hygiene and safety. Valuable assets exist in the community. To date, collaborative efforts resulted in a school First Aid station, a school nurse visit weekly, posting of emergency contact phone numbers in the school and community center, and development of a student health information form. ^

Counting Highly Cited Papers for University Research Assessment: Conceptual and Technical Issues

A Kuhnian approach to research assessment requires us to consider that the important scientific breakthroughs that drive scientific progress are infrequent and that the progress of science does not depend on normal research. Consequently, indicators of research performance based on the total number of papers do not accurately measure scientific progress. Similarly, those universities with the best reputations in terms of scientific progress differ widely from other universities in terms of the scale of investments made in research and in the higher concentrations of outstanding scientists present, but less so in terms of the total number of papers or citations. This study argues that indicators for the 1% high-citation tail of the citation distribution reveal the contribution of universities to the progress of science and provide quantifiable justification for the large investments in research made by elite research universities. In this tail, which follows a power low, the number of the less frequent and highly cited important breakthroughs can be predicted from the frequencies of papers in the upper part of the tail. This study quantifies the false impression of excellence produced by multinational papers, and by other types of papers that do not contribute to the progress of science. Many of these papers are concentrated in and dominate lists of highly cited papers, especially in lower-ranked universities. The h-index obscures the differences between higher- and lower-ranked universities because the proportion of h-core papers in the 1% high-citation tail is not proportional to the value of the h-index.

The state of the field in UK management research: reflections of the Research Assessment Exercise (RAE) panel

This paper reviews the state of the field of the sub-disciplines within UK management research, based upon the submissions of 94 UK higher education institutions to the Business and Management Studies Panel in the UK's 2001 Research Assessment Exercise (RAE). It offers observations on the UK model of the assessment of quality in, and funding of, research conducted in publicly funded higher education institutions.

Quality of Qualitative Research in the Health Sciences : Analysis of the Common Criteria Present in 58 Assessment Guidelines by Expert Users

The number of qualitative research methods has grown substantially over the last twenty years, both in social sciences and, more recently, in the health sciences. This growth came with questions on the quality criteria needed to evaluate this work, and numerous guidelines were published. The latters include many discrepancies though, both in their vocabulary and construction. Many expert evaluators decry the absence of consensual and reliable evaluation tools. The authors present the results of an evaluation of 58 existing guidelines in 4 major health science fields (medicine and epidemiology; nursing and health education; social sciences and public health; psychology / psychiatry, research methods and organization) by expert users (article reviewers, experts allocating funds, editors, etc.). The results propose a toolbox containing 12 consensual criteria with the definitions given by expert users. They also indicate in which disciplinary field each type of criteria is known to be more or less essential. Nevertheless, the authors highlight the limitations of the criteria comparability, as soon as one focuses on their specific definitions. They conclude that each criterion in the toolbox must be explained to come to broader consensus and identify definitions that are consensual to all the fields examined and easily operational.

Making sense of research quality assessment

Purpose – For many academics in UK universities the nature and orientation of their research is overwhelmingly determined by considerations of how that work will be graded in research assessment exercises (RAEs). The grades awarded to work in a particular subject area can have a considerable impact on the individual and their university. There is a need to better understand those factors which may influence these grades. The paper seeks to address this issue. Design/methodology/approach – The paper considers relationships between the grades awarded and the quantitative information provided to the assessment panels for the 1996 and 2001 RAEs for two subject areas, built environment and town and country planning, and for three other subject areas, civil engineering, geography and archaeology, in the 2001 RAE. Findings – A simple model demonstrating strong and consistent relationships is established. RAE performance relates to numbers of research active staff, the production of books and journal papers, numbers of research studentships and graduations, and research income. Important differences between subject areas are identified. Research limitations/implications – Important issues are raised about the extent to which the new assessment methodology to be adopted for the 2008 RAE will capture the essence of good quality research in architecture and built environment. Originality/value – The findings provide a developmental perspective of RAEs and show how, despite a changed methodology, various research activities might be valued in the 2008 RAE. The basis for a methodology for reviewing the credibility of the judgements of panels is proposed.

Altmetrics in Institutional Repositories: New Perspectives for Assessing Research Impact

Poster (and extended abstract) presented at the 13th International Conference "Libraries in the Digital Age (LIDA 2014)" held on 16-20th June, University of Zadar, Zadar, Croatia

Accessing Research Results in the Open Information Environment

Presentation at the "Tutkimus vapaaksi verkkoon!" seminar in Helsinki, January 25, 2011

Truth - the essential dimension of ethics in scholarship, teaching, learning and research

The introduction of metrics, league tables, performance targets, research assessment exercises and a range of other pressures placed by society, funding bodies and employers on scholars, teachers and students have resulted in diminished value being placed on the essential ethical criterion of truth. The impact of reduced valuation for truth has a huge impact on the standing of science and not least horticultural science in the eyes of the general public at a time when this should be a primary concern. This contribution discusses examples of the impact of diminished valuation of truth, the causes of this phenomenon, the results that come from this situation and remedies that are needed.

The Use of the Rey 15-Item Test and Recognition Trial to Evaluate Suboptimal Effort in Neuropsychological Assessment with a Pediatric Mild TBI Sample

The utilization of symptom validity tests (SVTs) in pediatric assessment is receiving increasing empirical support. The Rey 15-Item Test (FIT) is an SVT commonly used in adult assessment, with limited research in pediatric populations. Given that FIT classification statistics across studies to date have been quite variable, Boone, Salazar, Lu, Warner-Chacon, and Razani (2002) developed a recognition trial to use with the original measure to enhance accuracy. The current study aims to assess the utility of the FIT and recognition trial in a pediatric mild traumatic brain injury (TBI) sample (N = 112; M = 14.6 years), in which a suboptimal effort base rate of 17% has been previously established (Kirkwood & Kirk, 2010). All participants were administered the FIT as part of an abbreviated neuropsychological evaluation; failure on the Medical Symptom Validity Test (MSVT) was used as the criterion for suspect effort. The traditional adult cut-off score of(99%), but poor sensitivity (6%). When the recognition trial was also utilized, a combination score of(sensitivity = 64%, specificity = 93%). Results indicate that the FIT with recognition trial may be useful in the assessment of pediatric suboptimal effort, at least among relatively high functioning children following mild TBI.

Therapeutic Assessment for an individual with Binge Eating Disorder: A single-case time-series design .

Therapeutic Assessment (TA) is a treatment approach that combines psychological assessment and psychotherapy. The study examines the efficacy of this approach with an individual with Binge Eating Disorder. A replicated single-case time-series design with daily measures is used to assess the effects of TA and to track the process of change during the TA. The individual experienced inconclusive benefits after participation in TA. Significant change occurred in all variables measured, though none of the changes occurred in the hypothesized direction. Further research is needed to determine if TA is an effective treatment for individuals diagnosed with Binge Eating Disorder.

The Use of Therapeutic Assessment with Forensic Populations: Practitioners' Perspectives

Therapeutic Assessment is a semi-structured approach to collaborative assessment developed by Stephen E. Finn and colleagues. In Therapeutic Assessment, psychological assessment is used as a therapeutic intervention (Finn, 2007; Finn & Kamphuis, 2006). The Therapeutic Assessment model differs from traditional assessment with regard to procedure and the roles of both assessor and client. Therapeutic Assessment has yet to be explored in forensic settings, wherein assessors are required to take on a number of varying and conflicting roles. In the current study, five forensic psychologists completed a semi-structured interview to identify their perspectives of Therapeutic Assessment and its utility in forensic contexts. A phenomenological qualitative analysis of the interviews was conducted to derive themes about Therapeutic Assessment, forensic psychology, and the overlap between these two domains. General themes that emerged include (a) the role and the context of the practitioner's work with the forensic population; (b) the potential of using Therapeutic Assessment's paradigm in family law settings; and (c) the increased risk of harm when using Therapeutic Assessment with forensic populations. In addition to these themes, multiple respondents discussed components of collaborative/Therapeutic Assessment that they have found useful with this population. Finally, the implications of these results are discussed.