Gender and the evaluation of research

This study examines if and how gender relates to research evaluation via panel assessment and journal ratings lists. Using data from UK business schools we find no evidence that the proportion of women in a submission for panel assessment affected the score received by the submitting institution. However, we do find that women on average receive lower scores according to some journal ratings lists. There are important differences in the rated quality of journals that men and women publish in across the sub-disciplines with men publishing significantly more research in the highest rated accountancy, information management and strategy journals. In addition, women who are able to utilise networks to co-author with individuals outside their institution are able to publish in higher-rated journals, although the same is not true for men; women who are attributed with “individual staff circumstances” (e.g. maternity leave or part-time working) have lower scores according to journal ratings lists.

Uptake pathways: the potential of Bayesian belief networks to assist the management, monitoring and evaluation of development-orientated research

The effectiveness of development assistance has come under renewed scrutiny in recent years. In an era of growing economic liberalisation, research organisations are increasingly being asked to account for the use of public funds by demonstrating achievements. However, in the natural resources (NR) research field, conventional economic assessment techniques have focused on quantifying the impact achieved rather understanding the process that delivered it. As a result, they provide limited guidance for planners and researchers charged with selecting and implementing future research. In response, “pathways” or logic models have attracted increased interest in recent years as a remedy to this shortcoming. However, as commonly applied these suffer from two key limitations in their ability to incorporate risk and assess variance from plan. The paper reports the results of a case study that used a Bayesian belief network approach to address these limitations and outlines its potential value as a tool to assist the planning, monitoring and evaluation of development-orientated research.

Thinking skills in the early years: a literature review

Since 1999, thinking skills have been included in the National Curriculum alongside ‘key skills’ such as those to do with communication and information and communications technology (ICT). Thinking skills are expected to be developed at all key stages and centre on: information-processing skills, reasoning skills, enquiry skills, creative thinking skills and evaluation skills. This literature review consisted of three phases based on the following research questions: 1. What pedagogical approaches to developing generic thinking skills currently exist for children between the ages of three and seven? 2. What are the generic thinking skills that children are able to demonstrate at this age? 3. What is the relationship between these thinking capabilities and those that the pedagogical approaches aim to develop? The review covered post-2000 literature in the area of thinking skills in the early years. It provides an update of the evidence base upon which thinking skills approaches have been established, suggests areas where more evidence is needed and makes some practical recommendations for researchers, policy makers and practitioners.

Re-thinking stakeholder management in construction: theory & research

From its roots in strategic management theory, stakeholder management has been adopted by the construction management academic community and applied as a valid paradigm around which research work has been generated aiming to improve project effi ciencies and effectiveness. However, academics have argued that stakeholder management should move away from purely theoretical discussions and engage more with the realities of construction project work. This paper re-appraises the stakeholder management concept for the construction domain by re-thinking some of the fundamental principles and ideals present within the more general stakeholder theory literature. It engages with issues which researchers have arguably failed to acknowledge and calls for a re-evaluation of construction stakeholder management research by presenting a review around four distinctive themes: the moral obligations of engaging with stakeholders against the business and efficiency driven imperatives of construction organisations; the contrast between theoretical abstractions and empirically grounded research; the tensions between theoretical convergence versus calls for multiple and divergent perspectives on stakeholder management and the practicalities of conducting stakeholder management in the construction domain. Such a critical re-appraisal of stakeholder management thinking both generates new lines of enquiry and promises to help inform and shape current and future industry practice.

Liquid-vapour homogenisation of fluid inclusions in stalagmites: Evaluation of a new thermometer for paleoclimate research

We present a new approach to determine palaeotemperatures (mean annual surface temperatures) based on measurements of the liquid–vapour homogenisation temperature of fluid inclusions in stalagmites. The aim of this study is to explore the potential and the limitations of this new palaeothermometer and to develop a reliable methodology for routine applications in palaeoclimate research. Therefore, we have investigated recent fluid inclusions from the top part of actively growing stalagmites that have formed at temperatures close to the present-day cave air temperature. A precondition for measuring homogenisation temperatures of originally monophase inclusions is the nucleation of a vapour bubble by means of single ultra-short laser pulses. Based on the observed homogenisation temperatures (Th(obs)) and measurements of the vapour bubble diameter at a known temperature, we calculated stalagmite formation temperatures (Tf) by applying a thermodynamic model that takes into account the effect of surface tension on liquid–vapour homogenisation. Results from recent stalagmite samples demonstrate that calculated stalagmite formation temperatures match the present-day cave air temperature within ± 0.2 °C. To avoid artificially induced changes of the fluid density we defined specific demands on the selection, handling and preparation of the stalagmite samples. Application of the method is restricted to stalagmites that formed at cave temperatures greater than ~ 9–11 °C.

Standardized evaluation of algorithms for computer-aided diagnosis of dementia based on structural MRI: The CADDementia challenge

Algorithms for computer-aided diagnosis of dementia based on structural MRI have demonstrated high performance in the literature, but are difficult to compare as different data sets and methodology were used for evaluation. In addition, it is unclear how the algorithms would perform on previously unseen data, and thus, how they would perform in clinical practice when there is no real opportunity to adapt the algorithm to the data at hand. To address these comparability, generalizability and clinical applicability issues, we organized a grand challenge that aimed to objectively compare algorithms based on a clinically representative multi-center data set. Using clinical practice as the starting point, the goal was to reproduce the clinical diagnosis. Therefore, we evaluated algorithms for multi-class classification of three diagnostic groups: patients with probable Alzheimer's disease, patients with mild cognitive impairment and healthy controls. The diagnosis based on clinical criteria was used as reference standard, as it was the best available reference despite its known limitations. For evaluation, a previously unseen test set was used consisting of 354 T1-weighted MRI scans with the diagnoses blinded. Fifteen research teams participated with a total of 29 algorithms. The algorithms were trained on a small training set (n = 30) and optionally on data from other sources (e.g., the Alzheimer's Disease Neuroimaging Initiative, the Australian Imaging Biomarkers and Lifestyle flagship study of aging). The best performing algorithm yielded an accuracy of 63.0% and an area under the receiver-operating-characteristic curve (AUC) of 78.8%. In general, the best performances were achieved using feature extraction based on voxel-based morphometry or a combination of features that included volume, cortical thickness, shape and intensity. The challenge is open for new submissions via the web-based framework: http://caddementia.grand-challenge.org.