A discussion of the research performance evaluation in building and construction management discipline : the journal impact factors and SCI-index journals

The trend of diminished funding, demands for greater efficiency and higher public accountability have led to a rapid expansion of interest in the bibliometric assessment of research performance of universities. A pilot research is conducted to provide a preliminary overview of the research performance of the building and construction schools or departments through the analysis of bibliometric indicators including the journal impact factor (JIF) published by Institute for Scientific Information (ISI). The suitability of bibliometric evaluation approaches as a measure of research quality in building and construction management research field is discussed.

Efficiency of research performance of Australian universities : a reappraisal using a bootstrap truncated regression approach

The motivation of the study stems from the results reported in the Excellence in Research for Australia (ERA) 2010 report. The report showed that only 12 universities performed research at or above international standards, of which, the Group of Eight (G8) universities filled the top eight spots. While performance of universities was based on number of research outputs, total amount of research income and other quantitative indicators, the measure of efficiency or productivity was not considered. The objectives of this paper are twofold. First, to provide a review of the research performance of 37 Australian universities using the data envelopment analysis (DEA) bootstrap approach of Simar and Wilson (2007). Second, to determine sources of productivity drivers by regressing the efficiency scores against a set of environmental variables.

Enhancing Chinese TEFL academics' research performance : necessity and urgency

China’s increasing participation in world affairs and the growing popularity of English as a lingua franca have made significant impact on Chinese society, culture and education. As such, considerable research topics in relation to English require TEFL researchers’ attentions. Additionally, higher education reform in China has created higher demand on academics by stressing research as an important element in academics’ assessment. Recurrent rhetoric in the field of TEFL also calls on practitioners to theorise their practice. All these practical needs and theoretical arguments point to the necessity and significance of TEFL academics’ engagement in research. To find out whether Chinese TEFL academics’ research meet the new demand on them, a survey of TEFL academics at three Chinese higher institutions was conducted. One hundred eighty two of them provided valid responses which were analysed using SPSS. It was found that TEFL academics’ research productivity in each category of research products was quite low. Large percentages of them did not produce any item in the investigated categories of research. They were least productive in conference papers and research products at the national level. However for these least productive categories, there were highly-productive TEFL academics. The categories of research where the TEFL academics were found relatively productive were non-core journal articles and provincial projects. The findings suggest that it is necessary and urgent for Chinese TEFL academics to enhance their research productivity to be able to meet the demand that new era has rendered.

ADSA Performance as Research Guidelines

The relationships between performance, research and scholarship in drama, theatre and performance studies have been of critical importance to ADSA and its members for more than two decades now. The ADSA Performance as Research Guidelines offer a comprehensive articulation of policies, approaches, practices, and issues impacting on the production of performance as research, particularly advise on producing performance as research in Australia, New Zealand and the Pacific.

deepBlue early research

A video of an early deepBlue performance at The Block, Queensland University of Technology, Creative Industries Faulty, 2006

Research productivity levels of Chinese TEFL academics

Since China’s Economic Reform and its Open Door Policy, China has entered a new era of education (Adamson, 2002; Hu, 2005a). English has gained status as a language for international relations (Graddol, 1997) and international trade (Qu, 2007). Hence, in 2001, China’s Ministry of Education (MOE) required universities to offer 5-10% of their course units in English, particularly in the fields of information technology, biotechnology, finance and law (Jen, 2001; MOE, 2001). However, “the upgrading of national English proficiency, then, is predicted largely on the professional competence of the teaching force” (Hu, 2005b, p. 655). For TEFL academics, one component of this competence is the capacity to conduct research (Day, 1991; Shu, 2002). Indeed, research productivity has become essential for university success, and academics’ employment and promotional prospects. This study aims to investigate 182 Chinese TEFL academics’ research outputs across three Chinese higher education institutions through the research question: What are the research productivity levels of Chinese TEFL academics? A survey instrument was devised to gather TEFL academics’ calculations of research productivity and, in particular, the quality and quantity of research outputs over a five-year period (2004-2008). Descriptive statistics through SPSS were used to analyse data across research output fields (e.g., journal articles, conference papers). Academic status varied (n=182; teaching assistants 23.6%, lecturers 47.3%, associate professors 22.5%, and professors 6.6%) as did years of teaching (1-5 years 27.4%, 6-10 years 24.7%, 11-15 18.1%, 16-20 years 13.7%, > 21 years 15.9%). Results (n=182, male=27%, females=73%) indicated 18% had not produced any research in the five-year period. Indeed, more than 70% had produced no research in all categories except non-core journal articles and provincial projects. An overwhelming majority of TEFL academics had zero productivity in 10 of the 12 categories. Nevertheless, there were highly-productive TEFL academics, who had produced five or more pieces of research across the 12 categories. In addition, there was not much difference between sole and co-authored research outputs, except non-core journal articles where sole authored work was 20% higher than co-authored work. China’s desire for international competitiveness in education will require measures that facilitate higher levels of research productivity. These measures must include professional development, support and mentoring programs, and employment of personnel who can guide these processes. Research performance is an outcome, hence there is a need to understand Chinese TEFL academics’ perceptions about research, and experiences that may hinder and facilitate higher research productivity.

Coordinated research skills training at QUT

Universities are wanting to drive research performance to new levels to increase competitiveness and secure additional research funding. Information technology departments, libraries and research offices are being tasked with the triple role of developing infrastructure, introducing new services, and raising researchers’ awareness and skill levels in the uptake of these services and related eResearch concepts in order to achieve institutional goals. The purpose of this poster is to provide an overview of the coordinated approach to the provision of research skills workshops and seminars provided to researchers and higher degree research (HDR) students at QUT. Seminars and workshops are provided by the Library in collaboration with High Performance Computing and Research Support (HPC) and the Research Students Centre. The sessions are findable and bookable via the Library’s KickStart system. A list of session topics is provided. The Research Support services web site brings together information on a range of research support services provided by the Library and HPC. Seminars and workshops are also available via a research training calendar system into which all sessions are populated, regardless of the provider. The Library and HPC are also undertaking a train the trainer program.

Sri Lanka in global medical research: a scientific analysis of the Sri Lankan research output during 2000-2009

Background Scientific research is an essential component in guiding improvements in health systems. There are no studies examining the Sri Lankan medical research output at international level. The present study evaluated the Sri Lankan research performance in medicine as reflected by the research publications output between years 2000-2009. Methods This study was based on Sri Lankan medical research publication data, retrieved from the SciVerse Scopus® from January 2000 to December 2009. The process of article selection was as follows: Affiliation - 'Sri Lanka' or 'Ceylon', Publication year - 'January 2000 to December 2009' and Subject area - 'Life and Health Sciences'. The articles identified were classified according to disease, medical speciality, institutions, major international collaborators, authors and journals. Results Sri Lanka's cumulative medical publications output between years 2000-2009 was 1,740 articles published in 160 different journals. The average annual publication growth rate was 9.1%. Majority of the articles were published in 'International' (n = 950, 54.6%) journals. Most articles were descriptive studies (n = 611, 35.1%), letters (n-345, 19.8%) and case reports (n = 311, 17.9%). The articles were authored by 148 different Sri Lankan authors from 146 different institutions. The three most prolific local institutions were Universities of; Colombo (n = 547), Kelaniya (n = 246) and Peradeniya (n = 222). Eighty four countries were found to have published collaborative papers with Sri Lankan authors during the last decade. UK was the largest collaborating partner (n = 263, 15.1%). Malaria (n = 75), Diabetes Mellitus (n = 55), Dengue (n = 53), Accidental injuries (n = 42) and Lymphatic filariasis (n = 40) were the major diseases studied. The 1,740 publications were cited 9,708 times, with an average citation of 5.6 per paper. The most cited paper had 203 citations, while there were 597 publications with no citations. The Sri Lankan authors' contribution to the global medical research output during the last decade was only 0.086%. Conclusion The Sri Lankan medical research output during the last decade is only a small fraction of the global research output. There it is a necessity to setup an enabling environment for research, with a proper vision, support, funds and training. In addition, collaborations across the region need to be strengthened to face common regional health challenges. Keywords: Sri Lanka, Medical research, Publication, Analysis

Queensland Emergency Medicine Research Foundation: Special report

The development of any new profession is dependent on the development of a special body of knowledge which is the domain of the profession and key to this is the conduct of research. In 2007, as part of the settlement of an Enterprise Bargaining Agreement and following sustained lobbying by Emergency Physicians, the Queensland Government agreed to establish an Emergency Medicine Research Fund to foster the development of research activities in Emergency Medicine in Queensland. That fund is now managed by the Queensland Emergency Medicine Research Foundation. The aims of this article are to describe the strategic approaches taken by the Foundation and its first three years of experience, to describe the application of research funds and to foreshadow an evaluative framework for determining the strategic value of this community investment. The Foundation has developed a range of personnel and project support funding programs and competition for funding has increased. Ongoing evaluation will seek to determine the effectiveness of this funding strategy on improving the effectiveness of research performance and the clinical and organisational outcomes that may derive from that initiative.

The economics of awards, status and performance: the John Bates Clark Medal and the Fellowship of the Econometric Society

This thesis investigates whether receiving an important award in academia raises recipients’ subsequent research productivity and status compared to a synthetic control group of non-recipient scholars with similar previous research performance. It examines the case of being awarded the John Bates Clark Medal and becoming a Fellow of the Econometric Society finding evidence of positive incentive and status effects that raise both productivity and citation levels.

Education higher degree research students writing for publication

Higher Degree Research (HDR) student publications are increasingly valued by students, by professional communities and by research institutions. Peer-reviewed publications form the HDR student writer's publication track record and increase competitiveness in employment and research funding opportunities. These publications also make the results of HDR student research available to the community in accessible formats. HDR student publications are also valued by universities because they provide evidence of institutional research activity within a field and attract a return on research performance. However, although publications are important to multiple stakeholders, many Education HDR students do not publish the results of their research. Hence, an investigation of Education HDR graduates who submitted work for publication during their candidacy was undertaken. This multiple, explanatory case study investigated six recent Education HDR graduates who had submitted work to peer-reviewed outlets during their candidacy. The conceptual framework supported an analysis of the development of Education HDR student writing using Alexander's (2003, 2004) Model of Domain Learning which focuses on expertise, and Lave and Wenger's (1991) situated learning within a community of practice. Within this framework, the study investigated how these graduates were able to submit or publish their research despite their relative lack of writing expertise. Case data were gathered through interviews and from graduate publication records. Contextual data were collected through graduate interviews, from Faculty and university documents, and through interviews with two Education HDR supervisors. Directed content analysis was applied to all data to ascertain the support available in the research training environment. Thematic analysis of graduate and supervisor interviews was then undertaken to reveal further information on training opportunities accessed by the HDR graduates. Pattern matching of all interview transcripts provided information on how the HDR graduates developed writing expertise. Finally, explanation building was used to determine causal links between the training accessed by the graduates and their writing expertise. The results demonstrated that Education HDR graduates developed publications and some level of expertise simultaneously within communities of practice. Students were largely supported by supervisors who played a critical role. They facilitated communities of practice and largely mediated HDR engagement in other training opportunities. However, supervisor support alone did not ensure that the HDR graduates developed writing expertise. Graduates who appeared to develop the most expertise, and produce a number of publications reported experiencing both a sustained period of engagement within one community of practice, and participation in multiple communities of practice. The implications for the MDL theory, as applied to academic writing, suggests that communities of practice can assist learners to progress from initial contact with a new domain of interest through to competence. The implications for research training include the suggestion that supervisors as potentially crucial supporters of HDR student writing for publication should themselves be active publishers. Also, Faculty or university sponsorship of communities of practice focussed on HDR student writing for publication could provide effective support for the development of HDR student writing expertise and potentially increase the number of their peer-reviewed publications.

An investigation of the impacts of Excellence in Research for Australia : a case study on accounting for research

This is the first study to explore the way Excellence in Research for Australia (ERA), a research assessment exercise introduced in the Australian higher education sector in 2010, fostered the development of strategically oriented Management Accounting technologies in the form of Performance Management Systems (PMS) to achieve research excellence within an Australian university. It identifies ERA's intended and unintended consequences. While ERA enabled the creation of tighter controls in the PMS of faculties, departments and individual academics within the university, enhancing its reported research performance, the impact on academics was low job satisfaction, increased workload and a higher focus on research than teaching.

Academic honors and performance

Despite the social importance of awards, they have been largely disregarded by academic research in economics. This paper investigates whether receiving prestigious academic awards—the John Bates Clark Medal and the Fellowship of the Econometric Society—is associated with higher subsequent research productivity and status compared to a synthetic control group of non-recipient scholars with similar previous research performance. Our results suggest statistically significant positive publication and citation differences after award receipt.

A network DEA quantity and quality-orientated production model: An application to Australian university research services

The motivation for this analysis is the recently developed Excellence in Research for Australia (ERA) program developed to assess the quality of research in Australia. The objective is to develop an appropriate empirical model that better represents the underlying production of higher education research. In general, past studies on university research performance have used standard DEA models with some quantifiable research outputs. However, these suffer from the twin maladies of an inappropriate production specification and a lack of consideration of the quality of output. By including the qualitative attributes of peer-reviewed journals, we develop a procedure that captures both quality and quantity, and apply it using a network DEA model. Our main finding is that standard DEA models tend to overstate the research efficiency of most Australian universities.

Faculty mentoring, evidence-based assessment, and student learning : an Australian exploration of American initiatives

There have been many improvements in Australian engineering education since the 1990s. However, given the recent drive for assuring the achievement of identified academic standards, more progress needs to be made, particularly in the area of evidence-based assessment. This paper reports on initiatives gathered from the literature and engineering academics in the USA, through an Australian National Teaching Fellowship program. The program aims to establish a process to help academics in designing and implementing evidence-based assessments that meet the needs of not only students and the staff that teach them, but also industry as well as accreditation bodies. The paper also examines the kinds and levels of support necessary for engineering academics, especially early career ones, to help meet the expectations of the current drive for assured quality and standards of both research and teaching. Academics are experiencing competing demands on their time and energy with very high expectations in research performance and increased teaching responsibilities, although many are researchers who have not had much pedagogic training. Based on the literature and investigation of relevant initiatives in the USA, we conducted interviews with several identified experts and change agents who have wrought effective academic cultural change within their institutions and beyond. These reveal that assuring the standards and quality of student learning outcomes through evidence-based assessments cannot be appropriately addressed without also addressing the issue of pedagogic training for academic staff. To be sustainable, such training needs to be complemented by a culture of on-going mentoring support from senior academics, formalised through the university administration, so that mentors are afforded resources, time, and appropriate recognition.