A discussion of the research performance evaluation in building and construction management discipline : the journal impact factors and SCI-index journals

The trend of diminished funding, demands for greater efficiency and higher public accountability have led to a rapid expansion of interest in the bibliometric assessment of research performance of universities. A pilot research is conducted to provide a preliminary overview of the research performance of the building and construction schools or departments through the analysis of bibliometric indicators including the journal impact factor (JIF) published by Institute for Scientific Information (ISI). The suitability of bibliometric evaluation approaches as a measure of research quality in building and construction management research field is discussed.

Efficiency of research performance of Australian universities : a reappraisal using a bootstrap truncated regression approach

The motivation of the study stems from the results reported in the Excellence in Research for Australia (ERA) 2010 report. The report showed that only 12 universities performed research at or above international standards, of which, the Group of Eight (G8) universities filled the top eight spots. While performance of universities was based on number of research outputs, total amount of research income and other quantitative indicators, the measure of efficiency or productivity was not considered. The objectives of this paper are twofold. First, to provide a review of the research performance of 37 Australian universities using the data envelopment analysis (DEA) bootstrap approach of Simar and Wilson (2007). Second, to determine sources of productivity drivers by regressing the efficiency scores against a set of environmental variables.

Enhancing Chinese TEFL academics' research performance : necessity and urgency

China’s increasing participation in world affairs and the growing popularity of English as a lingua franca have made significant impact on Chinese society, culture and education. As such, considerable research topics in relation to English require TEFL researchers’ attentions. Additionally, higher education reform in China has created higher demand on academics by stressing research as an important element in academics’ assessment. Recurrent rhetoric in the field of TEFL also calls on practitioners to theorise their practice. All these practical needs and theoretical arguments point to the necessity and significance of TEFL academics’ engagement in research. To find out whether Chinese TEFL academics’ research meet the new demand on them, a survey of TEFL academics at three Chinese higher institutions was conducted. One hundred eighty two of them provided valid responses which were analysed using SPSS. It was found that TEFL academics’ research productivity in each category of research products was quite low. Large percentages of them did not produce any item in the investigated categories of research. They were least productive in conference papers and research products at the national level. However for these least productive categories, there were highly-productive TEFL academics. The categories of research where the TEFL academics were found relatively productive were non-core journal articles and provincial projects. The findings suggest that it is necessary and urgent for Chinese TEFL academics to enhance their research productivity to be able to meet the demand that new era has rendered.

Reviews: 'The 19th Step' research performance [Performance review]

Review of 'The 19th Step' Research Performance, which took place on 12th April 2008, at the Studio Theatre, Laban, London.

Marketing research performance and strategy

Purpose - To investigate whether strategic orientation affects the evaluation of specific market research projects in for-profit firms.
Design/methodology/approach - A small-scale follow-up survey was conducted, building on qualitative and quantitative research among a sample of the top-1,000 marketing managers in Australia. The study used an existing market research evaluation tool, the USER scale and items generated from the qualitative research, to investigate the firm's most recent market research project.
Findings - Four market research performance factors were identified - market research as a knowledge enhancing (KE) function, the internal political use of market research, the misuse of market research and the generation of market understanding. The Miles and Snow strategy types were related to these factors, with Prospector types more likely to use market research rationally and less likely to use it for internal political purposes. Tactical projects were more likely to be misused than were those with a strategic orientation. Prospectors were far less likely and analysers far more likely to misuse tactical research projects. Prospectors were more often satisfied with the performance of their most recent market research. The Porter typology was less successful in predicting market research performance.
Research limitations/implications - The study was based on a small sample of market research projects in Australian for-profit firms. Future studies need to study these phenomena more intensively using ethnographic methods and more extensively using larger multi-country samples.
Practical implications - Market research suppliers should learn the nature of their client's strategic intent to improve their effectiveness. Defender firms should carefully monitor the use of market research, especially that of a tactical nature, which may be wasted or misused.
Originality/value - Contributes to an understanding of how strategic orientation relates to the ways market research information is used within the firm.

Gender differences in publication output: towards an unbiased metric of research performance

We examined the publication records of a cohort of 168 life scientists in the field of ecology and evolutionary biology to assess gender differences in research performance. Clear discrepancies in publication rate between men and women appear very early in their careers and this has consequences for the subsequent citation of their work. We show that a recently proposed index designed to rank scientists fairly is in fact strongly biased against female researchers, and advocate a modified index to assess men and women on a more equitable basis.

An insight into research performance through a citation counting analysis

Prior studies on academic performance predominantly concentrated on ranking universities and geographical regions using publications in selected journals. Despite general agreement on journal rankings based on the number of citations, no extant articles analyze universities or countries on the basis of citations from publications in leading hospitality and tourism journals. This paper examined the number of citations that published articles from six leading journals in hospitality and tourism received during the 10-year period from 1996 to 2005. The affiliated universities, countries/regions, and geographical continents were then ranked to determine their level of academic performance. This paper provides an alternative insight into academic performance of research universities and countries.© 2014 The Authors.

ADSA Performance as Research Guidelines

The relationships between performance, research and scholarship in drama, theatre and performance studies have been of critical importance to ADSA and its members for more than two decades now. The ADSA Performance as Research Guidelines offer a comprehensive articulation of policies, approaches, practices, and issues impacting on the production of performance as research, particularly advise on producing performance as research in Australia, New Zealand and the Pacific.

The downside of relying on research outputs to assess business faculty performance : comments from down under regarding facilitating and creating synergies between teaching and research : the role of the academic administrator

This commentary presents an Australian perspective on Balkin and Mello’s “Facilitating and Creating Synergies between Teaching and Research: The Role of the Academic Administrator.” It addresses one particularly important aspect of the separation of teaching and research in business schools; namely, the increasing dominance of discipline-based research output measures in overall business faculty performance, coupled with a reliance on journal rankings as de facto quality measures for research output. Some possible alternate approaches to research performance/impact measurement in our rapidly changing academic environment are also considered.

Performance tiers: Implementing comparative effectiveness analysis in the health care setting through operations research and spatial methods

This dissertation develops and tests a comparative effectiveness methodology utilizing a novel approach to the application of Data Envelopment Analysis (DEA) in health studies. The concept of performance tiers (PerT) is introduced as terminology to express a relative risk class for individuals within a peer group and the PerT calculation is implemented with operations research (DEA) and spatial algorithms. The analysis results in the discrimination of the individual data observations into a relative risk classification by the DEA-PerT methodology. The performance of two distance measures, kNN (k-nearest neighbor) and Mahalanobis, was subsequently tested to classify new entrants into the appropriate tier. The methods were applied to subject data for the 14 year old cohort in the Project HeartBeat! study.^ The concepts presented herein represent a paradigm shift in the potential for public health applications to identify and respond to individual health status. The resultant classification scheme provides descriptive, and potentially prescriptive, guidance to assess and implement treatments and strategies to improve the delivery and performance of health systems. ^

deepBlue early research

A video of an early deepBlue performance at The Block, Queensland University of Technology, Creative Industries Faulty, 2006

Research productivity levels of Chinese TEFL academics

Since China’s Economic Reform and its Open Door Policy, China has entered a new era of education (Adamson, 2002; Hu, 2005a). English has gained status as a language for international relations (Graddol, 1997) and international trade (Qu, 2007). Hence, in 2001, China’s Ministry of Education (MOE) required universities to offer 5-10% of their course units in English, particularly in the fields of information technology, biotechnology, finance and law (Jen, 2001; MOE, 2001). However, “the upgrading of national English proficiency, then, is predicted largely on the professional competence of the teaching force” (Hu, 2005b, p. 655). For TEFL academics, one component of this competence is the capacity to conduct research (Day, 1991; Shu, 2002). Indeed, research productivity has become essential for university success, and academics’ employment and promotional prospects. This study aims to investigate 182 Chinese TEFL academics’ research outputs across three Chinese higher education institutions through the research question: What are the research productivity levels of Chinese TEFL academics? A survey instrument was devised to gather TEFL academics’ calculations of research productivity and, in particular, the quality and quantity of research outputs over a five-year period (2004-2008). Descriptive statistics through SPSS were used to analyse data across research output fields (e.g., journal articles, conference papers). Academic status varied (n=182; teaching assistants 23.6%, lecturers 47.3%, associate professors 22.5%, and professors 6.6%) as did years of teaching (1-5 years 27.4%, 6-10 years 24.7%, 11-15 18.1%, 16-20 years 13.7%, > 21 years 15.9%). Results (n=182, male=27%, females=73%) indicated 18% had not produced any research in the five-year period. Indeed, more than 70% had produced no research in all categories except non-core journal articles and provincial projects. An overwhelming majority of TEFL academics had zero productivity in 10 of the 12 categories. Nevertheless, there were highly-productive TEFL academics, who had produced five or more pieces of research across the 12 categories. In addition, there was not much difference between sole and co-authored research outputs, except non-core journal articles where sole authored work was 20% higher than co-authored work. China’s desire for international competitiveness in education will require measures that facilitate higher levels of research productivity. These measures must include professional development, support and mentoring programs, and employment of personnel who can guide these processes. Research performance is an outcome, hence there is a need to understand Chinese TEFL academics’ perceptions about research, and experiences that may hinder and facilitate higher research productivity.

Coordinated research skills training at QUT

Universities are wanting to drive research performance to new levels to increase competitiveness and secure additional research funding. Information technology departments, libraries and research offices are being tasked with the triple role of developing infrastructure, introducing new services, and raising researchers’ awareness and skill levels in the uptake of these services and related eResearch concepts in order to achieve institutional goals. The purpose of this poster is to provide an overview of the coordinated approach to the provision of research skills workshops and seminars provided to researchers and higher degree research (HDR) students at QUT. Seminars and workshops are provided by the Library in collaboration with High Performance Computing and Research Support (HPC) and the Research Students Centre. The sessions are findable and bookable via the Library’s KickStart system. A list of session topics is provided. The Research Support services web site brings together information on a range of research support services provided by the Library and HPC. Seminars and workshops are also available via a research training calendar system into which all sessions are populated, regardless of the provider. The Library and HPC are also undertaking a train the trainer program.