An investigation of the impacts of Excellence in Research for Australia : a case study on accounting for research

This is the first study to explore the way Excellence in Research for Australia (ERA), a research assessment exercise introduced in the Australian higher education sector in 2010, fostered the development of strategically oriented Management Accounting technologies in the form of Performance Management Systems (PMS) to achieve research excellence within an Australian university. It identifies ERA's intended and unintended consequences. While ERA enabled the creation of tighter controls in the PMS of faculties, departments and individual academics within the university, enhancing its reported research performance, the impact on academics was low job satisfaction, increased workload and a higher focus on research than teaching.

A new era for research education in Australia?

Use of the Australian research assessment exercise, Excellence in Research for Australia (ERA) to influence the policy and practice of research education in Australia will undoubtedly have many consequences, some of them unintended and potentially deleterious. ERA is a retrospective measure of research quality; research education is prospective.

An analysis of digital storytelling as a documentation tool for research in the creative and performing arts

This paper examines the capacity of digital storytelling to document research activity in the creative and performing arts. In particular, it seeks to identify the thought processes and methods that underpin this research and to capture them using the digital storytelling medium. Interest in this issue was prompted by the author’s work with the creative and performing artists from the Queensland Conservatorium and the Queensland College of Art as part of the Federal government’s Research Quality Framework (RQF) in 2007. The RQF compelled artists to address what it means to undertake research in their disciplines, to describe this, measure it and quantify it; for many practitioners this represents a significant challenge. These issues continue to be pertinent in the context of the Excellence in Research for Australia (ERA) initiative. This research is significant because it seeks to identify, in layman’s terms, the research methods and thought processes used by artists in their research practice. It seeks to do so free of the encumbrances of the professional doctorate policies, the higher education research quality frameworks, and the dense philosophical debates that have to-date dominated discussions of this issue. The research involves qualitative data collection methods including a detailed literature review, interviews with key practitioners and academics involved in the creative and performing arts, and three case studies. The literature review focuses on publications that explore issues of research practice and method in the creative and performing arts. The case studies involve three Queensland-based artists. Digital stories will be developed (and presented) with Marcus and Mafe using their visual materials and drawing on the issues identified in the literature review and interviews. Emmerson’s DVD provided a point of comparison with the digital stories. (Brief bios are attached)

Defining educational research : a perspective of/on presidential addresses and the Australian Association for Research in Education

This paper is concerned with the definition of the field of educational research and the changing and developing role of the Australian Association for Research in Education (AARE) in representing and constituting this field. The evidence for the argument is derived from AARE Presidential Addresses across its 40-year history. The paper documents the enhanced complexity and diversity of the field over these 40 years, including the emergence of a global educational policy field, theoretical and methodological developments in the social sciences and new research accountabilities such as the Excellence in Research for Australia (ERA) measure. Specifically, the paper suggests that the evidence-based movement in public management and education policy, and the introduction of the ERA, potentially limit and redefine the field of educational research, reducing the usefulness and relevance of educational research to policy makers and practitioners. This arises from a failure to recognise that Education is both a field of research and a field of policy and practice. Located against both developments, the paper argues for a principled eclecticism framed by a reassessment of quality, which can be applied to the huge variety of methodologies, theories, epistemologies and topics legitimately utilised and addressed within the field of educational research. At the same time, the paper argues the need to globalise the educational research imagination and deparochialise educational research. This call is located within a broader argument suggesting the need for a new social imaginary (in a post-neoliberal context of the global financial crisis) to frame educational policy and practice and the contribution that educational theory and research might make to its constitution. In relation to this, the paper considers the difficulties that political representations of such a new imaginary might entail for the President and the Association, given the variety of its membership and huge diversity of its research interests.

Utility as a first principle for education research : reworking autonomy in Australian higher education

The focus of this paper is on the community impact of education research, as conceived specifically within a changing context of research assessment in Australia, first mooted by the previous Federal Coalition (conservative) Government within a new Research Quality Framework (RQF), and now to be reworked by the Excellence in Research for Australia (ERA) initiated by the incoming Federal Labour (progressive) Government. Convinced that a penchant for the utility of research will not go away, irrespective of the political orientations of government, our interest is in exploring: the assumption that research, particularly in areas such as education, should have an impact in the community (as this was first defined within the RQF); the difficulties much education research (despite its “applied” characterisation) has in complying with this ideal; and what a community impact requirement means for the kinds of education research that will be privileged in the future. In particular, we are concerned about the potential narrowing of education research directed at or by community impact and what is lost in the process. One potential loss or weakening is in the positional autonomy of higher education to conduct independent education research.

Is journalism best located in the creative arts or as a communication discipline?

This paper considers the implications of journalism research being located within the Field of Research associated with the creative arts and writing in the recent Excellence in Research for Australia (ERA) evaluations. While noting that this classification does capture a significant trajectory in Australian journalism research, it also points to some anomalous implications of understanding journalism as an arts discipline, given its historical co-location in universities with communications disciplines, and the mutually reinforcing relationships between the two fields.

Efficiency of research performance of Australian universities : a reappraisal using a bootstrap truncated regression approach

The motivation of the study stems from the results reported in the Excellence in Research for Australia (ERA) 2010 report. The report showed that only 12 universities performed research at or above international standards, of which, the Group of Eight (G8) universities filled the top eight spots. While performance of universities was based on number of research outputs, total amount of research income and other quantitative indicators, the measure of efficiency or productivity was not considered. The objectives of this paper are twofold. First, to provide a review of the research performance of 37 Australian universities using the data envelopment analysis (DEA) bootstrap approach of Simar and Wilson (2007). Second, to determine sources of productivity drivers by regressing the efficiency scores against a set of environmental variables.

A network DEA quantity and quality-orientated production model: An application to Australian university research services

The motivation for this analysis is the recently developed Excellence in Research for Australia (ERA) program developed to assess the quality of research in Australia. The objective is to develop an appropriate empirical model that better represents the underlying production of higher education research. In general, past studies on university research performance have used standard DEA models with some quantifiable research outputs. However, these suffer from the twin maladies of an inappropriate production specification and a lack of consideration of the quality of output. By including the qualitative attributes of peer-reviewed journals, we develop a procedure that captures both quality and quantity, and apply it using a network DEA model. Our main finding is that standard DEA models tend to overstate the research efficiency of most Australian universities.

Australian Library and Information Studies (LIS) researchers' ranking of LIS journals

The paper describes the processes and the outcomes of the ranking of LIS journal titles by Australia’s LIS researchers during 2007-8, firstly through the Australian federal government’s Research Quality Framework (RQF) process and then its replacement, the Excellence in Research for Australia (ERA) initiative. The requirement to rank the journals titles used came from discussions held at the RQF panel meeting held in February 2007 in Canberra, Australia. While it was recognised that the Web of Science (formerly ISI) journal impact approach of journal acceptance for measures of research quality and impact might not work for LIS, it was apparent that this model would be the default if no other ranking of journal titles became apparent. Although an increasing number of LIS and related discipline journals were appearing in the Web of Science listed rankings, the number was few and it was thus decided by the Australian LIS research community to undertake the ranking exercise.

Double blind : women as creative practice-led researchers

While the productive relationship between praxis and feminist research has been well established, the situation is more complicated for female artist/researchers in the fraught field of creative practice-led research. Firstly, their research is being conducted in the context of ongoing debate, as Andrea Phillips has summarized, over whether practice-led research has been embraced in order to potentially produce emancipatory knowledge, or whether it is simply the rationalization and quantification of creative processes. Secondly, there is a pervasive paradox whereby, rather than feeling empowered by the process of critical and reflective self-analysis, many women are inhibited by enduring insecurities about the value of their work and/or their ownership of it. The reasons for this appear to be twofold: they are disheartened by the ongoing disproportion of successful women artists, and they are intimidated by the fundamentally masculine discourse surrounding research in the university. Many of these anxieties appear to have been exacerbated by the research quality assessment process, the Excellence in Research for Australia Initiative (ERA). This collaborative paper draws on the authors' experiences as both artist-researchers and educators to contextualize this paradox and also discuss what forms of praxis intervention may be useful in the preparation for, and supervision of, creative practice-led research by women.

Editorial of "International Journal of Critical Indigenous Studies Volume 6, Number 2, 2013"

The International Journal of Critical Indigenous Studies (IJCIS) now complements the recently launched National Indigenous Research and Knowledges Network (NIRAKN) in its efforts to build Indigenous research capacity. In this context the journal provides a platform for the research of Indigenous postgraduates, early- to mid-career researchers, and senior scholars. Indigenous scholars are therefore encouraged to submit their articles to future editions of the IJCIS, an ‘Excellence in Research for Australia’ (ERA) ranked journal.

Does ERA spell the end to the era of IS methodological pluralism?

Methodological pluralism has been slowly developing in Information Systems. However, this development is fragile and only interpretivism has made any inroads into the major journals. Further, the form of interpretivism that has made inroads is informed by grounded theory and we suggest largely based on CAQDAS. We argue that the new Excellence in Research for Australia (ERA) initiative and other pressures to publish will stymie this budding but fragile methodological and research pluralism. The pressure to publish and the list of ranked journals will lead to greater conformity in methodology and in research areas and we conclude that pluralism will be under threat. We suggest some ways that journals and conference organisers may respond, to increase or maintain pluralism and how we will research pluralism further.