Finding your research voice : the application of bibliometrics as an analytic literature tool on the pedagogic field of higher education

This paper documents the use of bibliometrics as a methodology to bring forth a structured, systematic and rigorous way to analyse and evaluate a range of literature. When starting out and reading broadly for my doctoral studies, one article by Trigwell and Prosser (1996b) led me to reflect about my level of comprehension as the content, concepts and methodology did not resonate with my epistemology. A disconnection between our paradigms emerged. Further reading unveiled the work by Doyle (1987) who categorised research in teaching and teacher education by three main areas: teacher characteristics, methods research and teacher behaviour. My growing concerns that there were gaps in the knowledge also exposed the difficulties in documenting said gaps. As an early researcher who required support to locate myself in the field and to find my research voice, I identified bibliometrics (Budd, 1988; Yeoh & Kaur, 2007) as an appropriate methodology to add value and rigour in three ways. Firstly, the application of bibliometrics to analyse articles is systematic, builds a picture from the characteristics of the literature, and offers a way to elicit themes within the categories. Secondly, by systematic analysis there is occasion to identify gaps within the body of work, limitations in methodology or areas in need of further research. Finally, extension and adaptation of the bibliometrics methodology, beyond citation or content analysis, to investigate the merit of methodology, participants and instruments as a determinant for research worth allowed the researcher to build confidence and contribute new knowledge to the field. Therefore, this paper frames research in the pedagogic field of Higher Education through teacher characteristics, methods research and teacher behaviour, visually represents the literature analysis and locates my research self within methods research. Through my research voice I will present the bibliometrics methodology, the outcomes and document the landscape of pedagogy in the field of Higher Education.

Satisfiers and dissatisfiers for international students of higher education : an exploratory study in Australia

This paper explores the main satisfiers and dissatisfiers for international students in Australia’s higher educational sector. Using a critical incident technique, this study is conducted with international students of higher education in Australia. Four categories of satisfiers and dissatisfiers emerge from the data which are related to individual performance, quality of the educational service, socialisation, and living conditions.

Consumer guarantees and the supply of educational services by higher education providers

The higher education sector is undergoing a number of significant changes, the implications of which have yet to emerge. One such change is the increasing reliance by higher education providers on the revenue generated by full fee paying international students to fund their operating expenses. The report by the Victorian Ombudsman, Investigation into how Universities Deal with International Students ('Victorian Ombudsman's Report') tabled in the Victorian Parliament on 27 October 2011, provides evidence that Australian higher education providers may be failing to meet their legal obligations to international students. The Victorian Ombudsman's Report is the result of an investigation into four Victorian universities teaching international students with a focus on accounting and nursing schools. The report contains evidence that the universities were admitting students with scores below, or at the lower end of, the International English Language Testing System ('IELTS') score considered acceptable. Alternatively, they were relying upon their own language testing admission standards and not on an independent test like the IELTS test. While the universities provided English language support services for their international students after they had been admitted, the Ombudsman was concerned that the universities 'have not dedicated sufficient resources to meet the level of need amongst international students'.

New media and the transformation of higher education

One set of public institutions that has seen growing discussion about the transformative impact of new media technologies has been universities. The higher education sector, historically one of the more venerable and stable areas of public life, is now the subject of almost continuous speculation about whether it can continue in its current form during the 21st century. Digital media technologies are often seen as being at the forefront of such changes. It has been widely noted that moves towards a knowledge economy generates ‘skills-biased technological change’, that places a premium upon higher education qualifications, and that this earnings gap remains despite the continuing increase in the number of university graduates. As the demand for higher education continues to grow worldwide, there are new discussions about whether technologically-mediated education through new forms such as Massively Open Online Courses (MOOCs) are broadening access to quality learning, or severing the vital connection between teacher and student seen as integral to the learning process. This paper critically appraises such debates in the context of early 21st century higher education. It will discuss ten drivers of change in higher education, many of which are related to themes discussed elsewhere in this book, such as the impact of social media, globalization, and a knowledge economy. It will also consider the issues raised in navigating such developments from the perspective of the ‘Five P’s’: practical issues; personal issues; pedagogical issues; policy issues; and philosophical issues. It also includes a critical evaluation of MOOCs from the point of view of their educational qualities. It will conclude with the observation that while universities will continue to play a significant – and perhaps growing – role in the economy, society and culture, the issues raised about what Clayton Christensen and Henry Eyring term the ‘disruptive university’ (Christensen and Eyring 2011) are nonetheless pressing ones, and that cost and policy pressures in particular are likely to generate significant institutional transformations in higher education worldwide.

REFRAME: a new approach to evaluation in higher education

Evaluation practices in the higher education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology began a project, entitled REFRAME, to review its approach to evaluation, particularly the student survey system it had been using for the past five years. This presentation will outline the scholarly, evidence based methodology used to undertake institution-wide change, meet the needs of stakeholders suitable to the cultural needs of the institution. It is believed that this approach is broadly applicable to other institutions contemplating change with regard to evaluation of learning and teaching.

Educating for digital futures : what the learning strategies of digital content professionals can teach higher education

Beginning in the second half of the 20th century, ICTs transformed many societies from industrial societies in which manufacturing was the central focus, into knowledge societies in which dealing effectively with data and information has become a central element of work (Anderson, 2008). To meet the needs of the knowledge society, universities must reinvent their structures and processes, their curricula and pedagogic practices. In addition to this, of course higher education is itself subject to the sweeping influence of ICTs. But what might effective higher education look like in the 21st century? In designing higher education systems and learning experiences which are responsive to the learning needs of the future and exploit the possibilities offered by ICTs, we can learn much from the existing professional development strategies of people who are already successful in 21st century fields, such as digital media. In this study, I ask: (1) what are the learning challenges faced by digital media professionals in the 21st century? (2) what are the various roles of formal and informal education in their professional learning strategies at present? (3) how do they prefer to acquire needed capabilities? In-depth interviews were undertaken with successful Australian digital media professionals working in micro businesses and SMEs to answer these questions. The strongest thematic grouping that emerged from the interviews related to the need for continual learning and relearning because of the sheer rate of change in the digital media industries. Four dialectical relationships became apparent from the interviewees’ commentaries around the learning imperatives arising out of the immense and continual changes occurring in the digital content industries: (1) currency vs best practice (2) diversification vs specialisation of products and services (3) creative outputs vs commercial outcomes (4) more learning opportunities vs less opportunity to learn. These findings point to the importance of ‘learning how to learn’ as a 21st century capability. The interviewees were ambivalent about university courses as preparation for professional life in their fields. Higher education was described by several interviewees as having relatively little value-add beyond what one described as “really expensive credentialling services.” For all interviewees in this study, informal learning strategies were the preferred methods of acquiring the majority of knowledge and skills, both for ongoing and initial professional development. Informal learning has no ‘curriculum’ per se, and tends to be opportunistic, unstructured, pedagogically agile and far more self-directed than formal learning (Eraut, 2004). In an industry impacted by constant change, informal learning is clearly both essential and ubiquitous. Inspired by the professional development strategies of the digital media professionals in this study, I propose a 21st century model of the university as a broad, open learning ecology, which also includes industry, professionals, users, and university researchers. If created and managed appropriately, the university learning network becomes the conduit and knowledge integrator for the latest research and industry trends, which students and professionals alike can access as needed.

Realigning capital portfolios : international students' educational experiences in higher education

This paper reports on first year experiences of international students who use English as an additional language (EAL) in higher education in Australia. It examines how valued resources can foster a positive educational experience of these students from sociological perspectives. It draws data from an interview study, exploring narrative accounts of 17 EAL international students from nine countries about their educational relations and strategies across their first year of study. Their narratives were analysed through Bourdieu's concepts of field, habitus, capital and legitimation, as well as tools of narrative inquiry. The paper finds that the students took up strategies to realign their capital portfolios with new rules of the game. Their decisions were dependent on their personal trajectories and conditions on offer. This paper suggests that more effort needs to be made to understand international students' differentiated access to valued resources in higher education.

Possible, inevitable or fait accompli? An analysis of streaming video acquisition, acceptance and use in higher education

This paper explores the potential for online video as a mechanism to transform the ways students learn, as measured by research, user experience and usage following surveys and trials of patron-driven acquisition collaboratively undertaken by Queensland University of Technology, La Trobe University and Kanopy.

E-motion diaries : blogging emotional responses to online learning in higher education

Emotions are inherently social, and are central to learning, online interaction and literacy practices (Shen, Wang, & Shen, 2009). Demonstrating the dynamic sociality of literacy practice, we used e-motion diaries or web logs to explore the emotional states of pre-service high school teachers’ experiences of online learning activities. This is because the methods of communication used by university educators in online learning and writing environments play an important role in fulfilling students’ need for social interaction and inclusion (McInnerney & Roberts, 2004). Feelings of isolation and frustration are common emotions experienced by students in many online learning environments, and are associated with the success or failure of online interactions and learning (Su, et al., 2005). The purpose of the study was to answer the research question: What are the trajectories of pre-service teachers’ emotional states during online learning experiences? This is important because emotions are central to learning, and the current trend toward Massive Open Online Courses (MOOCs) needs research about students’ emotional connections in online learning environments (Kop, 2011). The project was conducted with a graduate class of 64 high school science pre-service teachers in Science Education Curriculum Studies in a large Australian university, including males and females from a variety of cultural backgrounds, aged 22-55 years. Online activities involved the students watching a series of streamed live lectures for the first 5 weeks providing a varied set of learning experiences, such as viewing science demonstrations (e.g., modeling the use of discrepant events). Each week, students provided feedback on learning by writing and posting an e-motion diary or web log about their emotional response. Students answered the question: What emotions did you experience during this learning experience? The descriptive data set included 284 online posts, with students contributing multiple entries. Linguistic appraisal theory, following Martin and White (2005), was used to regroup the 22 different discrete emotions reported by students into the six main affect groups – three positive and three negative: unhappiness/happiness, insecurity/security, and dissatisfaction/satisfaction. The findings demonstrated that the pre-service teachers’ emotional responses to the streamed lectures tended towards happiness, security, and satisfaction within the typology of affect groups – un/happiness, in/security, and dis/satisfaction. Fewer students reported that the streamed lectures triggered negative feelings of frustration, powerlessness, and inadequacy, and when this occurred, it often pertained to expectations of themselves in the forthcoming field experience in classrooms. Exceptions to this pattern of responses occurred in relation to the fifth streamed lecture presented in a non-interactive slideshow format that compressed a large amount of content. Many students responded to the content of the lecture rather than providing their emotional responses to this lecture, and one student felt “completely disengaged”. The social practice of online writing as blogs enabled the students to articulate their emotions. The findings primarily contribute new understanding about students' wide range of differing emotional states, both positive and negative, experienced in response to streamed live lectures and other learning activities in higher education external coursework. The is important because the majority of previous studies have focused on particular negative emotions, such as anxiety in test taking. The research also highlights the potentials of appraisal theory for studying human emotions in online learning and writing.

Developing a culture to support peer review of teaching in higher education

This presentation addresses issues related to leadership, academic development and scholarship of teaching and learning, and highlights research funded by the Australian Office of Learning and Teaching (OLT) designed to embed and sustain peer review of teaching within the culture of 5 Australian universities: Queensland University of Technology, University of Technology, Sydney, University of Adelaide, Curtin University, and Charles Darwin University. Peer review of teaching in higher education will be emphasised as a professional process for providing feedback on teaching and learning practice, which if sustained, can become an effective ongoing strategy for academic development (Barnard et al, 2011; Bell, 2005; Bolt and Atkinson, 2010; McGill & Beaty 2001, 1992; Kemmis & McTaggart, 2000). The research affirms that using developmental peer review models (Barnard et al, 2011; D'Andrea, 2002; Hammersley-Fletcher & Orsmond, 2004) can bring about successful implementation, especially when implemented within a distributive leadership framework (Spillane & Healey, 2010). The project’s aims and objectives were to develop leadership capacity and integrate peer review as a cultural practice in higher education. The research design was a two stage inquiry process over 2 years. The project began in July 2011 and encompassed a development and pilot phase followed by a cascade phase with questionnaire and focus group evaluation processes to support ongoing improvement and measures of outcome. Leadership development activities included locally delivered workshops complemented by the identification and support of champions. To optimise long term sustainability, the project was implemented through existing learning and teaching structures and processes within the respective partner universities. Research outcomes highlight the fundamentals of peer review of teaching and the broader contextual elements of integration, leadership and development, expressed as a conceptual model for embedding peer review of teaching within higher education. The research opens a communicative space about introduction of peer review that goes further than simply espousing its worth and introduction. The conceptual model highlights the importance of development of distributive leadership capacity, integration of policies and processes, and understanding the values, beliefs, assumptions and behaviors embedded in an organizational culture. The presentation overviews empirical findings that demonstrate progress to advance peer review requires an ‘across-the-board’ commitment to embed change, and inherently demands a process that co-creates connection across colleagues, discipline groups, and the university sector. Progress toward peer review of teaching as a cultural phenomenon can be achieved and has advantages for academic staff, scholarship, teaching evaluation and an organisation, if attention is given to strategies that influence the contexts and cultures of teaching practice. Peer review as a strategy to develop excellence in teaching is considered from a holistic perspective that by necessity encompasses all elements of an educational environment and has a focus on scholarship of teaching. The work is ongoing and has implication for policy, research, teaching development and student outcomes, and has potential application world-wide.

Leadership Enabling Effective Pedagogic Change in Higher Education

This chapter will consider pedagogic change in Higher Education from the perspective of an Assistant Dean (Teaching and Learning) and one member of their leadership team with particular focus on reflective writing in their courses. The discussion will focus on leadership for the development of teaching capability for reflective writing development and implications for quality assurance of teaching and learning across faculties of a leading comprehensive University. The authors will present and contrast the experiences and challenges of developing teaching approaches for reflective writing across the discipline of teacher education. The chapter will argue a position for the establishment of a framework of distributed leadership that supports effective pedagogical change management generally and with specific reference to reflective writing.

LeaD-In : a cultural change model for peer review of teaching in higher education

Peer review of teaching is recognized increasingly as one strategy for academic development even though historically peer review of teaching is often unsupported by policy, action and culture in many Australian universities. Higher education leaders report that academics generally do not engage with peer review of teaching in a systematic or constructive manner, and this paper advances and analyses a conceptual model to highlight conditions and strategies necessary for the implementation of sustainable peer review in higher education institutions. The model highlights leadership, development and implementation, which are critical to the success and formation of a culture of peer review of teaching. The work arises from collaborative research funded by the Office for Learning and Teaching to foster and advance a culture of peer review of teaching across several universities in Australia.

Illuminative evaluation as a method applied to Australian Government policy borrowing and implementation in higher education

Any government deciding to invoke widespread change in its higher education sector through implementation of new policies impacts on every institution and all staff and students, often in both the time taken up and the heightened emotions caused. The central phenomenon that this study addresses is the process and consequences of policy changes in higher education in Australia. The aim of this article is to record the research design through the perspective (evaluation research), theoretical framework (program evaluation) and methods (content analysis, descriptive statistical analysis and bibliometric analysis) applied to the investigation of the 2003 federal government higher education reform package. This approach allows both the intended and unintended consequences arising from the policy implementation of three national initiatives focused on learning and teaching in higher education in Australia to surface. As a result, this program evaluation, also known in some disciplines as policy implementation analysis, will demonstrate the applicability of illuminative evaluation as a methodology and reinforce how program evaluation will assist and advise future government reform and policy implementation, and will serve as a legacy for future evaluative research.Any government deciding to invoke widespread change in its higher education sector through implementation of new policies impacts on every institution and all staff and students, often in both the time taken up and the heightened emotions caused. The central phenomenon that this study addresses is the process and consequences of policy changes in higher education in Australia. The aim of this article is to record the research design through the perspective (evaluation research), theoretical framework (program evaluation) and methods (content analysis, descriptive statistical analysis and bibliometric analysis) applied to the investigation of the 2003 federal government higher education reform package. This approach allows both the intended and unintended consequences arising from the policy implementation of three national initiatives focused on learning and teaching in higher education in Australia to surface. As a result, this program evaluation, also known in some disciplines as policy implementation analysis, will demonstrate the applicability of illuminative evaluation as a methodology and reinforce how program evaluation will assist and advise future government reform and policy implementation, and will serve as a legacy for future evaluative research.

Moderation in higher education: Four discourses

Across the globe, higher education institutions are working in environments of increasing accountability with little sign of this trend abating. This heightened focus on accountability has placed greater demands on institutions to provide evidence of quality and the achievement of standards that assure that quality. Moderation is one quality assurance process that plays a central role in the teaching, learning and assessment cycle in higher education institutions. While there is a growing body of research globally on teaching, learning and , to a lesser degree, assessment in higher education, the process of moderation has received even less attention (Watty, Freeman, Howieson, Hancock, O'Connell, et al. 2013). Until recently, moderation processes in Australian universities have been typically located within individual institutions, with universities given the responsibility for developing their own specific policies and practices. However, in 2009 the Australian Government announced that an independent national quality and regulatory body for higher education institutions would be established. With the introduction of the Tertiary Education Quality Standards Authority (TEQSA), more formalised requirements for moderation of assessment are being mandated. In light of these reforms, the purpose of this qualitative study was to identify and investigate current moderation practices operating within one faculty, the Faculty of Education, in a large urban university in eastern Australia. The findings of this study revealed four discourses of moderation: equity, justification, community building and accountability. These discourses provide a starting point for academics to engage in substantive conversations around assessment and to further critique the processes of moderation.

Leadership to support quality improvement in Vietnamese higher education

The impetus for the study reported in this paper is the Higher Education (HE) reform agenda outlined by the Vietnamese Ministry of Education and Training (MOET). The paper reports on phase one of a mixed method research; a quantitative approach using the Multifactor Leadership Questionnaire (MLQ) to investigate the Vietnamese HE leaders’ leadership styles. The MLQ survey was administered to approximately 190 senior managers in State HE institutions in Mekong Delta region in Vietnam (nine of colleges). The psychometrics of the MLQ for the Vietnamese sample confirmed the reliability and validity of the instrument with a Cronbach’s alpha of 0.779. A CFA was conducted and all factor structures were stable and consistent. The demographic variables were used to analyse patterns of leadership behaviours by the different sub-groups. The findings suggest that leaders who have different educational background and different gender in Mekong Delta region, Vietnam do not differ significantly in their perceptions about leadership factors.