Student feedback systems in higher education: a focused literature review and environmental scan

In recent times, higher education institutions have paid increasing attention to the views of students to obtain feedback on their experience of learning and teaching through internal surveys. This article reviews research in the field and reports on practices in other Australian universities. Findings demonstrate that while student feedback is valued and used by all Australian universities, survey practices are idiosyncratic and in the majority of cases, questionnaires lack validity and reliability; data are used inadequately or inappropriately; and they offer limited potential for cross-sector benchmarking. The study confirms the need for institutions to develop an overarching framework for evaluation in which a valid, reliable, multidimensional and useful student feedback survey constitutes just one part. Given external expectations and internal requirements to collect feedback from students on their experience of learning and teaching, the pursuit of sound evaluation practices will continue to be of interest at local, national and international levels.

PMI Research and Education Conference 2010

The PMI Research and Education Conference 2010 ended one week ago at the time of this writing. Aside from 3 enlightening keynote speeches, 78 proffered papers were presented. On the basis of the reviewers' assessments, the 10 best papers have been selected to form this special issue...

Making sense of mass education

Making Sense of Mass Education provides a comprehensive analysis of the field of mass education. The book presents new assessment of traditional issues associated with education – class, race, gender, discrimination and equity –to dispel myths and assumptions about the classroom. It examines the complex relationship between the media, popular culture and schooling, and places the expectations surrounding the modern teacher within ethical, legal and historical contexts. The book blurs some of the disciplinary boundaries within the field of education, drawing upon sociology, cultural studies, history, philosophy, ethics and jurisprudence to provide stronger analyses. The book reframes the sociology of education as a complex mosaic of cultural practices, forces and innovations. Engaging and contemporary, it is an invaluable resource for teacher education students, and anyone interested in a better understanding of mass education.

Finding your research voice : the application of bibliometrics as an analytic literature tool on the pedagogic field of higher education

This paper documents the use of bibliometrics as a methodology to bring forth a structured, systematic and rigorous way to analyse and evaluate a range of literature. When starting out and reading broadly for my doctoral studies, one article by Trigwell and Prosser (1996b) led me to reflect about my level of comprehension as the content, concepts and methodology did not resonate with my epistemology. A disconnection between our paradigms emerged. Further reading unveiled the work by Doyle (1987) who categorised research in teaching and teacher education by three main areas: teacher characteristics, methods research and teacher behaviour. My growing concerns that there were gaps in the knowledge also exposed the difficulties in documenting said gaps. As an early researcher who required support to locate myself in the field and to find my research voice, I identified bibliometrics (Budd, 1988; Yeoh & Kaur, 2007) as an appropriate methodology to add value and rigour in three ways. Firstly, the application of bibliometrics to analyse articles is systematic, builds a picture from the characteristics of the literature, and offers a way to elicit themes within the categories. Secondly, by systematic analysis there is occasion to identify gaps within the body of work, limitations in methodology or areas in need of further research. Finally, extension and adaptation of the bibliometrics methodology, beyond citation or content analysis, to investigate the merit of methodology, participants and instruments as a determinant for research worth allowed the researcher to build confidence and contribute new knowledge to the field. Therefore, this paper frames research in the pedagogic field of Higher Education through teacher characteristics, methods research and teacher behaviour, visually represents the literature analysis and locates my research self within methods research. Through my research voice I will present the bibliometrics methodology, the outcomes and document the landscape of pedagogy in the field of Higher Education.

Evaluation of the quality of diverse teaching practice in higher education research methods

The purpose of this paper is to report on a methods research project investigating the evaluation of diverse teaching practice in Higher Education. The research method is a single site case study of an Australian university with data collected through published documents, surveys, interviews and focus groups. This project provides evidence of the wide variety of evaluation practice and diverse teaching practice across the university. This breadth identifies the need for greater flexibility of evaluation processes, tools and support to assist teaching staff to evaluate their diverse teaching practice. The employment opportunities for academics benchmark the university nationally and position the case study in the field. Finally this reaffirms the institutional responsibility for services to support teaching staff in an ongoing manner.

Cultural factors affecting tertiary education access for Bundjalung men

Despite documented changes to mainstream educational systems, Indigenous educational achievements are still at critically low levels across all phases of formal education. According to the Australian Bureau of Statistics (2011) Indigenous students are still less likely than non-Indigenous students to complete their final years of schooling (45% compared with 77% in 2009); tertiary level entry and outcomes are also significantly lower than non-Indigenous entry and outcomes. Although significant research has focused on the area of Indigenous education, in particular, identifying and making recommendations on how to close educational gaps between Indigenous and non-Indigenous people, these studies have failed to bring about the change needed and to engage successfully with Indigenous communities and draw on Indigenous communities’ insights for best practice. This thesis focuses on Indigenous perspectives and takes a closer look at the cultural factors that impact on tertiary education access for Indigenous young men who come from a Bundjalung community on the far north coast of northern New South Wales. To date, this community has not been the focus of serious postgraduate study. Their experiences and the values and ideas of their community have not been investigated. To do this, the study uses an Indigenous methodological framework. It draws on Indigenous Standpoint Theory to analyse data through concepts of the cultural interface and tensions (Nakata, 2007, pp. 195-217). The study’s framing also draws on decolonising methods (Porsanger, 2004; Smith, 1999) and Indigenist research methods (Rigney, 1997). Such methodologies are intended to benefit both the research participants (community members) and the researcher. In doing so, the study draws on Creswell’s (2008) methods of restorying and retelling to analyse the participants’ interviews and yarns about their lives and experiences relating to tertiary educational access. The research process occurred in multiple stages: (1) selection of research sites, (2) granting of access which was requested through consultation with local Aboriginal Elders and through the local Aboriginal Lands Council, (3) conducting of interviews with participants/ data collection, (4) analysis of data, (5) documentation of findings, (6) theory development, and (7) reporting back to the nominated Indigenous community on the progress and findings of the research. The benefits of this research are numerous. First, this study addresses an issue that has been identified from within the local Aboriginal community as an issue of high precedence, looking at the cultural factors surrounding the underrepresentation of Indigenous people accessing tertiary education. This is not only of local significance but has been identified in the literature as a local, national and international area of concern amongst Indigenous peoples (Department of Economic and Social Affairs, 2009; Herbert, 2010; King, 2011). Secondly, the study draws on local Indigenous knowledges and learning processes from within a Bundjalung community to gain inside perspectives, namely the cultural factors that are being expressed from a range of Indigenous community members – young men, community Elders and community members – and finding out what they perceive inhibit and/or promote tertiary education participation within their community. Such perspectives are rarely heard. Finally, recommendations made from this study are aimed at revealing investigative styles that may be utilised by Western institutions to improve access for Indigenous young men living in the Narlumdarlum1 region in the tertiary context.

The pedagogical balancing act : teaching reflection in higher education

Despite the common use of the term reflection in higher education assessment tasks, learners are not often taught how to communicate their disciplinary knowledge through reflection. This paper argues that students can and should be taught how to reflect in deep and transformative ways. It highlights the reflexive pedagogical balancing act of attending to different levels of reflection as a way to stimulate focused, thoughtful and reasoned reflections that show evidence of new ways of thinking and doing. The paper uses data from a current project to illustrate the effects of focusing on particular levels of reflection in the pedagogical strategies used, and argues that while the goal of academic or professional reflection is generally to move students to the highest level of reflection to transform their learning/practice, unless higher education teachers attend to every level of reflection, there are specific, observable gaps in the reflections that students produce.

Behavioural beliefs concerning gender and high-risk sexual behaviours in the context of HIV/AIDS in PNG : views from within teacher education

Education is often viewed as a key approach to address sexual-health issues; the current concern is the burgeoning HIV/AIDS epidemic. This ethnographic study investigates the gender practices associated with high-risk sexual behaviour in Papua New Guinea as viewed by educators there. A number of practices, including gender inequality and associated sexual behaviours have been highlighted by male and female participants as escalating PNG’s HIV/AIDS epidemic. The study finds that although participants were well-informed concerning HIV/AIDS, they had varying beliefs concerning the prevailing gender/sexual issues involved in escalating highrisk behaviour and how to address the problem. The study further examines the behavioural beliefs and intentions of the educators themselves. Subsequently, within the data a number of underpinning factors, pertaining to gender, education and life experience, were found to be related to the behaviour beliefs and intentions of participants towards embracing change with regard to behaviours associated with gender equality in PNG. These factors appeared to encourage participants to adopt healthier gender and sexual behavioural intentions and, arguably, could provide the basis for ways to help address the gender inequality and high-risk behaviours associated with HIV/AIDS in PNG.

Factors affecting the motivation of TEFL academics in higher education in China

This study investigates the motivation of English language lecturers in a Chinese university. Recent studies have shown that low morale and job dissatisfaction are significant problems identified in lecturers who teach English in universities in China. Given the importance of teaching English as a second language in China, this problem has potentially significant ramifications for the nation’s future. Low staff morale is likely to be associated with less effective teaching and poor student learning outcomes. Although the problem is acknowledged, there has been limited research to understand the underlying contributing factors. To address this, a sequential explanatory mixed methods approach was adopted and implemented in two phases at a large regional university in Northern China. The participants in the main study were 100 lecturers from two colleges at this university. All of the lecturers were responsible for teaching English as a foreign language (TEFL); 50 were teaching English majors and 50 were teaching university students whose majors were not English. The research was informed by a synthesis of self determination theory and theories of organisational culture. The study found: 1) in contrast to previously reported studies, lecturers in this institution were in general autonomously motivated in teaching. 2) However, their level of motivation was influenced by their personal experiences and varied sense of competence, relatedness and autonomy. 3) In particular, personal experiences and contextual factors such as the influence of Chinese culture, societal context, and organisational climate were significant in regulating lecturers’ motivation to teach. The findings are significant for leaders in higher education who need to implement policies that foster effective work environments. The study has also provided insights into the capacity of self determination theory to explain motivation in a Chinese culture.

Ecological footprinting : its potential as a tool for change in preservice teacher education

Environmental and sustainability issues pose challenges for society. Although education is seen as being a contributor to addressing sustainability, teacher education has been slow to act in preparing future teachers to teach sustainability. Recent Australian curriculum documents nominate sustainability as one of three cross-curriculum priorities. In one Australian university course, an Ecological Footprint Calculator tool has been employed to challenge preservice early childhood teachers to consider the sustainability of their lifestyles as a means for engaging them in learning and teaching for sustainability. Students enrolled in an integrated arts and humanities subject voluntarily engaged with the online calculator and shared their findings on an electronic discussion forum. These postings then became the basis of qualitative analysis and discussion. Data categories included reactions and reflections on reasons for the ‘heaviness’ of their footprints , student reactions leading to actions to reduce their footprints, reflections on the implications of the footprint results for future teaching, reactions that considered the need for societal change, and reflections on the integration of sustainability with the visual arts. The power of the tool’s application to stimulate interest in sustainability and education for sustainability more broadly in teacher education is explored.

What young children say about art : a comparative study

Given the opportunities, young children can be prolific in their productions of drawings and paintings. In the study reported in this paper, we had two questions about this. Why do young children draw and paint? And, what does this prolific activity do? We consider that particular ways of seeing art position children, and children use their artistic activities to position themselves, producing their identities. We interviewed a group of children in Hong Kong, aged between 4 and 5 years, (n=27), and a group of children in Brisbane, Australia, who were of similar ages (n=15). The cross-cultural dimension added another dimension to our thinking and conversations around art and young children.

Success factors for ICT shared services in the higher education sector

Shared services is a prominent organizational arrangement for organizations, in particular for support functions. The success (or failure) of shared services is a critical concern as the move to shared services can entail large scale investment and involve fundamental organizational change. The Higher Education (HE) sector is particularly well poised to benefit from shared services as there is a need to improve organizational performance and strong potential from sharing. Through a multiple case study of shared services experiences in HE, this study identifies ten important antecedents of shared services success: (1) Understanding of shared services; (2) Organizational environment; (3) Top management support; (4) IT environment; (5) Governance; (6) Process centric view; (7) Implementation strategy; (8) Project management; (9) Change management; and (10) Communication. The study then develops a preliminary model of shared services success that addresses the interdependencies between the success factors. As the first empirical success model for shared services, it provides valuable guidance to practice and future research.

Problem-based learning : does accounting education need it?

Problem-based learning (PBL) has been used successfully in disciplines such as medicine, nursing, law and engineering. However a review of the literature shows that there has been little use of this approach to learning in accounting. This paper extends the research in accounting education by reporting the findings of a case study of the development and implementation of PBL at the Queensland University of Technology (QUT) in a new Accountancy Capstone unit that began in 2006. The fundamentals of the PBL approach were adhered to. However, one of the essential elements of the approach adopted was to highlight the importance of questioning as a means of gathering the necessary information upon which decisions are made. This approach can be contrasted with the typical ‘give all the facts’ case studies that are commonly used. Another feature was that students worked together in the same group for an entire semester (similar to how teams in the workplace operate) so there was an intended focus on teamwork in solving unstructured, real-world accounting problems presented to students. Based on quantitative and qualitative data collected from student questionnaires over seven semesters, it was found that students perceived PBL to be effective, especially in terms of developing the skills of questioning, teamwork, and problem solving. The effectiveness of questioning is very important as this is a skill that is rarely the focus of development in accounting education. The successful implementation of PBL in accounting through ‘learning by doing’ could be the catalyst for change to bring about better learning outcomes for accounting graduates.

The impact of a model of nurse education to improve knowledge and recognition of delirium in older persons by registered nurses

Introduction: Delirium is a serious issue associated with high morbidity and mortality in older hospitalised people. Early recognition enables diagnosis and treatment of underlying cause/s, which can lead to improved patient outcomes. However, research shows knowledge and accurate nurse recognition of delirium and is poor and lack of education appears to be a key issue related to this problem. Thus, the purpose of this randomised controlled trial (RCT) was to evaluate, in a sample of registered nurses, the usability and effectiveness of a web-based learning site, designed using constructivist learning principles, to improve acute care nurse knowledge and recognition of delirium. Prior to undertaking the RCT preliminary phases involving; validation of vignettes, video-taping five of the validated vignettes, website development and pilot testing were completed. Methods: The cluster RCT involved consenting registered nurse participants (N = 175) from twelve clinical areas within three acute health care facilities in Queensland, Australia. Data were collected through a variety of measures and instruments. Primary outcomes were improved ability of nurses to recognise delirium using written validated vignettes and improved knowledge of delirium using a delirium knowledge questionnaire. The secondary outcomes were aimed at determining nurse satisfaction and usability of the website. Primary outcome measures were taken at baseline (T1), directly after the intervention (T2) and two months later (T3). The secondary outcomes were measured at T2 by participants in the intervention group. Following baseline data collection remaining participants were assigned to either the intervention (n=75) or control (n=72) group. Participants in the intervention group were given access to the learning intervention while the control group continued to work in their clinical area and at that time, did not receive access to the learning intervention. Data from the primary outcome measures were examined in mixed model analyses. Results: Overall, the effect of the online learning intervention over time comparing the intervention group and the control group were positive. The intervention groups‘ scores were higher and the change over time results were statistically significant [T3 and T1 (t=3.78 p=<0.001) and T2 and T1 baseline (t=5.83 p=<0.001)]. Statistically significant improvements were also seen for delirium recognition when comparing T2 and T1 results (t=2.58 p=0.012) between the control and intervention group but not for changes in delirium recognition scores between the two groups from T3 and T1 (t=1.80 p=0.074). The majority of the participants rated the website highly on the visual, functional and content elements. Additionally, nearly 80% of the participants liked the overall website features and there were self-reported improvements in delirium knowledge and recognition by the registered nurses in the intervention group. Discussion: Findings from this study support the concept that online learning is an effective and satisfying method of information delivery. Embedded within a constructivist learning environment the site produced a high level of satisfaction and usability for the registered nurse end-users. Additionally, the results showed that the website significantly improved delirium knowledge & recognition scores and the improvement in delirium knowledge was retained at a two month follow-up. Given the strong effect of the intervention the online delirium intervention should be utilised as a way of providing information to registered nurses. It is envisaged that this knowledge would lead to improved recognition of delirium as well as improvement in patient outcomes however; translation of this knowledge attainment into clinical practice was outside the scope of this study. A critical next step is demonstrating the effect of the intervention in changing clinical behaviour, and improving patient health outcomes.