Student feedback systems in higher education: a focused literature review and environmental scan

In recent times, higher education institutions have paid increasing attention to the views of students to obtain feedback on their experience of learning and teaching through internal surveys. This article reviews research in the field and reports on practices in other Australian universities. Findings demonstrate that while student feedback is valued and used by all Australian universities, survey practices are idiosyncratic and in the majority of cases, questionnaires lack validity and reliability; data are used inadequately or inappropriately; and they offer limited potential for cross-sector benchmarking. The study confirms the need for institutions to develop an overarching framework for evaluation in which a valid, reliable, multidimensional and useful student feedback survey constitutes just one part. Given external expectations and internal requirements to collect feedback from students on their experience of learning and teaching, the pursuit of sound evaluation practices will continue to be of interest at local, national and international levels.

Short answer versus multiple choice examination questions for first year chemistry

Multiple choice (MC) examinations are frequently used for the summative assessment of large classes because of their ease of marking and their perceived objectivity. However, traditional MC formats usually lead to a surface approach to learning, and do not allow students to demonstrate the depth of their knowledge or understanding. For these reasons, we have trialled the incorporation of short answer (SA) questions into the final examination of two first year chemistry units, alongside MC questions. Students’ overall marks were expected to improve, because they were able to obtain partial marks for the SA questions. Although large differences in some individual students’ performance in the two sections of their examinations were observed, most students received a similar percentage mark for their MC as for their SA sections and the overall mean scores were unchanged. In-depth analysis of all responses to a specific question, which was used previously as a MC question and in a subsequent semester in SA format, indicates that the SA format can have weaknesses due to marking inconsistencies that are absent for MC questions. However, inclusion of SA questions improved student scores on the MC section in one examination, indicating that their inclusion may lead to different study habits and deeper learning. We conclude that questions asked in SA format must be carefully chosen in order to optimise the use of marking resources, both financial and human, and questions asked in MC format should be very carefully checked by people trained in writing MC questions. These results, in conjunction with an analysis of the different examination formats used in first year chemistry units, have shaped a recommendation on how to reliably and cost-effectively assess first year chemistry, while encouraging higher order learning outcomes.

PMI Research and Education Conference 2010

The PMI Research and Education Conference 2010 ended one week ago at the time of this writing. Aside from 3 enlightening keynote speeches, 78 proffered papers were presented. On the basis of the reviewers' assessments, the 10 best papers have been selected to form this special issue...

Making sense of mass education

Making Sense of Mass Education provides a comprehensive analysis of the field of mass education. The book presents new assessment of traditional issues associated with education – class, race, gender, discrimination and equity –to dispel myths and assumptions about the classroom. It examines the complex relationship between the media, popular culture and schooling, and places the expectations surrounding the modern teacher within ethical, legal and historical contexts. The book blurs some of the disciplinary boundaries within the field of education, drawing upon sociology, cultural studies, history, philosophy, ethics and jurisprudence to provide stronger analyses. The book reframes the sociology of education as a complex mosaic of cultural practices, forces and innovations. Engaging and contemporary, it is an invaluable resource for teacher education students, and anyone interested in a better understanding of mass education.

Finding your research voice : the application of bibliometrics as an analytic literature tool on the pedagogic field of higher education

This paper documents the use of bibliometrics as a methodology to bring forth a structured, systematic and rigorous way to analyse and evaluate a range of literature. When starting out and reading broadly for my doctoral studies, one article by Trigwell and Prosser (1996b) led me to reflect about my level of comprehension as the content, concepts and methodology did not resonate with my epistemology. A disconnection between our paradigms emerged. Further reading unveiled the work by Doyle (1987) who categorised research in teaching and teacher education by three main areas: teacher characteristics, methods research and teacher behaviour. My growing concerns that there were gaps in the knowledge also exposed the difficulties in documenting said gaps. As an early researcher who required support to locate myself in the field and to find my research voice, I identified bibliometrics (Budd, 1988; Yeoh & Kaur, 2007) as an appropriate methodology to add value and rigour in three ways. Firstly, the application of bibliometrics to analyse articles is systematic, builds a picture from the characteristics of the literature, and offers a way to elicit themes within the categories. Secondly, by systematic analysis there is occasion to identify gaps within the body of work, limitations in methodology or areas in need of further research. Finally, extension and adaptation of the bibliometrics methodology, beyond citation or content analysis, to investigate the merit of methodology, participants and instruments as a determinant for research worth allowed the researcher to build confidence and contribute new knowledge to the field. Therefore, this paper frames research in the pedagogic field of Higher Education through teacher characteristics, methods research and teacher behaviour, visually represents the literature analysis and locates my research self within methods research. Through my research voice I will present the bibliometrics methodology, the outcomes and document the landscape of pedagogy in the field of Higher Education.

Evaluation of the quality of diverse teaching practice in higher education research methods

The purpose of this paper is to report on a methods research project investigating the evaluation of diverse teaching practice in Higher Education. The research method is a single site case study of an Australian university with data collected through published documents, surveys, interviews and focus groups. This project provides evidence of the wide variety of evaluation practice and diverse teaching practice across the university. This breadth identifies the need for greater flexibility of evaluation processes, tools and support to assist teaching staff to evaluate their diverse teaching practice. The employment opportunities for academics benchmark the university nationally and position the case study in the field. Finally this reaffirms the institutional responsibility for services to support teaching staff in an ongoing manner.

Cultural factors affecting tertiary education access for Bundjalung men

Despite documented changes to mainstream educational systems, Indigenous educational achievements are still at critically low levels across all phases of formal education. According to the Australian Bureau of Statistics (2011) Indigenous students are still less likely than non-Indigenous students to complete their final years of schooling (45% compared with 77% in 2009); tertiary level entry and outcomes are also significantly lower than non-Indigenous entry and outcomes. Although significant research has focused on the area of Indigenous education, in particular, identifying and making recommendations on how to close educational gaps between Indigenous and non-Indigenous people, these studies have failed to bring about the change needed and to engage successfully with Indigenous communities and draw on Indigenous communities’ insights for best practice. This thesis focuses on Indigenous perspectives and takes a closer look at the cultural factors that impact on tertiary education access for Indigenous young men who come from a Bundjalung community on the far north coast of northern New South Wales. To date, this community has not been the focus of serious postgraduate study. Their experiences and the values and ideas of their community have not been investigated. To do this, the study uses an Indigenous methodological framework. It draws on Indigenous Standpoint Theory to analyse data through concepts of the cultural interface and tensions (Nakata, 2007, pp. 195-217). The study’s framing also draws on decolonising methods (Porsanger, 2004; Smith, 1999) and Indigenist research methods (Rigney, 1997). Such methodologies are intended to benefit both the research participants (community members) and the researcher. In doing so, the study draws on Creswell’s (2008) methods of restorying and retelling to analyse the participants’ interviews and yarns about their lives and experiences relating to tertiary educational access. The research process occurred in multiple stages: (1) selection of research sites, (2) granting of access which was requested through consultation with local Aboriginal Elders and through the local Aboriginal Lands Council, (3) conducting of interviews with participants/ data collection, (4) analysis of data, (5) documentation of findings, (6) theory development, and (7) reporting back to the nominated Indigenous community on the progress and findings of the research. The benefits of this research are numerous. First, this study addresses an issue that has been identified from within the local Aboriginal community as an issue of high precedence, looking at the cultural factors surrounding the underrepresentation of Indigenous people accessing tertiary education. This is not only of local significance but has been identified in the literature as a local, national and international area of concern amongst Indigenous peoples (Department of Economic and Social Affairs, 2009; Herbert, 2010; King, 2011). Secondly, the study draws on local Indigenous knowledges and learning processes from within a Bundjalung community to gain inside perspectives, namely the cultural factors that are being expressed from a range of Indigenous community members – young men, community Elders and community members – and finding out what they perceive inhibit and/or promote tertiary education participation within their community. Such perspectives are rarely heard. Finally, recommendations made from this study are aimed at revealing investigative styles that may be utilised by Western institutions to improve access for Indigenous young men living in the Narlumdarlum1 region in the tertiary context.

The pedagogical balancing act : teaching reflection in higher education

Despite the common use of the term reflection in higher education assessment tasks, learners are not often taught how to communicate their disciplinary knowledge through reflection. This paper argues that students can and should be taught how to reflect in deep and transformative ways. It highlights the reflexive pedagogical balancing act of attending to different levels of reflection as a way to stimulate focused, thoughtful and reasoned reflections that show evidence of new ways of thinking and doing. The paper uses data from a current project to illustrate the effects of focusing on particular levels of reflection in the pedagogical strategies used, and argues that while the goal of academic or professional reflection is generally to move students to the highest level of reflection to transform their learning/practice, unless higher education teachers attend to every level of reflection, there are specific, observable gaps in the reflections that students produce.

Behavioural beliefs concerning gender and high-risk sexual behaviours in the context of HIV/AIDS in PNG : views from within teacher education

Education is often viewed as a key approach to address sexual-health issues; the current concern is the burgeoning HIV/AIDS epidemic. This ethnographic study investigates the gender practices associated with high-risk sexual behaviour in Papua New Guinea as viewed by educators there. A number of practices, including gender inequality and associated sexual behaviours have been highlighted by male and female participants as escalating PNG’s HIV/AIDS epidemic. The study finds that although participants were well-informed concerning HIV/AIDS, they had varying beliefs concerning the prevailing gender/sexual issues involved in escalating highrisk behaviour and how to address the problem. The study further examines the behavioural beliefs and intentions of the educators themselves. Subsequently, within the data a number of underpinning factors, pertaining to gender, education and life experience, were found to be related to the behaviour beliefs and intentions of participants towards embracing change with regard to behaviours associated with gender equality in PNG. These factors appeared to encourage participants to adopt healthier gender and sexual behavioural intentions and, arguably, could provide the basis for ways to help address the gender inequality and high-risk behaviours associated with HIV/AIDS in PNG.

Factors affecting the motivation of TEFL academics in higher education in China

This study investigates the motivation of English language lecturers in a Chinese university. Recent studies have shown that low morale and job dissatisfaction are significant problems identified in lecturers who teach English in universities in China. Given the importance of teaching English as a second language in China, this problem has potentially significant ramifications for the nation’s future. Low staff morale is likely to be associated with less effective teaching and poor student learning outcomes. Although the problem is acknowledged, there has been limited research to understand the underlying contributing factors. To address this, a sequential explanatory mixed methods approach was adopted and implemented in two phases at a large regional university in Northern China. The participants in the main study were 100 lecturers from two colleges at this university. All of the lecturers were responsible for teaching English as a foreign language (TEFL); 50 were teaching English majors and 50 were teaching university students whose majors were not English. The research was informed by a synthesis of self determination theory and theories of organisational culture. The study found: 1) in contrast to previously reported studies, lecturers in this institution were in general autonomously motivated in teaching. 2) However, their level of motivation was influenced by their personal experiences and varied sense of competence, relatedness and autonomy. 3) In particular, personal experiences and contextual factors such as the influence of Chinese culture, societal context, and organisational climate were significant in regulating lecturers’ motivation to teach. The findings are significant for leaders in higher education who need to implement policies that foster effective work environments. The study has also provided insights into the capacity of self determination theory to explain motivation in a Chinese culture.

Ecological footprinting : its potential as a tool for change in preservice teacher education

Environmental and sustainability issues pose challenges for society. Although education is seen as being a contributor to addressing sustainability, teacher education has been slow to act in preparing future teachers to teach sustainability. Recent Australian curriculum documents nominate sustainability as one of three cross-curriculum priorities. In one Australian university course, an Ecological Footprint Calculator tool has been employed to challenge preservice early childhood teachers to consider the sustainability of their lifestyles as a means for engaging them in learning and teaching for sustainability. Students enrolled in an integrated arts and humanities subject voluntarily engaged with the online calculator and shared their findings on an electronic discussion forum. These postings then became the basis of qualitative analysis and discussion. Data categories included reactions and reflections on reasons for the ‘heaviness’ of their footprints , student reactions leading to actions to reduce their footprints, reflections on the implications of the footprint results for future teaching, reactions that considered the need for societal change, and reflections on the integration of sustainability with the visual arts. The power of the tool’s application to stimulate interest in sustainability and education for sustainability more broadly in teacher education is explored.

Success factors for ICT shared services in the higher education sector

Shared services is a prominent organizational arrangement for organizations, in particular for support functions. The success (or failure) of shared services is a critical concern as the move to shared services can entail large scale investment and involve fundamental organizational change. The Higher Education (HE) sector is particularly well poised to benefit from shared services as there is a need to improve organizational performance and strong potential from sharing. Through a multiple case study of shared services experiences in HE, this study identifies ten important antecedents of shared services success: (1) Understanding of shared services; (2) Organizational environment; (3) Top management support; (4) IT environment; (5) Governance; (6) Process centric view; (7) Implementation strategy; (8) Project management; (9) Change management; and (10) Communication. The study then develops a preliminary model of shared services success that addresses the interdependencies between the success factors. As the first empirical success model for shared services, it provides valuable guidance to practice and future research.