Student feedback systems in higher education: a focused literature review and environmental scan

In recent times, higher education institutions have paid increasing attention to the views of students to obtain feedback on their experience of learning and teaching through internal surveys. This article reviews research in the field and reports on practices in other Australian universities. Findings demonstrate that while student feedback is valued and used by all Australian universities, survey practices are idiosyncratic and in the majority of cases, questionnaires lack validity and reliability; data are used inadequately or inappropriately; and they offer limited potential for cross-sector benchmarking. The study confirms the need for institutions to develop an overarching framework for evaluation in which a valid, reliable, multidimensional and useful student feedback survey constitutes just one part. Given external expectations and internal requirements to collect feedback from students on their experience of learning and teaching, the pursuit of sound evaluation practices will continue to be of interest at local, national and international levels.

The relationship between drivers’ perceptions toward police speed enforcement and self-reported speeding behaviour

Exceeding the speed limit and driving too fast for the conditions are regularly cited as significant contributing factors in traffic crashes, particularly fatal and serious injury crashes. Despite an extensive body of research highlighting the relationship between increased vehicle speeds and crash risk and severity, speeding remains a pervasive behaviour on Australian roads. The development of effective countermeasures designed to reduce the prevalence of speeding behaviour requires that this behaviour is well understood. The primary aim of this program of research was to develop a better understanding of the influence of drivers’ perceptions and attitudes toward police speed enforcement on speeding behaviour. Study 1 employed focus group discussions with 39 licensed drivers to explore the influence of perceptions relating to specific characteristics of speed enforcement policies and practices on drivers’ attitudes towards speed enforcement. Three primary factors were identified as being most influential: site selection; visibility; and automaticity (i.e., whether the enforcement approach is automated/camera-based or manually operated). Perceptions regarding these enforcement characteristics were found to influence attitudes regarding the perceived legitimacy and transparency of speed enforcement. Moreover, misperceptions regarding speed enforcement policies and practices appeared to also have a substantial impact on attitudes toward speed enforcement, typically in a negative direction. These findings have important implications for road safety given that prior research has suggested that the effectiveness of speed enforcement approaches may be reduced if efforts are perceived by drivers as being illegitimate, such that they do little to encourage voluntary compliance. Study 1 also examined the impact of speed enforcement approaches varying in the degree of visibility and automaticity on self-reported willingness to comply with speed limits. These discussions suggested that all of the examined speed enforcement approaches (see Section 1.5 for more details) generally showed potential to reduce vehicle speeds and encourage compliance with posted speed limits. Nonetheless, participant responses suggested a greater willingness to comply with approaches operated in a highly visible manner, irrespective of the corresponding level of automaticity of the approach. While less visible approaches were typically associated with poorer rates of driver acceptance (e.g., perceived as “sneaky” and “unfair”), participants reported that such approaches would likely encourage long-term and network-wide impacts on their own speeding behaviour, as a function of the increased unpredictability of operations and increased direct (specific deterrence) and vicarious (general deterrence) experiences with punishment. Participants in Study 1 suggested that automated approaches, particularly when operated in a highly visible manner, do little to encourage compliance with speed limits except in the immediate vicinity of the enforcement location. While speed cameras have been criticised on such grounds in the past, such approaches can still have substantial road safety benefits if implemented in high-risk settings. Moreover, site-learning effects associated with automated approaches can also be argued to be a beneficial by-product of enforcement, such that behavioural modifications are achieved even in the absence of actual enforcement. Conversely, manually operated approaches were reported to be associated with more network-wide impacts on behaviour. In addition, the reported acceptance of such methods was high, due to the increased swiftness of punishment, ability for additional illegal driving behaviours to be policed and the salutary influence associated with increased face-to-face contact with authority. Study 2 involved a quantitative survey conducted with 718 licensed Queensland drivers from metropolitan and regional areas. The survey sought to further examine the influence of the visibility and automaticity of operations on self-reported likelihood and duration of compliance. Overall, the results from Study 2 corroborated those of Study 1. All examined approaches were again found to encourage compliance with speed limits, such that all approaches could be considered to be “effective”. Nonetheless, significantly greater self-reported likelihood and duration of compliance was associated with visibly operated approaches, irrespective of the corresponding automaticity of the approach. In addition, the impact of automaticity was influenced by visibility; such that significantly greater self-reported likelihood of compliance was associated with manually operated approaches, but only when they are operated in a less visible fashion. Conversely, manually operated approaches were associated with significantly greater durations of self-reported compliance, but only when they are operated in a highly visible manner. Taken together, the findings from Studies 1 and 2 suggest that enforcement efforts, irrespective of their visibility or automaticity, generally encourage compliance with speed limits. However, the duration of these effects on behaviour upon removal of the enforcement efforts remains questionable and represents an area where current speed enforcement practices could possibly be improved. Overall, it appears that identifying the optimal mix of enforcement operations, implementing them at a sufficient intensity and increasing the unpredictability of enforcement efforts (e.g., greater use of less visible approaches, random scheduling) are critical elements of success. Hierarchical multiple regression analyses were also performed in Study 2 to investigate the punishment-related and attitudinal constructs that influence self-reported frequency of speeding behaviour. The research was based on the theoretical framework of expanded deterrence theory, augmented with three particular attitudinal constructs. Specifically, previous research examining the influence of attitudes on speeding behaviour has typically focussed on attitudes toward speeding behaviour in general only. This research sought to more comprehensively explore the influence of attitudes by also individually measuring and analysing attitudes toward speed enforcement and attitudes toward the appropriateness of speed limits on speeding behaviour. Consistent with previous research, a number of classical and expanded deterrence theory variables were found to significantly predict self-reported frequency of speeding behaviour. Significantly greater speeding behaviour was typically reported by those participants who perceived punishment associated with speeding to be less certain, who reported more frequent use of punishment avoidance strategies and who reported greater direct experiences with punishment. A number of interesting differences in the significant predictors among males and females, as well as younger and older drivers, were reported. Specifically, classical deterrence theory variables appeared most influential on the speeding behaviour of males and younger drivers, while expanded deterrence theory constructs appeared more influential for females. These findings have important implications for the development and implementation of speeding countermeasures. Of the attitudinal factors, significantly greater self-reported frequency of speeding behaviour was reported among participants who held more favourable attitudes toward speeding and who perceived speed limits to be set inappropriately low. Disappointingly, attitudes toward speed enforcement were found to have little influence on reported speeding behaviour, over and above the other deterrence theory and attitudinal constructs. Indeed, the relationship between attitudes toward speed enforcement and self-reported speeding behaviour was completely accounted for by attitudes toward speeding. Nonetheless, the complexity of attitudes toward speed enforcement are not yet fully understood and future research should more comprehensively explore the measurement of this construct. Finally, given the wealth of evidence (both in general and emerging from this program of research) highlighting the association between punishment avoidance and speeding behaviour, Study 2 also sought to investigate the factors that influence the self-reported propensity to use punishment avoidance strategies. A standard multiple regression analysis was conducted for exploratory purposes only. The results revealed that punishment-related and attitudinal factors significantly predicted approximately one fifth of the variance in the dependent variable. The perceived ability to avoid punishment, vicarious punishment experience, vicarious punishment avoidance and attitudes toward speeding were all significant predictors. Future research should examine these relationships more thoroughly and identify additional influential factors. In summary, the current program of research has a number of implications for road safety and speed enforcement policy and practice decision-making. The research highlights a number of potential avenues for the improvement of public education regarding enforcement efforts and provides a number of insights into punishment avoidance behaviours. In addition, the research adds strength to the argument that enforcement approaches should not only demonstrate effectiveness in achieving key road safety objectives, such as reduced vehicle speeds and associated crashes, but also strive to be transparent and legitimate, such that voluntary compliance is encouraged. A number of potential strategies are discussed (e.g., point-to-point speed cameras, intelligent speed adaptation. The correct mix and intensity of enforcement approaches appears critical for achieving optimum effectiveness from enforcement efforts, as well as enhancements in the unpredictability of operations and swiftness of punishment. Achievement of these goals should increase both the general and specific deterrent effects associated with enforcement through an increased perceived risk of detection and a more balanced exposure to punishment and punishment avoidance experiences.

PMI Research and Education Conference 2010

The PMI Research and Education Conference 2010 ended one week ago at the time of this writing. Aside from 3 enlightening keynote speeches, 78 proffered papers were presented. On the basis of the reviewers' assessments, the 10 best papers have been selected to form this special issue...

Making sense of mass education

Making Sense of Mass Education provides a comprehensive analysis of the field of mass education. The book presents new assessment of traditional issues associated with education – class, race, gender, discrimination and equity –to dispel myths and assumptions about the classroom. It examines the complex relationship between the media, popular culture and schooling, and places the expectations surrounding the modern teacher within ethical, legal and historical contexts. The book blurs some of the disciplinary boundaries within the field of education, drawing upon sociology, cultural studies, history, philosophy, ethics and jurisprudence to provide stronger analyses. The book reframes the sociology of education as a complex mosaic of cultural practices, forces and innovations. Engaging and contemporary, it is an invaluable resource for teacher education students, and anyone interested in a better understanding of mass education.

Transport injury risks in Queensland adolescents of Pacific Islander descent

Ethnicity is rarely considered in the development of injury prevention programs, despite its known impact on participation in risk behaviour. This study sought to understand engagement in transport related risk behaviours, patterns of injury and perceptions of risk among early adolescents who self-identify as being from a Pacific Islander background. In total 5 high schools throughout Queensland, Australia were recruited, of which 498 Year 9 students (13-14 years) completed questionnaires relating to their perceptions of risk and recent injury experience (specifically those transport behaviours that were medically treated and those that were not medically treated). The transport related risk behaviours captured in the survey were bicycle use, motorcycle use and passenger safety (riding with a drink driver and riding with a dangerous driver). The results are explored in terms of the prevalence of engagement in risky transport related behaviour among adolescents’ of Pacific Islander background compared to others of the same age. The results of this study provide an initial insight into the target participants’ perspective of risk in a road safety context as well as their experience of such behaviour and related injuries. This information may benefit future intervention programs specific to adolescents’ of Pacific Islander background.

Finding your research voice : the application of bibliometrics as an analytic literature tool on the pedagogic field of higher education

This paper documents the use of bibliometrics as a methodology to bring forth a structured, systematic and rigorous way to analyse and evaluate a range of literature. When starting out and reading broadly for my doctoral studies, one article by Trigwell and Prosser (1996b) led me to reflect about my level of comprehension as the content, concepts and methodology did not resonate with my epistemology. A disconnection between our paradigms emerged. Further reading unveiled the work by Doyle (1987) who categorised research in teaching and teacher education by three main areas: teacher characteristics, methods research and teacher behaviour. My growing concerns that there were gaps in the knowledge also exposed the difficulties in documenting said gaps. As an early researcher who required support to locate myself in the field and to find my research voice, I identified bibliometrics (Budd, 1988; Yeoh & Kaur, 2007) as an appropriate methodology to add value and rigour in three ways. Firstly, the application of bibliometrics to analyse articles is systematic, builds a picture from the characteristics of the literature, and offers a way to elicit themes within the categories. Secondly, by systematic analysis there is occasion to identify gaps within the body of work, limitations in methodology or areas in need of further research. Finally, extension and adaptation of the bibliometrics methodology, beyond citation or content analysis, to investigate the merit of methodology, participants and instruments as a determinant for research worth allowed the researcher to build confidence and contribute new knowledge to the field. Therefore, this paper frames research in the pedagogic field of Higher Education through teacher characteristics, methods research and teacher behaviour, visually represents the literature analysis and locates my research self within methods research. Through my research voice I will present the bibliometrics methodology, the outcomes and document the landscape of pedagogy in the field of Higher Education.

Evaluation of the quality of diverse teaching practice in higher education research methods

The purpose of this paper is to report on a methods research project investigating the evaluation of diverse teaching practice in Higher Education. The research method is a single site case study of an Australian university with data collected through published documents, surveys, interviews and focus groups. This project provides evidence of the wide variety of evaluation practice and diverse teaching practice across the university. This breadth identifies the need for greater flexibility of evaluation processes, tools and support to assist teaching staff to evaluate their diverse teaching practice. The employment opportunities for academics benchmark the university nationally and position the case study in the field. Finally this reaffirms the institutional responsibility for services to support teaching staff in an ongoing manner.

Cultural factors affecting tertiary education access for Bundjalung men

Despite documented changes to mainstream educational systems, Indigenous educational achievements are still at critically low levels across all phases of formal education. According to the Australian Bureau of Statistics (2011) Indigenous students are still less likely than non-Indigenous students to complete their final years of schooling (45% compared with 77% in 2009); tertiary level entry and outcomes are also significantly lower than non-Indigenous entry and outcomes. Although significant research has focused on the area of Indigenous education, in particular, identifying and making recommendations on how to close educational gaps between Indigenous and non-Indigenous people, these studies have failed to bring about the change needed and to engage successfully with Indigenous communities and draw on Indigenous communities’ insights for best practice. This thesis focuses on Indigenous perspectives and takes a closer look at the cultural factors that impact on tertiary education access for Indigenous young men who come from a Bundjalung community on the far north coast of northern New South Wales. To date, this community has not been the focus of serious postgraduate study. Their experiences and the values and ideas of their community have not been investigated. To do this, the study uses an Indigenous methodological framework. It draws on Indigenous Standpoint Theory to analyse data through concepts of the cultural interface and tensions (Nakata, 2007, pp. 195-217). The study’s framing also draws on decolonising methods (Porsanger, 2004; Smith, 1999) and Indigenist research methods (Rigney, 1997). Such methodologies are intended to benefit both the research participants (community members) and the researcher. In doing so, the study draws on Creswell’s (2008) methods of restorying and retelling to analyse the participants’ interviews and yarns about their lives and experiences relating to tertiary educational access. The research process occurred in multiple stages: (1) selection of research sites, (2) granting of access which was requested through consultation with local Aboriginal Elders and through the local Aboriginal Lands Council, (3) conducting of interviews with participants/ data collection, (4) analysis of data, (5) documentation of findings, (6) theory development, and (7) reporting back to the nominated Indigenous community on the progress and findings of the research. The benefits of this research are numerous. First, this study addresses an issue that has been identified from within the local Aboriginal community as an issue of high precedence, looking at the cultural factors surrounding the underrepresentation of Indigenous people accessing tertiary education. This is not only of local significance but has been identified in the literature as a local, national and international area of concern amongst Indigenous peoples (Department of Economic and Social Affairs, 2009; Herbert, 2010; King, 2011). Secondly, the study draws on local Indigenous knowledges and learning processes from within a Bundjalung community to gain inside perspectives, namely the cultural factors that are being expressed from a range of Indigenous community members – young men, community Elders and community members – and finding out what they perceive inhibit and/or promote tertiary education participation within their community. Such perspectives are rarely heard. Finally, recommendations made from this study are aimed at revealing investigative styles that may be utilised by Western institutions to improve access for Indigenous young men living in the Narlumdarlum1 region in the tertiary context.

The pedagogical balancing act : teaching reflection in higher education

Despite the common use of the term reflection in higher education assessment tasks, learners are not often taught how to communicate their disciplinary knowledge through reflection. This paper argues that students can and should be taught how to reflect in deep and transformative ways. It highlights the reflexive pedagogical balancing act of attending to different levels of reflection as a way to stimulate focused, thoughtful and reasoned reflections that show evidence of new ways of thinking and doing. The paper uses data from a current project to illustrate the effects of focusing on particular levels of reflection in the pedagogical strategies used, and argues that while the goal of academic or professional reflection is generally to move students to the highest level of reflection to transform their learning/practice, unless higher education teachers attend to every level of reflection, there are specific, observable gaps in the reflections that students produce.

Evaluation of screening tests for predicting older driver performance and safety assessed by an on-road test

A number of tests and test batteries are available for the prediction of older driver safety, but many of these have not been validated against standardized driving outcome measures. The aim of this study was to evaluate a series of previously described screening tests in terms of their ability to predict the potential for safe and unsafe driving. Participants included 79 community-dwelling older drivers (M=72.16 years, SD=5.46; range 65-88 years; 57 males and 22 females) who completed a previously validated multi-disciplinary driving assessment, a hazard perception test, a hazard change detection test and a battery of vision and cognitive tests. Participants also completed a standardized on-road driving assessment. The multi-disciplinary test battery had the highest predictive ability with a sensitivity of 80% and a specificity of 73%, followed by the hazard perception test which demonstrated a sensitivity of 75% and a specificity of 61%. These findings suggest that a relatively simple and practical battery of tests from a range of domains has the capacity to predict safe and unsafe driving in older adults.

Behavioural beliefs concerning gender and high-risk sexual behaviours in the context of HIV/AIDS in PNG : views from within teacher education

Education is often viewed as a key approach to address sexual-health issues; the current concern is the burgeoning HIV/AIDS epidemic. This ethnographic study investigates the gender practices associated with high-risk sexual behaviour in Papua New Guinea as viewed by educators there. A number of practices, including gender inequality and associated sexual behaviours have been highlighted by male and female participants as escalating PNG’s HIV/AIDS epidemic. The study finds that although participants were well-informed concerning HIV/AIDS, they had varying beliefs concerning the prevailing gender/sexual issues involved in escalating highrisk behaviour and how to address the problem. The study further examines the behavioural beliefs and intentions of the educators themselves. Subsequently, within the data a number of underpinning factors, pertaining to gender, education and life experience, were found to be related to the behaviour beliefs and intentions of participants towards embracing change with regard to behaviours associated with gender equality in PNG. These factors appeared to encourage participants to adopt healthier gender and sexual behavioural intentions and, arguably, could provide the basis for ways to help address the gender inequality and high-risk behaviours associated with HIV/AIDS in PNG.

Factors affecting the motivation of TEFL academics in higher education in China

This study investigates the motivation of English language lecturers in a Chinese university. Recent studies have shown that low morale and job dissatisfaction are significant problems identified in lecturers who teach English in universities in China. Given the importance of teaching English as a second language in China, this problem has potentially significant ramifications for the nation’s future. Low staff morale is likely to be associated with less effective teaching and poor student learning outcomes. Although the problem is acknowledged, there has been limited research to understand the underlying contributing factors. To address this, a sequential explanatory mixed methods approach was adopted and implemented in two phases at a large regional university in Northern China. The participants in the main study were 100 lecturers from two colleges at this university. All of the lecturers were responsible for teaching English as a foreign language (TEFL); 50 were teaching English majors and 50 were teaching university students whose majors were not English. The research was informed by a synthesis of self determination theory and theories of organisational culture. The study found: 1) in contrast to previously reported studies, lecturers in this institution were in general autonomously motivated in teaching. 2) However, their level of motivation was influenced by their personal experiences and varied sense of competence, relatedness and autonomy. 3) In particular, personal experiences and contextual factors such as the influence of Chinese culture, societal context, and organisational climate were significant in regulating lecturers’ motivation to teach. The findings are significant for leaders in higher education who need to implement policies that foster effective work environments. The study has also provided insights into the capacity of self determination theory to explain motivation in a Chinese culture.

Ecological footprinting : its potential as a tool for change in preservice teacher education

Environmental and sustainability issues pose challenges for society. Although education is seen as being a contributor to addressing sustainability, teacher education has been slow to act in preparing future teachers to teach sustainability. Recent Australian curriculum documents nominate sustainability as one of three cross-curriculum priorities. In one Australian university course, an Ecological Footprint Calculator tool has been employed to challenge preservice early childhood teachers to consider the sustainability of their lifestyles as a means for engaging them in learning and teaching for sustainability. Students enrolled in an integrated arts and humanities subject voluntarily engaged with the online calculator and shared their findings on an electronic discussion forum. These postings then became the basis of qualitative analysis and discussion. Data categories included reactions and reflections on reasons for the ‘heaviness’ of their footprints , student reactions leading to actions to reduce their footprints, reflections on the implications of the footprint results for future teaching, reactions that considered the need for societal change, and reflections on the integration of sustainability with the visual arts. The power of the tool’s application to stimulate interest in sustainability and education for sustainability more broadly in teacher education is explored.

Effects of speeding and headway related variable message signs on driver behaviour and attitudes

This research project examined objective measures of driver behaviour and road users' perceptions on the usefulness and effectiveness of three specific VMS (Variable Message Signs) interventions to improve speeding and headway behaviours. The interventions addressed speeding behaviour alone (intervention 1), headway behaviour alone (intervention 2) and a combination of speeding and headway behaviour (intervention 3). Six VMS were installed along a segment of the Bruce Highway, with a series of three signs for each of the northbound and southbound traffic. Speeds and headway distances were measured with loop detectors installed before and after each VMS. Messages addressing speeding and headway were devised for display on the VMS. A driver could receive a message if they were detected as exceeding the posted speed limit (of 90km/hr) or if the distance to the vehicle in front was less than 2.0s. In addition to the on-road objective measurement of speeding and headway behaviours, the research project elicited self-reported responses to the speeding and headway messages from a sample of drivers via a community-based survey. The survey sought to examine the drivers' beliefs about the effectiveness of the signs and messages, and their views about the role, use, and effectiveness of VMS more generally.