Conceptualising and measuring student engagement through the Australasian Survey of Student Engagement (AUSSE) : a critique

Student engagement has rapidly developed a central place in the quality agenda of Australian universities since the introduction of the Australasian Survey of Student Engagement (AUSSE). The AUSSE is based on one developed in the USA. The main arguments given for adopting this survey in Australia are that it provides a valid instrument for measuring engagement and that it enables international comparisons. However, the survey instrument and scales have been adopted with little scrutiny of these arguments. This paper examines these arguments by considering different perspectives of engagement, examining the importance of contextual differences and evaluating the AUSSE engagement scales in the light of both. The paper concludes that the AUSSE results should be used by universities and policy-makers with caution.

Measuring passers-by engagement with AmPost: a printed interactive audio poster

This paper presents AmPost, a prototype of an interactive audio poster, which integrates ink-jet printed sonic and tactile elements along with textual and graphical information. This enables users to directly interact and engage with the poster. To achieve a seamless paper-based interactive poster that includes printed interactive elements, we implement a printed speaker and audio feedback system directly into the paper-based medium, which plays a short tune when someone walks by. Engaging passers-by with this new interface becomes a challenge as posters, in general, are non-interactive. This paper also presents an initial empirical evaluation of AmPost that captures and analyses the frequency and length of user engagement, and evaluates whether user engagement improves with the integration of interactive features, in comparison to the traditional non-interactive poster. This study facilitates in building the generic approach to measure engagement that applies to any kind of posters.

Measuring student engagement : using 'flow' theory to guide question development

In December 2009 the Department of Education, Employment and Workplace Relations (DEEWR) issued a discussion paper, ‘An Indicator Framework for Higher Education Performance Funding’, with the purpose of contributing to the development of indicators for guiding ‘compact’ negotiations between Australian universities and the government. The discussion paper makes it clear that ‘student experience’ will be an important part of the indicators and discusses the possibility that the Government will develop a new
questionnaire to investigate the engagement and satisfaction of students in their first year of study. This paper contributes ideas to assist the development of such an instrument, particularly for the measurement of student engagement. We discuss problems with the predictive validity of existing instruments and argue that predictive validity may be improved by a focus on highly engaging ‘flow-type’ activities. Specifically, we
investigate flow activities in the context of online learning. Our findings suggest that some of the current questions from the Australasian Survey of Student Engagement (AUSSE) do appear to capture flow activities. We also identify gaps in the AUSSE. Finally, we make recommendations about the inclusion of additional items that capture highly engaging, flow activities for either the AUSSE or the Government’s proposed new instrument.

Measuring work-study engagement in built environment undergraduate education in Australia

The cost of accessing higher education is expensive causing students to juggle the demands of paid work with study responsibilities. Whilst some work can be beneficial to student leaning this research seeks a more accurate understanding of why students undertake paid experience work to the level that they do. This paper examines the extent of work and study during an undergraduate program in construction at RMIT University Australia. Students responded to a questionnaire on the duration and nature of their work and study times. The results indicate that students who were involved in paid work do in excess of 20 hours per week, whist also enrolled as full-time undergraduates. The results of the study show that students in the early years of the program seem to be more engaged with study and spent slightly less time at work. This is contrasted with students in the final two years of the course spend considerable more time in paid work and less time undertaking study.
The paper concludes by suggesting that the results are partly the result of the unstructured work-experience requirements that occur from about year 3 of the program. Students who were encouraged by the university to undertake paid work-experience appeared to be increasingly disinterested in connecting with the broader university experience.

eVALUate: an evaluation instrument for measuring students’ perceptions of their engagement and learning outcomes

In the current climate in Australian higher education, quality assurance in university teaching is a priority. In particular, the introduction of the Learning and Teaching Performance Fund (LTPF) has refocused attention on universities’ internal student evaluation survey instruments. This paper reports the development, validation and implementation of a new unit survey instrument which prompts students to reflect on what helps their achievement of unit learning outcomes, and to report their levels of motivation, engagement and overall satisfaction with a semester‐long course or unit of study. The instrument (eVALUate) was created from precepts reported in the research literature, current practices in evaluating teaching, and sound quality assurance practices appropriate to a university outcomes‐focused education paradigm.

Measuring audience response on-line : an evaluation of the portable audience response facility (pARF)

If it is the case that artists and art explore organization of the brain (Zeki & Lamb, 1994), then the investigation of response to artistic performance holds promise as a window to perceptual and cognitive processes. The portable Audience Response Facility (pARF) is an instrument for recording real‐time audience response (Stevens et al. 2009). Twenty, handheld, Personal Digital Assistants (PDAs) collect responses on customizable skin interfaces. The pARF server transmits the customizable options, synchronizes devices and collects data for export. In this paper we report ratings of the usability of the pARF that were collected after 37 participants had used it to continuously rate engagement along a single dimension while a female dance artist gave two performances of a short solo contemporary dance work. The motion of the dancer was also captured as she performed the piece but only usability rating data are reported here. Ratings indicate that the cognitive load imposed by continuously rating engagement while watching a dance performance was manageable and the pARF was easy to use. An extended familiarization phase may further reduce dual task demand.

Measuring the performance of a regional cluster in innovation facilitation

Regional industry clusters have been promoted for several years as effective mechanisms to assist firms become more innovative and more competitive. But do they really achieve this goal, and more importantly, just how should an assessment of cluster performance in supporting and facilitating innovation within its members, be undertaken? In this paper we report on a study of a regional IT cluster in Western Sydney, Australia, develop some criteria for assessing the innovation facilitation performance of industry clusters, and discuss the cluster in relation to these criteria. We suggest that engagement with a cluster may enhance the innovation capacity of a firm, and the type of required innovation support varies significantly with the maturity and absorptive capacity of individual firms.