eVALUate: an evaluation instrument for measuring students’ perceptions of their engagement and learning outcomes

In the current climate in Australian higher education, quality assurance in university teaching is a priority. In particular, the introduction of the Learning and Teaching Performance Fund (LTPF) has refocused attention on universities’ internal student evaluation survey instruments. This paper reports the development, validation and implementation of a new unit survey instrument which prompts students to reflect on what helps their achievement of unit learning outcomes, and to report their levels of motivation, engagement and overall satisfaction with a semester‐long course or unit of study. The instrument (eVALUate) was created from precepts reported in the research literature, current practices in evaluating teaching, and sound quality assurance practices appropriate to a university outcomes‐focused education paradigm.

Role of ADRI model in teaching and assessing novice programmers

In this research, an ADRI approach was introduced in the teaching and learning process of an introductory programming course. The result shows that the ADRI approach impacted positively on the students learning outcomes. The ADRI approach not only reduced the failure rate but also improved student’s retention in the course.

Effective science teaching and a strategy for its implementation

Is the way being lost in teaching science? Many primary schools do not have a well developed culture of science teaching and learning, there is a declining interest in science over the years 7 to 10, and there are proportionally fewer students continuing onto science in the senior years. In response to these concerns, the Victorian Department of Education, Employment and Training (DEET) established a major initiative, the Science in Schools (SiS) Research Project, to enhance and invigorate science teaching and learning. During 2000 and 2001 the project team has worked with teachers in primary and secondary schools across Victoria to introduce new initiatives into their science programs. Central to the project are the SiS Components, a framework that describes effective science teaching, and the SiS Strategy, a process by which schools implement change. This paper outlines the SiS Components and Strategy and describes some of the findings that have emerged from the project.

Effective integration of teaching and research in a first year food and nutrition course

Previous research has indicated that undergraduate student learning can be enhanced through active involvement in research. Furthermore, creating an academic environment where teaching and research are intimately linked can facilitate the induction of students into a community of learners where new knowledge is created, explored and critiqued. Scaffolding and supporting student learning via engagement in authentic research experiences can work to ensure graduating students have the capacity to generate and investigate important questions that contributes to the development of new knowledge. This paper presents a case study that outlines curriculum design and pedagogical strategies aimed at integrating teaching and research within the first year of an undergraduate course. First year Food and Nutrition students were asked to partake in a research project where they were asked to complete a series of diet and food related questionnaires, analyse, interpret and critique the resulting data. Students were supported through this learning activity via small group tutorial support and question and answer sessions within the learning management system. Anonymous evaluation of the teaching and learning experience was conducted at the end of the teaching period and the results indicate that the students welcomed the opportunity to engage in an authentic, research based learning activity. Students’ found the assessment tasks were clearly explained to them (88% agreeing), and felt well supported in approaching this research based assessment task. Furthermore, the qualitative comments indicated that the students’ found the learning environment to be meaningful and relevant. This case study indicates that it is possible to effectively incorporate authentic research experiences within the curriculum of a first year course. The experiential, inquiry based learning approach used supported the students’ participation in a systematic, rigorous data collection process required in a structured research environment and blended these requirements with authentic learning of discipline specific skills and knowledge.

Enhancing quality in online learning : scaffolding planning and design through proactive evaluation

A major issue confronting educators is the extent to which they wish to conform to so-called paradigm shifts in teaching and learning. In the contemporary world of tertiary education these shifts embrace both pedagogy (from instructivist to constructivist) and technology (from classroom to online). As teachers and learners are faced with the potential of these new learning environments, the extent to which learning outcomes are achieved remains a high priority and subject to a wide range of evaluation strategies. Conventionally, evaluation has been positioned at the end of the instructional development cycle, to assess first whether or not the creative effort achieved the original product goals and second whether or not the desired learning outcomes were realized. In the context of online teaching and learning environments, however, the level of understanding teachers, learners and developers have of the medium can impact the ultimate effectiveness of the product. This paper articulates an additional dimension to post-development evaluation processes in proposing proactive evaluation, a framework that identifies critical online learning factors and influences that will better inform the planning, design and development of learning resources. This notion of proactive evaluation advocates resource development being undertaken where all planning activities are assessed against the evaluation criteria that would normally be applied during formative assessment. By performing these evaluation checks proactively, online learning resources will, in principle, work first time as all relevant factors and issues will have been considered and resolved. More importantly, for those participants who are new to online environments, proactive evaluation will perform a scaffolding and professional development role by enhancing online teaching or learning competencies.

Creating and sustaining quality e-learning environments of enduring value for teachers and learners

Australian universities continue staking a claim on the future of e-learning, acquiring Learning Management Systems (LMS) as rapidly as universities overseas. Much is published on processes and criteria for selecting the best LMS for an organisation's needs and attempts to establish training and support mechanisms for deploying these systems. Beyond initial efforts to commission these technologies, particularly in the hands of teachers and students, what should happen to ensure these commitments yield real educational value in the long term? The search for and realisation of systemic and substantial new value requires a more profound reconceptualisation of what it means to design and work within contemporary learning environments, incorporating e-learning, in support of excellence in educational outcomes. This demands the foregrounding of the role of the academic teacher in the system in relation to other parties who can make important educational contributions in support of student learning. Central to new strategies is a transformation of the role of academic teacher, but on terms understood by them and supportive of their educational values. Six areas of value creation for teachers and learners are considered in relation to this transformation.

An investigation of scale economies and quality issues in the teaching and management of large subjects

Many in the tertiary education system have had concerns with the issues surrounding the teaching of large classes, including teaching quality and whether there are effective learning outcomes for students. An issue closely related to quality is the cost of providing an efficacious education system. It is a common perception that large classes are economical to run and small subjects are not. As with any complex issue there are several perspectives that could be utilised, the needs of the institution, the teaching staff, the community or the students, and whether or not these needs are being met.

This study aims to assess whether universities are meeting the needs of students in large marketing classes. For this purpose the study investigates the application of selfdetermination theory and psychological needs satisfaction. The basic needs scale, comprising of three constructs; Control, Competence and Caring was adapted and used to evaluate students' perception of an introductory marketing subject.

The study used a multi-method approach consisting of a literature review, a qualitative phase involving in-depth interviews and focus groups. A survey of 366 students who had undertaken an introductory level marketing subject in a large class format was also conducted. The results show that the psychological needs satisfaction of many students are not being fully realised. It was also found that marketing degree students enjoyed the challenges and were more stimulated by the subject (than students in other degree streams). The higher achieving students enjoyed the challenge of the subject more than the lower achieving students. The implications of these findings and suggestions for
further investigation are discussed.

Teaching quality and tutorial delivery : experience of a second year marketing unit

The higher education sector, the world over, is faced with the challenging task of servicing an increasingly diverse international student community in the globally competitive education market. The rising expectation of students of education outcomes, varied learning styles and orientations of the student population have brought in challenges such as providing a high quality educational environment with changes in curricula and pedagogy (Coldrake, 2001) to negotiate the cultural and linguistic diversity and the resulting expectations of students. The 'quality' of teaching and learning is high on the agenda among the key issues that had emerged from policy developments to meet these challenges.

Using the SPQ2F instrument (Biggs, 2003) and depth interviews, this paper investigates the study 3J'PToaches of students enrolled in a second year marketing unit in an Australian university focusing on the learning contexts in which learning occurs. The findings indicate that there are no significant differences in study approaches of students and that the study approaches differ according the learning context. The paper concludes that student perceptions on learning contexts assist in the development of teaching strategies that lead to quality outcomes, higher student satisfaction and providing universities a competitive edge in marketing its services to prospective students.

Learning opportunities for Australian prevocational hospital doctors: exposure, perceived quality and desired methods of learning.

Objective:

To survey prevocational doctors working in Australian hospitals on aspects of postgraduate learning.
Participants and setting:

470 prevocational doctors in 36 health services in Australia, August 2003 to October 2004.
Design:

Cross-sectional cohort survey with a mix of ordinal multicategory questions and free text.
Main outcome measures:

Perceived preparedness for aspects of clinical practice; perceptions of the quantity and usefulness of current teaching and learning methods and desired future exposure to learning methods.
Results:

64% (299/467) of responding doctors felt generally prepared for their job, 91% (425/469) felt prepared for dealing with patients, and 70% (325/467) for dealing with relatives. A minority felt prepared for medicolegal problems (23%, 106/468), clinical emergencies (31%, 146/469), choosing a career (40%, 188/468), or performing procedures (45%, 213/469). Adequate contact with registrars was reported by 90% (418/465) and adequate contact with consultants by 56% (257/466); 20% (94/467) reported exposure to clinical skills training and 11% (38/356) to high-fidelity simulation. Informal registrar contact was described as useful or very useful by 94% (433/463), and high-fidelity simulation by 83% (179/216). Most prevocational doctors would prefer more formal instruction from their registrars (84%, 383/456) and consultants (81%, 362/447); 84% (265/316) want increased exposure to high-fidelity simulation and 81% (283/350) to professional college tutorials.
Conclusion:

Our findings should assist planning and development of training programs for prevocational doctors in Australian hospitals.

Student learning orientations : are there differences between age and gender?

The increasing diversity and mobility of students have challenged universities, world over, to review educational courses and delivery to provide a more satisfying learning environment to students. The continuous improvement of the 'quality' of teaching and learning is one of the key goals of universities endeavouring to fulfil their obligations as learning institutions. Using a revised SPQ2F instrument (Biggs, 2003, Biggs and Leung, 2001), this exploratory study undertakes a comparative analysis of the age and gender differences in the learning orientations of two groups of tertiary students in an Australian University. The results indicate that there are no significant differences in the learning orientations of students but on average they seem to demonstrate deep learning than surface learning although they may differ in terms of the learning contexts.

Principal led school improvement and teacher capacity building in the Barwon South Network : final report, May 2013

The period of interest for this report is the beginning of 2011 to the end of 2012. The period commenced when the Regional Network Leader of the Barwon South Network of schools in the Barwon South Region of the Department of Education and Early Childhood contacted the School of Education at Deakin University, Waurn Ponds Campus Geelong. The Regional Network Leader outlined a desire to engage with Deakin University to research a short-term-cycle model of school improvement to be implemented in the region. While the model was expected to be taken on by all schools in the region the research was limited to the 23 schools in the Barwon South Network with four schools to be investigated more closely for each of two years (2001 & 2012) – eight focus schools in total.

Many positive outcomes flowed from the implementation of short-term-cycle school improvement plans and their associated practices but there was wide variation in the nature and degrees of success and of the perception of the process. The research team asked the following questions of the data:

1. What aspects of the School Improvement Plan (SIP) approach were important for initiating and supporting worthwhile change?
2. What might we take from this, to provide guidance on how best to support change in teaching and learning processes in schools?

The School Improvement Plan (SIP) worked in a range of ways. At one level it was strongly focused on school leadership, and a need to improve principals’ capacity to initiate worthwhile teaching and learning processes in their schools. Underlying this intent, one might think an assumption is operation is that the leadership process involves top down decision-making and a willingness to hold staff accountable for the quality of their practice.

The second strong focus was on the translation into practice and the consequent effect on student learning, involving an emphasis on data and evidence led practice. Hence, along with the leadership focus there was a demand for the process of school improvement to reach down into students and classrooms. Thus, the SIP process inevitably involved a chain of decision-making by which student learning quality drove the intervention, and teachers responsible for this had a common view. The model therefore should not be seen as an intervention only on the principal, but rather on the school decision-making system and focus. Even though it was the principal receiving the SIP planning template, and reporting to the network, the reporting was required to include description of the operation of the school processes, of classroom processes, and of student learning. This of course placed significant constraints on principals, which may help explain the variation in responses and outcomes described above.

The findings from this study are based on multiple data sources: analysis of both open and closed survey questions which all teachers in the 23 schools in the network were invited to complete; interviews with principals, teachers and leaders in the eight case study schools; some interviews with students in the case study schools; and interviews with leaders who worked in the regional network office; and field notes from network meetings including the celebrations days. Celebrations days occurred each school term when groups of principals came together to share and celebrate the improvements and processes happening in their schools. Many of the themes emerging from the analysis of the different data sources were similar or overlapping, providing some confidence in the evidence-base for the findings.

The study, conducted over two years of data collection and analysis, has demonstrated a range of positive outcomes in at the case study schools relating to school communication and collaboration processes, professional learning of principals, leadership teams and classroom teachers. There was evidence in the survey responses and field notes from ‘celebration days’ that these outcomes were also represented in other schools in the network. The key points of change concerned the leadership processes of planning for improvement, and the rigorous attention to student data in framing teaching and learning processes. This latter point of change had the effect of basing SIP processes on a platform of evidence-based change. The research uncovered considerable anecdotal and observational evidence of improvements in student learning, in teacher accounts in interview, and presentations of student work. Interviews with students, although not as representative as the team would have liked, showed evidence of student awareness of learning goals, a key driver in the SIP improvement model. It was, however, not possible over this timescale to collect objective comparative evidence of enhanced learning outcomes.

A number of features of the short-term-cycle SIP were identified that supported positive change across the network. These were: 1) the support structures represented by the network leader and support personnel within schools, 2) the nature of the SIP model – focusing strongly on change leadership but within a collaborative structure that combined top-down and bottom-up elements, 3) the focus on data-led planning and implementation that helped drill down to explicit elements of classroom practice, and 4) the accountability regimes represented by network leader presence, and the celebration days in which principals became effectively accountable to their peers. We found that in the second year of the project, momentum was lost in the case study schools, as the network was dismantled. This raised issues also for the conduct of research in situations of systemic change.

Alongside the finding of evidence of positive outcomes in the case study schools overall, was the finding that the SIP processes and outcomes varied considerably across schools. A number of contextual factors were identified that led to this variation, including school histories of reform, principal management style, and school size and structure that made the short-term-cycle model unmanageable. In some cases there was overt resistance to the SIP model, at least in some part, and this led to an element of performativity in which the language of the SIP was conscripted to other purposes. The study found that even with functioning schools the SIP was understood differently and the processes performed differently, raising the question of whether in the study we are dealing with one SIP or many. The final take home message from the research is that schools are complex institutions, and models of school improvement need to involve both strong principled features, and flexibility in local application, if all schools’ interests in improving teaching and learning processes and outcomes are to be served.

Relationships between vocational interests and learning approaches to advance the quality of student learning in accounting

This study investigates the influence of vocational interests on the learning approach of accounting students at the undergraduate level. It brings together two theoretical models: vocational interests and approaches to learning, to investigate student learning in the accounting discipline. The research focus is supported by more general findings from the education literature which suggest that interest-oriented learning leads to superior approaches to learning. The research was tested using 917 tertiary accounting students across two universities. The associations between vocational interests and learning approaches provide support for the theoretical model linking vocational interests (e.g. conventional) with deep learning approaches in a tertiary accounting environment. There are practical implications for the teaching of accounting with particular reference to whether the current curriculum reinforces the values of those individuals with conventional interests.

Fostering cultural diversity in Australia: a case study of teaching, learning and assessing African musical arts

Australia is forged by ongoing migration welcoming a range of cultures, languages and ethnicities thus celebrating a diverse range of musical arts. In this multicultural society, music and dance may serve as a positive medium to transmit and promote social cohesion. I argue that the inclusion of innovative and immersive practice of African music in particular where authentic teaching and learning is facilitated may help foster understandings of culture in educational settings and the wider society. As a migrant forming part of the African Diaspora in Melbourne, I am strongly connected to my ancestral homeland (South Africa) when teaching African music to Australian tertiary students. Having gained ethical clearance to undertake the two research projects at Deakin University in Melbourne (Attitudes and perceptions of Arts Education Students: preparing culturally responsive teachers and Pre-service teacher attitudes and understandings of Music Education), I discuss tertiary students experience in relation to the teaching and learning of African music within higher education courses. Drawing on interview, questionnaire, observation notes, anecdotal feedback and narrative reflection, I employ Interpretative Phenomenological Analysis to analyse and code the data into themes. By offering a discussion of assessment and evaluation, I explore and invite international dialogue in regards to how best we can prepare, assess and evaluate our students to improve the quality of musical arts education.

Quality teaching in Australian and German primary science classrooms: characterising difference to help identify quality

This chapter reports on results of an international research project across Australia, Taiwan and Germany, titled: Exploring quality primary education in different cultures: A cross-national study of teaching and learning in primary science classrooms (EQUALPRIME).1 Its aim is to explore through video capture the practice of expert teachers of science in Taiwan, Germany and Australia. This chapter explores the pedagogical practices in two cases – fi rstly a Grade 4 Australian school with a specialist science teacher, Bob (pseudonym), and secondly, a mixed-age (Grade 4–6) German classroom being co-taught by a pair of teachers, Mr Arnold and Mrs Lennard. In both cases the students were studying the topic of force. The project is not determining what quality teaching is in any essentialised sense; this could be contentious in that quality practice might be considered to varywithin classrooms from the same country, let alone across countries and across cultures. Rather, given cases in which quality teaching is reported to be occurring, the project aims to describe these examples and identify features of quality science teaching practices as judged by peers in varied cultural settings. Data from these two cases in which quality teaching of science occurs, are used to address the research question: What can quality teaching and learning look like in a science classroom?