Exploring contributions to scholarship in e-learning : weighing up the evidence

Recent views on the scholarship of teaching and learning have conceptualised the work of teachers as a form of inquiry, drawing on scholarly discourse about teaching and learning and communicating new understandings back to the scholarly community for peer review and evaluation. Knowledge about teaching may be based on a variety of forms of evidence, including research, evaluation, reflection, review, and the discussion or development of theoretical perspectives, ideas and concepts. This raises questions about the quality and forms of evidence about teaching which contribute to scholarship, whether these are the same in relation e-teaching and learning as they are for teaching in other contexts, and the implications of different forms of evidence for the relationship between research and teaching. In this paper we examine articles from three recent issues of three journals (two of them relating to e-learning and one to higher education in general), in order to draw some preliminary conclusions about the kind of contributions to discourse about e-learning which may be regarded as valuable in advancing the scholarship of teaching and learning.

Investigating sample bias in student evaluations of teaching

Student evaluations of teaching have increased in importance to universities in Australia over recent years due to changes in government policy. There has been significant debate in the literature as to the validity and usefulness of such evaluations and as to whether students who respond to the evaluations are indeed representative of the student population. A potential invalidating issue is self selection in the evaluation process. In this paper, we consider student evaluations of a large first year business statistics subject that had 1073 eligible students enrolled across four campuses at the time of the evaluation. The study is based on the 373 students (34.8%) who responded to the survey, and their final results. The evaluations were open for a period of six weeks leading up to and just after the final exam. The study looks in detail at the student population identifying such attributes as gender; home campus; course of study; domestic/international; Commonwealth Supported Place/full fee paying, etc. and then mapping these results to those of the students who responded to the survey.

A comparison of student evaluation of teaching with student performance

This study measures the evaluation of teaching given by students against their final outcomes in a subject. The subject in question had an enrolment across four campuses of 1073 students at the time of the evaluation and is a statistics subject that is core (i.e. compulsory) to several undergraduate business degrees. This study is based on the 373 students (34.8%) who responded to the survey, and their final results. The evaluations were open for a period of six weeks leading up to and just after the final exam. The study matches the responses to the question “This unit was well taught” to final outcomes, in an attempt to ascertain whether there is a link between student evaluation of teaching and performance. The analysis showed that for the students who self -selected to complete the survey:

· Students who perform well in the subject generally give higher scores than lower performing students.

· The same general pattern prevailed when other secondary factors were taken into account, such as, when the evaluation was completed, campus and gender.

· The timing of when a student completes the evaluation seems the most important of these secondary variables.

· In general, students who submitted their evaluations after the exam gave higher ratings if they eventually obtained a pass grade or better, and lower grades if they failed.

Students' evaluations of teaching quality and their unit online activity : an empirical investigation

This paper reports on an investigation of the relationship between students’ level of online activity in units in a business faculty and their evaluations of teaching quality in these units. The analysis was conducted using student evaluation data from 2004 to 2007 together with data for student online activity for one semester. We compare on-campus and off-campus students and undergraduate and postgraduate students. The results indicate that students’ evaluations of units have improved on all surveyed criteria during the five years. We also show that for some cohorts student online activity is associated with greater satisfaction with teaching. The paper concludes by considering the implications of these findings for further research and teaching practice.

Dealing with the challenges of teaching large groups

It is now well established that teaching a large class poses significant challenges in tertiary education (Biggs, 2003; Ramsden 2003). In this era of internationalization of education, the problems of teaching a large class are further compounded by the background and diversity of the student cohort. As the student groups become diverse they create challenges in a range of issues including designing the curriculum to appeal to large groups with varying learning styles, assessment, motivation, and creating a suitable learning environment.
Critical reflecting on one’s experiences is a necessary condition for improving teaching (Ramsden 2003). Brookfield (1995: 27) argues that critical reflection should be done from ‘as many unfamiliar angles as possible’ and proposes the use of four critical reflective lenses which include own experiences as a learner and a teacher, students perspectives, colleagues perspectives and though the lens of literature.
In this presentation, I intend to draw upon my experiences of teaching MMM132, one of the largest units in Deakin, to discuss both the challenges of teaching a large class and addressing some of these challenges. In doing so, I will explain how I used Brookfield’s (1995) critical reflection process by reflecting critically upon my own experiences as a teacher and a learner, using my students’ eyes, my colleagues’ perspectives and drawing on the existing literature to address the challenges of teaching a large group.

Technology adoption : voices of teaching academics, educational designers and students

This folio presents three studies (a dissertation and two electives) which use qualitative case study methodologies to investigate technology adoption from three perspectives. Central to all three studies is the study context of Monash University. The Dissertation explores adoption of web-based learning and teaching approaches from the perspective of teaching academics as they incorporate these to facilitate their students’ learning. The study investigates teaching academics’ reasons for adopting these new technologies, the factors that influenced their adoption decisions, and the challenges they were confronted with, including the contributing factors that impacted on their adoption decisions. The study shows that while contextual factors such as power and politics of the school, department, faculty and the institution impact on adoption, supportive organisational infrastructures and policy frameworks are necessary to encourage adoption, including wider adoption. In turn, on going staff development, adoption of new work practices and being adaptive to changing work environments are key demands made on teaching academics as a result of adopting web-based teaching approaches. Elective 1, a smaller study, leads on from the dissertation and examines the impact of technology adoption on the evolving role of educational designers. The study identifies the educational designers’ role change in assisting teaching academics to move from more conventional forms of teaching to more technology based learner-centred collaborative models. An important aspect of the study is the managers’ perspectives of this role in a university that has adopted a strong flexible learning and technology policy. The findings show that educational designers now work as project managers in larger teams consisting of a wider range of professionals, their expanded role in introducing technology into learning designs, providing staff development in the area, and giving technical help including advice on copyright and intellectual property issues. Elective 2 explores student readiness to adopt these technologies for learning. The study is designed to achieve an understanding of three broad categories of learners from a first year design unit: (1) South East Asian and East Asian students, (2) all other international students, and (3) local Australian students are studied to examine their readiness for modes of learning that are flexible; their approaches to study in a creative discipline area; and their openness to using technology. Findings of the study are discussed under the key themes – dependence on the teacher and classroom environment, flexible learning and working alone, structure, communication and work patterns. The study concludes by discussing the possible cultural attributes that have an impact on the learning. The three studies found that the institution, its people, structures and processes must all adapt, evolve and grow in order to provide effective, engaging, student-centred web-based learning environments. Students in turn must be enabled to manage their study, make use of the technologies and maximise their learning experience. The findings revealed the stage of technology use reached at Monash University at the time of the study through the voices of the teaching academics, educational designers and students.

Learning approaches and student perceptions of teaching quality

This research investigated the links between students' personal characteristics, their approaches to learning and their perceptions of teaching quality in a first-year accounting unit. Significant learning differences were found between Australian and Chinese students, and strong inter-relationships between contextual factors, such as teaching quality, and learning approaches were identified.

The development of teaching skills to support active learning in university science (ALIUS)

This paper describes an Australian Learning and Teaching Council funded project for which Learning Design is encompassed in the broadest sense. ALIUS (Active Learning In University Science) takes the design of learning back to the learning experiences created for students. ALIUS is not about designing a particular activity, or subject, or course, but rather the development of a method, or process, by which we have re-designed the way in which learning occurs in large university classrooms world wide.

Australian higher education institutions transforming the future of teaching and learning through 3D virtual worlds

What are educators‟ motivations for using virtual worlds with their students? Are they using them to support the teaching of professions and if this is the case, do they introduce virtual worlds into the curriculum to develop and/or expand students' professional learning networks? Are they using virtual worlds to transform their teaching and learning? In  recognition of the exciting opportunities that virtual worlds present for higher education, the DEHub Virtual Worlds Working Group was formed. It is made up of Australian university academics who are investigating the role that virtual worlds will play in the future of education and actively implementing the technology within their own teaching practice and  curricula. This paper presents a typology for teaching and learning in 3D virtual worlds and applies the typology to a series of case studies based on the ways in which academics and their institutions are exploiting the power of virtual worlds for diverse purposes ranging from business scenarios and virtual excursions to role-play, experimentation and language development. The case studies offer insight into the ways in which institutions are transforming their teaching for an unknown future through innovative teaching and learning in virtual worlds. The paper demonstrates how virtual worlds enable low cost alternatives to existing pedagogies as well as creating opportunities for rich, immersive and authentic activities that would otherwise not be feasible or maybe not even be possible. Through the use of virtual worlds, teaching and learning can be transformed to cater for an unknown future.

Using action research to improve the quality of teaching in basic education in remote schools in PNG.

This paper discusses the use of action research with teachers in remote primary schools in PNG to provide sustainable professional learning to help improve the quality of schooling. It arises from an ADRA research project being undertaken by the authors. The paper describes the project’s research design and its implementation to investigate the introduction, implementation and feasibility of teachers using action research to solve their own problems related to providing basic education in remote communities. If successful, action research may prove to be an effective approach to sustaining professional learning communities in locations where traditional approaches and means of professional development are difficult or impossible to sustain.

The paper describes the research team’s approach to identifying and engaging schools in remote districts of Western and East Sepik provinces, surveying teachers in those districts about their professional learning needs and circumstances, identifying schools to trial action research, and to undertake the fieldwork to implement action research and to study its implementation. The teachers’ experiences with using action research are presented in the context of their particular research topics chosen for their school. To date, the findings suggest that teachers can use action research to help them improve the quality of the education they provide for children. However, the initiation and sustainability of such an action research approach is influenced by the capacities and commitment of head teachers and standards officers, in particular, valuing and understanding reflective practice and action research for professional learning in school communities.

Strategic leadership of teaching and learning centres : from reality to ideal

This paper reports on the third phase of a study of Australian Teaching and Learning Centres to identify factors that contribute to the effective strategic leadership of Centres. Focus groups at 10 Australian universities included 66 respondents, providing a diverse range of perspectives, from students to members of the university executive. Analysis of participant contributions extended findings from prior project phases and the wider literature. They also contributed to the final construction of the strategic leadership Teaching and Learning Centre maturity framework presented here. Centres remain in a state of flux, enduring regular reconfiguration. For most Centres, their level of interaction with students is low and increased engagement with students would be of benefit. Perceptions of Centres vary widely, reinforcing the importance of a strategic partnership between the University’s Senior Executive, the Centre and faculties as a prerequisite for implementing identified high-impact strategies for improvement in teaching and learning.