Enhancing quality in online learning : scaffolding planning and design through proactive evaluation

A major issue confronting educators is the extent to which they wish to conform to so-called paradigm shifts in teaching and learning. In the contemporary world of tertiary education these shifts embrace both pedagogy (from instructivist to constructivist) and technology (from classroom to online). As teachers and learners are faced with the potential of these new learning environments, the extent to which learning outcomes are achieved remains a high priority and subject to a wide range of evaluation strategies. Conventionally, evaluation has been positioned at the end of the instructional development cycle, to assess first whether or not the creative effort achieved the original product goals and second whether or not the desired learning outcomes were realized. In the context of online teaching and learning environments, however, the level of understanding teachers, learners and developers have of the medium can impact the ultimate effectiveness of the product. This paper articulates an additional dimension to post-development evaluation processes in proposing proactive evaluation, a framework that identifies critical online learning factors and influences that will better inform the planning, design and development of learning resources. This notion of proactive evaluation advocates resource development being undertaken where all planning activities are assessed against the evaluation criteria that would normally be applied during formative assessment. By performing these evaluation checks proactively, online learning resources will, in principle, work first time as all relevant factors and issues will have been considered and resolved. More importantly, for those participants who are new to online environments, proactive evaluation will perform a scaffolding and professional development role by enhancing online teaching or learning competencies.

Can an online tutorial pass the test for library instruction? An evaluation and comparison of library skills instruction methods for first year students at Deakin University

An online, interactive tutorial, Smart Searcher, was introduced at Deakin University as part of the Iibrary's information skills program in late 2000. As liaison librarians responsible for library skills training we wanted to compare and evaluate this mode of instruction with our normal face-to-face delivery of library instruction. This study found that students with face-to-face instruction did, in fact, gain higher posttest mean scores than students completing the online tutorial. Also, students attending these library sessions felt more confident about their library skills than those in the online tutorial only session.

Social presence online: networking learners at a distance

This paper draws on two studies which researched the use of online small group environments where collaborative learning is a central structure for learning. The establishment of social presence is facilitated through the socio-affective aspect of small group interaction which contributed to the effectiveness of learning online. Social presence, the ability of online learners to project themselves into a textual environment which has few visual or contextual cues, will be explored as an important element in facilitating effective online learning. The teacher's role in helping students project their online social presence and in establishing an environment for learning within the larger group computer conference will also be discussed.

Towards identifying factors underlying readiness for online learning: an exploratory study

To test the potential value of McVay's (2000) Readiness for Online Learning questionnaire for research and practice, the instrument was administered to 107 undergraduate university students drawn from a range of courses in the United States and Australia. The questionnaire was subjected to a reliability analysis and a factor analysis. The instrument fared well in the reliability analysis, and yielded a two-factor structure that was readily interpretable in a framework of existing theory and research. Factors identified were "Comfort with e-learning" and "Self-management of learning." It is suggested that the instrument is useful for both research and practice, but would be enhanced through further work on 5 of the 13 items. Additionally, further work is required to establish predictive validity.

The emergence of an online learning community in first year tertiary studies in psychology

The introduction of an online supported, resource based learning environment into a large, multi-modal first year psychology unit led to the spontaneous development of a small, but active, learning community. While off campus students were more active online contributors, many other students "observed" these interactions, not actively contributing but finding the discussion postings valuable to their learning. Overall, use and perceived value of the online communication facilities were related to how confident students were that they had an appropriate study strategy, with off campus and older students reporting greater confidence in their study approach. The results highlight that the nature and function of learning communities for large, multi-modal foundation units are quite different to those typically articulated in the literature and are worth further investigation.

Impacts of an online-supported, resouce-based learning environment: does one size fit all?

This paper reports on the use of an online, resource-based learning (RBL) approach in first year psychology at Deakin University. Differences between on- and off-campus students that emerged are examined in the context of the learning goals and study approaches of the two student groups and their attitudes to using computers. Unlike the on-campus students who were less positive about working with computers and reported confusion about how and what to study for the unit, the off-campus students reported feeling confident they had a good study strategy and were more positive about computers. The off-campus students also reported that they spent more time working with electronic resources and attached greater value to them. While all students valued the prescribed resources, the off-campus students found some of the optional, electronic resources valuable because they added to the learning experience. These students also reported greater use of the computer-mediated communication available as part of the online learning environment, and valued this functionality more highly than did the on-campus students. These findings highlight the need to take into account learner characteristics when designing learning environments that cater for individual differences and preferences. While online-supported RBL approaches have the potential to cater to the diverse needs of students, learning environments need to be designed, structured and delivered so the learning experience can be customized to the needs of different student cohorts, while preserving the overarching, pedagogical goals.

Online versus postal data collection methods: an examination of issues and a comparison of results

New communications technologies often allow new ways of conducting market research. Determining the advantages of a new data collection method over established alternatives is difficult without thorough comparative testing. Computer-mediated marketing research is one such example of a new technology that has been enthusiastically embraced by marketing organisations and those servicing them. While researchers using the Internet (Net) and World Wide Web (Web) in its early years reported benefits such as high response levels, there is little in the way of comparative evidence to support any claimed advantages. This paper reports on the outcomes of three separate studies in which members (subscribers) of various organisations have been surveyed using both postal and online (email invitation and HTML Web form) data collection methods. The conclusion here is that it would be unwise to assume that one method can be directly substituted for another and obtain the same response. Differences in both the response pattern and demographic profile of respondents between the groups are consistently noticed, such as to warrant further examination of the methods used in online marketing research, and to suggest the need for further study.

Cultural issues in online learning - is blended learning a possible solution?

The emergence of cross-cultural classrooms has been steadily increasing in Australian tertiary institutions, due to the growing population of international students enrolling to complete their degrees. This increase in international students has signified a change in the student demographics, thus recognizing the differences in students’ learning styles, and indicating that a more flexible approach is needed for learner content delivery. Research has suggested that students from different cultures have varying compatibility with different learning environments. With tertiary institutions now expanding towards the online forum for delivery of units, these compatibilities of students are even more evident. Hence, in order to ensure that all students are able to participate in this domain, preparations are needed to accommodate all cultural types. Therefore with the emphasis on creating flexible learning environments for all students the blended learning approach has been suggested as a solution.