Sustainable assessment for large science classes : non-multiple choice, randomised assignments through a Learning Management System

This paper reports on the development of a tool that generates randomised, non-multiple choice assessment within the BlackBoard Learning Management System interface. An accepted weakness of multiple-choice assessment is that it cannot elicit learning outcomes from upper levels of Biggs’ SOLO taxonomy. However, written assessment items require extensive resources for marking, and are susceptible to copying as well as marking inconsistencies for large classes. This project developed an assessment tool which is valid, reliable and sustainable and that addresses the issues identified above. The tool provides each student with an assignment assessing the same learning outcomes, but containing different questions, with responses in the form of words or numbers. Practice questions are available, enabling students to obtain feedback on their approach before submitting their assignment. Thus, the tool incorporates automatic marking (essential for large classes), randomised tasks to each student (reducing copying), the capacity to give credit for working (feedback on the application of theory), and the capacity to target higher order learning outcomes by requiring students to derive their answers rather than choosing them. Results and feedback from students are presented, along with technical implementation details.

Enhancing interdisciplinary learning with a learning management system

Interdisciplinary learning is a form of knowledge production that is increasingly being embraced as an educational approach in higher education. A role of information and communication technologies (ICT) is to enhance interdisciplinary learning. Issues surrounding the mix of interdisciplinary pedagogic methodologies and emerging digital technologies are worthy of investigation. In this paper, the authors report the findings of a study that examined student perceptions of an interdisciplinary course on information technology (IT) and visual design that utilized a learning management system. Using questionnaire instrumentation, the authors sought the perceptions of first-year university students enrolled in a newly formed interdisciplinary IT course. Results indicate that ICT-based interdisciplinary learners prefer a self-directed and collaborative instructional modality, as well as teacher presence and interventions in the online environment. The types of student participation can significantly influence how students perceive ICT-based interdisciplinary learning design.

Perceptions of online learning in an Australian university : Malaysian students' perspectives

Several researchers have reported that cultural and language differences can affect online interactions and communications between students from different cultural backgrounds. Other researchers have asserted that online learning is a tool that can improve teaching and learning skills, but, its effectiveness depends on how the tool is used. Therefore, this study aims to investigate the kinds of challenges encountered by the international students and how they actually cope with online learning. To date little research exists on the perceptions of online learning environments by international Asian students, in particular Malaysian students who study in Australian Universities; hence this study aims to fill this gap. A mixed-method approach was used to collect quantitative and qualitative data using a modified Online Learning Environment Survey (OLES) instrument and focus group interviews. The sample comprised 76 international students from a university in Brisbane. Thirty-five domestic Australian students were included for comparison. Contrary to assumptions from previous research, the findings revealed that there were few differences between the international Asian students from Malaysia and Australian students with regard to their perceptions of online learning. Another cogent finding that emerged was that online learning was most effective when included within blended learning environments. The students clearly indicated that when learning in a blended environment, it was imperative that appropriate features are blended in and customised to suit the particular needs of international students. The study results indicated that the university could improve the quality of the blended online learning environment by: 1) establishing and maintaining a sense of learning community; 2) enhancing the self motivation of students; and 3) professional development of lecturers/tutors, unit coordinators and learning support personnel. Feedback from focus group interviews, highlighted the students‘ frustration with a lack of cooperative learning, strategies and skills which were expected of them by their lecturers/tutors in order to work productively in groups. They indicated a strong desire for lecturers/tutors to provide them prior training in these strategies and skills. The students identified four ways to optimise learning opportunities in cross-cultural spaces. These were: 1) providing preparatory and ongoing workshops focusing on the dispositions and roles of students within student-centred online learning environments; 2) providing preparatory and ongoing workshops on collaborative group learning strategies and skills; 3) providing workshops familiarising students with Australian culture and language; and 4) providing workshops on strategies for addressing technical problems. Students also indicated a strong desire for professional development of lecturers/tutors focused on: 1) teacher attributes, 2) ways to culturally sensitive curricula, and 3) collaborative learning and cooperative working strategies and skills, and 4) designing flexible program structures. Recommendations from this study will be useful to Australian universities where Asian international students from Malaysia study in blended learning environments. An induction program (online skills, collaborative and teamwork skills, study expectations plus familiarisation with Australian culture) for overseas students at the commencement of their studies; a cultural awareness program for lecturers (cultural sensitivity, ways to communicate and a better understanding of Asian educational systems), upskilling of lecturers‘ ability to structure their teaching online and to apply strong theoretical underpinnings when designing learning activities such as discussion forums, and consistency with regards to how content is located and displayed in a learning management system like Blackboard. Through addressing the research questions in this study, the researcher hopes to contribute to and advance the domain of knowledge related to online learning, and to better understand how international Malaysian students‘ perceive online learning environments. These findings have theoretical and pragmatic significance.

Perceptions of online learning in an Australian university: an international students’ (Asian Region) perspective – enjoyment

Several researchers have reported that cultural and language differences can affect online interactions and communications between students from different cultural backgrounds. Other researchers have asserted that online learning is a tool that can improve teaching and learning skills, but its effectiveness depends on how the tool is used. To delve into these aspects further, this study set out to investigate the kinds of learning difficulties encountered by the international students and how they actually coped with online learning. The modified Online Learning Environment Survey (OLES) instrument was used to collect data from the sample of 109 international students at a university in Brisbane. A smaller group of 35 domestic students was also included for comparison purposes. Contrary to assumptions from previous research, the findings revealed that there were only few differences between the international Asian and Australian students with regards to their perceptions of online learning. Recommendations based on the findings of this research study were made for Australian universities where Asian international students study online. Specifically the recommendations highlighted the importance of upskilling of lecturers’ ability to structure their teaching online and to apply strong theoretical underpinnings when designing learning activities such as discussion forums, and for the university to establish a degree of consistency with regards to how content is located and displayed in a learning management system like Blackboard.

Internationalisation and international students : creating an internationalised learning context for international students’ study preparation via CMC

Australian universities have been phenomenally internationalised because of significant numbers of international students in their student cohorts. The international students make up 17.3 percent (OECD 2007) of all the university enrolment, and some universities have much more international student enrolments than the average. From a truly internationalisation perspective, however, there is far more demand of integration with Australian students and international students, the internationalising learning content and context. There have not been much discussion and effort of understanding and practicing of internationalising the learning context from international students’ cultural background and internationalised learning environment. There are many factors which interfere with internationalisation in the learning context such as English proficiency, culture difference and academic staff unawareness. This paper argues the concepts of cultural dimensions and the characteristics of CMC (Computer-Mediated Communication) in a multicultural learning context of Australian higher education. This paper aims to develop a framework of international students’ preparation program for their Western university study based on technology-driven learning models, especially targeting those students who have an Asian cultural background. The program is expected to help international students bridge the gap of cultural differences and better preparation for their active participation and engagement in a new learning environment in order to realise truly internationalisation in Australian higher education

Faculty and students’ awareness and challenges of e-learning in a college of education

This study explored the use of e-learning by student teachers and faculty members at the Paro College of Education, Royal University of Bhutan. It provides an overview of the current status of e-learning at the College including the challenges faced by both faculty members and students teachers, and the influence of ICT resources on the use of e-learning by the lecturers and student teachers. The results indicated that there exist challenges in exercising e-learning at the College for teaching and learning. The data indicated that the Internet connection is slow and revealed that most of the lecturers have average computer competency. This study strongly recommends that the College develops a strategic plan for ICT infrastructure and resources that includes policy and guidelines for use. This study also suggests that lecturers and student teachers use freely available e-learning management software.

Blackboard as an online learning environment : what do teacher education students and staff think?

Abstract: As online learning environments now have an established presence in higher education we need to ask the question: How effective are these environments for student learning? Online environments can provide a different type of learning experience than traditional face-to-face contexts (for on-campus students) or print-based materials (for distance learners). This article identifies teacher education student and staff perceptions of teaching and learning using the online learning management system, Blackboard. Perceptions of staff and students are compared and implications for teacher education staff interested in providing high quality learning environments within an online space are discussed.

Facilitating learning in a real time strategy computer game

The aim of this project was to implement a just-in-time hints help system into a real time strategy (RTS) computer game that would deliver information to the user at the time that it would be of the most benefit. The goal of this help system is to improve the user’s learning in terms of their rate of learning, retention and avoidance of stagnation. The first stage of this project was implementing a computer game to incorporate four different types of skill that the user must acquire, namely motor, perceptual, declarative knowledge and strategic. Subsequently, the just-in-time hints help system was incorporated into the game to assess the user’s knowledge and deliver hints accordingly. The final stage of the project was to test the effectiveness of this help system by conducting two phases of testing. The goal of this testing was to demonstrate an increase in the user’s assessment of the helpfulness of the system from phase one to phase two. The results of this testing showed that there was no significant difference in the user’s responses in the two phases. However, when the results were analysed with respect to several categories of hints that were identified, it became apparent that patterns in the data were beginning to emerge. The conclusions of the project were that further testing with a larger sample size would be required to provide more reliable results and that factors such as the user’s skill level and different types of goals should be taken into account.

The power of educational podcasting : using short-format podcasts to reinforce tertiary student learning experiences in science

In 2007 I introduced short-format educational podcast resources that reinforced conceptual teaching and learning in an interdisciplinary tertiary science study area (biochemistry). This study aims to determine student attitudes to the perceived usefulness and benefit of short-format educational podcasts, and presents the findings (qualitative and quantitative) from surveys obtained from three offerings of the science teaching unit (2007, 2008 and 2009). Podcasts were recorded (MP3 audio files) separately from the instructive lecture sessions, and subsequent to the weekly lecture, short-format podcasts summarising the key learning objectives were integrated within the resources presented through the students learning management system (Blackboard). The vast majority (>88%) of students utilised the podcast resources, indicating a high level of acceptance and uptake for this portable educational technology. The respondents reported that podcasts focused their attention to core learning concepts and supported their understanding and learning of the lecture material. Furthermore, the data showed that respondents agreed strongly that podcasts assisted with study and revision for examinations and, somewhat surprisingly, there was a perception that podcasts positively impacted on examination performance. Overall, student users perceived that podcasting is as an effective and valuable educational tool that offers convenience and flexibility for their learning and understanding of a tertiary science study area, such as biochemistry.

Less but more : weaving disparate disciplines together for learners to construct their own knowledge

This paper reports on a Professional Learning Program conducted in China with 140 general technology teachers. It aimed to integrate robotics technology across and within the disciplines of science, technology, engineering and mathematics. With the help of university facilitators teachers developed General Technology lessons that seamlessly integrated with rich learning content across disciplines. Teachers engaged in seminars and workshops, which provided the opportunities for them to actively couch sound principles of learning in their daily work. They gained first-hand experience in applying an aligned system of assessments, standards and quality learning experiences geared to the needs of each student. Teachers worked collaboratively in teams to create inquiry, design and collaborative learning activities that aligned with their curriculum and which dealt with real world problems, issues and challenges. They continually discussed and reflected deeply on the activities and shared the newly developed resources online with teachers across the entire country. It is evident from the preliminary analysis of data that teachers are beginning to apply rich pedagogical practices and are becoming ‘adaptive’ in their approach when using LEGO® robotic tools to design, redesign, create and re-create learning activities for their students.

Do students and lecturers actively use collaboration tools in learning management systems?

In recent years there has been a large emphasis placed on the need to use Learning Management Systems (LMS) in the field of higher education, with many universities mandating their use. An important aspect of these systems is their ability to offer collaboration tools to build a community of learners. This paper reports on a study of the effectiveness of an LMS (Blackboard©) in a higher education setting and whether both lecturers and students voluntarily use collaborative tools for teaching and learning. Interviews were conducted with participants (N=67) from the faculties of Science and Technology, Business, Health and Law. Results from this study indicated that participants often use Blackboard© as an online repository of learning materials and that the collaboration tools of Blackboard© are often not utilised. The study also found that several factors have inhibited the use and uptake of the collaboration tools within Blackboard©. These have included structure and user experience, pedagogical practice, response time and a preference for other tools.

Locally weighted learning model predictivek control for elastic joint robots

This paper proposes an efficient and online learning control system that uses the successful Model Predictive Control (MPC) method in a model based locally weighted learning framework. The new approach named Locally Weighted Learning Model Predictive Control (LWL-MPC) has been proposed as a solution to learn to control complex and nonlinear Elastic Joint Robots (EJR). Elastic Joint Robots are generally difficult to learn to control due to their elastic properties preventing standard model learning techniques from being used, such as learning computed torque control. This paper demonstrates the capability of LWL-MPC to perform online and incremental learning while controlling the joint positions of a real three Degree of Freedom (DoF) EJR. An experiment on a real EJR is presented and LWL-MPC is shown to successfully learn to control the system to follow two different figure of eight trajectories.

Critical success elements for the design and implementation of organisational e-learning

Organisations are engaging in e-learning as a mechanism for delivering flexible learning to meet the needs of individuals and organisations. In light of the increasing use and organisational investment in e-learning, the need for methods to evaluate the success of its design and implementation seems more important than ever. To date, developing a standard for the evaluation of e-learning appears to have eluded both academics and practitioners. The currently accepted evaluation methods for e-learning are traditional learning and development models, such as Kirkpatrick’s model (1976). Due to the technical nature of e-learning it is important to broaden the scope and consider other evaluation models or techniques, such as the DeLone and McLean Information Success Model, that may be applicable to the e-learning domain. Research into the use of e-learning courses has largely avoided considering the applicability of information systems research. Given this observation, it is reasonable to conclude that e-learning implementation decisions and practice could be overlooking useful or additional viewpoints. This research investigated how existing evaluation models apply in the context of organisational e-learning, and resulted in an Organisational E-learning success Framework, which identifies the critical elements for success in an e-learning environment. In particular this thesis highlights the critical importance of three e-learning system creation elements; system quality, information quality, and support quality. These elements were explored in depth and the nature of each element is described in detail. In addition, two further elements were identified as factors integral to the success of an e-learning system; learner preferences and change management. Overall, this research has demonstrated the need for a holistic approach to e-learning evaluation. Furthermore, it has shown that the application of both traditional training evaluation approaches and the D&M IS Success Model are appropriate to the organisational e-learning context, and when combined can provide this holistic approach. Practically, this thesis has reported the need for organisations to consider evaluation at all stages of e-learning from design through to implementation.

The use of Facebook in tertiary education : case study of a unit-related Facebook page in a university justice class

Purpose – This study aims to evaluate the usefulness of a university unit Facebook page, which was established to support a first-year university justice unit. The study pays particular regard to the Facebook page's impact on students learning outcomes and communications amongst students and between students and teaching staff. Design/methodology/approach – All students enrolled in the unit were asked to complete an online survey, which sought to determine whether they used the unit Facebook page and if so, the nature and extent of their use. Findings – The study found that the unit Facebook page was useful in achieving most learning objectives for the unit. This included enhancing students' knowledge and understanding of unit content, as well as their ability to critically analyse unit materials. Students also indicated that they found the Facebook page better than the university's central learning management system across a range of areas. It was particularly useful for facilitating unit-related discussions. Research limitations/implications – The survey results reported in this paper are based on a relatively small sample of students (n=67) from a first-year university justice unit. Future studies should seek to garner evidence from broader and larger samples that transcend specific unit populations. However, the findings of this study do indicate further support for the use of Facebook as a supplementary tool in university education. Originality/value – This study focuses on two aspects of social networking technologies that have not been previously researched and thus contributes to the growing literature on the uses and benefits of Facebook in tertiary education.

Locally weighted learning model predictive control for nonlinear and time varying dynamics

This paper proposes an online learning control system that uses the strategy of Model Predictive Control (MPC) in a model based locally weighted learning framework. The new approach, named Locally Weighted Learning Model Predictive Control (LWL-MPC), is proposed as a solution to learn to control robotic systems with nonlinear and time varying dynamics. This paper demonstrates the capability of LWL-MPC to perform online learning while controlling the joint trajectories of a low cost, three degree of freedom elastic joint robot. The learning performance is investigated in both an initial learning phase, and when the system dynamics change due to a heavy object added to the tool point. The experiment on the real elastic joint robot is presented and LWL-MPC is shown to successfully learn to control the system with and without the object. The results highlight the capability of the learning control system to accommodate the lack of mechanical consistency and linearity in a low cost robot arm.