Benefits of e-learning benchmarks : Australian case studies

In 2004, the Australian Flexible Learning Framework developed a suite of quantitative and qualitative indicators on the uptake, use and impact of e-learning in the Vocational Education and Training (VET) sector. These indicators were used to design items for a survey to gather quantitative data for benchmarking. A series of four surveys gathered data from VET providers, teachers, students and their employers. The data formed baseline indicators that were used to establish organisational goals and benchmarks for e-learning. These indicators were the first know set for benchmarking e-learning in Australia. The case studies in this paper illustrate ways in which VET providers have approached e-learning benchmarking, the benefits achieved and the lessons that they learned. The cases exemplify how VET providers have adapted the baseline indicators, how the indicators informed organisational plans and e-learning outcomes. The benefits of benchmarking are categorised under three purposes: reporting, performance management, and service improvement. A set of practical strategies is derived from the cases for consideration by other organisations interested in benchmarking e-learning services.

Implementation of an integrated, technology-based, discovery mode assessment item involving an incubation period to enhance learning outcomes for engineering maths students

In this paper we discuss our current efforts to develop and implement an exploratory, discovery mode assessment item into the total learning and assessment profile for a target group of about 100 second level engineering mathematics students. The assessment item under development is composed of 2 parts, namely, a set of "pre-lab" homework problems (which focus on relevant prior mathematical knowledge, concepts and skills), and complementary computing laboratory exercises which are undertaken within a fixed (1 hour) time frame. In particular, the computing exercises exploit the algebraic manipulation and visualisation capabilities of the symbolic algebra package MAPLE, with the aim of promoting understanding of certain mathematical concepts and skills via visual and intuitive reasoning, rather than a formal or rigorous approach. The assessment task we are developing is aimed at providing students with a significant learning experience, in addition to providing feedback on their individual knowledge and skills. To this end, a noteworthy feature of the scheme is that marks awarded for the laboratory work are primarily based on the extent to which reflective, critical thinking is demonstrated, rather than the amount of CBE-style tasks completed by the student within the allowed time. With regard to student learning outcomes, a novel and potentially critical feature of our scheme is that the assessment task is designed to be intimately linked to the overall course content, in that it aims to introduce important concepts and skills (via individual student exploration) which will be revisited somewhat later in the pedagogically more restrictive formal lecture component of the course (typically a large group plenary format). Furthermore, the time delay involved, or "incubation period", is also a deliberate design feature: it is intended to allow students the opportunity to undergo potentially important internal re-adjustments in their understanding, before being exposed to lectures on related course content which are invariably delivered in a more condensed, formal and mathematically rigorous manner. In our presentation, we will discuss in more detail our motivation and rationale for trailing such a scheme for the targeted student group. Some of the advantages and disadvantages of our approach (as we perceived them at the initial stages) will also be enumerated. In a companion paper, the theoretical framework for our approach will be more fully elaborated, and measures of student learning outcomes (as obtained from eg. student provided feedback) will be discussed.

A reflective model for colour studies learning

In a university context how should colour be taught in order to engage students? Entwistle states, ‘What we learn depends on how we learn, and why we have to learn it.’ Therefore, there is a need to address the accumulating evidence that highlights the effects of learning environments on the quality of student learning when considering colour education. It is necessary to embrace the contextual demands while ensuring that the student knowledge of colour and the joy of discovering its characteristics in practice are enhanced. Institutional policy is forcing educators to re-evaluate traditional studio’s effectiveness and the intensive 'hands-on' interactive approach that is embedded in such an approach. As curriculum development involves not only theory and project work, the classroom culture and physical environment also need to be addressed. The increase in student numbers impacting the number of academic staff/student ratio, availability of teaching support as well as increasing variety of student age, work commitments, learning styles and attitudes have called for positive changes to how we teach. The Queensland University of Technology’s restructure in 2005 was a great opportunity to re-evaluate and redesign the approach to teaching within the design units of Interior Design undergraduate program –including colour. The resultant approach “encapsulates a mode of delivery, studio structure, as well as the learning context in which students and staff interact to facilitate learning”1 with a potential “to be integrated into a range of Interior Design units as it provides an adaptive educational framework rather than a prescriptive set of rules”.

The quality of interface design for educational courseware development in Malaysian educational context

Interactive educational courseware has been adopted in diverse education sectors such as primary, secondary, tertiary education, vocational and professional training. In Malaysian educational context, the ministry of education has implemented Smart School Project that aims to increase high level of academic achievement in primary and secondary schools by using interactive educational courseware. However, many researchers have reported that many coursewares fail to accommodate the learner and teacher needs. In particular, the interface design is not appropriately designed in terms of quality of learning. This paper reviews educational courseware development process in terms of defining quality of interface design and suggests a conceptual model of interface design through the integration of design components and interactive learning experience into the development process. As a result, it defines the concept of interactive learning experience in a more practical approach in order to implement each stage of the development process in a seamless and integrated way.

Aligning ICT in assessment with teaching and learning : enhancing student achievement in the middle years

Student underachievement in the middle years (typically Years 4 to 9) is a concern in education. Incorporating Information and Communication Technologies (ICT) in assessment that is aligned to teaching and learning has the potential to engage students in higher cognitive processes that lead to increased student achievement. To examine this proposition an investigation was undertaken into teachers’ perceptions of alignment and the implications of those for student achievement in ICT enhanced middle years assessment tasks. This investigation used a collective case study design underpinned by socio-cultural theory. Two methods were used for data collection, namely, semi-structured interviews with individual teachers and a focus group discussion with teachers and another with students. Findings revealed teachers’ perceptions that alignment: assists in mediating achievement of learning outcomes in quality middle years assessment tasks, assists in creating a challenging but supportive environment in which positive learning dispositions and success is encouraged for all students, and contributes to more rigorous use of ICT in assessment. The process of implementing alignment was found to be complex but assisted through prioritising particular practices. These findings enabled the development of eight steps which serve as a guide to the effective implementation of alignment in middle years assessment tasks.

Cooperative learning in Thailand : professional development to enhance primary education

The overall purpose of this study was to develop a model to inform the design of professional development programs and the implementation of cooperative learning within Thai primary school mathematics classrooms. Action research design, with interviews, surveys and observations, was used for this study. Survey questionnaires and classroom observations investigated the factors that influence the implementation of cooperative learning strategies and academic achievement in Thai primary school mathematics classrooms. The teachers’ interviews and classroom observation also examined the factors that need to be addressed in teacher professional development programs in order to facilitate cooperative learning in Thai mathematics classrooms. The outcome of this study was a model consisting of two sets of criteria to inform the successful implementation of cooperative learning in Thai primary schools. The first set of criteria was for proposers and developers of professional development programs. This set consists of macro- and micro-level criteria. The macro-level criteria focus on the overall structure of professional development programs and how and when the professional development programs should be implemented. The micro-level criteria focused on the specific topics that need to be included in professional development programs. The second set of criteria was for Thai principals and teachers to facilitate the introduction of cooperative learning in their classrooms. The research outcome also indicated that the attainment of these cooperative learning strategies and skills had a positive impact on the students’ learning of mathematics.

Redundancy in interface design and its impact on intuitive use of a product in older users

Many older adults have difficulty using modern consumer products due to their complexity both in terms of functionality and interface design. It has been observed that older people also have more problems learning new systems. It was hypothesised that designing technological products that are more intuitive for older people to use can solve this problem. An intuitive interface allows a user’s to employ prior knowledge, thus minimizing the learning needed for effective interaction. This paper discusses an experiment investigating the effectiveness of redundancy in interface design. The primary objective of this experiment was to find out if using more than one modality for a product’s interface improves the speed and intuitiveness of interactions for older adults. Preliminary analysis showed strong correlation between technology familiarity and time on tasks, but redundancy in interface design improved speed and accuracy of use only for participants with moderate to high technology familiarity.

Increasing stochastic perturbations enhances acquisition and learning of complex sport movements

Traditionally, the aquisition of skills and sport movement has been characterised by numerous repetitions of presumed model movement pattern to be acquired by learners. This approach has been questioned by research identifying the presence of individualised movement patterns and the low probability of occurrence of two identical movements within and between individuals. In contrast, the differential learning approach claims advantage for incurring variability in the learning process by adding stochastic perturbations during practice. These ideas are exemplified by data from a high jump experiment which compared the effectiveness of classical and a differential training approach with pre-post test design. Results showed clear advantages for the group with additional stochastic perturbation during the aquisition phase in comparison to classically trained athletes. Analogies to similar phenomenological effects in the neurobiological literature are discussed.

Problem solving in a middle school robotics design classroom

Little research has been conducted on how students work when they are required to plan, build and evaluate artefacts in technology rich learning environments such as those supported by tools including flow charts, Labview programming and Lego construction. In this study, activity theory was used as an analytic tool to examine the social construction of meaning. There was a focus on the effect of teachers’ goals and the rules they enacted upon student use of the flow chart planning tool, and the tools of the programming language Labview and Lego construction. It was found that the articulation of a teacher’s goals via rules and divisions of labour helped to form distinct communities of learning and influenced the development of different problem solving strategies. The use of the planning tool flow charting was associated with continuity of approach, integration of problem solutions including appreciation of the nexus between construction and programming, and greater educational transformation. Students who flow charted defined problems in a more holistic way and demonstrated more methodical, insightful and integrated approaches to their use of tools. The findings have implications for teaching in design dominated learning environments.

Levelling expectations across different years in an undergraduate degree to support work-related learning : evidence for a multi-pronged approach.

One of the ways in which university departments and faculties can enhance the quality of learning and assessment is to develop a ‘well thought out criterion‐referenced assessment system’ (Biggs, 2003, p. 271). In designing undergraduate degrees (courses) this entails making decisions about the levelling of expectations across different years through devising objectives and their corresponding criteria and standards: a process of alignment analogous to what happens in unit (subject) design. These decisions about levelling have important repercussions in terms of supporting students’ work‐related learning, especially in relation to their ability to cope with the increasing cognitive and skill demands made on them as they progress through their studies. They also affect the accountability of teacher judgments of students’ responses to assessment tasks, achievement of unit objectives and, ultimately, whether students are awarded their degrees and are sufficiently prepared for the world of work. Research reveals that this decision‐making process is rarely underpinned by an explicit educational rationale (Morgan et al, 2002). The decision to implement criterion referenced assessment in an undergraduate microbiology degree was the impetus for developing such a rationale because of the implications for alignment, and therefore ‘levelling’ of expectations across different years of the degree. This paper provides supporting evidence for a multi‐pronged approach to levelling, through backward mapping of two revised units (foundation and exit year). This approach adheres to the principles of alignment while combining a work‐related approach (via industry input) with the blended disciplinary and learner‐centred approaches proposed by Morgan et al. (2002). It is suggested that this multi‐pronged approach has the potential for making expectations, especially work‐related ones across different year levels of degrees, more explicit to students and future employers.

Harnessing assessment and feedback in the first year to support learning success, engagement and retention

It has been argued that intentional first year curriculum design has a critical role to play in enhancing first year student engagement, success and retention (Kift, 2008). A fundamental first year curriculum objective should be to assist students to make the successful transition to assessment in higher education. Scott (2006) has identified that ‘relevant, consistent and integrated assessment … [with] prompt and constructive feedback’ are particularly relevant to student retention generally; while Nicol (2007) suggests that ‘lack of clarity regarding expectations in the first year, low levels of teacher feedback and poor motivation’ are key issues in the first year. At the very minimum, if we expect first year students to become independent and self-managing learners, they need to be supported in their early development and acquisition of tertiary assessment literacies (Orrell, 2005). Critical to this attainment is the necessity to alleviate early anxieties around assessment information, instructions, guidance, and performance. This includes, for example:  inducting students thoroughly into the academic languages and assessment genres they will encounter as the vehicles for evidencing learning success; and  making expectations about the quality of this evidence clear. Most importantly, students should receive regular formative feedback of their work early in their program of study to aid their learning and to provide information to both students and teachers on progress and achievement. Leveraging research conducted under an ALTC Senior Fellowship that has sought to articulate a research-based 'transition pedagogy' (Kift & Nelson, 2005) – a guiding philosophy for intentional first year curriculum design and support that carefully scaffolds and mediates the first year learning experience for contemporary heterogeneous cohorts – this paper will discuss theoretical and practical strategies and examples that should be of assistance in implementing good assessment and feedback practices across a range of disciplines in the first year.

Historical timelines : analyzing multimodal text design

The recent focus on literacy in Social Studies has been on linguistic design, particularly that related to the grammar of written and spoken text. When students are expected to produce complex hybridized genres such as timelines, a focus on the teaching and learning of linguistic design is necessary but not sufficient to complete the task. Theorizations of new literacies identify five interrelated meaning making designs for text deconstruction and reproduction: linguistic, spatial, visual, gestural, and audio design. Honing in on the complexity of timelines, this paper casts a lens on the linguistic, visual, spatial, and gestural designs of three pairs of primary school aged Social Studies learners. Drawing on a functional metalanguage, we analyze the linguistic, visual, spatial, and gestural designs of their work. We also offer suggestions of their effect, and from there consider the importance of explicit instruction in text design choices for this Social Studies task. We conclude the analysis by suggesting the foci of explicit instruction for future lessons.

Problem-based learning (PBL) in Virtual Space : Developing experiences for professional development

This book reports the outcomes of an investigation into discovering the qualitatively different ways that students experience Problem-based learning (PBL)in virtual space. PBL is increasingly being used in many fields including engineering education. At the same time, many engineering education providers are turning to online distance education. Unfortunately there is a dearth of research into what constitutes an effective learning experience for adult learners who undertake PBL instruction through online distance education. Data were collected from a course which adopted the PBL strategy and was delivered entirely in virtual space. Students were asked to respond to open-ended questions designed to elicit their learning experiences. Data were analysed using the phenomenographic approach. Five qualitatively different ways of experiencing PBL in virtual space were discovered. Results indicate that the design of students' online learning experience was responsible for making students aware of deeper ways of experienceing PBL in virtual space. The outcomes imply that pedagogical strategies can be devised for shifting students' focus as they engage in virtual PBL.

Daylighting design in the architectural design studio

This paper discusses two different approaches to teaching design and their modes of delivery and reflects upon their successes and failures. Two small groups of third year design students have been given projects focussing on incorporation of daylighting to architectural design in studios having different design themes. In association with the curriculum, the themes were Digital Tools and Sustainability. Although both studios had the topic of daylighting, the aim and methodology used were different. Digital Tool studio’s aim was to teach how to design daylighting by using a digital tool, where as, Sustainability studio aimed at using scale modelling as a tool to learn about daylighting and integrating it into design. Positive results for providing student learning success within the University context were the students’ chance to learn and practice some new skills –using a new tool for designing; integration of the tutors’ extensive research expertise to their teaching practice; and the students’ construction of their own understanding of knowledge in a student-centred educational environment. This environment created a very positive attitude in the form of exchanging ideas and collaboration among the students of Digital Tools students at the discussion forum. Sustainability group students were enthusiastic about designing and testing various proposals. Problems that both studios experienced were mainly related to timing. Synchronizing with other groups of their studios and learning of a new skill on top of an already complicated process of design learning were the setbacks.

Ageing and learning in Australia

Powerpoint presentation of keynote speech