Course evaluation : reconfigurations for learning with learning management systems

The introduction of online delivery platforms such as learning management systems (LMS) in tertiary education has changed the methods and modes of curriculum delivery and communication. While course evaluation methods have also changed from paper-based in-class-administered methods to largely online-administered methods, the data collection instruments have remained unchanged. This paper reports on a small exploratory study of two tertiary-level courses. The study investigated why design of the instruments and methods to administer surveys in the courses are ineffective measures against the intrinsic characteristics of online learning. It reviewed the students' response rates of the conventional evaluations for the courses over an eight-year period. It then compared a newly developed online evaluation and the conventional methods over a two-year period. The results showed the response rates with the new evaluation method increased by more than 80% from the average of the conventional evaluations (below 30%), and the students' written feedback was more detailed and comprehensive than in the conventional evaluations. The study demonstrated the possibility that the LMS-based learning evaluation can be effective and efficient in terms of the quality of students' participation and engagement in their learning, and for an integrated pedagogical approach in an online learning environment.

Student interactivity and teacher participation: An application of legitimate peripheral participation in higher education online learning environments

Lave and Wenger’s legitimate peripheral participation is an important aspect of online learning environments. It is common for teachers to scaffold varying levels of online participation in Web 2.0 contexts, such as online discussion forums and blogs. This study argues that legitimate peripheral participation needs to be redefined in response to students’ decentralised multiple interactions and non-linear engagement in hyperlinked learning environments. The study examines students’ levels of participation in online learning through theories of interactivity, distinguishing between five levels of student participation in the context of a first-year university course delivered via a learning management system. The data collection was implemented through two instruments: i) a questionnaire about students’ interactivity perception in the online reflective learning (n = 238) and then ii) an open discussion on the reason for the diverse perceptions of interactivity (n = 34). The study findings indicate that student participants, other than those who were active, need high levels of teacher or moderator intervention, which better enables legitimate peripheral participation to occur in online learning contexts.

From policy borrowing to implementation : an illuminative evaluation of learning and teaching in higher education in Australia (2002 to 2008)

This study documents and theorises the consequences of the 2003 Australian Government Reform Package focussed on learning and teaching in Higher Education during the period 2002 to 2008. This is achieved through the perspective of program evaluation and the methodology of illuminative evaluation. The findings suggest that the three national initiatives of that time, Learning and Teaching Performance Fund (LTPF), Australian Learning and Teaching Council (ALTC), and Australian Universities Quality Agency (AUQA), were successful in repositioning learning and teaching as a core activity in universities. However, there were unintended consequences brought about by international policy borrowing, when the short-lived nature of LTPF suggests a legacy of quality compliance rather than one of quality enrichment.

Improving the outcomes of foot and ankle surgery through the audit cycle : a case study

The direct costs of managing adverse outcomes from Australian health care are estimated to be $2 billion. The audit cycle is considered an important tool to assist in the preventive management of adverse outcomes.Australian guidelines for audit cycle design allow for comparison of data sets derived from similar surgical specialities. However a lack of data set standardisation inhibits meaningful comparisons of foot and ankle surgical audits. This research will assist development of a best practice model for auditing foot and ankle surgery. Data derived from this model will improve the safety and quality of foot and ankle surgery. The preliminary phase of this process is to identify and understand the attitudes and behaviours of how and why surgeons participate in the audit cycle. A descriptive embedded multiple case study research design is planned to provide an intense focus on a single phenomenon (the audit cycle) within its real life context (clinical governance). The measures to be included in the case study have been identified by the Balanced Patient Safety Measurement Framework. These include: audit and peer review activity, provider attitudes to patient safety, safety learning, action and performance. A purposive sample of 6 to 8 surgeons (units of analysis) from 3 to 4 specialities (cases) will undergo semi-structured interview. This will investigate: current audit tools and processes; attitudes; and behaviours of surgeons to the audit cycle. Similarities in and differences between the units of analysis will indicate which identified measures function as barriers or enablers of the audit cycle. Reliability and validity (external and construct) will be assessed using established methods for case studies. The descriptive embedded multiple case study will reveal how and why foot and ankle surgeons participate in the audit cycle. This will inform further research to improve the outcomes of foot and ankle surgery through development of an audit tool.

What makes e-learning work?

This chapter examines lessons learnt from a study of the use of e-learning within the rail sector in Australia and explores factors that inhibit or advance its organisational effectiveness. We examine the social, organisational and technical influences on the way employees perceive and use e-learning. By examining these issues, we aim to demonstrate that successful organisational adoption of e-learning is influenced by factors beyond the systems themselves and requires a more holistic understanding of the target workforce and the suitability of the e-learning tasks. Without a clear understanding of these relationships, organisations run the real risk of investing heavily in e-learning without receiving benefits or, worse still, impacting negatively on their ability to deliver training.

Do nursing students have the recall of bioscience necessary to study pharmacology?

Background: For medical and allied health students, bioscience knowledge underpins the successful scaffolding of learning in their developmental and advanced level units. Many of these students complete theory-based Bioscience units, followed by a unit in Pharmacology, which specifically requires knowledge of anatomy, physiology and microbiology. In general, studies of recall report relatively large losses over short retention intervals (months), which accumulate, but level off, for longer retention intervals (years) (Custers, 2010). However, there are no studies that specifically test the recall of bioscience knowledge by allied health students. Methods: We are tracking the recall of bioscience in nursing students prior to, and during, their Pharmacology unit. In each semester, students complete short, basic, knowledge-based MCQ quizzes on concepts from (i) the gastrointestinal system and (ii) fundamental microbiology. Students were given 5 days warning about the microbiology quizzes but were given no warning prior to the gastrointestinal system quiz. Performance in these quizzes was compared to individual student’s results in the final examination on these topics in the first semester of their degree. Results: At the start of the study, the nursing students performed better in the exam MCQs on the gastrointestinal system than on microbiology. In the exam, the students’ mean marks for the gastrointestinal system ranged from 69–83%, and this was successively reduced to 63%, 53% and 49% after 4, 9 and 16 months, respectively. The mean exam marks for microbiology was 48–58%, and this did not change significantly after 4 (63%), 9 (59%) or 16 months (47%). This suggests that warning the nursing students that they were to be quizzed on microbiology may have helped their recall. However, after 16 months regardless of the subject, the nursing students undertaking the Pharmacology unit recalled less than half of the bioscience quiz answers. Conclusions: Nursing students may not have the recall of bioscience necessary to study pharmacology, and this may limit their success in pharmacology. Reference: Custers, E. J. F. M. (2010). Long-term retention of basic science knowledge: a review study. Advances in Health Science Education, 15, 109–128.

Evaluation of assessment in the context of work-based learning: Qualitative perspectives of new graduates

Aim Evaluation or assessment of competence is an important step to ensure the safety and efficacy of health professionals, including dietitians. Most competency-based assessment studies are focussed on valid and reliable methods of assessment for the preparation of entry-level dietitians, few papers have explored student dietitians’ perceptions of these evaluations. This study aimed to explore the perceptions of recent graduates from accredited nutrition and dietetics training programs in Australia. It also aimed to establish the relevance of competency-based assessment to adequately prepare them for entry-level work roles. Methods A purposive sample of newly-graduated dietitians with a range of assessment experiences and varied employment areas was recruited. A qualitative approach, using in-depth interviews with 13 graduates, with differing assessment experiences was undertaken. Graduates were asked to reflect upon their competency-based assessment experiences whilst a student. Data was thematically analysed by multiple authors. Results Four themes emerged from the data analysis: (i) Transparency and consistency are critical elements of work-based competency assessment. (ii) Students are willing to take greater responsibility in their assessment process. (iii) Work-based competency assessment prepares students for employment. (iv) The relationship between students and their assessors can impact on the student experience and their assessment performance. Conclusions Understanding this unique perspective of students can improve evaluation of future health professionals and assist in designing valid competency-based assessment approaches.

Contexts, codes and online communications – a case study exploring issues related to using CMCs in a drama education project

Many educators are currently interested in using computer-mediated communications (CMCs) to support learning and creative practice. In my work I have been looking at how we might create drama through using cyberspaces, working with teachers and students in secondary school contexts. In trying to understand issues that have arisen and ways of working with the data I have found a number of frameworks helpful for analysing the online interactions. These frameworks draw from O'Toole's work on contexts negotiated in the creation of drama and other frameworks drawn from Wertsch, Bakhtin and Vygotsky's work on speech utterances, dialogic processes and internalisation of learning. The contexts and factors which must be negotiated in online communications within learning contexts are quite complex and educators may need to provide parameters and protocols to ensure appropriate languages, genres and utterances are utilised. The paper explores some of the types of languages, genres and utterances that emerged from a co-curricula drama project and issues that arose, including the importance of establishing processes for giving and receiving critical feedback This paper is of relevance to those whose research strategies may involve the use of computer-mediated communications as well as those utilising cyberspaces in educational contexts.

Pharmacy educators' intention for the curriculum : an Australian pilot study

Background: Pharmacy educators play an important role in supporting the professional identity formation of students, particularly in relation to their perceptions and strategies for the curriculum and subsequent learning experiences. Aim: To explore pharmacy educators’ perceptions of the purpose of the pharmacy curriculum and how they contribute to students’ development as pharmacists. Methods: A one-off survey using a 20-item questionnaire distributed to all pharmacy educators at a single school of pharmacy who contributed to an Australian undergraduate pharmacy degree program. Results: Most educators viewed the curriculum and their role from a traditional perspective. The educators felt the key purpose of the curriculum was to develop competent pharmacists by providing students with knowledge and skills. There was a limited emphasis on patient-centredness. Conclusion: Whilst educators were focused on developing competent pharmacists through the provision of knowledge and skills, important learning opportunities supporting identity formation may be missed.

Effectiveness of a puppet show on iodine knowledge, attitudes and behaviour of elementary students and the indirect effects on their parents and households in Ho Chi Minh City : a pilot study

Deficiencies in iodine levels have been shown to seriously affect a child’s intellectual development and learning capacity.1 In South-East Asia, iodine deficiency remains a major public health concern. Approximately 30% of the region’s population of 503.6 million have insufficient iodine intake, and only 61% of households have access to iodized salt.1 For this reason, it is necessary to initiate effective, community-based health promotion activities that are targeted toward populations of various ages. A puppet show is one imaginative and entertaining method of health education that has been advocated for use in communicating positive health behaviours to children.2e5 The authors undertook a literature review and found no studies assessing the effectiveness of a puppet show to teach an iodine education programme...

Tales of science and defiance : the case for co-learning and collaboration in bridging the science/emotion divide in water recycling debates

Although science is generally assumed to be well integrated into rational decision-making models, it can be used to destabilise consultative processes, particularly when emotions are involved. Water policies are often seen as debates over technical and engineering issues, but can be highly controversial. Recycled water proposals, in particular, can create highly emotive conflicts. Through a case study regarding the rejection of recycled water proposals in the south-east Queensland, Australia, we explore the influence of science and emotions in contemporary water planning. We highlight the dangers inherent in promoting technical water planning issues at the expense of appropriate consideration of citizen concerns. Combining the science–policy interface and stakeholder engagement literatures, we advocate for collaborative decision-making processes that accommodate emotions and value judgements. A more collaborative stakeholder engagement model, founded on the principles of co-learning, has the potential to broaden the decision-making base and to promote better and more inclusive decision-making.

Dimensions of effectiveness and efficiency: A case study on industry–school partnerships

Internationally, the delivery of vocational education and training is being challenged by increasing skills shortages in certain industries and/or rapidly changing skill requirements. To respond to this challenge, rigid and centralised state bureaucracies are increasingly adopting partnerships between schools and industry as a strategy to encourage school-to-work transition programmes to address the local labour market demand. Drawing on experiences in Australia, this paper reports on a case study of government led partnerships between schools and industry. The Queensland Gateway to industry schools initiative currently involves over 120 schools. The study investigated how two commonly used partnership principles were understood by the Gateway to industry partners. Twelve school–industry partnerships from four industry sectors were analysed in terms of the principles of ‘efficiency’ and ‘effectiveness’ derived from the public–private partnership literature. The study found that some evidence of partnership activities associated with efficiency and effectiveness may be assigned to Gateway schools projects. However, little evidence was found that the above underlying principles were addressed systematically. Some of these partnerships were tenuously facilitated by individuals who had limited infrastructure or strategic support. Implications are that industry–school partnership stakeholders would benefit from applying partnership principles regarding implementation and management to ensure the sustainability of partnerships.

Case Study 4: Education Doctoral Student - "An Exploratory Study of Online Social Networking within a Doctorate of Education Program"

Introduction The professional doctorate is specifically designed for professionals investigating real-world problems and relevant issues for a profession, industry, and/or the community. The focus is scholarly research into professional practices. The research programme bridges academia and the professions, and offers doctoral candidates the opportunity to investigate issues relevant to their own practices and to apply these understandings to their professional contexts. The study on which this article is based sought to track the scholarly skill development of a cohort of professional doctoral students who commenced the course in January 2008 at an Australian university. Because they hold positions of responsibility and are time-poor, many doctoral students have difficulty transitioning from professional practitioner to researcher and scholar. The struggle many experience is in the development of a theoretical or conceptual standpoint for argumentation (Lesham, 2007; Weese et al., 1999). It was thought that the use of a scaffolded learning environment that drew upon a blended learning approach incorporating face to face intensive blocks and collaborative knowledge-building tools such as wikis would provide a data source for understanding the development of scholarly skills. Wikis, weblogs and similar social networking software have the potential to support communities to share, learn, create and collaborate. The development of a wiki page by each candidate in the 2008 cohort was encouraged to provide the participants and the teaching team members with textual indicators of progress. Learning tasks were scaffolded with the expectation that the candidates would complete these tasks via the wikis. The expectation was that cohort members would comment on each other’s work, together with the supervisor and/or teaching team member who was allocated to each candidate. The supervisor is responsible for supervising the candidate’s work through to submission of the thesis for examination and the teaching team member provides support to both the supervisor and the candidate through to confirmation. This paper reports on the learning journey of a cohort of doctoral students during the first seven months of their professional doctoral programme to determine if there had been any qualitative shifts in understandings, expectations and perceptions regarding their developing knowledge and skills. The paper is grounded in the literature pertaining to doctoral studies and examines the structure of the professional doctoral programme. Following this is a discussion of the qualitative study that helped to unearth key themes regarding the participants’ learning journey.

Blended learning : meeting the needs of distance education students

This thesis involved research into the barriers and enablers that existed for a cohort of mature-aged education support students engaging with blended learning through distance education. The findings that emerged from this research indicated that a flexible model of blended learning is possible in this context. The findings shed light on the experiences of novice technology users' participation in blended learning. The study highlighted the significance of factors such as isolation, technology, communication, connectivity, prior learning, and the growth of self-efficacy that influenced learner engagement.