Does calibration reduce variability in the assessment of accounting learning outcomes?

Reliable, consistent assessment process that produces comparable assessment grades between assessors and institutions is a core activity and an ongoing challenge with which universities have failed to come to terms. In this paper, we report results from an experiment that tests the impact of an intervention designed to reduce grader variability and develop a shared understanding of national threshold learning standards by a cohort of reviewers. The intervention involved consensus moderation of samples of accounting students’ work, with a focus on three research questions. First, what is the quantifiable difference in grader variability on the assessment of learning outcomes in ‘application skills’ and ‘judgement’? Second, does participation in the workshops lead to reduced disparity in the assessment of the students’ learning outcomes in ‘application skills’ and ‘judgement’? Third, does participation in the workshops lead to greater confidence by reviewers in their ability to assess students’ skills in application skills and judgement? Our findings suggest consensus moderation does reduce variability across graders and also builds grader confidence.

Enhancing learning for distance students in an Undergraduate engineering course through real-time web-conferencing

On-line education in engineering has attracted a great deal of interest in recent years. One of the difficulties faced in an on-line engineering program is how to ensure effective communication between lecturers and students, and among the students themselves.Techniques common ten years ago such as email, lecture notes posted to websites, and telephone conversations, are now seen as archaic when compared with opportunities offered by more modern communication technologies, such as real-time web-conferencing.We present our efforts to use the web-conferencing software Elluminate-Live! for delivering tutorials, discussion classes, and even laboratory practicals to groups of students studying engineering off-campus, including students posted overseas. Examples are given from two disciplines. We then compare student feedback across all engineering subjects over the years 2012-2013. Our results show that students welcome web-conferencing as a very effectivemeans to deliver classes to distance students and improve their learning experience.

Teamwork benefits in tertiary education

Purpose – The purpose of this paper is to contribute to the understanding of the development ofstudents’ skills in the context of team-based learning. Academics have heeded the call to incorporateteam learning activities into the curricula, yet little is known of student perception of teamworkand whether they view it as beneficial to them and their future professional career. Further, this studypresents an instructional framework to guide best practice in higher education practitioners withregard to the design of teamwork assessment.Design/methodology/approach – The paper adopts a qualitative approach utilising 190 students’reflections to examine their perception of the benefits of teamwork and whether it will contribute totheir future professional work.Findings – Results indicate students perceive team-based assessment tasks require them to adopt adeep approach to learning together with a deep approach to study, as well as improving their skillsin the areas of collaboration, team unity and cultural diversity. Further, the study identified a bestpractice approach that higher education practitioners should adopt in teamwork assessment designgiving this study both national and international significance and aids fellow educators in theirpractices.Research limitations/implications – Because of the chosen research approach, the results maylack generalisability. Therefore, researchers are encouraged to test the proposed propositions further.Practical implications – The paper presents important implications for those involved in thedevelopment of assessment items where objectives include the development of team skills and qualitylearning outcomes. The findings are vital for unit and course planning and design generally, andassessment planning, design and processes, specifically, both nationally and internationally.Originality/value – This paper fulfils an identified need to study students’ perceptions of teamwork,whether they view it as beneficial to them and their future professional career, and presents a bestpractice approach for teamwork assessment design.

Chinese students’ perceptions of the teaching in an Australian accounting programme – an exploratory study

This exploratory study is designed to elicit and understand the views of Mainland Chinese students concerning their learning experience in an Australian accounting education programme. The article contributes to the literature by investigating the issues and implications associated with international students’ perceptions of teaching, as little research has been undertaken in this context. Data were obtained from focus group interviews at two Australian universities, comprising students who had no prior experience of Western education. Based on an adaptation of Ramsden's 2003 model [Learning to teach in higher education (2nd ed.). London: Routledge], the data show that the students’ educational experience in China has a direct and negative influence on their perceptions of the teaching and learning experience in Australia. The negativity is particularly strong for entry-level students but dissipates to some extent with time. Issues concerning teachers’ enthusiasm, commitment, delivery skills and students’ expectations also emerged as important factors affecting student perceptions.

Drivers of teaching effectiveness: Views from accounting educator exemplars in Australia

This paper summarizes the views, obtained via a survey instrument created by the authors and reported in studies by Stout and Wygal, of 22 accounting educator teaching exemplars from Australia. Each of these individuals has been cited for teaching excellence through receipt of one or more formal teaching awards. The paper responds to calls in Australia for increased attention to the dimensions of teaching effectiveness and to initiatives in the United States calling for a broader sharing of information among members of the academy regarding the characteristics of teaching effectiveness. Little direct evidence from the field of accounting education is available to date regarding such characteristics or antecedents of teaching effectiveness in the student learning environment. Our research therefore extends in a fundamental way the work of Stice and Stocks and Stout and Wygal. Specifically, perceptions from a sample of award-winning non-US faculties regarding the 'drivers of teaching effectiveness' in accounting education are recorded and analyzed. In decreasing order of perceived importance, drivers of teaching effectiveness are: having a student focus; commitment to teaching (as a profession); high levels of preparation/organization; the ability to link subject matter to the practice environment; and, instructor skills and attributes. This paper adds to our understanding of the drivers of teaching effectiveness and begins the process of creating a worldwide knowledge base in accounting education. The paper should be of interest to accounting faculty members interested in improving their teaching effectiveness and/or mentoring junior faculty members. © 2014 © 2014 Taylor & Francis.

Exploring the impact of clinical placement models on undergraduate midwifery students

BACKGROUND: Learning undertaken through clinical placements provides up to 50% of the educational experience for students in pre-registration midwifery courses. However little is known about of the impact various models of clinical placement have on the learning experiences of undergraduate midwifery students. Two clinical placement models have been employed for undergraduate midwifery students at Monash University, including the block placement model and the continuous two days per week model. OBJECTIVE: This project sought to explore the learning experiences of students in these two models of placement. METHOD: Focus groups were held on two campuses with a total of 17 students from different cohorts and programs. DISCUSSION: No one type of placement was favoured over another both had benefits and disadvantages. Further, this study found that regardless of program and clinical placement model the major learning impact for students was related to the midwife they worked with each day on placement rather than to the model. CONCLUSION: No one type of placement was favoured over another both had benefits and disadvantages. Further, this study found that regardless of program and clinical placement model the major learning impact for students was related to the midwife they worked with each day on placement rather than to the model.

Undergraduate midwifery students' sense of belongingness in clinical practice

BACKGROUND: Clinical placements form a large and integral part of midwifery education. While much has been written about nursing students' clinical placements, less is known about clinical experiences of undergraduate midwifery students. In nursing, belongingness has been demonstrated to be a key factor in clinical learning but little is known about this in midwifery education. OBJECTIVES: This study sought to examine undergraduate midwifery students' sense of belongingness in their clinical practice. DESIGN: A quantitative design using an online questionnaire was employed. A tool adapted by Levett-Jones (2009a), and previously used with nursing students, was utilised to examine sense of belonging in undergraduate midwifery students. PARTICIPANTS: Sixty undergraduate midwifery students from two campuses at one Australian university participated in the study. Students were drawn from a single Bachelor of Midwifery degree and a double Bachelor of Nursing/Bachelor of Midwifery degree. METHODS: On completion of a scheduled lecture, students were invited by one of the researchers to participate in the study by completing the online questionnaire and the link provided. Data were analysed using descriptive statistics. RESULTS: Midwifery students generally reported similar perceptions of belongingness with previous studies on nursing students. However, a few differences were noted that require further exploration to fully understand. CONCLUSIONS: Midwifery students experienced a sense of belonging in their clinical placements. The findings contribute to understandings of the experiences for midwifery students and provide a foundation on which to develop future clinical placement experiences.

Becoming a 21st century literacy teacher:provocations, perceptions and possibilities in teacher education

This paper reports on a study that investigated pre-service teachers’ digital funds of knowledge and their perceptions of the digital pedagogies and practices in early years literacy classrooms. It also explores pre-service teachers’ experiences of “produsing” a cumulative multimodal portfolio (in the form of a wiki) and its application for future literacy teaching and learning. Specifically, 123 education students enrolled in their second year of an undergraduate initial-teacher education course at an Australian university completed an anonymous survey. The resultsshow that this group of students were active users of technology-based tools, but had limited experience with using participatory user-led knowledge creation tools (such as Web 2.0 technologies) although many observed the use of these tools in early years literacy classrooms while on professional experience school placements. Further findings show thatalthough the majority of this group of pre-service teachers felt more confident after creating a wiki and reported that they would use them in future literacy teaching and learning, their understandings of the pedagogical and creative potential of these digital tools in supporting literacy learning in young children appeared limited. The findings suggest that there is a need for educators in higher education to understand their students’ digital funds of knowledge and to provide rich opportunities to support these students’ use and understandings of the affordances of these new technologies as vehicles to explore and enrich 21st century literacy learning in early years digital environments.

Investigating the effects of personality traits on pair programming in a higher education setting through a family of experiments

Evidence from our systematic literature review revealed numerous inconsistencies in findings from the Pair Programming (PP) literature regarding the effects of personality on PP's effectiveness as a pedagogical tool. In particular: i) the effect of differing personality traits of pairs on the successful implementation of pair-programming (PP) within a higher education setting is still unclear, and ii) the personality instrument most often used had been Myers-Briggs Type Indicator (MBTI), despite being an indicator criticized by personality psychologists as unreliable in measuring an individual's personality traits. These issues motivated the research described in this paper. We conducted a series of five formal experiments (one of which was a replicated experiment), between 2009 and 2010, at the University of Auckland, to investigate the effects of personality composition on PP's effectiveness. Each experiment looked at a particular personality trait of the Five-Factor personality framework. This framework comprises five broad traits (Openness to experience, Conscientiousness, Extraversion, Agreeableness, and Neuroticism), and our experiments focused on three of these - Conscientiousness, Neuroticism, and Openness. A total of 594 undergraduate students participated as subjects. Overall, our findings for all five experiments, including the replication, showed that Conscientiousness and Neuroticism did not present a statistically significant effect upon paired students' academic performance. However, Openness played a significant role in differentiating paired students' academic performance. Participants' survey results also indicated that PP not only caused an increase in satisfaction and confidence levels but also brought enjoyment to the tutorial classes and enhanced students' motivation.

ePortfolios in business education: a national study of ePortfolio implementation 2013 to 2015

To be launched in March 2016, this study explores the transformative potential of ePortfolios in business education. Educators and higher education institutions are increasingly looking for innovative ways to enhance learning outcomes through technology. Given their potential to aid in the development of engaged, reflective lifelong learners, and develop and showcase employability skills, ePortfolios are increasingly being used around the globe.

This study shares the experience of, and lessons learned from, the implementation of ePortfolios in one general business management course and three accounting related courses at three higher education institutions. The recommendations and principles proposed provide benchmarks for best practice and practical guidance for embedding ePortfolios into business curricula.

Realising the potential: assessing professional learning through the integration of ePortfolios in Australian business education

This project will enable academic leadership of Australian Business and Management education programs to design into the curriculum, and best use, ePortfolios and associated technologies in assessing students' learning of highly valued professionally-based capabilities. The project will investigate and support the best ways of broadly and deeply embedding ePortfolios across entire undergraduate business and management education curricula. ePortfolios for enabling and assessing student learning is seen as a key means for integrating student learning across the curriculum and, therefore, creating a holistic learning experience. The project will work with Program Leaders across the sector through liaison with the Australian Business Deans Council (ABDC), Teaching and Learning Network to both draw in better practices and disseminate project findings as the project progresses through its key phases. These planned actions will lead to the progressive development of a Business Education ePortfolio Professional Learning Capabilities Assessment Framework.

Video technology as pedagogy: past teacher education students speak to current students through performed research

This paper reports the use of video representations of first-year teachers’ experiences in teacher education workshops that focus on the transition to teaching. This use of video technology is a responsive act that draws on the notion of looking back, where graduates ‘speak to’ current students. Video footage of the performed research ‘The First Time’ shaped activities and discussions in the unit. Workshop/video themes included teacher identity discourses; epiphanic and revelatory moments of transition to becoming a teacher; and preparing for job applications and interviews. A range of data including semi-structured interviews with undergraduate students upon completion of the workshops were analysed within a phenomenographic paradigm, with the aim of describing variations of conception that people have of a particular phenomenon (Sin, 2010). The investigation of the use of video technology as a pedagogical approach to promote critical thinking about the transition to teaching revealed a range of conceptual meanings. These meanings were classified into categories according to their similarities and differences concerning the effectiveness of the technological tool in assisting undergraduates in their transition to teaching. Participants’ conceptions of the phenomenon are individual and relational, and as such results were quite varied. Emergent varied themes include: ‘I now know what it is that I need to learn’; ‘Is this theory or practice?’; and ‘I don’t do drama’. Similarities include: ‘Preparing for the unexpected’. The use of video technology was deemed effective in creating workshop content from the past, in order to teach for tomorrow.

Residential schools in a first-year undergraduate engineering programme

BACKGROUND OR CONTEXT: For over 20 years, Deakin University has delivered an accredited undergraduate engineering course by means of distance education. Prior to 2004, off-campus students were not required to attend classes in person on campus. The course was designed so that the off campus students were able to undertake all study and assessment tasks remotely from the university campus. Offering accredited domestic undergraduate engineering courses via distance education has been seen as an important strategy for helping to provide graduate domestically educated engineers to meet Australia’s current and future needs. From 2000 the Australian accreditation management system for professional engineers, as managed by Engineers Australia, has increased its scrutiny of accredited domestic undergraduate engineering courses that were provided in distance-education mode. This led to a series of policies and recommendations for Australian universities that offer accredited engineering courses in distance-education mode: one of the recommendations was that off campus
enrolled engineering students should periodically attend some campus-based activities throughout the course. During the 2004 accreditation review of engineering courses at Deakin University, the
accreditation panel requested that mandatory campus-based activities be incorporated into the accredited undergraduate engineering course. Specifically the request was that Deakin mandate that all off-campus students enrolled in an accredited undergraduate engineering course provided by university attend in person a residential school at least once during every year of equivalent full-time study load. The accreditation panel suggested a program model for the residential school component of the course as developed by the University of Southern Queensland.
PURPOSE OR GOAL: This paper describes the development of the mandatory residential school component of accredited distance education undergraduate engineering courses at Deakin University with
a particular focus on how the residential school program is implemented at level 1 (first-year full-time equivalent level) of the courses.
APPROACH: To be compliant with accreditation requirements, since 2005 Deakin has conducted residential schools for off-campus students at its Geelong Waurn Ponds Campus. Initially the schools were conducted annually over two-weeks during the first semester, and have transitioned to the current mode where the residential school is conducted as a one week programme in each of the trimesters. During these schools, activities are organised around the respective engineering-course units undertaken by students during the trimester.
DISCUSSION: The minimum requirements for the on-campus components of distance-education-mode accredited engineering courses were developed by Engineers Australia in consultation with members of the Washington Accord (International Education Alliance) and at the time of development, generated considerable debate (Palmer, 2005, 2008). The intended purpose of residential schools was for off-campus enrolled students to have reasonable exposure to a typical “on-the-campus” student experience periodically throughout the course. Elements considered suitable and worthwhile for inclusion in residential school programs included:
• in person engagement with their academic lecturers,
• presentations and interaction with guest speakers from industry,
• industry-based site visits,
• engagement in sole and group-based learning and assessment activities on campus, and
• social interaction with other students.
RECOMMENDATIONS/IMPLICATIONS/CONCLUSION: We have found that advantages to the students who attends a residential school include completing real practical work without the need to assemble their own materials at home, and social engagement with staff and students. Off-campus students leave the residential school with a sense of belonging to a “community”, “one of many doing the same and not the only one”. They have the opportunity to share their often significant professional experience with the generally younger and less experienced on-campus student colleagues. Through this interaction between on-campus and off-campus students, the on-campus students benefit as much as the off-campus students. The disadvantages to the off-campus students is the requirement to travel to Geelong for an extended time, which costs the students both money and time away from work and family. From our experience, we recommend to other institutions starting residential schools of their own that they exploit the mandatory on-campus-presence requirement to enhance learning outcomes, well publicised timetables be available to students before trimester begins (certainly before census date), a standardised academic week during trimester be set for all residential schools, encourage student feedback on the program, and apply a practice of uniformity and consistency in how the programme is managed, especially mandated student attendance. Our residential schools for off-campus-mode students have been running for over 10 years. We have found that the educational and social advantages to the student outweigh the disadvantages.