The systematic influences on student evaluation of teaching in engineering education

BACKGROUND Student evaluation of teaching (SET) has a long history, has grown in prevalence and importance over a period of decades, and is now common-place in many universities internationally. SET data are collected for a range of purposes, including: as diagnostic feedback to improve the quality of teaching and learning; as an input to staff performance management processes and personnel decisions such as promotion for staff; to provide information to prospective students in their selection of courses and programs; and as a source of data for research on teaching. Rovai et al. (2006) report that while SET research provides mixed results, there is evidence that, for course-related factors, smaller classes are rated more favourably than large classes, upper-year-level classes are rated more favourably than lower-year classes, and that there are rating differences between discipline areas. While additional course-related factors are also noted, other reviews of the literature on SET also identify these three factors as commonly reported systematic influences on SET ratings. The School of Engineering at Deakin University in Australia offers undergraduate and postgraduate engineering programs, and these programs are delivered in both on-campus and off-campus modes.PURPOSEThe paper presents a quantitative investigation of SET data for the School of Engineering at Deakin University to identify whether the commonly reported systematic influences on SET ratings of class size and year level are also observed here. The influence of online mode of offer is also explored.DESIGN/METHOD Deakin University’s Student Evaluation of Teaching and Units (SETU) questionnaire is administered to students enrolled in every unit of study every time that unit is offered, unless it is specially exempted. Following data collation, summary results are reported via a public website. The publicly available SETU data for all School of Engineering units of study were collected for a two year period. The collected data were subjected to analysis of variance (ANOVA) analysis to identify any significant systematic influences on mean student SETU ratings.RESULTS SETU data from 100 separate units of study over the two year period were collected, representing 3375 sets of SETU ratings, and covering unit enrolment sizes from 12 to 462 students. Although this was a modest sized investigation, significantly higher mean ratings for some SETU items were observed for units with small enrolments, for postgraduate level units compared to undergraduate level units, and for units offered in conventional mode compared to online mode of offer. The presence of the commonly observed systematic influences on SET ratings was confirmed.CONCLUSIONS While the use of SET data may have originally been primarily for formative purposes to improve teaching and learning, they are also increasingly used for summative judgements of teaching quality and teaching staff performance that have implications for personnel decision making. There may be an acceptance of the need for SET, however there remains no universal consensus as to what constitutes quality in university teaching and learning, and the increasing use of SET for high-stakes decision making puts pressure on institutions to ensure that their SET practices are sound, equitable and defensible.

Remixing to design learning: social media and peer-to-peer interaction

Social and participatory media offer opportunities to interact and share user-generated content. After some investigation and research, the authors are in their initial stages of using such media to provide a pathway for thinking about learning design in higher education. Using the concept of remixing, the authors aim to creatively blend and manipulate ideas to build a sustainable approach to course/program enhancement. Remixing is touted as one of the most important practices within the field of open educational resources, but it is not mainstream practice in educational thinking or design. This article highlights the authors’ approach and uses their pre-service teacher education program and their previous high school study as an example of remixing. The high school study involved the integration of social and participatory media into the face-to-face classroom; Author 1 was the practitioner researcher in the high school study. This article articulates the use of online social environments at the high school level to highlight concepts of sharing and remixing as a creative and social approach to designing learning in higher education. It also attempts to consider this within a course-wide approach.

The evolution of clinical audit as a tool for quality improvement.

Clinical auditing practices are recognized universally as a useful tool in evaluating and improving the quality of care provided by a health service. External auditing is a regular activity for mental health services in Australia but internal auditing activities are conducted at the discretion of each service. This paper evaluates the effectiveness of 6 years of internal auditing activities in a mental health service. A review of the scope, audit tools, purpose, sampling and design of the internal audits and identification of the recommendations from six consecutive annual audit reports was completed. Audit recommendations were examined, as well as levels of implementation and reasons for success or failure. Fifty-seven recommendations were identified, with 35% without action, 28% implemented and 33.3% still pending or in progress. The recommendations were more likely to be implemented if they relied on activity, planning and action across a selection of service areas rather than being restricted to individual departments within a service, if they did not involve non-mental health service departments and if they were not reliant on attitudinal change. Tools used, scope and reporting formats have become more sophisticated as part of the evolutionary nature of the auditing process. Internal auditing in the Barwon Health Mental Health Service has been effective in producing change in the quality of care across the organization. A number of evolutionary changes in the audit process have improved the efficiency and effectiveness of the audit.

Designing and developing interactive digital media mobile learning resources best practices and guidelines

Interactive digital media learning resources and mobile devices offer flexible teaching and learning options and experiences for the student and teacher. Recent technological advancements of mobile devices, release of forth generation mobile broadband and discussions of a fifth generation to come mean that interactive digital media rich content delivered over mobile devices will become mainstream. Given the popularity of mobile devices such as smartphones, laptops, netbooks and digital tablets all have capacity to deliver interactive digital media content, the design and pedagogical factors of mobile learning resources is fundamental. Course designers and education developers need to consider the design and pedagogical considerations involved in the creation of these learning resources. This paper provides best practices and guidelines that course designers and educational developers can use to help them design and develop interactive digital media learning resources for mobile devices.

A university-based clinical exercise facility that serves as a clinical, teaching and research space

Deakin University opened its Clinical Exercise Learning Centre (CELC) in May 2011, initially staffed by four (now seven) Accredited Exercise Physiologists (AEP), and funded by the university. The main objectives of CELC are to provide (i) excellent clinical practicum learning opportunities for postgraduate students enrolled in the Master of Clinical Exercise Physiology that prepare students for subsequent external placements; (ii) learning opportunities that are vertically integrated with the preparatory components of the Masters, including pathophysiology units and pre-clinical units; (iii) learning opportunities that are also integrated with the external clinical practicum program that is embedded in the Masters; (iv) a clinical service to the community and strong referral networks with local GPs; (v) a research centre that is focussed on evaluating the efficacy of Accredited Exercise Physiology (AEP) services for a range of clinical situations, with a view to contributing to a future national evidence-based practice network supported by ESSA. Deakin University funds the CELC facility, equipment, consumables, limited car parking, practice management software and server and, most importantly, the staff. Therefore CELC runs at a loss even against fees charged and this was built into the original model. Staff include an AEP clinical practicum coordinator, two casual AEPs and several academic AEPs; the latter practise as a small part of their approved workloads. The practice model is for all AEPs to provide clinical services with referred clients who are billed as if CELC is a private practice, whilst concurrently teaching and mentoring students; the latter are expected to be active learners in CELC and have exposure to a wide range of pathologies and clinical situations. Billable hours are always provided by AEPs, not students, but students can assist. CELC provides clinical services 1:1:1 (client: AEP: student), 1:1:5 and 8:1:5. CELC was awarded national runner-up in the ESSA Exercise Physiology clinic of the year in 2011 and has grown its caseload to > 200 referrers in 2013. CELC recently designed a generic research platform and has begun to roll out research projects that are designed to translate 'traditional' research-based evidence of exercise benefits for chronic disease in order to evaluate AEP efficacy of practice in the Australian context. CELC provides a model for other universities, provided those universities see it for its learning value, and not to generate revenue or profit.

Personality types and languages learning strategies: chameleons changing colours

This exploration of associations between the reported Language Learning Strategy (LLS) preferences of learners of English as a Second Language (ESL) and their personality types is positioned within the contention that the two are generally related. Our findings unequivocally support the existence of this relationship. Moreover, they also provide a platform from which to understand the contribution to learning a second language of two very commonly cited personality traits, introversion/extroversion and neuroticism. However, they also provide the basis for the important caution that the association between personality types and LLS is quite volatile. We have found that it is variation rather than unwavering stability that features in how personality traits apply as predictive of ESL learners' specific LLS preferences. Such prediction is specified even further by the particular contexts of ESL learning where the LLS are applied, for example for listening or speaking and whether this occurs inside or outside a classroom. The implications of these findings for ESL teaching and learning are discussed as is the explanatory power of the chameleon metaphor.

The pedagogy of using video to develop reflective practice in learning to teach science

Purpose The purpose of this chapter is to identify the pedagogical approaches that foster critical reflection using video among the preservice teachers during tutorials. Methodology/approach The research is situated in a school-based teaching programme in which pairs of pre-service teachers taught small groups of primary aged children over a period of seven weeks. Volunteer pre-service teachers videotaped their lessons and selected video excerpts to share with their peers in the tutorial. The educator guided the preservice teachers’ reflection using the video. A case study drawing on interviews with pre-service teachers and audio recordings of tutorials, charted the development of pedagogical decisions made by the educators to promote reflection.Findings The pre-service teachers had difficulties undertaking deep reflection of their own and peers’ teaching practice. The response by educators was to promote collaboration among pre-service teachers by discussing specific aspects of the teaching in small groups and to use a jigsaw approach. This enabled a deeper analysis of particular elements of the lesson that were then integrated to produce a more holistic understanding of the teaching. The video data is most suitable for reflection and provides valuable evidence for pre-service teachers to develop their practice. Practical implications For pre-service teachers to develop effective skills to analyse their own practice they need to experience teaching in a safe but challenging environment, over a sustained period; have opportunities to develop a shared understanding of what constitutes quality teaching; have opportunities to critically analyse their teaching in discussion with peers and educators and be able to be guided by a framework of reflective strategies.

Constructive alignment and the research skills development framework: Using theory to practically align graduate attributes, learning experiences, and assessment tasks in undergraduate midwifery

Midwifery educators have to provide students with stimulating curricula that teach academic and vocational content, as well as transferable skills. The Research Skills Development (RSD) framework provides a conceptual model that allows educators to explicitly scaffold the development of their students’ research skills. This paper aims to demonstrate the effective use of the RSD framework and constructive alignment theory to redesign a second-year Midwifery assessment task.The assessment task was changed into a scenario-based question to better reflect the unit learning objectives and expected graduate attributes. Students were provided with extra time in class to explore the assessment task in a peer environment. Following the return of their assessments, students were asked to complete a questionnaire to evaluate the effectiveness of the assessment redesign. We show that using a constructively aligned scenario-based assessment task in a second year unit more successfully articulated the expected graduate attributes of midwives. Qualitative and quantitative feedback suggested that students and staff appreciated a more clinically- relevant assessment task. This paper demonstrates that the use of the RSD framework to constructively aligngraduate attributes, learning experiences, and assessment tasks allows for the transformation of undergraduate assessment into a learning experience relevant to clinical practice.

Does student engagement improve when 1:1 device technologies are used and adapted to cater for individual learning styles during online delivery of engineering courses?

BACKGROUND OR CONTEXT: A developing international engineering industry is dependent on competition and innovation, creating a market for highly skilled graduates from respected overseas and Australian Engineering universities. The delivery of engineering teaching and learning via blended faceto-face, problem based, research focused and online collaborative learning will continue to be the foundation of future engineering education, however, it will be those institutions who can reshape its learning spaces within a culture of innovation using 1:1 devices that will continue to attract the brightest minds. Investing in educational research that explores the preferred learning styles of learners and matching this to specifically designed 1:1 personalized web applications may be the ‘value add’ to improve student engagement. In this paper, a survey of Australian engineering education is presented and contrasted against a backdrop of internationally recognised educational pedagogy to demonstrate how engineering teaching and learning has changed over time. This paper draws on research and identifies a gap where a necessity to question the validity of 1:1 devices as the next step in the evolution of engineering education needs to be undertaken. How will teaching and learning look using 1:1 devices and will it drive student demand into engineering higher
education courses. Will this lead to improving professional standards within a dynamic engineering education context? How will current and future teaching and learning be influenced by constructivism using 1:1 device technologies? How will the engineering industry benefit from higher education investment in individualised engineering education
using 1:1 devices for teaching and learning?
PURPOSE OR GOAL: To review the current academic thinking around the topic of 1:1 devices within higher education engineering teaching and learning context in Australia. To identify any gaps in the current understandings and use of 1:1 devices within engineering courses in Australia. To generate discussion and better understanding about how the use of 1:1 devices may hinder and/or improve teaching and learning and student engagement.
APPROACH: A review covering the development of engineering education in Australia and a broader international review of engineering teaching methodology. To identify the extent of research into the use and effectiveness of online strategies within engineering education utilising 1:1 devices for teaching and learning. i.e. “Students must feel that they are part of a learning community and derive motivation to engage in the study material from the lecturer.’ (Lloyd et al., 2001) It is proposed to add to the current body of understandings and explore the effectiveness of a constructiveness teaching approach using course material specifically designed to cater for individual learning styles and delivered via the use of 1:1 devices in the classroom. It is anticipated the research will contrast current engineering teaching and learning practices and identify factors that will facilitate a greater understanding about student connectedness and engagement with the teaching and learning experience; where a constructiveness environment is supported with the use of 1:1 devices. Also, it is anticipated that the constructed learning environment will foster a culture of innovation and students will be empowered to take control of their own learning and be encouraged to contribute back to the discussion initiated by the lecture and/or course material with the aid of 1:1 device technologies. A gap has been identified in the academic literature that show there is a need to understand the relationship between engineering teaching, learning, students engagement and the use of 1:1 devices.
DISCUSSION: A review covering the development of engineering education in Australia and a broader international review of engineering teaching methodology. To identify the extent of research into the use and effectiveness of online strategies within engineering education utilising 1:1 devices for teaching and learning. i.e. “Students must feel that they are part of a learning community and derive motivation to engage in the study material from the lecturer.’ (Lloyd et al., 2001) It is proposed to add to the current body of understandings and explore the effectiveness of a constructiveness teaching approach using course material specifically designed to cater for individual learning styles and delivered via the use of 1:1 devices in the classroom.
ANTICIPATED OUTCOMES: It is anticipated the research will contrast current engineering teaching and learning practices and identify factors that will facilitate a greater understanding about student connectedness and engagement with the teaching and learning experience; where a constructiveness environment is supported with the use of 1:1 devices. Also, it is anticipated that the constructed learning environment will foster a culture of innovation and students will be empowered to take control of their own learning and be encouraged to contribute back to the discussion initiated by the lecture and/or course material with the aid of 1:1 device technologies. A gap has been identified in the academic literature that show there is a need to understand the relationship between engineering teaching, learning, students engagement and the use of 1:1 devices.
RECOMMENDATIONS/IMPLICATIONS/CONCLUSION: A gap exists in the current research about the effectiveness and use of 1:1 devices in engineering education; therefore, it is necessary to undertake further research in the area. It is proposed to hypothesize and conduct field research to identify any shortcomings and possible benefits for engineering educators and learners within a constructivist-teaching
context that explores the relationship between the use of personalized 1:1 devices for teaching and learning, adapting for individual learning styles, and identification and application of appropriate teaching and learning strategies within a constructiveness engineering course approach. Research is required to clarify the following research questions;
• What education teaching and learning strategies best facilitate the use of 1:1 devices for online teaching and learning?
• Does student engagement improve when 1:1 device technologies are used and adapted to cater for individual learning styles during online delivery of engineering courses?
• What are the factors within a university engineering faculty that may hinder and/or support the use of 1:1 devices for online teaching and learning?
• To what extent do 1:1 devices assist engineering educators and students to foster a culture of innovation? The study results will offer engineering educators and students an opportunity to reflect on
their current teaching and learning practice, and contextualise the use of 1:1 devices as a tool to improve student engagement. It is expected the learning benefits will outweigh the implementation costs and derive a unique learning experience that will empower engineering educators and students to inspire a culture of innovation.

Inclusive pedagogy in Australian universities: a review of current policies and professional development activities

This article reports on activities undertaken by Australian universities to support academic staff to provide inclusive teaching. The findings of two lines of inquiry are reported - a desktop audit of the presence of inclusive teaching or universal design for learning (UDL) in publically available policies and procedures documents, and a survey of the methods adopted to build staff capacity to provide inclusive teaching and learning. Just over a third (34.21%) of Australian universities referred to inclusive teaching or UDL in their policies and procedures. A wide range of current practices in professional development for inclusive teaching was reported, with the most frequent being one-off workshops focussing on accommodating specific groups of students. Improved institutional support through policies, procedures and professional development would enable Australian higher education teachers to provide quality inclusive teaching to all students.

Cultural respect encompassing simulation training: being heard about health through broadband

BACKGROUND: Cultural Respect Encompassing Simulation Training (CREST) is a learning program that uses simulation to provide health professional students and practitioners with strategies to communicate sensitively with culturally and linguistically diverse (CALD) patients. It consists of training modules with a cultural competency evaluation framework and CALD simulated patients to interact with trainees in immersive simulation scenarios. The aim of this study was to test the feasibility of expanding the delivery of CREST to rural Australia using live video streaming; and to investigate the fidelity of cultural sensitivity - defined within the process of cultural competency which includes awareness, knowledge, skills, encounters and desire - of the streamed simulations. DESIGN AND METHODS: In this mixed-methods evaluative study, health professional trainees were recruited at three rural academic campuses and one rural hospital to pilot CREST sessions via live video streaming and simulation from the city campus in 2014. Cultural competency, teaching and learning evaluations were conducted. RESULTS: Forty-five participants rated 26 reliable items before and after each session and reported statistically significant improvement in 4 of 5 cultural competency domains, particularly in cultural skills (P<0.05). Qualitative data indicated an overall acknowledgement amongst participants of the importance of communication training and the quality of the simulation training provided remotely by CREST. CONCLUSIONS: Cultural sensitivity education using live video-streaming and simulation can contribute to health professionals' learning and is effective in improving cultural competency. CREST has the potential to be embedded within health professional curricula across Australian universities to address issues of health inequalities arising from a lack of cultural sensitivity training. Significance for public healthThere are significant health inequalities for migrant populations. They commonly have poorer access to health services and poorer health outcomes than the Australian-born population. The factors are multiple, complex and include language and cultural barriers. To address these disparities, culturally competent patient-centred care is increasingly recognised to be critical to improving care quality, patient satisfaction, patient compliance and patient outcomes. Yet there is a lack of quality in the teaching and learning of cultural competence in healthcare education curricula, particularly in rural settings where qualified trainers and resources can be limited. The Cultural Respect Encompassing Simulation Training (CREST) program offers opportunities to health professional students and practitioners to learn and develop communication skills with professionally trained culturally and linguistically diverse simulated patients who contribute their experiences and health perspectives. It has already been shown to contribute to health professionals' learning and is effective in improving cultural competency in urban settings. This study demonstrates that CREST when delivered via live video-streaming and simulation can achieve similar results in rural settings.

A review of the game-centred approaches to teaching and coaching literature since 2006

Background: In 2006, Oslin and Mitchell published a review of the game-centred approaches (GCAs) to teaching and coaching literature highlighting a number of core concepts thought to provide justification for the use of GCAs including (a) its potential to enhance participant motivation, (b) potential for tactical transfer, and (c) development of decision-making skills and effective decision-makers. Oslin and Mitchell also suggested recommendations for future GCA research.Purpose: The purpose of this paper was threefold: (a) to present a review of Anglophone research into GCAs building on the previous review of Oslin and Mitchell published in 2006; (b) to identify new trends in research since 2006; and (c) to investigate the extent to which the initial suggestions and future research directions suggested by Oslin and Mitchell have been addressed.Data collection: GCA literature since 2006 was searched systematically using a three-phase approach. Phase 1 included initial searches of the EBSCO database using terms associated with GCAs and their acronyms (e.g. TGfU (teaching games for understanding), GS (Game Sense), etc.). Phase 2 expanded the search adopting more generic terms from keywords located in the recent literature (e.g. teaching games, tactical development, game performance, etc.). Multiple searches through the EBSCO database were conducted, whereby key terms were cross-referenced until a saturation point was reached. Phase 3 involved removing those publications that were not empirical, peer reviewed, intervention studies or published in English.Findings: Forty-four studies on GCA implementation were identified and the methodological and substantive nature of these studies was examined. The review noted two positive trends: (a) the expansion of research which included the growth of research on GCAs in Europe and Southeast Asia and (b) an increased amount of research in the affective domain. The review found, however, that a number of key challenges remain within GCA research, which include (a) the need for improved articulation of GCA verification procedures; (b) further assessment of tactical awareness development; (c) extended inquiry about GCAs in coaching contexts; (d) more research into ‘newer’ GCAs (i.e. PP (play practice), IGCM (invasion game competence model) and TDLM (tactical decision learning model)); (e) use of longitudinal research designs; (f) inadequate length of GCA induction and training for teachers and coaches, and (g) examination of GCAs in terms of fitness and special populations.Conclusions: GCA pedagogies are of significant importance as they have the potential to promote change within current adult-centric cultures of youth sport and encourage engagement in physical activity over the life course. To meet these needs, it is recommended that GCA research undergo continued expansion with the use of research designs and data collection techniques that aid the examination of different philosophical understandings of GCAs (e.g. ethnographic, phenomenological and psycho-phenomenological). These are paramount to the exploration of ‘who the individual is’ and ‘how the learner is motivated to continue to participate’ and further permit the in-depth, contextual and ecological analysis of GCA interventions that Oslin and Mitchell recommended in their previous review.

Gender issues in elementary mathematics teaching materials: a comparative study between China and Australia

International Association for the Evaluation of Educational Achievement (IEA) cross-national studies (FIMS, SIMS and TIMSS) show that gender differences in mathematical achievements and attitudes have decreased considerably over thirty years (Hanna, 2000), however, mathematics is still historically stereotyped as a male domain with crucial evidence supporting this belief (Forgasz, Leder, & Kloosterman, 2009). Previous research showed that gender differences in mathematics participation,performance and achievement existed widely in the majority of English speaking countries, specifically favouring boys (Forgasz, 1992; Hyde, Fennema, & Lamon, 1990; Tiedemann, 2000). Hyde, Lindberg, Linn, Ellis and Williams (2008) pointed out that the stereotype that females lack mathematical ability persists and is widely held by parents and teachers.Mathematics teaching materials play an important role in mathematics teaching and learning. The contents within mathematical teaching materials are rational, and deliver both explicit and implicit information. The explicit information refers to mathematics knowledge that students can learn from textbooks, while the latter one, also named as hidden curriculum, contains social and cultural messages. Hidden curriculum is a side effect of education. It has deep and long-term influences on students’ construction of math-gender stereotype that impact their future mathematicallearning (Zhang & Zhou, 2008). Therefore, this study will investigate Chinese andAustralian elementary mathematics teaching materials to explore the messages of gender equity and inequity delivered through hidden curriculum including names, images and problem-solving contexts. Based on the findings, practical implications concerning the promotion of equitable gender environments within elementary mathematics teaching materials from a cross-cultural perspective will be discussed.

Responding to the widening participation agenda through improved access to and within 3D virtual learning environments

The Australian Government's widening participation agenda - also referred to as the social inclusion agenda - considers equity through the triple focus of access, participation and outcomes. These foci are catalysts for re-examining teaching and learning approaches in formal education. This article considers this national refocus and the possibilities for addressing access and equity issues through and within threedimensional virtual learning environments (3DVLEs). The findings of an Australian Learning and Teaching Council (ALTC)-funded project that investigated the potential of an accessible 3DVLE for increasing access and participation of students with disabilities are reported, and strategies for improving outcomes (i.e. retention, success and completion) proposed. The article also highlights some of the remaining challenges with regard to the goal of improving outcomes for under-represented learner groups. The final section of the article identifies areas for further research.

Xylanolytic modification in wheat flour and its effect on dough rheological characteristics and bread quality attributes

Effects of various xylanase treatments applied at different stages of bread making process on dough rheological characteristics and bread quality attributes were investigated. Different doses (200, 400, 600, 800, and 1000 IU) of purified enzyme were applied at two stages (tempering and mixing). In milling and dough making processes, both types of flour (subjected to enzyme treatment during tempering and flour mixing) exhibited decreasing trend in water absorption, dough development time, dough stability, softening of dough, dough mixing time, viscosity peak, set back, and increasing tendency in peak height and pasting temperature. Treatments during tempering resulted in more significant effects as compared to applications during flour mixing. The dough rising during proofing resulted in enhancement from 137±3.21% (control) to maximum value (192.33±2.90%), when 600 IU of xylanases were applied to 1 kg of wheat grains during tempering. The bread sensory attributes also exhibited significant improvement in response to various doses of purified enzymes.