The practice of quality assuring learning in higher education

There remains a lack of published empirical data on the substantive outcomes of higher learning and the establishment of quality processes for determining them. Studies that do exist are nationally focused with available rankings of institutions reflecting neither the quality of teaching and learning nor the diversity of institutions. This paper describes two studies in which Associate Deans from Australian higher education institutions and focus groups of management and academics identify current issues and practices in the design, development and implementation of processes for assuring the quality of learning and teaching. Results indicate that developing a perspective on graduate attributes and mapping assessments to measure outcomes across an entire program necessitates knowledge creation and new inclusive processes. Common elements supporting consistently superior outcomes included: inclusivity; embedded graduate attributes; consistent and appropriate assessment; digital collection mechanisms; and systematic analysis of outcomes used in program review. Quality measures for assuring learning are proliferating nationally and changing the processes, systems and culture of higher education as a result.

Could MOOCs answer the problems of teaching AQF required skills in Australian tertiary programmes?

From 2015, Australian universities will be required to demonstrate that their programmes explicitly teach, and assess achievement of, knowledge and skills and the application of both as specified by the Australian Qualifications Framework (AQF). Over the last twenty years, the sector has applied significant effort and resource to embedding the development of skills through tertiary programmes. Despite these national and institutional efforts, employer and industry concerns remain about the quality of graduate skills. The authors propose a ‘massive open online course’ (MOOC) approach to teaching and assessing AQF required skills. As an example the paper identifies the skills modules that would need to be developed by experts in each skill area for AQF level 9 master’s by coursework programmes. The proposed MOOC would include assessment tasks and rubrics allowing students to develop and demonstrate achievement of the AQF required skills. The assessment tasks could be used by institutions to provide evidence of attainment of coursework master’s standards.

Higher Education and Sustainable Development : A Model for Curriculum Renewal

Responding to the global and unprecedented challenge of capacity building for twenty-first century life, this book is a practical guide for tertiary education institutions to quickly and effectively renew the curriculum towards education for sustainable development. The book begins by exploring why curriculum change has been so slow. It then describes a model for rapid curriculum renewal, highlighting the important roles of setting timeframes, formal and informal leadership, and key components and action strategies. The second part of the book provides detailed coverage of six core elements that have been trialled and peer reviewed by institutions around the world: - raising awareness among staff and students - mapping graduate attributes - auditing the curriculum - developing niche degrees, flagship courses and fully integrated programs - engaging and catalysing community and student markets - integrating curriculum with green campus operations. With input from more than seventy academics and grounded in engineering education experiences, this book will provide academic staff with tools and insights to rapidly align program offerings with the needs of present and future generations of students.

Collaborative resource development for energy efficiency education

BACKGROUND There is a growing volume of open source ‘education material’ on energy efficiency now available however the Australian government has identified a need to increase the use of such materials in undergraduate engineering education. Furthermore, there is a reported need to rapidly equip engineering graduates with the capabilities in conducting energy efficiency assessments, to improve energy performance across major sectors of the economy. In January 2013, building on several years of preparatory action-research initiatives, the former Department of Industry, Innovation, Climate Change, Science, Research and Tertiary Education (DIICCSRTE) offered $600,000 to develop resources for energy efficiency related graduate attributes, targeting Engineers Australia college disciplines, accreditation requirements and opportunities to address such requirements. PURPOSE This paper discusses a $430,000 successful bid by a university consortium led by QUT and including RMIT, UA, UOW, and VU, to design and pilot several innovative, targeted open-source resources for curriculum renewal related to energy efficiency assessments, in Australian engineering programs (2013-2014), including ‘flat-pack’, ‘media-bites’, ‘virtual reality’ and ‘deep dive’ case study initiatives. DESIGN/ METHOD The paper draws on literature review and lessons learned by the consortium partners in resource development over the last several years to discuss methods for selecting key graduate attributes and providing targeted resources, supporting materials, and innovative delivery options to assist universities deliver knowledge and skills to develop such attributes. This includes strategic industry and key stakeholders engagement. The paper also discusses processes for piloting, validating, peer reviewing, and refining these resources using a rigorous and repeatable approach to engaging with academic and industry colleagues. RESULTS The paper provides an example of innovation in resource development through an engagement strategy that takes advantage of existing networks, initiatives, and funding arrangements, while informing program accreditation requirements, to produce a cost-effective plan for rapid integration of energy efficiency within education. By the conference, stakeholder workshops will be complete. Resources will be in the process of being drafted, building on findings from the stakeholder engagement workshops. Reporting on this project “in progress” provides a significant opportunity to share lessons learned and take on board feedback and input. CONCLUSIONS This paper provides a useful reference document for others considering significant resource development in a consortium approach, summarising benefits and challenges. The paper also provides a basis for documenting the second half of the project, which comprises piloting resources and producing a ‘good practice guide’ for energy efficiency related curriculum renewal.

Engineering education for sustainable development : a review of international progress

Since the late 1980s there have been increasing calls around the world for embedding sustainability content throughout engineering curricula, particularly over the past decade. However in general there has been little by way of strategic or systematic integration within programs offered by higher education institutions(HEIs). Responding to a growing awareness towards the issues surrounding sustainability, a number of professional engineering institutions (PEIs) internationally have placed increasing emphasis on policies and initiatives relating to the role of engineering in addressing 21st Century challenges. This has resulted in some consideration towards integrating sustainable development into engineering curricula as envisaged by accreditation guidelines. This paper provides a global overview of such accreditation developments, highlighting emerging sustainability competencies (or ‘graduate attributes’) and places these in the context of relevant PEI declarations, initiatives, policies, codes of ethics and guideline publications. The paper concludes by calling for urgent action by PEIs, including strategic accreditation initiatives that promote timely curriculum renewal towards EESD.

Hunting and gathering : new imperatives in mapping and collecting student learning data to assure quality outcomes

Assurance of learning (AOL) is a quality enhancement and quality assurance process used in higher education. It involves a process of determining programme learning outcomes and standards, and systematically gathering evidence to measure students' performance on these. The systematic assessment of whole-of-programme outcomes provides a basis for curriculum development and management, continuous improvement, and accreditation. To better understand how AOL processes operate, a national study of university practices across one discipline area, business and management, was undertaken. To solicit data on AOL practice, interviews were undertaken with a sample of business school representatives (n = 25). Two key processes emerged: (1) mapping of graduate attributes and (2) collection of assurance data. External drivers such as professional accreditation and government legislation were the primary reasons for undertaking AOL outcomes but intrinsic motivators in relation to continuous improvement were also evident. The facilitation of academic commitment was achieved through an embedded approach to AOL by the majority of universities in the study. A sustainable and inclusive process of AOL was seen to support wider stakeholder engagement in the development of higher education learning outcomes.

Whole-of-Curriculum Design in Law

In this book teaching professionalism is characterised by the scholarly underpinning of each contribution; and every contribution provides a rich resource for enhancing teaching practice. The critical concerns for legal education have been identified and discussed: curriculum design that includes graduate attributes; embedding specific attributes across the curriculum; empowering students to learn; academic teamwork to manage large student cohorts; first year and final year transition strategies; tracking students' personal development through the use of ePortfolio; assessment strategies; improving student well-being and promoting resilience; teaching practice to achieve deep learning; flexibility in delivery; the use of Web 2.0 technology; and understanding the 21st century student.

Teaching peer review reflective processes in accounting

A well designed peer review process in higher education subjects can lead to more confident and reflective learners who become skilled at making independent judgements of their own and others’ work; essential requirements for successful lifelong learning. The challenge for educators is to ensure their students gain these important graduate attributes within the constraints of a range of internal and external tensions currently facing higher education systems, including, respectively, the realities of large undergraduate Accounting subjects, culturally diverse and time-poor academics and students, and increased calls for public accountability of the Higher Education sector by groups such as the OECD. Innovative curriculum and assessment design and collaborative technologies have the capacity to simultaneously provide some measure of relief from these internal and external tensions and to position students as responsible partners in their own learning. This chapter reports on a two phase implementation of an online peer review process as part of the assessment in a large, under-graduate, International Accounting class. Phase One did not include explicit reflective strategies within the process, and anonymous and voluntary student views served to clearly highlight that students were ‘confused’ and ‘hesitant’ about moving away from their own ideas; often mistrusting the conflicting advice received from multiple peer reviewers. A significant number of students also felt that they did not have the skills to constructively review the work of their peers. Phase Two consequently utilised the combined power of e-Technology, peer review feedback and carefully scaffolded and supported reflective practices from Ryan and Ryan’s Teaching and Assessing Reflective Learning (TARL) model (see Chap. 2). Students found the reflective skills support workshop introduced in Phase Two to be highly useful in maximising the benefits of the peer review process, with 83 % reporting it supported them in writing peer reviews, while 90 % of the respondents reporting the workshop supported them in utilising peer and staff feedback.

Design thinking frameworks as transformative cross-disciplinary pedagogy

Final report for the Australian Government Office for Learning and Teaching. "This seed project ‘Design thinking frameworks as transformative cross-disciplinary pedagogy’ aimed to examine the way design thinking strategies are used across disciplines to scaffold the development of student attributes in the domain of problem solving and creativity in order to enhance the nation’s capacity for innovation. Generic graduate attributes associated with innovation, creativity and problem solving are considered to be amongst the most important of all targeted attributes (Bradley Review of Higher Education, 2009). The project also aimed to gather data on how academics across disciplines conceptualised design thinking methodologies and strategies. Insights into how design thinking strategies could be embedded at the subject level to improve student outcomes were of particular interest in this regard. A related aim was the investigation of how design thinking strategies could be used by academics when designing new and innovative subjects and courses." Case Study 3: QUT Community Engaged Learning Lab Design Thinking/Design Led Innovation Workshop by Natalie Wright Context "The author, from the discipline area of Interior Design in the QUT School of Design, Faculty of Creative Industries, is a contributing academic and tutor for The Community Engaged Learning Lab, which was initiated at Queensland University of Technology in 2012. The Lab facilitates university-wide service-learning experiences and engages students, academics, and key community organisations in interdisciplinary action research projects to support student learning and to explore complex and ongoing problems nominated by the community partners. In Week 3, Semester One 2013, with the assistance of co-lead Dr Cara Wrigley, Senior Lecturer in Design led Innovation, a Masters of Architecture research student and nine participating industry-embedded Masters of Research (Design led Innovation) facilitators, a Design Thinking/Design led Innovation workshop was conducted for the Community Engaged Learning Lab students, and action research outcomes published at 2013 Tsinghua International Design Management Symposium, December 2013 in Shenzhen, China (Morehen, Wright, & Wrigley, 2013)."

Teaching manufacturing engineering at tertiary institutions in conjunction with engineering design and engineering materials

Tertiary institutions now face serious challenges. Modern industry requires engineering graduates with strong knowledge of modern technologies, highly practical focus, management skills, ability to work individually and in a team, understanding of environmental issues and many other skills and graduate attributes. Institutions in the tertiary sector change courses and modify curriculum to reflect challenges of the modern industry and make engineering graduates better prepared for the “real world”. Queensland University of Technology in the recent years introduced an innovative structure of engineering courses with a common core for Bachelor of Engineering Mechanical, Infomechatronics and Medical, where manufacturing is taught in conjunction with engineering design and engineering materials. In this paper we discuss the innovative curriculum structure, teaching and learning approaches of coherent delivery of manufacturing in conjunction with engineering design and

An ePortfolio Approach: Supporting Critical Reflection for Pedagogic Innovation

This chapter investigates the capacity of a well-supported holistic ePortfolio program, the QUT Student ePortfolio Program (QSeP), to support critical reflection for pedagogic innovation in higher education, by exploring practice examples. The chapter looks across faculty and discipline areas to illustrate a range of ePortfolio learning case studies, which have led pedagogical innovation across a whole institution, to enhance student learning and support academic teaching. The ePortfolio strategies discussed support innovation in learning and teaching where academics use the ePortfolio approach in different ways to develop connectedness (productive pedagogies) within learning. Students are supported to develop awareness of the connections between formal and informal learning opportunities and between their learning and personal and professional goals. Students are guided to understand what they have learned and how they have learned in terms of generic employability skills or graduate attributes and also in relation to professional standards and competencies and personal goals. In essence, the ePortfolio-supported pedagogy creates capstone events enabling students to develop a professional identity and understanding of ongoing professional development. The examples are drawn from distinct discipline areas and illustrate the capacity of ePortfolio to underpin pedagogic innovation across discipline areas: • Bachelor of Information Technology—the ePortfolio approach supports students to explore the IT industry as a means of clarifying personal expectations and goals, thereby enhancing student potential in the course c• Bachelor of Nursing and Master of Nursing Science—students develop a professional ePortfolio to show development of the nursing competencies • Master of Information Technology—Library and Information students compile a Professional Portfolio for assessment in the Professional Practice subject • Bachelor of Laws—Virtual Law Placement (VLP) is a unit of study that challenges students to critically reflect on their performance and development duringthe work placement Each case study illustrates the academic teaching goal and student ePortfolio task in context. Issues, challenges and support strategies are identified. Comments from the students and their lecturers give an indication of the effectiveness of the ePortfolio approach to meet learning and teaching goals.

The Australian Qualifications Framework for bachelor degree in property economics

The Australian Qualifications Framework (AQF) requires every course in Australia to be reviewed and compliant by 2015. This paper compares the difference between AQF level 7 and level 8 and outlines the paradigm shift in course development, improvement and quality assurance. The AQF requires an outcome oriented process which influences the development, monitoring and implementation of AQF courses. Firstly the graduate profile is defined to underscore the direction of the property course development. Required graduate attributes are then defined, together with course learning outcomes. Each unit/subject assessment is then designed to reflect the desired learning outcomes, and then finally the unit/subject content is backfilled. This reverse engineered process will ensure that all students have been taught and assessed on the graduate attributes which will form the graduate profile. Therefore, monitoring the inclusion of learning outcomes on unit/subject level during course restructure and development is crucial to achieve the course learning outcomes. This paper recommends that further evaluation needs to be conducted in the course development phases by involving professional accreditation bodies, industry representatives, students and recent graduates in this course development process. It also discusses challenges for developing an undergraduate property course.

Consultation: Energy efficiency and engineering education

This report provides the Commonwealth Department of Resources, Energy and Tourism (RET) with a summary of consultation undertaken with representatives from industry and academia around Australia regarding mainstreaming energy efficiency within engineering education. Specifically, the report documents the purpose of the consultation process, key messages and emerging themes, industry-perceived gaps in energy efficiency related knowledge and skills, and academic considerations regarding graduate attributes and learning pathways to close these gaps. This information complements previous reports by presenting the current thoughts and ideas of more than 100 engineering academic and practising professionals who are actively involved in building capacity through the education system or implementing energy efficiency improvements in companies/the workplace. Furthermore, the report describes the emergence of a potential ‘community of practice’ in energy efficiency capacity building that arose during the project.

Preparing health science students for interdisciplinary professional practice

In 2002, a number of lecturers from different clinical schools within the Faculty of Health Sciences at La Trobe University embarked on the development of a new interdisciplinary professional practice subject to be undertaken by all final-year undergraduate health science students. The subject was designed to better prepare students for their first professional appointment by introducing them to the concepts of interdisciplinary teamwork, the health care context, and the challenges and constraints that organizational contexts present. This report details the background of the project, the consultation and development that took place in the design of the subject, and implementation of the subject. The uniqueness of the project is explained by the number of disciplines involved, the online delivery, and the focus on a set of generic graduate attributes for health science students. It is hoped that students who have undertaken this subject will have a better understanding of the roles of other health professionals and the context in which they will be working by grappling with many real-life professional issues that they will face when they graduate and enter the workforce.

The efficacy of a CDIO based integrated curriculum as preparation for professional practice in product design and development

The School of Mechanical and Aerospace Engineering at Queen’s University Belfast started BEng and MEng degree programmes in Product Design and Development (PDD) in 2004. Intended from the outset to be significantly different from the existing programmes within the School the PDD degrees used the syllabus and standards defined by the CDIO Initiative as the basis for an integrated curriculum. Students are taught in the context of conceiving, designing, implementing and operating a product. Fundamental to this approach is a core sequence of Design-Build-Test (DBT) experiences which facilitates the development of a range of professional skills as well as the immediate application of technical knowledge gained in strategically aligned supporting modules.
The key objective of the degree programmes is to better prepare students for professional practice. PDD graduates were surveyed using a questionnaire developed by the CDIO founders and interviewed to examine the efficacy of these degree programmes, particularly in this key objective. Graduate employment rates, self assessment of graduate attributes and examples of work produced by MEng graduates provided positive evidence that their capabilities met the requirements of the profession. The 24% questionnaire response rate from the 96 graduates to date did not however facilitate statistically significant conclusions to be drawn and particularly not for BEng graduates who were under represented in the response group. While not providing proof of efficacy the investigation did provide a good amount of useful data for consideration as part of a continuous improvement process.