A methodological approach to quality assurance of programs in an independent school

This paper reports on ways in which one Australian independent school seeks to develop and sustain best practice and academic integrity in its programs through a quality assurance system of ongoing program reviews, and findings of a study that we conducted into staff perceptions of the different program reviews. First, we outline the overarching methodological and conceptual approaches used in the school’s program reviews. Second, we present and discuss the findings of the study.

Engineering education quality assurance within the school of engineering: a holistic approach

BACKGROUND Quality assurance is a key element of engineering education at Deakin University and is monitored through various mechanisms which also include the process of collecting students’ feedback within the Schools and faculties. The information received are then looked at holistically and action plan is developed to implement. This has proven to be very effective to ensure feedback received from the students has been properly addressed.
PURPOSE The School of Engineering at Deakin University, has initiated the formation of Engineering Educational Quality Working Group (QWG). The aim of QWG is to provide a focal point for learning and teaching quality and its assurance in undergraduate and postgraduate Engineering courses. The school approach complements Deakin University processes of collecting and analysing student feedback on unit curricula design, delivery and facilitator delivery performance; feedback regarding individual facilitator, unit evaluations and graduate course experiences.
DESIGN/METHOD The data are collected through face to face feedback from both on and off campus students. Feedback received from the end of trimester student evaluation process was also analysed.
RESULTS The motivation behind the practise is to close the loop for the feedback received from the students and take appropriate action against the feedback. This is to enhance overall delivery of engineering education at Deakin University.
CONCLUSIONS This paper outlines the activities planned by the QWG and elaborates on quality assurance approaches and key strategies to be implemented by the working group to achieve the desired quality as well as efficacy of those recommendations/actions undertaken at the school level.

Software quality assurance : in large scale and complex software-intensive systems

In recent decades we have seen enormous increases in the capabilities of software intensive systems, resulting in exponential growth in their size and complexity. Software and systems engineers routinely develop systems with advanced functionalities that would not even have been conceived of 20 years ago. This observation was highlighted in the Critical Code report commissioned by the US Department of Defense in 2010, which identified a critical software engineering challenge as theability to deliver “software assurance in the presence of...architectural innovation and complexity, criticality with respect to safety, (and) overall complexity and scale”.

The Sustainability and Evolution of Quality Improvement Programmes-an Australian Case Study

This paper presents a case study on the implementation of quality management programmes and initiatives in one manufacturing company in Australia, which has lasted for more than two decades. Using data collected through in-depth interviews, the case study describes how the company progressed from an earlier initiative based on quality control to the present initiatives that emphasize customer focus, product development, and innovation. Several important insights are drawn from the case study, including the importance of aligning the quality programmes or initiatives with a clear strategic focus. In addition, the commitment and leadership of senior management of the company has been demonstrated, particularly in the provision of resources and facilities to support the TQM programme, and also shown is how the company has been successful in maintaining its long-term commitment to quality management, which has led to an accumulation of various knowledge and competencies, which function as a valuable resource to sustain its business performance.

Proactive evaluation : new perspectives for ensuring quality in online learning applications

A major issue confronting educators is the extent to which they wish to conform to so-called paradigm shifts in teaching and learning. In the contemporary world of tertiary education these shifts embrace both pedagogy (from instructivist to constructivist) and technology (classroom to online). As teachers and learners are faced with the potential of these new learning environments, the extent to which the learning outcomes are achieved remains a high priority and subject to a wide range of evaluation strategies. Conventionally, evaluation is often conceptualised as occurring at the end of the development process, to assess first (formatively) whether or not the creative effort has achieved the original product goals and second (summatively) whether or not the desired learning outcomes were achieved. However, in the context of imperatives to implement online learning paradigms, the level of understanding teachers and developers have of the medium can impact the effectiveness of the product. This paper presents an additional perspective to the post-development, reactive evaluation processes in proposing the concept of proactive evaluation, a framework that identifies critical online learning factors and influences to better inform the development of learning resources. In essence, the proposal advocates an approach where development is undertaken within an environment where all activities are assessed using the evaluation criteria that would be applied when the product is assessed reactively. By performing these checks proactively, online learning resources will, in principle, work first time as all relevant factors and issues will have been considered and resolved.

Knowledge mediation in software quality engineering

The risk of failure of the software development process remains high despite many attempts to improve the quality of software engineering. Contemporary approaches to process assurance, such as the capability maturity model have not prevented systemic failures, nor have project management methodologies provided guarantees of software quality. The paper proposes an approach to software quality assurance based on a knowledge mediated concurrent audit, which incorporates essential feedback processes. Through a tightly integrated approach to quality audit, programmers would be empowered to use any chosen methodology to advantage, supported by intelligent monitoring of the essential interactions which occur in the development process. An experimental application implementing some aspects of the proposal is described

Actor network theory and the study of online learning: new perspectives on quality

This paper describes an approach to studying innovation and change that is taken from the field of Science and Technology Studies. Actor-network theory draws attention to the performative nature of the implementation of new technologies like quality systems and on1ine teaching. The theory posits that the world is not populated with entities that possess certain essences in and of themselves, but rather that the world is a texture of relations-a network which occasionally produces the effect of stabilised entities. We examine the consequences of producing durable forms of online teaching and quality assurance and argue that achieving durable performances requires a conformity to existing performances of a university thus reproducing current patterns of inequity.

Back from the brink: reclaiming `quality` in the pursuit of a transformative education agenda

Discussions about ‘quality’ and ‘quality assurance’ abound in contemporary Australian universities. Since 1992, the Australian federal government has ‘promoted’ and/or mandated the use of particular quality assurance mechanisms within higher education and in 2001 The Australian University Quality Agency began to conduct the first of a series of ‘audits’ aimed at determining how well particular institutions meet standards and achieve
outcomes overseen, at least indirectly, by government agencies.

Student learning: "the heart of quality" in education and training

This paper surveys the development of various approaches to quality that are essentially learning-centred:

•In the Schools sector: a brief overview of the Victorian Quality in Schools project;

•In Higher Education: work in progress at two Australian universities (Victoria University of Technology and Swinburne Universities of Technology in Melbourne); and

•In Vocational Education and Training: work in progress in re-orienting the policy approach to Quality towards a more flexible and learning-centred model.

This paper will argue that when looked at from the perspective of the individual learner, there is a strong case for student learning to be placed at the very heart of Quality Systems in all sectors of education, and also therefore in related sectoral Quality Assurance programs and processes.

Increasing national capability for quality higher education the case of the Sultanate of Oman

This paper explores a number of quality enhancement initiatives being implemented in a developing country, the Sultanate of Oman, to increase the national capability for quality higher education. Oman is a young country with a youthful and rapidly growing population. A brief description of the relatively short history of Oman’s national systems for secondary and postsecondary education is provided. This highlights the challenges for quality education resulting from a strategy of importing postsecondary education from a variety of countries, and delivering the programs through a largely privatized sector.

The paper then describes the outcomes of an initial needs analysis that led to the development of a National Quality Plan. Some of the strategies in this plan for improving and increasing capability are considered, most particularly the establishment of a practitioner‐oriented Oman Quality Network, and the design and implementation of a National Quality Training Program. These two strategies attempt to address common obstacles to capability, namely a paradigm that entrenches compliance and helplessness, and only early awareness of effective quality enhancement and quality assurance principles and methods.

Evaluation results are presented that comment on progress thus far, and suggest critical success factors. These include building legitimacy and trust to overcome barriers to sharing information in a competitive privatized environment. They also include the establishment of peer to peer mechanisms that build confidence and create sustainability over time, as imported or external expertise gives way to local capability and expertise.

Designing an e-portfolio for assurance of learning focusing on adoptability and learning analytics

The Assurance of Learning for Graduate Employability framework is a quality assurance model for curriculum enhancement for graduate employability, enabling graduates to achieve "the skills, understandings and personal attributes that make [them] more likely to secure employment and be successful in their chosen occupations to the benefit of themselves, the workforce, the community and the economy" (Yorke, 2006). Of particular note is the framework's dependence on three foundations, including easy access to integrated and accessible tools for staff and student self-management. In other words, this approach to curriculum quality depends on staff and student access to tools that enable them to self-manage their learning. This paper examines two aspects which informed the design of a student e-portfolio system, iPortfolio, intended for students' self-management of their learning, particularly recording evidence of their achievement of capabilities. The paper focuses on two particular considerations in the design of the iPortfolio: adoptability and learning analytics. Adoptability means the phase preceding adoption, whether students have the devices, platforms and technology skills to be able to use such an innovation. The iPortfolio also facilitates learning analytics: it has the capability to gather data related to learning indicators for course quality assurance purposes. Both adoptability and analytics are very dynamic fields: new devices, platforms and applications constantly spark changes in user habits, and policy changes mean institutions need to be able to provide new data, often at short notice. In the conclusion, the paper suggests how tools such as the iPortfolio can be designed for 'future proofing' and sustainability.

Inter-professional clinical handover in post-anaesthetic care units: tools to improve quality and safety

OBJECTIVES: To examine quality and safety in inter-professional clinical handovers in Post Anaesthetic Care Units (PACUs) and make recommendations for tools to standardize handover processes.
DESIGN: Mixed methods combining data from observations and focus groups.
SETTING: Three PACUs, one public tertiary hospital and two private hospitals.
PARTICIPANTS: Observations were made of 185 patient handovers from anaesthetists to nurses. Eight focus groups were conducted with 62 staff (15 anaesthetists and 47 nurses) across the study sites.
INTERVENTION: Inter-professional clinical handovers in PACU's.
MAIN OUTCOME MEASURES: Characteristics of the structure and processes that support safe inter-professional PACU handover practice.
RESULTS: Characteristics of the process, content, activities and risks during anaesthetist to nurse patient handover into the PACU were integrated into four steps in the PACU handover process summarized by the acronym COLD (Connect, Observe, Listen and Delegate), a verbal communication tool (ISoBAR), a checklist of critical information for safe patient transfer into PACU and a matrix of factors perceived to increase handover risk.
CONCLUSIONS: The standard structure and checklists for optimal content of patient handovers were derived from existing practices and consensus, hence, expected to provide ecologically valid and practical resources to improve quality and safety during clinical handovers in the PACU.

Quality concerns in large-scale and complex software-intensive systems

Software quality management (SQM) is the collection of all processes that ensure that software products, services, and life cycle process implementations meet organizational software quality objectives and achieve stakeholder satisfaction. SQM comprises three basic subcategories: software quality planning, software quality assurance (SQA), and software quality control and software process improvement. This chapter provides a general overview of the SQA domain and discuss the related concept. A conceptual model for software quality framework is provided together with the current approaches for SQA. The chapter concludes with some of the identified challenges and future challenges regarding SQA.

Outcomes, standards and benchmarks

The use of outcomes as a tool for curriculum development has considerable currency in Australia. It is widely perceived as representing world's best practice (South Australia Department of Education, Training and Employment, 2000, foreword) and as providing an effective means for quality assurance and enhancement (Willis & Kissane, 1997). At a system level, these assumptions have been unquestioned and unexamined, and curriculum frameworks in all Australian States now consider themselves to be 'outcome-based'. Surprisingly, this results in little similarity between Australian State educational frameworks, and raises the question of what I really understood about the concept of an 'outcome'. This essay explores some definitions of the term and related concepts of 'standards' and 'benchmarks'. The latter terms have less currency in Australia but can be shown to more accurately describe much of what we consider to be outcomes. The issue is not a semantic one, but goes to the very heart of our intentions in specifying learning outcomes. The indiscriminate use of the term 'outcome' has largely devalued it to the point that there is little real understanding and little debate about the efficacy of outcome setting as the primary process in curriculum production in Australia.