The Effectiveness of Learning Portfolios: A Study of Quality Assurance Programs of Selected Health Regulatory Colleges in Ontario

Health regulatory colleges promote quality practice and continued competence through Quality Assurance (QA) programs. For many colleges, a QA program includes the use of portfolios that incorporate self-directed learning. The purpose of this study was to determine some of the issues surrounding the effectiveness of QA portfolio programs. The literature review revealed that portfolios are valuable tools, but gaps in knowledge include a comparative analysis of QA programs and the perspective of regulatory college administrators. Data were collected through interviews with 6 administrators and a review of 14 portfolio models described on college websites. The results from the two data sources were applied to Robert Stake's responsive evaluation framework to identify issues related to the portfolio's effectiveness (Stake, 1967). The learning components of portfolios were analyzed through the humanist and constructivist lenses. All 14 portfolio models were found to have 3 main components: self-diagnosis, learning plan and activities, and self-evaluation. However, differences were uncovered in learners' autonomy in selecting learning activities, methods of portfolio evaluation, and the relationship between the portfolio and other QA components. The results revealed a dual philosophy of learning in portfolio models and an apparent contradiction between the needs of the individual learner and the organization. Paths for future research include the tenuous relationship between competence and learning, and the impact of technical approaches on selfdirected learning initiatives. A key recommendation is to acknowledge the unique identity of each profession so that health regulatory colleges can address legislative demands and learner needs.

Conceptions of Quality and Approaches to Quality Assurance in Ontario’s Universities

Many international, political, and economic influences led to increased demands for development of new quality assurance systems for universities. Like many policies and processes that aim to assure quality, Ontario’s Quality Assurance Framework (QAF) did not define quality. This study sought to explore conceptions of quality and approaches to quality assurance used within Ontario’s universities. A document analysis of the QAF’s rationale and structure suggested that quality was conceived primarily as fitness for purpose, while suggested indicators represented an exceptional conception of quality. Ontario universities perpetuated such confusion by adopting the framework without customizing it to their institutional conceptions of quality. Drawing upon phenomenographic traditions, a qualitative investigation was conducted to better understand various conceptions of quality held by university administrators and to appreciate ways in which they implemented the QAF. Three main approaches to quality assurance were identified: (a) Defending Quality, characterized by conceptions of quality as exceptional, which focuses on administrative accountability and uses a hands-off strategy to defend traditional notions of quality inputs and resources; (b) Demonstrating Quality, characterized by conceptions of quality as fitness for purpose and value for money, which focuses on accountability to students and uses centralized engaged strategies to demonstrate how programs meet current priorities and intended outcomes; and (c) Enhancing Quality, characterized by conceptions of quality as transformation, which focuses on reflection and learning experience and uses engaged strategies to find new ways of improving learning and teaching. The development of a campus culture that values the institution’s function in student learning and quality teaching would benefit from Enhancing Quality approaches to quality assurance. This would require holistic consideration of the beliefs held by members of the institution, a clear articulation of the institution’s conceptions of quality, and a critical analysis of how these conceptions align with institutional practices and policies.

The graduate teacher programme in England: mentor training, quality assurance and the findings of inspection

In its recent report on the Graduate Teacher Programme (GTP), an employment-based route to Qualified Teacher Status (QTS) in England, the Government's Office for Standards in Education found that, although almost all trainees meet the standards required to qualify, too often they do so at an adequate level, rather than achieving the high levels of which they should be capable. The underlying reason for this is the quality of mentoring provided in the schools. The inspectors concluded that schoolbased trainers are often not adequately prepared for their role in implementing wide-ranging training programmes for trainee teachers. Despite this generally bleak picture, Ofsted concluded that 'the minority of cases of good practice in the training programmes and of high quality teaching by trainees indicate that the GTP can be an effective alternative route for training teachers'™. This article considers the strengths and weaknesses of the Graduate Teacher Programme, introduced in January 1998, and also reports on a small-scale project, funded by the Teacher Training Agency (TTA), the key objective of which was to strengthen the existing partnerships by improving the quality of school-based tutor training and continuous professional development of staff.

Acceptability, impact and sustainability of the national pilot quality assurance system for self management programs

Chronic condition self-management education and training interventions such as the Stanford Self Management Programs (SMP) have the capacity to improve health and quality of life of people with chronic conditions whilst reducing the use of health services. This is in line with the outcomes from the recent Council of Australian Governments’ meeting where it was indicated that self-management will be a centrepiece in forthcoming chronic disease initiatives.
Aim: report on a large national pilot quality assurance program involving the implementation and of an evaluation and quality monitoring system for SMPs including the provision of structured feedback to courses course leaders and service providers. During 2005/06 the quality assurance program was implemented at 11 diverse organisations across Australia. The program involved assisting organisations apply the 42-item Health Education Impact Questionnaire (HEIQ), a chronic disease health education outcome measure, and then observe and evaluate the value and impact of the quality program. Interviews with course leaders (n=60) and course participants (n=35) have elicited views about course quality and feedback processes.
Results: The evaluation revealed enablers and barriers to effective implementation and sustainability. Important enablers were:
- Course Leaders and organisations valued an Australia-wide system that provided feedback on course
quality and the impact on participants.
- Course Leaders were strongly personally motivated to respond appropriately to HEI-Q course
report feedback.
- Completing the questionnaire provided participants with the opportunity to reflect on issues that
emerge in the course content and reflect on their progression at the end of the SSMP.
Sustainability issues included:
- Organisations and course leaders require support, training and flexibility on how to administer and
manage the use of the HEI-Q.
- Availability of administrative resources in organisations to support the quality assurance activities.
- The requirement that course leaders are trained in interpreting HEI-Q course report data.
A quality improvement framework was developed which identified the actions required of key stakeholders to
support effective implementation.
Discussion: With the increasing endorsement of SMP across sectors it is important that course quality is known, is acceptable, and is communicated to stakeholders to inform and engender confidence in the SSMP. To effectively implement and sustain a quality improvement program for SMP, the processes and tools for measuring outcomes need to be responsive, flexible and easily integrated into the organisation and delivery of programs.

From quality assurance to process improvement : an action research project

This action research project was undertaken at the Casino & District Memorial Hospital in northern N.S.W. during 1995 & 1996. The purpose was to utilise the Action Research frameork to enable the participants to improve their problem solving skills in relation to quality improvement strategies within the Nursing Division.