QA and Enhancement Marketplace for HEIs – An Erasmus+ project

Improving European education and training system quality has been set as a key target in Europe’s strategy to become a smart, sustainable and inclusive economy by 2020 (European Commission, 2010). These objectives are more specifically defined in the so called Modernisation Agenda (European Commission, 2011). More specifically it sets a goal to improve the quality and relevance of higher education. In this process external evaluation and
Proceedings of the 11th International CDIO Conference, Chengdu University of Information Technology,
Chengdu, Sichuan, P.R. China, June 8-11, 2015.
self-assessment are seen in a key role! In the CDIO approach the 12 CDIO standards provide a framework for continuous improvement. Each institution/institutional department are encouraged to regularly do the self-evaluation using the CDIO Standards. Eight European universities identified a need for further enhancement of the self-evaluations and creation of processes with peers to reduce the inertia of heavy accreditations/evaluations in HEIs. In September 2014 these universities started an Erasmus+ project (QAEMarketPlace4HEI) aiming at
1. Developing a collaborative, comprehensive and accessible evaluation process model, methods and tools for HEIs to complement the accreditation systems.
2. Promoting, increasing and exploiting further the European collaboration in the evaluation processes and the exchange of best practices.
3. Disseminating the model, best practices and widen the cooperation to new HEIs in Europe through the partner networks.

Using accreditation criteria for collaborative quality enhancement

This paper describes a process to enhance the quality of higher education. At the heart of the process is a cross-sparring collaborative model, whereby institutions are critical friends. This is based on a prior self-evaluation, where the institution / programme identifies quality criteria it wants to improve. Part of the process is to ensure the documentation of best practices so that they can be shared with others in a so called market place. Linking the best practices to a criterion makes them searchable on a large scale. Optimal pairings of institutions can then take place for the cross-sparring activities.

A Preliminary Case Study for Collaborative Quality Enhancement

Eight universities have collaborated in an Erasmus+ funded project to create a lean process to enhance self-evaluation and accreditation through peer alliance and cooperation. Central to this process is the partnering of two institutions as critical friends, based on prior selfevaluations of specific programmes to identify particular criteria for improvement. A pairing algorithm matches two institutions based on their respective self-evaluation scores. It ensures there are significant differences in key criteria that are mutually beneficial for future programme development and enhancement. The ensuing meetings between critical friends have been designated as ‘cross-sparring’. This paper focuses on a case-study of the crosssparring and resulting enhancement outcomes between Umeå University and Queen’s University Belfast, and their respective Masters programmes in Software Engineering and Mechanical Engineering. The collaborative experiences of the process are evaluated, reported, discussed and conclusions provided on the efficacy of this particular application of cross-sparring.

Acceptability, impact and sustainability of the national pilot quality assurance system for self management programs

Chronic condition self-management education and training interventions such as the Stanford Self Management Programs (SMP) have the capacity to improve health and quality of life of people with chronic conditions whilst reducing the use of health services. This is in line with the outcomes from the recent Council of Australian Governments’ meeting where it was indicated that self-management will be a centrepiece in forthcoming chronic disease initiatives.
Aim: report on a large national pilot quality assurance program involving the implementation and of an evaluation and quality monitoring system for SMPs including the provision of structured feedback to courses course leaders and service providers. During 2005/06 the quality assurance program was implemented at 11 diverse organisations across Australia. The program involved assisting organisations apply the 42-item Health Education Impact Questionnaire (HEIQ), a chronic disease health education outcome measure, and then observe and evaluate the value and impact of the quality program. Interviews with course leaders (n=60) and course participants (n=35) have elicited views about course quality and feedback processes.
Results: The evaluation revealed enablers and barriers to effective implementation and sustainability. Important enablers were:
- Course Leaders and organisations valued an Australia-wide system that provided feedback on course
quality and the impact on participants.
- Course Leaders were strongly personally motivated to respond appropriately to HEI-Q course
report feedback.
- Completing the questionnaire provided participants with the opportunity to reflect on issues that
emerge in the course content and reflect on their progression at the end of the SSMP.
Sustainability issues included:
- Organisations and course leaders require support, training and flexibility on how to administer and
manage the use of the HEI-Q.
- Availability of administrative resources in organisations to support the quality assurance activities.
- The requirement that course leaders are trained in interpreting HEI-Q course report data.
A quality improvement framework was developed which identified the actions required of key stakeholders to
support effective implementation.
Discussion: With the increasing endorsement of SMP across sectors it is important that course quality is known, is acceptable, and is communicated to stakeholders to inform and engender confidence in the SSMP. To effectively implement and sustain a quality improvement program for SMP, the processes and tools for measuring outcomes need to be responsive, flexible and easily integrated into the organisation and delivery of programs.

Evaluation of exclusion netting for insect pest control and fruit quality enhancement in tree crops

This work evaluated the following aspects of the use of exclusion netting in low chill stone fruit: the efficacy of protection from fruit fly for this highly susceptible crop; the effects on environmental factors; and the effects on crop development. Concurrently, an economic viability study on the use of exclusion netting was undertaken. The trial site was a 0.6-ha block of low chill stone fruit at Nambour, south-east Queensland, Australia. In this area, populations of Queensland fruit fly (Bactrocera tryoni) are known to be substantial, particularly in spring and summer. The trial block contained healthy 4-year-old trees as follows: 96 peach trees (Prunus persica cv. Flordaprince) and 80 nectarine trees (40 P. persica var. nucipersica cv. White Satin and 40 P. persica var. nucipersica cv. Sunwright). Exclusion netting was installed over approximately half of the block in february 2001. The net was a UV-stabilized structural knitted fabric made from high-density polyethylene yarn with a 10-year prorated UV degradation warranty. The results demonstrated the efficacy of exclusion netting in the control of fruit flies. Exclusion netting increased maximum temperatures by 4.4 deg C and decreased minimum temperatures by 0.5 deg C. Although exclusion netting reduced irradiance by approximately 20%, it enhanced fruit development by 7-10 days and improved fruit quality by increasing sugar concentration by 20-30% and colour intensity by 20%.

Leading the evaluation of institutional online learning environments for quality enhancement in times of change

This paper reports on findings from a nationally funded project which aims to design and implement a quality management framework for online learning environments (OLEs). Evaluation is a key component of any quality management system and it is this aspect of the framework that is the focus of this paper. In developing the framework initial focus groups were conducted at the five participating institutions. These revealed that, although regarded as important, there did not appear to be a shared understanding of the nature and purpose of evaluation. A second series of focus groups revealed there were multiple perspectives arising from those with a vested interest in online learning. These perspectives will be outlined. Overall, how evaluation was undertaken was highly variable within and across the five institutions reflecting where they were at in relation to the development of their OLE.

Antecedents and consequences of service quality in consumer evaluation of self-service internet technologies

Advances in technology coupled with increasing labour costs have caused service firms to explore self-service delivery options. Although some studies have focused on self-service and use of technology in service delivery, few have explored the role of service quality in consumer evaluation of technology-based self-service options. By integrating and extending the self-service quality framework the service evaluation model and the Technology Acceptance Model the authors address this emerging issue by empirically testing a comprehensive model that captures the antecedents and consequences of perceived service quality to predict continued customer interaction in the technology-based self-service context of Internet banking. Important service evaluation constructs like perceived risk, perceived value and perceived satisfaction are modelled in this framework. The results show that perceived control has the strongest influence on service quality evaluations. Perceived speed of delivery, reliability and enjoyment also have a significant impact on service quality perceptions. The study also found that even though perceived service quality, perceived risk and satisfaction are important predictors of continued interaction, perceived customer value plays a pivotal role in influencing continued interaction.

Organization specific predictors of job satisfaction: findings from a Canadian multi-site quality of work life cross-sectional survey

Background: Organizational features can affect how staff view their quality of work life. Determining staff perceptions about quality of work life is an important consideration for employers interested in improving employee job satisfaction. The purpose of this study was to identify organization specific predictors of job satisfaction within a health care system that consisted of six independent health care organizations.

Methods: 5,486 full, part and causal time (non-physician) staff on active payroll within six organizations (2 community hospitals, 1 community hospital/long-term care facility, 1 long-term care facility, 1 tertiary care/community health centre, and 1 visiting nursing agency) located in five communities in Central West Ontario, Canada were asked to complete a 65-item quality of work life survey. The self-administered questionnaires collected staff perceptions of: co-worker and supervisor support; teamwork and communication; job demands and decision authority; organization characteristics; patient/resident care; compensation and benefits; staff training and development; and impressions of the organization. Socio-demographic data were also collected.

Results: Depending on the organization, between 15 and 30 (of the 40 potential predictor) variables were found to be statistically associated with job satisfaction (univariate analyses). Logistic regression analyses identified the best predictors of job satisfaction and these are presented for each of the six organizations and for all organizations combined.

Conclusions: The findings indicate that job satisfaction is a multidimensional construct and although there appear to be some commonalities across organizations, some predictors of job satisfaction appear to be organization and context specific.

Examination of a multi-factorial model of body-related experiences during pregnancy : the relationships among physical symptoms, sleep quality, depression, self-esteem, and negative body attitudes

The aim of this cross-sectional study was to investigate relationships among women's body attitudes, physical symptoms, self-esteem, depression, and sleep quality during pregnancy. Pregnant women (N = 215) at 15–25 weeks gestation completed a questionnaire including four body image subscales assessing self-reported feeling fat, attractiveness, strength/fitness, and salience of weight and shape. Women reported on 29 pregnancy-related physical complaints, and completed the Beck Depression Inventory, Rosenberg Self-esteem Scale, and Pittsburgh Sleep Quality Index. In regressions, controlling for retrospective reports of body image, more frequent and intense physical symptoms were related to viewing the self as less strong/fit, and to poorer sleep quality and more depressive symptoms. In a multi-factorial model extending previous research, paths were found from sleep quality to depressive symptoms to self-esteem; self-esteem was found to be a mediator associated with lower scores on feeling fat and salience of weight and shape, and on higher perceived attractiveness.

Developing a robust self evaluation framework for active learning:the first stage of an ERASMUS+ project (QAEMarketPlace4HEI)

In ensuring the quality of learning and teaching in Higher Education, self-evaluation is an important component of the process. An example would be the approach taken within the CDIO community whereby self-evaluation against the CDIO standards is part of the quality assurance process. Eight European universities (Reykjavik University, Iceland; Turku University of Applied Sciences, Finland; Aarhus University, Denmark; Helsinki Metropolia University of Applied Sciences, Finland; Ume? University, Sweden; Telecom Bretagne, France; Aston University, United Kingdom; Queens University Belfast, United Kingdom) are engaged in an EU funded Erasmus + project that is exploring the quality assurance process associated with active learning. The development of a new self-evaluation framework that feeds into a ?Marketplace? where participating institutions can be paired up and then engage in peer evaluations and sharing around each institutions approach to and implementation of active learning. All of the partner institutions are engaged in the application of CDIO within their engineering programmes and this has provided a common starting point for the partnership to form and the project to be developed. Although the initial focus will be CDIO, the longer term aim is that the approach could be of value beyond CDIO and within other disciplines. The focus of this paper is the process by which the self-evaluation framework is being developed and the form of the draft framework. In today?s Higher Education environment, the need to comply with Quality Assurance standards is an ever present feature of programme development and review. When engaging in a project that spans several countries, the wealth of applicable standards and guidelines is significant. In working towards the development of a robust Self Evaluation Framework for this project, the project team decided to take a wide view of the available resources to ensure a full consideration of different requirements and practices. The approach to developing the framework considered: a) institutional standards and processes b) national standards and processes e.g. QAA in the UK c) documents relating to regional / global accreditation schemes e.g. ABET d) requirements / guidelines relating to particular learning and teaching frameworks e.g. CDIO. The resulting draft self-evaluation framework is to be implemented within the project team to start with to support the initial ?Marketplace? pairing process. Following this initial work, changes will be considered before a final version is made available as part of the project outputs. Particular consideration has been paid to the extent of the framework, as a key objective of the project is to ensure that the approach to quality assurance has impact but is not overly demanding in terms of time or paperwork. In other words that it is focused on action and value added to staff, students and the programmes being considered.