Developing a robust self evaluation framework for active learning:the first stage of an ERASMUS+ project (QAEMarketPlace4HEI)

In ensuring the quality of learning and teaching in Higher Education, self-evaluation is an important component of the process. An example would be the approach taken within the CDIO community whereby self-evaluation against the CDIO standards is part of the quality assurance process. Eight European universities (Reykjavik University, Iceland; Turku University of Applied Sciences, Finland; Aarhus University, Denmark; Helsinki Metropolia University of Applied Sciences, Finland; Ume? University, Sweden; Telecom Bretagne, France; Aston University, United Kingdom; Queens University Belfast, United Kingdom) are engaged in an EU funded Erasmus + project that is exploring the quality assurance process associated with active learning. The development of a new self-evaluation framework that feeds into a ?Marketplace? where participating institutions can be paired up and then engage in peer evaluations and sharing around each institutions approach to and implementation of active learning. All of the partner institutions are engaged in the application of CDIO within their engineering programmes and this has provided a common starting point for the partnership to form and the project to be developed. Although the initial focus will be CDIO, the longer term aim is that the approach could be of value beyond CDIO and within other disciplines. The focus of this paper is the process by which the self-evaluation framework is being developed and the form of the draft framework. In today?s Higher Education environment, the need to comply with Quality Assurance standards is an ever present feature of programme development and review. When engaging in a project that spans several countries, the wealth of applicable standards and guidelines is significant. In working towards the development of a robust Self Evaluation Framework for this project, the project team decided to take a wide view of the available resources to ensure a full consideration of different requirements and practices. The approach to developing the framework considered: a) institutional standards and processes b) national standards and processes e.g. QAA in the UK c) documents relating to regional / global accreditation schemes e.g. ABET d) requirements / guidelines relating to particular learning and teaching frameworks e.g. CDIO. The resulting draft self-evaluation framework is to be implemented within the project team to start with to support the initial ?Marketplace? pairing process. Following this initial work, changes will be considered before a final version is made available as part of the project outputs. Particular consideration has been paid to the extent of the framework, as a key objective of the project is to ensure that the approach to quality assurance has impact but is not overly demanding in terms of time or paperwork. In other words that it is focused on action and value added to staff, students and the programmes being considered.

Design and evaluation for the future of m-interaction

Mobile technology has been one of the major growth areas in computing over recent years (Urbaczewski, Valacich, & Jessup, 2003). Mobile devices are becoming increasingly diverse and are continuing to shrink in size and weight. Although this increases the portability of such devices, their usability tends to suffer. Fuelled almost entirely by lack of usability, users report high levels of frustration regarding interaction with mobile technologies (Venkatesh, Ramesh, & Massey, 2003). This will only worsen if interaction design for mobile technologies does not continue to receive increasing research attention. For the commercial benefit of mobility and mobile commerce (m-commerce) to be fully realized, users’ interaction experiences with mobile technology cannot be negative. To ensure this, it is imperative that we design the right types of mobile interaction (m-interaction); an important prerequisite for this is ensuring that users’ experience meets both their sensory and functional needs (Venkatesh, Ramesh, & Massey, 2003). Given the resource disparity between mobile and desktop technologies, successful electronic commerce (e-commerce) interface design and evaluation does not necessarily equate to successful m-commerce design and evaluation. It is, therefore, imperative that the specific needs of m-commerce are addressed–both in terms of design and evaluation. This chapter begins by exploring the complexities of designing interaction for mobile technology, highlighting the effect of context on the use of such technology. It then goes on to discuss how interaction design for mobile devices might evolve, introducing alternative interaction modalities that are likely to affect that future evolution. It is impossible, within a single chapter, to consider each and every potential mechanism for interacting with mobile technologies; to provide a forward-looking flavor of what might be possible, this chapter focuses on some more novel methods of interaction and does not, therefore, look at the typical keyboard and visual display-based interaction which, in essence, stem from the desktop interaction design paradigm. Finally, this chapter touches on issues associated with effective evaluation of m-interaction and mobile application designs. By highlighting some of the issues and possibilities for novel m-interaction design and evaluation, we hope that future designers will be encouraged to “think out of the box” in terms of their designs and evaluation strategies.

Reducing medicines waste in the community

There is increasing concern at the amount and cost of prescribed medicines that are unused or wasted and then have to be disposed of. Previous studies have used health promotion and Dispose Unwanted Medicines Properly campaigns targeted at the patient to describe and quantify the annual cost of waste. The reasons patients return unused drugs to pharmacies have also been explored. The paper focuses on patient explanations for not needing medication; categorized as: over-collection in the past, self-management strategies, changes in medical condition, other changes in patient circumstances, or the repeat medicines policy at the surgery. The aim of the original study was to make a measurable change in prescribed medicines with a reduction in medicines wastage, whilst at the same time achieving improved standards of pharmaceutical care. Information on patient needs and behaviour came from consultation in the pharmacy monitoring forms and interview. The study was based on two medical practices in the West Midlands, UK, comparing an outer city and an inner city population. The participants were general practitioners, pharmacists and 350 repeat prescription patients. Prescriptions were issued for two three-month periods. The outcome was that 23.8% of the prescribed items were not dispensed, at a value of £13.1K, 58% of the medications that would be expected to be regularly supplied were collected. The study suggests that closer professional management at the point of dispensing and an understanding of patient experiences can help reduce the amount of unwanted medication collected by patients.

Controlled study into the effectiveness of individual client-centred counselling for young offenders in residential care

This study is toe first documented account in the British Isles of an evaluation of the effectiveness of client-centred counselling with young offenders in secure residential care. It is a test of Rogers' (1957) position on the 'necessary and sufficient' conditions of therapeutic personality change within a counselling relationship. Forty teenage male offenders, the subjects of Training School Orders, were randomly allocated in equal numbers to either an experimental or control group. Boys in the experimental group received weekly individual sessions of client-centred counselling over a seven month period. Boys in the control group received no formal counselling but were shown to have similar intellectual, personality, socio-economic and criminal backgrounds to those in the experimental group. It was hypothesised that counselled subjects would show more positive outcomes than control subjects over a range of measures relating to criminal behaviour and self-conception. The results indicated that the counselled subjects had a significantly lower rate of offending and a srnaller range of offences over a mean follow-up period of 2.5 years. They were also licensed from the institution significantly earlier and spent less time in custody during a one year follow-up after counselling was completed. Self-conception measures gave less clear-cut results. The direction of change towards better adjustment favoured the counselled subjects but the magnitude was often small. Those counselled subjects with most positive behaviour change tended to have significantly improved self-evaluation, less self/ideal self discrepancy and more variation on 'actual' self concept compared to pre-counselling. The results are discussed in the context of client-centred theory, methodological adequacy of the experimental design, and their application to the future treatment of young offenders in secure residential care.

Provision of pharmaceutical care by community pharmacists:a comparison across Europe

Objective To investigate the provision of pharmaceutical care by community pharmacists across Europe and to examine the various factors that could affect its implementation. Methods A questionnaire-based survey of community pharmacies was conducted within 13 European countries. The questionnaire consisted of two sections. The first section focussed on demographic data and services provided in the pharmacy. The second section was a slightly adapted version of the Behavioral Pharmaceutical Care Scale (BPCS) which consists of three main dimensions (direct patient care activities, referral and consultation activities and instrumental activities). Results Response rates ranged from 10–71% between countries. The mean total score achieved by community pharmacists, expressed as a percentage of the total score achievable, ranged from 31.6 (Denmark) to 52.2% (Ireland). Even though different aspects of pharmaceutical care were implemented to different extents across Europe, it was noted that the lowest scores were consistently achieved in the direct patient care dimension (particularly those related to documentation, patient assessment and implementation of therapeutic objectives and monitoring plans) followed by performance evaluation and evaluation of patient satisfaction. Pharmacists who dispensed higher daily numbers of prescriptions in Ireland, Germany and Switzerland had significantly higher total BPCS scores. In addition, pharmacists in England and Ireland who were supported in their place of work by other pharmacists scored significantly higher on referral and consultation and had a higher overall provision of pharmaceutical care. Conclusion The present findings suggest that the provision of pharmaceutical care in community pharmacy is still limited within Europe. Pharmacists were routinely engaged in general activities such as patient record screening but were infrequently involved in patient centred professional activities such as the implementation of therapeutic objectives and monitoring plans, or in self-evaluation of performance.

Using accreditation criteria for collaborative quality enhancement

This paper describes a process to enhance the quality of higher education. At the heart of the process is a cross-sparring collaborative model, whereby institutions are critical friends. This is based on a prior self-evaluation, where the institution / programme identifies quality criteria it wants to improve. Part of the process is to ensure the documentation of best practices so that they can be shared with others in a so called market place. Linking the best practices to a criterion makes them searchable on a large scale. Optimal pairings of institutions can then take place for the cross-sparring activities.

Antecedents and consequences of service quality in consumer evaluation of self-service internet technologies

Advances in technology coupled with increasing labour costs have caused service firms to explore self-service delivery options. Although some studies have focused on self-service and use of technology in service delivery, few have explored the role of service quality in consumer evaluation of technology-based self-service options. By integrating and extending the self-service quality framework the service evaluation model and the Technology Acceptance Model the authors address this emerging issue by empirically testing a comprehensive model that captures the antecedents and consequences of perceived service quality to predict continued customer interaction in the technology-based self-service context of Internet banking. Important service evaluation constructs like perceived risk, perceived value and perceived satisfaction are modelled in this framework. The results show that perceived control has the strongest influence on service quality evaluations. Perceived speed of delivery, reliability and enjoyment also have a significant impact on service quality perceptions. The study also found that even though perceived service quality, perceived risk and satisfaction are important predictors of continued interaction, perceived customer value plays a pivotal role in influencing continued interaction.

An evaluation of the effectiveness of intervention strategies for the promotion of health and safety performance in small firms

Recognition of the contribution of small firms to the UK economy has grown considerably since 1995 when this research first began. The poor record of small firms in managing health and safety effectively has caused concern, and efforts made to improve knowledge and awareness of the target group through various initiatives have had some success. This research thesis attempts to identify the range of intervention routes and methods available to reach the target group, and to consider ways of evaluating the outcome of such efforts. Various interventions were tested with small firms, including a Workshop; use of Questionnaires; short postal Reply Slip survey; leading to a closer evaluation of a specific industry- the Licensed Trade. Attitudes and beliefs of the sample were identified, and observations carried out to consider actions taken by workers and others in the workplace. These empirical research findings were used to develop the theme of Primary and Secondary interventions intended to change behaviours, and to confirm assumptions about what small firms currently do to manage health and safety risks. Guidance for small firms was developed as a Secondary intervention tool to support Primary interventions, such as inspection or insurance provision.

Evaluation of public housing strategies in Mexico City : an exploratory goal programming approach

This thesis describes the development and use of a goal programming methodology for the evaluation of public housjng strategies in Mexico City, The methodology responds to the need to incorporate the location, size and densities of housing projects on the one hand, and "external" constraints such as the ability of low income families to pay for housing, and the amounts of capital and land available, on the other. The provision of low cost housing by public housing agencies in Mexico City is becoming increasingly difficult because there are so many constraints to be met and overcome, the most important of which is the ability of families to pay for housing. Other important limiting factors are the availability of capital and of land plots of the right size in desired locations. The location of public housing projects is significant because it determines the cost and pattern of work trips, which in a metropolitan area such as Mexico City are of considerable importance to both planners and potential. house owners. In addition, since the price of land is closely related to its location, the last factor is also significant in determining the price of the total housing package. Consequently there is a major trade-off between a housing strategy based on the provision of housing at locations close to employment, and the opposite one based on the provjsion of housjng at locations where employment accessibility is poorer but housing can be provided at a lower price. The goal programming evaluation methodology presented in this thesis was developed to aid housing planners to evaluate housing strategies which incorporate the issues raised above,

The evaluation of marketing strategies for the sale of sports goods in Europe

The objectives of this thesis are to examine and evaluate the process of marketing as practiced by an established and successful company in the sports trade, Dunlop Sports Company Ltd. (D.S.C.). In particular the field of strategy formulation for exporting is considered in an operational context, and compared with existing literature and theory on the subject. Market intelligence has been gathered by visiting European territories and pursuing available sources in the United Kingdom. The data now available is intended to act as a base for developing a more effective market research function within D.S.C. At various stages reports have been submitted on specific topics to the Company and this thesis represents the culmination of these reports and an outline for future policies which are open to D.S.C. The thesis chooses certain aspects of marketing and examines the way in which the marketing strategy of the Company appears to act upon these. In particular the topics of Pricing, Distribution and Market Research are considered. Initially a series of alternative market postures are postulated and assessed within the European strategy of D.S.C. Where no explicit strategy is available an implied strategy is identified and evaluated. In chapters on Pricing and Distribution some of the problems being encountered are given detailed consideration and preferred policies arc suggested. In the final chapter the major strengths and weaknesses of of the Company are brought together and the various recommendations summarised in the context of a marketing strategy which would meet some o:f the current difficulties. The emphasis tliroughout is on the effect of strategy formulation, whether or not this appears adequate, and how each of the various operational elements of the marketing mix depend upon this.

Run-time model evaluation for requirements model-driven self-adaptation

A self-adaptive system adjusts its configuration to tolerate changes in its operating environment. To date, requirements modeling methodologies for self-adaptive systems have necessitated analysis of all potential system configurations, and the circumstances under which each is to be adopted. We argue that, by explicitly capturing and modelling uncertainty in the operating environment, and by verifying and analysing this model at runtime, it is possible for a system to adapt to tolerate some conditions that were not fully considered at design time. We showcase in this paper our tools and research results. © 2012 IEEE.

Finding qualitative research: an evaluation of search strategies

Background Qualitative research makes an important contribution to our understanding of health and healthcare. However, qualitative evidence can be difficult to search for and identify, and the effectiveness of different types of search strategies is unknown. Methods Three search strategies for qualitative research in the example area of support for breast-feeding were evaluated using six electronic bibliographic databases. The strategies were based on using thesaurus terms, free-text terms and broad-based terms. These strategies were combined with recognised search terms for support for breast-feeding previously used in a Cochrane review. For each strategy, we evaluated the recall (potentially relevant records found) and precision (actually relevant records found). Results A total yield of 7420 potentially relevant records was retrieved by the three strategies combined. Of these, 262 were judged relevant. Using one strategy alone would miss relevant records. The broad-based strategy had the highest recall and the thesaurus strategy the highest precision. Precision was generally poor: 96% of records initially identified as potentially relevant were deemed irrelevant. Searching for qualitative research involves trade-offs between recall and precision. Conclusions These findings confirm that strategies that attempt to maximise the number of potentially relevant records found are likely to result in a large number of false positives. The findings also suggest that a range of search terms is required to optimise searching for qualitative evidence. This underlines the problems of current methods for indexing qualitative research in bibliographic databases and indicates where improvements need to be made.

From the workplace to the classroom:examining the impact of self-leadership learning strategies on higher educational attainment and success

Self-leadership is a concept from the organisational and management literature broadly combining processes of self-goal setting, self-regulation and self-motivation. Research has typically focused on the impact of self-leadership on work performance outcomes, with little attention to potential benefits for learning and development. In this paper, we employ a longitudinal design to examine the association of a number of processes of self-leadership with higher educational attainment in a sample of business students (N = 150). Self-reported use of strategies related to behavioural, cognitive and motivational aspects of self-leadership were measured in the first semester of the academic year, and correlated with end-of year grade point average. We found that in particular, self-goal setting, pro-active goal-related behaviour, behaviour regulation and direction, motivational awareness, and optimism were all significant predictors of educational attainment. We discuss implications for educational research and for teachers and tutors in practice.