evaluation framework for software test processes

Magdeburg, Univ., Fak. für Informatik, Diss., 2009

Standard Evaluation Framework for Weight Management Interventions - Core Criteria

The National Obesity Observatory was established to provide a single point of contact for wide-ranging authoritative information on data and evidence related to obesity, overweight, underweight and their determinants. The Standard Evaluation Framework is a list of data collection criteria and supporting guidance for collecting high quality information to support the evaluation of weight management interventions. This is a quick reference guide to the core criteria of the Standard Evaluation Framework. Essential criteria are presented as the minimum recommended data for evaluating a weight management intervention. Desirable criteria are additional data that would enhance the evaluation.refer to the resource

Standard Evaluation Framework (SEF) for weight management interventions Presentation

This presentation summaries the Standard Evaluation Framework which is designed to support high quality, consistent evaluation of weight management interventions in order to increase the evidence base.

Introducing blended learning into a Master Program in Nursing Sciences: a first exploration of a holistic evaluation framework

This contribution presents the first stage of a project to assist the transition of a traditional to a blended program in higher nursing education. We shall describe the goals and context of this project, present the evaluation framework, discuss some early results and then discuss the usefulness of the first version of the evaluation framework.

Refinement of the Clinical Scenario Evaluation Framework for Assessment of Competing Development Strategies with an Application to Multiple Sclerosis

When competing strategies for development programs, clinical trial designs, or data analysis methods exist, the alternatives need to be evaluated in a systematic way to facilitate informed decision making. Here we describe a refinement of the recently proposed clinical scenario evaluation framework for the assessment of competing strategies. The refinement is achieved by subdividing key elements previously proposed into new categories, distinguishing between quantities that can be estimated from preexisting data and those that cannot and between aspects under the control of the decision maker from those that are determined by external constraints. The refined framework is illustrated by an application to a design project for an adaptive seamless design for a clinical trial in progressive multiple sclerosis.

Applications of the behavioural homogeneity evaluation framework: the predictive ability of consumer involvement for international food market segmentation

This article proposes a framework of alternative international marketing strategies, based on the evaluation of intra- and inter-cultural behavioural homogeneity for market segmentation. The framework developed in this study provides a generic structure to behavioural homogeneity, proposing consumer involvement as a construct with unique predictive ability for international marketing strategy decisions. A model-based segmentation process, using structural equation models, is implemented to illustrate the application of the framework.

The behavioural homogeneity evaluation framework:Multi-level evaluations of consumer involvement in international segmentation

This paper presents a generic strategic framework of alternative international marketing strategies and market segmentation based on intra- and inter-cultural behavioural homogeneity. Consumer involvement (CI) is proposed as a pivotal construct to capture behavioural homogeneity, for the identification of market segments. Results from a five-country study demonstrate how the strategic framework can be valuable in managerial decision-making. First, there is evidence for the cultural invariance of the measurement of CI, allowing a true comparison of inter- and intra-cultural behavioural homogeneity. Second, CI influences purchase behaviour, and its evaluation provides a rich source of information for responsive market segmentation. Finally, a decomposition of behavioural variance suggests that national-cultural environment and nationally transcendent variables explain differences in behaviour. The Behavioural Homogeneity Evaluation Framework therefore suggests appropriate international marketing strategies, providing practical guidance for implementing involvement-contingent strategies. © 2007 Academy of International Business. All rights reserved.

An ex ante evaluation framework for the regional benefits of publicly supported R&D projects

This paper draws on the knowledge-base implicit in ex post evaluations of publicly funded R&D and other related conceptual and empirical studies to suggest a framework for the ex ante evaluation of the regional benefits from R&D projects. The framework developed comprises two main elements: an inventory of the global private and social benefits which might result from any R&D project; and, an assessment of the share of these global benefits which might accrue to a host region, taking into account the characteristics of the R&D project and the region's innovation system. The inventory of global benefits separately identifies private and social benefits and distinguishes between increments to public and private knowledge stocks, benefits to R&D productivity and benefits from commercialisation. Potential market and 'pure' knowledge spillovers are also considered separately. The paper concludes with the application of the framework to two illustrative case studies. © 2003 Elsevier B.V. All rights reserved.

Developing a robust self evaluation framework for active learning:the first stage of an ERASMUS+ project (QAEMarketPlace4HEI)

In ensuring the quality of learning and teaching in Higher Education, self-evaluation is an important component of the process. An example would be the approach taken within the CDIO community whereby self-evaluation against the CDIO standards is part of the quality assurance process. Eight European universities (Reykjavik University, Iceland; Turku University of Applied Sciences, Finland; Aarhus University, Denmark; Helsinki Metropolia University of Applied Sciences, Finland; Ume? University, Sweden; Telecom Bretagne, France; Aston University, United Kingdom; Queens University Belfast, United Kingdom) are engaged in an EU funded Erasmus + project that is exploring the quality assurance process associated with active learning. The development of a new self-evaluation framework that feeds into a ?Marketplace? where participating institutions can be paired up and then engage in peer evaluations and sharing around each institutions approach to and implementation of active learning. All of the partner institutions are engaged in the application of CDIO within their engineering programmes and this has provided a common starting point for the partnership to form and the project to be developed. Although the initial focus will be CDIO, the longer term aim is that the approach could be of value beyond CDIO and within other disciplines. The focus of this paper is the process by which the self-evaluation framework is being developed and the form of the draft framework. In today?s Higher Education environment, the need to comply with Quality Assurance standards is an ever present feature of programme development and review. When engaging in a project that spans several countries, the wealth of applicable standards and guidelines is significant. In working towards the development of a robust Self Evaluation Framework for this project, the project team decided to take a wide view of the available resources to ensure a full consideration of different requirements and practices. The approach to developing the framework considered: a) institutional standards and processes b) national standards and processes e.g. QAA in the UK c) documents relating to regional / global accreditation schemes e.g. ABET d) requirements / guidelines relating to particular learning and teaching frameworks e.g. CDIO. The resulting draft self-evaluation framework is to be implemented within the project team to start with to support the initial ?Marketplace? pairing process. Following this initial work, changes will be considered before a final version is made available as part of the project outputs. Particular consideration has been paid to the extent of the framework, as a key objective of the project is to ensure that the approach to quality assurance has impact but is not overly demanding in terms of time or paperwork. In other words that it is focused on action and value added to staff, students and the programmes being considered.

TREF – Total Risk Evaluation Framework: integrált kockázatmenedzsment-szemléletű keretrendszer kifejlesztése és bevezetése egy magyarországi termelővállalatnál

A felhasználók, a szabványos és törvényi előírások ma már több területen kikényszerítették a kockázatok elemzését és kezelését. A jelenlegi rendszerek alapvető jellemzői, hogy a vállalatokon belüli rendszerek egymástól elkülönülten működnek. Ennek oka az eltérő időpontban, eltérő követelmények, valamint különböző felfogás szerint történt rendszerbevezetés. Az integráció elsősorban vállalati szinten történik, az elemzés szempontját alapvetően az adott funkcionális terület filozófiája határozza meg. Emiatt ritkán kerül sor egy termék vagy folyamat által hordozott összes kockázat módszeres számbavételére. A szabványosítás területén vannak törekvések az integrált szemlélet érvényesítésére. Ez részben már megjelent az ISO 9001 (Minőségirányítási Rendszer [MIR]), az ISO 14001 (Környezetközpontú Irányítási Rendszer [KIR]) és az MSZ 28001 (Munkahelyi Egészségvédelem és Biztonsági Rendszer [MEBIR]) szabványok vonatkozásában. Az ISO 31000 szabványcsalád általános útmutatást ad egy szervezeten belül a kockázatkezelési folyamat tervezésére, megvalósítására és fenntartására. A jelenlegi tanulmány alapvető célja egy olyan újszerű módszer bemutatása, amely lehetővé teszi a különböző irányítási rendszerek hierarchikus, folyamatcentrikus, kockázatmenedzsment-alapú integrációját.

Evaluation Framework EFI for Measuring the Impact of Learning, Education and Training

This article introduces the Evaluation Framework EFI for the Impact Measurement of learning, education and training: The Evaluation Framework for Impact Measurement was developed for specifying the evaluation phase and its objectives and tasks within the IDEAL Reference Model for the introduction and optimization of quality development within learning, education and training. First, a description of the Evaluation Framework for Impact Measurement will be provided, followed by a brief overview of the IDEAL Reference Model. Finally, an example for the implementation of the Evaluation Framework for Impact Measurement within the ARISTOTELE project is presented.

Defining a framework for the evaluation of information

In any enterprise, decisions need be made during the life cycle of information about its management. This requires information evaluation to take place; a little-understood process. For evaluation support to be both effective and resource efficient, some sort of automatic or semi-automatic evaluation method would be invaluable. Such a method would require an understanding of the diversity of the contexts in which evaluation takes place so that evaluation support can have the necessary context-sensitivity. This paper identifies the dimensions influencing the information evaluation process and defines the elements that characterise them, thus providing the foundations for a context-sensitive evaluation framework.

Evaluation of email alerts in practice: Part 2. Validation of the information assessment method.

RATIONALE AND OBJECTIVE:. The information assessment method (IAM) permits health professionals to systematically document the relevance, cognitive impact, use and health outcomes of information objects delivered by or retrieved from electronic knowledge resources. The companion review paper (Part 1) critically examined the literature, and proposed a 'Push-Pull-Acquisition-Cognition-Application' evaluation framework, which is operationalized by IAM. The purpose of the present paper (Part 2) is to examine the content validity of the IAM cognitive checklist when linked to email alerts. METHODS: A qualitative component of a mixed methods study was conducted with 46 doctors reading and rating research-based synopses sent on email. The unit of analysis was a doctor's explanation of a rating of one item regarding one synopsis. Interviews with participants provided 253 units that were analysed to assess concordance with item definitions. RESULTS AND CONCLUSION: The content relevance of seven items was supported. For three items, revisions were needed. Interviews suggested one new item. This study has yielded a 2008 version of IAM.

Evaluation and comparison of current fetal ultrasound image segmentation methods for biometric measurements: a grand challenge.

This paper presents the evaluation results of the methods submitted to Challenge US: Biometric Measurements from Fetal Ultrasound Images, a segmentation challenge held at the IEEE International Symposium on Biomedical Imaging 2012. The challenge was set to compare and evaluate current fetal ultrasound image segmentation methods. It consisted of automatically segmenting fetal anatomical structures to measure standard obstetric biometric parameters, from 2D fetal ultrasound images taken on fetuses at different gestational ages (21 weeks, 28 weeks, and 33 weeks) and with varying image quality to reflect data encountered in real clinical environments. Four independent sub-challenges were proposed, according to the objects of interest measured in clinical practice: abdomen, head, femur, and whole fetus. Five teams participated in the head sub-challenge and two teams in the femur sub-challenge, including one team who tackled both. Nobody attempted the abdomen and whole fetus sub-challenges. The challenge goals were two-fold and the participants were asked to submit the segmentation results as well as the measurements derived from the segmented objects. Extensive quantitative (region-based, distance-based, and Bland-Altman measurements) and qualitative evaluation was performed to compare the results from a representative selection of current methods submitted to the challenge. Several experts (three for the head sub-challenge and two for the femur sub-challenge), with different degrees of expertise, manually delineated the objects of interest to define the ground truth used within the evaluation framework. For the head sub-challenge, several groups produced results that could be potentially used in clinical settings, with comparable performance to manual delineations. The femur sub-challenge had inferior performance to the head sub-challenge due to the fact that it is a harder segmentation problem and that the techniques presented relied more on the femur's appearance.