D10.1 - Quality Assurance Handbook

The purpose of this Quality Assurance Handbook (QAH) is to present and describe quality standards and procedures to be applied in the internal management and execution of the Research and Innovation Action 644187 RAGE (Realising and Applied Gaming Eco-system). This document is based on the terms and conditions established in the Grant Agreement (nº 644187) signed by the European Commission and the project coordinator, and its Annexes as well as the RAGE Consortium Agreement specifications and requirements

Quality Assurance for GCxGC-FID, Accreditation for TPH CWG Protocol

A new technological approach in the analysis and forensic interpretation of Total Hydrocarbons in soils and waters using 2D Gas Chromatography method (GC-GC) was developed alongside environmental forensic and the assessment models to provide better customer products for the environmental industry.
The objective was to develop an analytical methodology for TPH CWG. Raw data from this method is then to be evaluated for forensic interpretation and risk assessment modelling. Access will be made available to the expertise in methods of forensic tracing contaminant sources, transport modelling, human health risk modelling and detailed quantitative risk assessment.
The quantification of internal standards was key to the development of this method. As the laboratory does not test for TPH in 1D, it was requested during INAB ISO 17025 audit to individually map out where each compound falls chromatographically in the 2D. This was done through comparing carbon equivalent numbers to the n-alkane carbons. This proved e.g. 2-methylnaphthalene has 11 carbons in its structure; its carbon equivalent is 12.84 , the result of which falls within the band of Aromatic eC12-eC16 as opposed to expected eC10-eC12. This was carried out for all 16 PAH (polyaromatic hydrocarbons) and BTEX (benzene, toluene, ethylbenzene and o, m and p-xylenes). The n-alkanes were also assigned to their corresponding aliphatic bands e.g. nC8 would be expected to be in nC8-nC10.
The method was validated through a designated systematic experimental protocol and was challenged with spikes of known concentration of hydrocarbon parameters such as recoveries, precision, bias and linearity. The method was verified by testing a certified reference material which was used as a proficiency round of testing for numerous laboratories.
It is hoped that the method will be used in conjunction with the analysis through Bonn Agreement with their OSINet group. This is a panel of experts and laboratories (including CLS) who forensically identify oil spill contamination from a water source.
This method can prove itself to be a robust method and benefit the industry for contaminated land and water but the method needs to be seen as separate from the regular 1D chromatography. It will help identify contaminants and assist consultants, regulators, clients and scientists valuable information not seen in 1D

Quality assurance in the 22991 EORTC ROG trial in localized prostate cancer: dummy run and individual case review.

INTRODUCTION: EORTC trial 22991 was designed to evaluate the addition of concomitant and adjuvant short-term hormonal treatments to curative radiotherapy in terms of disease-free survival for patients with intermediate risk localized prostate cancer. In order to assess the compliance to the 3D conformal radiotherapy protocol guidelines, all participating centres were requested to participate in a dummy run procedure. An individual case review was performed for the largest recruiting centres as well. MATERIALS AND METHODS: CT-data of an eligible prostate cancer patient were sent to 30 centres including a description of the clinical case. The investigator was requested to delineate the volumes of interest and to perform treatment planning according to the protocol. Thereafter, the investigators of the 12 most actively recruiting centres were requested to provide data on five randomly selected patients for an individual case review. RESULTS: Volume delineation varied significantly between investigators. Dose constraints for organs at risk (rectum, bladder, hips) were difficult to meet. In the individual case review, no major protocol deviations were observed, but a number of dose reporting problems were documented for centres using IMRT. CONCLUSIONS: Overall, results of this quality assurance program were satisfactory. The efficacy of the combination of a dummy run procedure with an individual case review is confirmed in this study, as none of the evaluated patient files harboured a major protocol deviation. Quality assurance remains a very important tool in radiotherapy to increase the reliability of the trial results. Special attention should be given when designing quality assurance programs for more complex irradiation techniques.

New perspectives in the use of ink evidence in forensic science: Part I. Development of a quality assurance process for forensic ink analysis by HPTLC

The level of information provided by ink evidence to the criminal and civil justice system is limited. The limitations arise from the weakness of the interpretative framework currently used, as proposed in the ASTM 1422-05 and 1789-04 on ink analysis. It is proposed to use the likelihood ratio from the Bayes theorem to interpret ink evidence. Unfortunately, when considering the analytical practices, as defined in the ASTM standards on ink analysis, it appears that current ink analytical practices do not allow for the level of reproducibility and accuracy required by a probabilistic framework. Such framework relies on the evaluation of the statistics of the ink characteristics using an ink reference database and the objective measurement of similarities between ink samples. A complete research programme was designed to (a) develop a standard methodology for analysing ink samples in a more reproducible way, (b) comparing automatically and objectively ink samples and (c) evaluate the proposed methodology in a forensic context. This report focuses on the first of the three stages. A calibration process, based on a standard dye ladder, is proposed to improve the reproducibility of ink analysis by HPTLC, when these inks are analysed at different times and/or by different examiners. The impact of this process on the variability between the repetitive analyses of ink samples in various conditions is studied. The results show significant improvements in the reproducibility of ink analysis compared to traditional calibration methods.

An exploration of the impact of a mandatory quality assurance program on the staff nurse's commitment to professional development /

This study explored experiences in relation to the impact of the College of Nurses of Ontario's (CNO's) mandatory Quality Assurance (QA) program on registered nurses (RNs) working in a clinical setting of an acute care hospital. A qualitative descriptive research design was used and data collection was done in 2 stages. First, a survey with open-ended questions was given to 45 nurses. Second, 8 respondents from the survey were interviewed using a semistructured format. Data were obtained from 2 groups-diploma-prepared and post diploma-prepared RNs. Findings demonstrated that the CNO's QA program had varying influences on the RNs' learning paths, and these differences appeared to be related to the educational background of the individual. The diploma-prepared nurses reported that their commitment to professional development was influenced by their level of internal motivation, the pressures associated with time, and the need for a strong external motivator, namely the obligation of management to conduct formal performance appraisals. They further reported that the QA program played a part in positively altering their commitment to continuing education. The post-diploma baccalaureate nurses reported that the QA program played a positive role in influencing their ongoing learning, along with their level of internal motivation, the work and health care environment, and the element of professionalism. Several implications for nursing practice, theory, and fiirther research also became evident.

The Effectiveness of Learning Portfolios: A Study of Quality Assurance Programs of Selected Health Regulatory Colleges in Ontario

Health regulatory colleges promote quality practice and continued competence through Quality Assurance (QA) programs. For many colleges, a QA program includes the use of portfolios that incorporate self-directed learning. The purpose of this study was to determine some of the issues surrounding the effectiveness of QA portfolio programs. The literature review revealed that portfolios are valuable tools, but gaps in knowledge include a comparative analysis of QA programs and the perspective of regulatory college administrators. Data were collected through interviews with 6 administrators and a review of 14 portfolio models described on college websites. The results from the two data sources were applied to Robert Stake's responsive evaluation framework to identify issues related to the portfolio's effectiveness (Stake, 1967). The learning components of portfolios were analyzed through the humanist and constructivist lenses. All 14 portfolio models were found to have 3 main components: self-diagnosis, learning plan and activities, and self-evaluation. However, differences were uncovered in learners' autonomy in selecting learning activities, methods of portfolio evaluation, and the relationship between the portfolio and other QA components. The results revealed a dual philosophy of learning in portfolio models and an apparent contradiction between the needs of the individual learner and the organization. Paths for future research include the tenuous relationship between competence and learning, and the impact of technical approaches on selfdirected learning initiatives. A key recommendation is to acknowledge the unique identity of each profession so that health regulatory colleges can address legislative demands and learner needs.

Conceptions of Quality and Approaches to Quality Assurance in Ontario’s Universities

Many international, political, and economic influences led to increased demands for development of new quality assurance systems for universities. Like many policies and processes that aim to assure quality, Ontario’s Quality Assurance Framework (QAF) did not define quality. This study sought to explore conceptions of quality and approaches to quality assurance used within Ontario’s universities. A document analysis of the QAF’s rationale and structure suggested that quality was conceived primarily as fitness for purpose, while suggested indicators represented an exceptional conception of quality. Ontario universities perpetuated such confusion by adopting the framework without customizing it to their institutional conceptions of quality. Drawing upon phenomenographic traditions, a qualitative investigation was conducted to better understand various conceptions of quality held by university administrators and to appreciate ways in which they implemented the QAF. Three main approaches to quality assurance were identified: (a) Defending Quality, characterized by conceptions of quality as exceptional, which focuses on administrative accountability and uses a hands-off strategy to defend traditional notions of quality inputs and resources; (b) Demonstrating Quality, characterized by conceptions of quality as fitness for purpose and value for money, which focuses on accountability to students and uses centralized engaged strategies to demonstrate how programs meet current priorities and intended outcomes; and (c) Enhancing Quality, characterized by conceptions of quality as transformation, which focuses on reflection and learning experience and uses engaged strategies to find new ways of improving learning and teaching. The development of a campus culture that values the institution’s function in student learning and quality teaching would benefit from Enhancing Quality approaches to quality assurance. This would require holistic consideration of the beliefs held by members of the institution, a clear articulation of the institution’s conceptions of quality, and a critical analysis of how these conceptions align with institutional practices and policies.

Modelling software quality : a multidimensional approach

Les sociétés modernes dépendent de plus en plus sur les systèmes informatiques et ainsi, il y a de plus en plus de pression sur les équipes de développement pour produire des logiciels de bonne qualité. Plusieurs compagnies utilisent des modèles de qualité, des suites de programmes qui analysent et évaluent la qualité d'autres programmes, mais la construction de modèles de qualité est difficile parce qu'il existe plusieurs questions qui n'ont pas été répondues dans la littérature. Nous avons étudié les pratiques de modélisation de la qualité auprès d'une grande entreprise et avons identifié les trois dimensions où une recherche additionnelle est désirable : Le support de la subjectivité de la qualité, les techniques pour faire le suivi de la qualité lors de l'évolution des logiciels, et la composition de la qualité entre différents niveaux d'abstraction. Concernant la subjectivité, nous avons proposé l'utilisation de modèles bayésiens parce qu'ils sont capables de traiter des données ambiguës. Nous avons appliqué nos modèles au problème de la détection des défauts de conception. Dans une étude de deux logiciels libres, nous avons trouvé que notre approche est supérieure aux techniques décrites dans l'état de l'art, qui sont basées sur des règles. Pour supporter l'évolution des logiciels, nous avons considéré que les scores produits par un modèle de qualité sont des signaux qui peuvent être analysés en utilisant des techniques d'exploration de données pour identifier des patrons d'évolution de la qualité. Nous avons étudié comment les défauts de conception apparaissent et disparaissent des logiciels. Un logiciel est typiquement conçu comme une hiérarchie de composants, mais les modèles de qualité ne tiennent pas compte de cette organisation. Dans la dernière partie de la dissertation, nous présentons un modèle de qualité à deux niveaux. Ces modèles ont trois parties: un modèle au niveau du composant, un modèle qui évalue l'importance de chacun des composants, et un autre qui évalue la qualité d'un composé en combinant la qualité de ses composants. L'approche a été testée sur la prédiction de classes à fort changement à partir de la qualité des méthodes. Nous avons trouvé que nos modèles à deux niveaux permettent une meilleure identification des classes à fort changement. Pour terminer, nous avons appliqué nos modèles à deux niveaux pour l'évaluation de la navigabilité des sites web à partir de la qualité des pages. Nos modèles étaient capables de distinguer entre des sites de très bonne qualité et des sites choisis aléatoirement. Au cours de la dissertation, nous présentons non seulement des problèmes théoriques et leurs solutions, mais nous avons également mené des expériences pour démontrer les avantages et les limitations de nos solutions. Nos résultats indiquent qu'on peut espérer améliorer l'état de l'art dans les trois dimensions présentées. En particulier, notre travail sur la composition de la qualité et la modélisation de l'importance est le premier à cibler ce problème. Nous croyons que nos modèles à deux niveaux sont un point de départ intéressant pour des travaux de recherche plus approfondis.

Discriminative pattern mining in software fault detection

We present a method to enhance fault localization for software systems based on a frequent pattern mining algorithm. Our method is based on a large set of test cases for a given set of programs in which faults can be detected. The test executions are recorded as function call trees. Based on test oracles the tests can be classified into successful and failing tests. A frequent pattern mining algorithm is used to identify frequent subtrees in successful and failing test executions. This information is used to rank functions according to their likelihood of containing a fault. The ranking suggests an order in which to examine the functions during fault analysis. We validate our approach experimentally using a subset of Siemens benchmark programs.

The graduate teacher programme in England: mentor training, quality assurance and the findings of inspection

In its recent report on the Graduate Teacher Programme (GTP), an employment-based route to Qualified Teacher Status (QTS) in England, the Government's Office for Standards in Education found that, although almost all trainees meet the standards required to qualify, too often they do so at an adequate level, rather than achieving the high levels of which they should be capable. The underlying reason for this is the quality of mentoring provided in the schools. The inspectors concluded that schoolbased trainers are often not adequately prepared for their role in implementing wide-ranging training programmes for trainee teachers. Despite this generally bleak picture, Ofsted concluded that 'the minority of cases of good practice in the training programmes and of high quality teaching by trainees indicate that the GTP can be an effective alternative route for training teachers'™. This article considers the strengths and weaknesses of the Graduate Teacher Programme, introduced in January 1998, and also reports on a small-scale project, funded by the Teacher Training Agency (TTA), the key objective of which was to strengthen the existing partnerships by improving the quality of school-based tutor training and continuous professional development of staff.