Quality Governance based on Enterprise Engineering Method and Six Sigma Approach

Enterprise Modeling (EM) is currently in operation either as a technique to represent and understand the structure and behavior of the enterprise, or as a technique to analyze business processes, and in many cases as support technique for business process reengineering. However, EM architectures and methods for Enterprise Engineering can also used to support new management techniques like SIX SIGMA, because these new techniques need a clear, transparent and integrated definition and description of the business activities of the enterprise to be able to build up, optimize and operate an successful enterprise. The main goal of SIX SIGMA is to optimize the performance of processes. A still open question is: "What are the adequate Quality criteria and methods to ensure such performance? What must we do to get Quality governance?" This paper describes a method including an Enterprise Engineering method and SIX SIGMA strategy to reach Quality Governance

Organizational excellence through quality governance

This paper provides an overview of an Enterprise Engineering method called IEM (Integrated Enterprise Modeling) and it describes the usage of SIX SIGMA approach for performance measurement of an enterprise. Based on these two instruments a methodology including procedure and tools is developed, which allows enterprises to define their adequate quality criteria for performance, to measure performance and quality and to derive reasonable actions to take for optimization. Determination of adequate quality and performance criteria and reasonable measures for the enterprise organization means “Quality Governance”.

Criteria for analysis of the structure of electronic scientific journals

This paper is the result of the Masters dissertation studying the role and history of scientific communication, especially the changes that have occurred after the appearance of electronic communication and computer networks. This study showed that hypertext systems are increasingly being used in the scientific and academic world in the production of electronic journals; this makes it possible for the user to rapidly access information in their area. However, these systems need to be improved to help the user during search and access to information. Both printed journals migrating to electronic media, and the exclusively electronic journals should present the current quality indicators. The attempt was made to discover whether characteristics related to printed journals are being maintained in their electronic counterparts. For this, a prototype model was developed to analyze the structure of electronic scientific journals; it composes 14 criteria expressing aspects of quality for these journals. It includes elements of Website Information Architecture and those already in place in printed scientific journals in order to ensure that basic functions - archiving and dissemination - are maintained in electronic publishing. Each criterion consists of variables, which measure the maintenance of these functions both in the migrating printed journals and the exclusively electronic ones. This prototype model was used to analyze Ciência da Informação On-line and DataGramaZero - Revista de Ciência da Informação. Results indicate that this model is able to find out if the basic functions of archiving and dissemination are being maintained in electronic journals. Therefore, its implementation is justified in electronic journals. The model can help librarians, authors, and users of electronic journals to identify quality journals, and assist editors in developing their projects. The material from the study may be included in the preservice and inservice education of Information Science professionals and to support editors of scientific journals.

Composition of stingless bee honey: Setting quality standards

Compositional data from 152 stingless bee (Meliponini) honey samples were compiled from studies since 1964, and evaluated to propose a quality standard for this product. Since stingless bee honey has a different composition than Apis mellifera honey, some physicochemical parameters are presented according to stingless bee species. The entomological origin of the honey was known for 17 species of Meliponini from Brazil, one from Costa Rica, six from Mexico, 27 from Panama, one from Surinam, two from Trinidad & Tobago, and seven from Venezuela, most from the genus Melipona. The results varied as follows: moisture (19.9-41.9g/100g), pH (3.15-4.66), free acidity (5.9-109.0meq/Kg), ash (0.01-1.18g/100g), diastase activity (0.9-23.0DN), electrical conductivity (0.49-8.77mS/cm), HMF (0.4-78.4mg/Kg), invertase activity (19.8-90.1IU), nitrogen (14.34-144.00mg/100g), reducing sugars (58.0-75.7g/100g) and sucrose (1.1-4.8g/100g). Moisture content of stingless bee honey is generally higher than the 20% maximum established for A. mellifera honey. Guidelines for further contributions would help make the physicochemical database of meliponine honey more objective, in order to use such data to set quality standards. Pollen analysis should be directed towards the recognition of unifloral honeys produced by stingless bees, in order to obtain standard products from botanical species. A honey quality control campaign directed to both stingless beekeepers and stingless bee honey hunters is needed, as is harmonization of analytical methods. © 2007 Asociación Interciencia.

Image quality of supine chest radiographs: intra-individual comparison of computed radiography and low-dose linear-slit digital radiography

The purpose of this retrospective study was to intra-individually compare the image quality of computed radiography (CR) and low-dose linear-slit digital radiography (LSDR) for supine chest radiographs. A total of 90 patients (28 female, 62 male; mean age, 55.1 years) imaged with CR and LSDR within a mean time interval of 2.8 days +/- 3.0 were included in this study. Two independent readers evaluated the image quality of CR and LSDR based on modified European Guidelines for Quality Criteria for chest X-ray. The Wilcoxon test was used to analyse differences between the techniques. The overall image quality of LSDR was significantly better than the quality of CR (9.75 vs 8.16 of a maximum score of 10; p < 0.001). LSDR performed significantly better than CR for delineation of anatomical structures in the mediastinum and the retrocardiac lung (p < 0.001). CR was superior to LSDR for visually sharp delineation of the lung vessels and the thin linear structures in the lungs. We conclude that LSDR yields better image quality and may be more suitable for excluding significant pathological features of the chest in areas with high attenuation compared with CR.

Systematic reviews published in higher impact clinical journals were of higher quality.

OBJECTIVES To compare the methodological quality of systematic reviews (SRs) published in high- and low-impact factor (IF) Core Clinical Journals. In addition, we aimed to record the implementation of aspects of reporting, including Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) flow diagram, reasons for study exclusion, and use of recommendations for interventions such as Grading of Recommendations Assessment, Development and Evaluation (GRADE). STUDY DESIGN AND SETTING We searched PubMed for systematic reviews published in Core Clinical Journals between July 1 and December 31, 2012. We evaluated the methodological quality using the Assessment of Multiple Systematic Reviews (AMSTAR) tool. RESULTS Over the 6-month period, 327 interventional systematic reviews were identified with a mean AMSTAR score of 63.3% (standard deviation, 17.1%), when converted to a percentage scale. We identified deficiencies in relation to a number of quality criteria including delineation of excluded studies and assessment of publication bias. We found that SRs published in higher impact journals were undertaken more rigorously with higher percentage AMSTAR scores (per IF unit: β = 0.68%; 95% confidence interval: 0.32, 1.04; P < 0.001), a discrepancy likely to be particularly relevant when differences in IF are large. CONCLUSION Methodological quality of SRs appears to be better in higher impact journals. The overall quality of SRs published in many Core Clinical Journals remains suboptimal.

Quality Control for SP Performance Regarding Patient Portrayal in a High-Stakes OSCE

Introduction Since the quality of patient portrayal of standardized patients (SPs) during an Objective Structured Clinical Exam (OSCE) has a major impact on the reliability and validity of the exam, quality control should be initiated. Literature about quality control of SP’s performance focuses on feedback [1, 2] or completion of checklists [3, 4]. Since we did not find a published instrument meeting our needs for the assessment of patient portrayal, we developed such an instrument after being inspired by others [5] and used it in our high-stakes exam. Methods SP trainers from all five Swiss medical faculties collected and prioritized quality criteria for patient portrayal. Items were revised with the partners twice, based on experiences during OSCEs. The final instrument contains 14 criteria for acting (i.e. adequate verbal and non-verbal expression) and standardization (i.e. verbatim delivery of the first sentence). All partners used the instrument during a high-stakes OSCE. Both, SPs and trainers were introduced to the instrument. The tool was used in training (more than 100 observations) and during the exam (more than 250 observations). FAIR_OSCE The list of items to assess the quality of the simulation by SPs was primarily developed and used to provide formative feedback to the SPs in order to help them to improve their performance. It was therefore named “Feedbackstruckture for the Assessment of Interactive Role play in Objective Structured Clinical Exams (FAIR_OSCE). It was also used to assess the quality of patient portrayal during the exam. The results were calculated for each of the five faculties individually. Formative evaluation was given to the five faculties with individual feedback without revealing results of other faculties other than overall results. Results High quality of patient portrayal during the exam was documented. More than 90% of SP performances were rated to be completely correct or sufficient. An increase in quality of performance between training and exam was noted. In example the rate of completely correct reaction in medical tests increased from 88% to 95%. 95% completely correct reactions together with 4% sufficient reactions add up to 99% of the reactions meeting the requirements of the exam. SP educators using the instrument reported an augmentation of SPs performance induced by the use of the instrument. Disadvantages mentioned were high concentration needed to explicitly observe all criteria and cumbersome handling of the paper-based forms. Conclusion We were able to document a very high quality of SP performance in our exam. The data also indicate that our training is effective. We believe that the high concentration needed using the instrument is well invested, considering the observed augmentation of performance. The development of an iPad based application for the form is planned to address the cumbersome handling of the paper.

Quality assurance of simulated patient feedback in communication training for fourth-year medical students

Introduction In our program, simulated patients (SPs) give feedback to medical students in the course of communication skills training. To ensure effective training, quality control of the SPs’ feedback should be implemented. At other institutions, medical students evaluate the SPs’ feedback for quality control (Bouter et al., 2012). Thinking about implementing quality control for SPs’ feedback in our program, we wondered whether the evaluation by students would result in the same scores as evaluation by experts. Methods Consultations simulated by 4th-year medical students with SPs were video taped including the SP’s feedback to the students (n=85). At the end of the training sessions students rated the SPs’ performance using a rating instrument called Bernese Assessment for Role-play and Feedback (BARF) containing 11 items concerning feedback quality. Additionally the videos were evaluated by 3 trained experts using the BARF. Results The experts showed a high interrater agreement when rating identical feedbacks (ICCunjust=0.953). Comparing the rating of students and experts, high agreement was found with regard to the following items: 1. The SP invited the student to reflect on the consultation first, Amin (= minimal agreement) 97% 2. The SP asked the student what he/she liked about the consultation, Amin = 88%. 3. The SP started with positive feedback, Amin = 91%. 4. The SP was comparing the student with other students, Amin = 92%. In contrast the following items showed differences between the rating of experts and students: 1. The SP used precise situations for feedback, Amax (=maximal agreement) 55%, Students rated 67 of SPs’ feedbacks to be perfect with regard to this item (highest rating on a 5 point Likert scale), while only 29 feedbacks were rated this way by the experts. 2. The SP gave precise suggestions for improvement, Amax 75%, 62 of SPs’ feedbacks obtained the highest rating from students, while only 44 of SPs’ feedbacks achieved the highest rating in the view of the experts. 3. The SP speaks about his/her role in the third person, Amax 60%. Students rated 77 feedbacks with the highest score, while experts judged only 43 feedbacks this way. Conclusion Although evaluation by the students was in agreement with that of experts concerning some items, students rated the SPs’ feedback more often with the optimal score than experts did. Moreover it seems difficult for students to notice when SPs talk about the role in the first instead of the third person. Since precision and talking about the role in the third person are important quality criteria of feedback, this result should be taken into account when thinking about students’ evaluation of SPs’ feedback for quality control. Bouter, S., E. van Weel-Baumgarten, and S. Bolhuis. 2012. Construction and Validation of the Nijmegen Evaluation of the Simulated Patient (NESP): Assessing Simulated Patients’ Ability to Role-Play and Provide Feedback to Students. Academic Medicine: Journal of the Association of American Medical Colleges

The trouble with quality filtering based on relative Cramér-Rao lower bounds.

Cramér Rao Lower Bounds (CRLB) have become the standard for expression of uncertainties in quantitative MR spectroscopy. If properly interpreted as a lower threshold of the error associated with model fitting, and if the limits of its estimation are respected, CRLB are certainly a very valuable tool to give an idea of minimal uncertainties in magnetic resonance spectroscopy (MRS), although other sources of error may be larger. Unfortunately, it has also become standard practice to use relative CRLB expressed as a percentage of the presently estimated area or concentration value as unsupervised exclusion criterion for bad quality spectra. It is shown that such quality filtering with widely used threshold levels of 20% to 50% CRLB readily causes bias in the estimated mean concentrations of cohort data, leading to wrong or missed statistical findings-and if applied rigorously-to the failure of using MRS as a clinical instrument to diagnose disease characterized by low levels of metabolites. Instead, absolute CRLB in comparison to those of the normal group or CRLB in relation to normal metabolite levels may be more useful as quality criteria. Magn Reson Med, 2015. © 2015 Wiley Periodicals, Inc.

BSRN Toolbox V2.0 - a tool to create quality checked output files from BSRN datasets and station-to-archive files

The BSRN Toolbox is a software package supplied by the WRMC and is freely available to all station scientists and data users. The main features of the package include a download manager for Station- to-Archive files, a tool to convert files into human readable TAB-separated ASCII-tables (similar to those output by the PANGAEA database), and a tool to check data sets for violations of the "BSRN Global Network recommended QC tests, V2.0" quality criteria. The latter tool creates quality codes, one per measured value, indicating if the data are "physically possible," "extremely rare," or if "intercomparison limits are exceeded." In addition, auxiliary data such as solar zenith angle or global calculated from diffuse and direct can be output. All output from the QC tool can be visualized using PanPlot (doi:10.1594/PANGAEA.816201).

Quality of pharmaceutical advertising and gender bias in medical journals (1998-2008): a review of the scientific literature

Objective: To review the scientific literature on pharmaceutical advertising aimed at health professionals in order to determine whether gender bias has decreased and the quality of information in pharmaceutical advertising has improved over time. Methods: We performed a content analysis of original articles dealing with medical drug promotion (1998-2008), according to quality criteria such as (a) the number, validity and accessibility of bibliographic references provided in pharmaceutical advertising and (b) the extent to which gender representations were consistent with the prevalence of the diseases. Databases: PUBMED, Medline, Scopus, Sociological Abstract, Eric and LILACS. Results: We reviewed 31 articles that analyzed advertising in medical journals from 1975-2005 and were published between 1998 and 2008. We found that the number of references used to support pharmaceutical advertising claims increased from 1975 but that 50% of these references were not valid. There was a tendency to depict men in paid productive roles, while women appeared inside the home or in non-occupational social contexts. Advertisements for psychotropic and cardiovascular drugs overrepresented women and men respectively. Conclusions: The use of bibliographic references increased between 1998 and 2008. However, representation of traditional male-female roles was similar in 1975 and 2005. Pharmaceutical advertisements may contribute to reinforcing the perception that certain diseases are associated with the most frequently portrayed sex.

Quality of life instruments in studies of menorrhagia: a systematic review

BACKGROUND: The use of quality of life (QoL) instruments in menorrhagia research is increasing but there is concern that not enough emphasis is placed on patient-focus in these measurements, i.e. on issues which are of importance to patients and reflect their experiences and concerns (clinical face validity). The objective was to assess the quality of QoL instruments in studies of menorrhagia. STUDY DESIGN: A systematic review of published research. Papers were identified through MEDLINE (1966-April 2000), EMBASE (1980-April 2000), Science Citation Index (1981-April 2000), Social Science Citation Index (1981-April 2000), CINAHL (1982-1999) and PsychLIT (1966-1999), and by manual searching of bibliographies of known primary and review articles. Studies were selected if they assessed women with menorrhagia for life quality, either developing QoL instruments or applying them as an outcome measure. Selected studies were assessed for quality of their QoL instruments, using a 17 items checklist including 10 items for clinical face validity (issues of relevance to patients' expectations and concerns) and 7 items for measurement properties (such as reliability, responsiveness, etc.). RESULTS: A total of 19 articles, 8 on instrument development and 11 on application, were included in the review. The generic Short Form 36 Health Survey Questionnaire (SF36) was used in 12/19 (63%) studies. Only two studies developed new specific QoL instruments for menorrhagia but they complied with 7/17 (41%) and 10/17 (59%) of the quality criteria. Quality assessment showed that only 7/19 (37%) studies complied with more than half the criteria for face validity whereas 17/19 (90%) studies complied with more than half of the criteria for measurement properties (P = 0.0001). CONCLUSION: Among existing QoL instruments, there is good compliance with the quality criteria for measurement properties but not with those for clinical face validity. There is a need to develop methodologically sound disease specific QoL instruments in menorrhagia focussing both on face validity and measurement properties.

Quality of life instruments in studies of menorrhagia: a systematic review

BACKGROUND: The use of quality of life (QoL) instruments in menorrhagia research is increasing but there is concern that not enough emphasis is placed on patient-focus in these measurements, i.e. on issues which are of importance to patients and reflect their experiences and concerns (clinical face validity). The objective was to assess the quality of QoL instruments in studies of menorrhagia. STUDY DESIGN: A systematic review of published research. Papers were identified through MEDLINE (1966-April 2000), EMBASE (1980-April 2000), Science Citation Index (1981-April 2000), Social Science Citation Index (1981-April 2000), CINAHL (1982-1999) and PsychLIT (1966-1999), and by manual searching of bibliographies of known primary and review articles. Studies were selected if they assessed women with menorrhagia for life quality, either developing QoL instruments or applying them as an outcome measure. Selected studies were assessed for quality of their QoL instruments, using a 17 items checklist including 10 items for clinical face validity (issues of relevance to patients' expectations and concerns) and 7 items for measurement properties (such as reliability, responsiveness, etc.). RESULTS: A total of 19 articles, 8 on instrument development and 11 on application, were included in the review. The generic Short Form 36 Health Survey Questionnaire (SF36) was used in 12/19 (63%) studies. Only two studies developed new specific QoL instruments for menorrhagia but they complied with 7/17 (41%) and 10/17 (59%) of the quality criteria. Quality assessment showed that only 7/19 (37%) studies complied with more than half the criteria for face validity whereas 17/19 (90%) studies complied with more than half of the criteria for measurement properties (P = 0.0001). CONCLUSION: Among existing QoL instruments, there is good compliance with the quality criteria for measurement properties but not with those for clinical face validity. There is a need to develop methodologically sound disease specific QoL instruments in menorrhagia focussing both on face validity and measurement properties.

Quality Estimation of e-Learning Systems

Existing approaches to quality estimation of e-learning systems are analyzed. The “layered” approach for quality estimation of e-learning systems enhanced with learning process modeling and simulation is presented. The method of quality estimation using learning process modeling and quality criteria are suggested. The learning process model based on extended colored stochastic Petri net is described. The method has been implemented in the automated system of quality estimation of e-learning systems named “QuAdS”. Results of approbation of the developed method and quality criteria are shown. We argue that using learning process modeling for quality estimation simplifies identifying lacks of an e-learning system for an expert.

An Objective Framework to Test the Quality of Candidate Indicators of Good Environmental Status

Large efforts are on-going within the EU to prepare the Marine Strategy Framework Directive’s (MSFD) assessment of the environmental status of the European seas. This assessment will only be as good as the indicators chosen to monitor the eleven descriptors of good environmental status (GEnS). An objective and transparent framework to determine whether chosen indicators actually support the aims of this policy is, however, not yet in place. Such frameworks are needed to ensure that the limited resources available to this assessment optimize the likelihood of achieving GEnS within collaborating states. Here, we developed a hypothesis-based protocol to evaluate whether candidate indicators meet quality criteria explicit to the MSFD, which the assessment community aspires to. Eight quality criteria are distilled from existing initiatives, and a testing and scoring protocol for each of them is presented. We exemplify its application in three worked examples, covering indicators for three GEnS descriptors (1, 5 and 6), various habitat components (seaweeds, seagrasses, benthic macrofauna and plankton), and assessment regions (Danish, Lithuanian and UK waters). We argue that this framework provides a necessary, transparent and standardized structure to support the comparison of candidate indicators, and the decision-making process leading to indicator selection. Its application could help identify potential limitations in currently available candidate metrics and, in such cases, help focus the development of more adequate indicators. Use of such standardized approaches will facilitate the sharing of knowledge gained across the MSFD parties despite context-specificity across assessment regions, and support the evidence-based management of European seas.