A classification of data quality assessment methods

Data quality (DQ) assessment can be significantly enhanced with the use of the right DQ assessment methods, which provide automated solutions to assess DQ. The range of DQ assessment methods is very broad: from data profiling and semantic profiling to data matching and data validation. This paper gives an overview of current methods for DQ assessment and classifies the DQ assessment methods into an existing taxonomy of DQ problems. Specific examples of the placement of each DQ method in the taxonomy are provided and illustrate why the method is relevant to the particular taxonomy position. The gaps in the taxonomy, where no current DQ methods exist, show where new methods are required and can guide future research and DQ tool development.

A preliminary study on methods for retaining data quality problems in automatically generated test data

Data in an organisation often contains business secrets that organisations do not want to release. However, there are occasions when it is necessary for an organisation to release its data such as when outsourcing work or using the cloud for Data Quality (DQ) related tasks like data cleansing. Currently, there is no mechanism that allows organisations to release their data for DQ tasks while ensuring that it is suitably protected from releasing business related secrets. The aim of this paper is therefore to present our current progress on determining which methods are able to modify secret data and retain DQ problems. So far we have identified the ways in which data swapping and the SHA-2 hash function alterations methods can be used to preserve missing data, incorrectly formatted values, and domain violations DQ problems while minimising the risk of disclosing secrets. © (2012) by the AIS/ICIS Administrative Office All rights reserved.

Classifying data quality problems in asset management

© Springer International Publishing Switzerland 2015. Making sound asset management decisions, such as whether to replace or maintain an ageing underground water pipe, are critical to ensure that organisations maximise the performance of their assets. These decisions are only as good as the data that supports them, and hence many asset management organisations are in desperate need to improve the quality of their data. This chapter reviews the key academic research on data quality (DQ) and Information Quality (IQ) (used interchangeably in this chapter) in asset management, combines this with the current DQ problems faced by asset management organisations in various business sectors, and presents a classification of the most important DQ problems that need to be tackled by asset management organisations. In this research, eleven semi structured interviews were carried out with asset management professionals in a range of business sectors in the UK. The problems described in the academic literature were cross checked against the problems found in industry. In order to support asset management professionals in solving these problems, we categorised them into seven different DQ dimensions, used in the academic literature, so that it is clear how these problems fit within the standard frameworks for assessing and improving data quality. Asset management professionals can therefore now use these frameworks to underpin their DQ improvement initiatives while focussing on the most critical DQ problems.

Fingerprinting quality control of Qianghuo by high-performance liquid chromatography-photodiode array detection

A novel, simple and accurate fingerprint method was developed using high-performance liquid chromatography-photodiode array detection (HPLC-DAD) for the quality control of Qianghuo, a Tibetan folk and Chinese herbal medicine used as a diaphoretic, an antifebrile and an anodyne. For the first time, the feasibility and advantages of employing chromatographic fingerprint were investigated and demonstrated for the evaluation of Qianghuo by systematically comparing chromatograms of aqueous extracts with the professional analytical software recommended by State Food and Drug Administration (SFDA). Our results revealed that the chromatographic fingerprint combing similarity evaluation could efficiently identify and distinguish raw herbs of Qianghno from different sources and different species. The effects on Notopterygium forbesii Boiss (Apiaceae) chromatographic fingerprints resulted from collecting locations, harvesting time were also examined. (c) 2006 Elsevier lrelanc Ltd. All rights reserved.

Quality control autophagy: a joint effort of ubiquitin, protein deacetylase and actin cytoskeleton.

Autophagy has been predominantly studied as a nonselective self-digestion process that recycles macromolecules and produces energy in response to starvation. However, autophagy independent of nutrient status has long been known to exist. Recent evidence suggests that this form of autophagy enforces intracellular quality control by selectively disposing of aberrant protein aggregates and damaged organelles--common denominators in various forms of neurodegenerative diseases. By definition, this form of autophagy, termed quality-control (QC) autophagy, must be different from nutrient-regulated autophagy in substrate selectivity, regulation and function. We have recently identified the ubiquitin-binding deacetylase, HDAC6, as a key component that establishes QC. HDAC6 is not required for autophagy activation per se; rather, it is recruited to ubiquitinated autophagic substrates where it stimulates autophagosome-lysosome fusion by promoting F-actin remodeling in a cortactin-dependent manner. Remarkably, HDAC6 and cortactin are dispensable for starvation-induced autophagy. These findings reveal that autophagosomes associated with QC are molecularly and biochemically distinct from those associated with starvation autophagy, thereby providing a new molecular framework to understand the emerging complexity of autophagy and therapeutic potential of this unique machinery.

Quantifying data quality for clinical trials using electronic data capture.

BACKGROUND: Historically, only partial assessments of data quality have been performed in clinical trials, for which the most common method of measuring database error rates has been to compare the case report form (CRF) to database entries and count discrepancies. Importantly, errors arising from medical record abstraction and transcription are rarely evaluated as part of such quality assessments. Electronic Data Capture (EDC) technology has had a further impact, as paper CRFs typically leveraged for quality measurement are not used in EDC processes. METHODS AND PRINCIPAL FINDINGS: The National Institute on Drug Abuse Treatment Clinical Trials Network has developed, implemented, and evaluated methodology for holistically assessing data quality on EDC trials. We characterize the average source-to-database error rate (14.3 errors per 10,000 fields) for the first year of use of the new evaluation method. This error rate was significantly lower than the average of published error rates for source-to-database audits, and was similar to CRF-to-database error rates reported in the published literature. We attribute this largely to an absence of medical record abstraction on the trials we examined, and to an outpatient setting characterized by less acute patient conditions. CONCLUSIONS: Historically, medical record abstraction is the most significant source of error by an order of magnitude, and should be measured and managed during the course of clinical trials. Source-to-database error rates are highly dependent on the amount of structured data collection in the clinical setting and on the complexity of the medical record, dependencies that should be considered when developing data quality benchmarks.

Solder paste characterisation: towards the development of quality control (QC) tool

Purpose – The purpose of this paper is to develop a quality control tool based on rheological test methods for solder paste and flux media. Design/methodology/approach – The rheological characterisation of solder pastes and flux media was carried out through the creep-recovery, thixotropy and viscosity test methods. A rheometer with a parallel plate measuring geometry of 40mm diameter and a gap height of 1mm was used to characterise the paste and associated flux media. Findings – The results from the study showed that the creep-recovery test can be used to study the deformation and recovery of the pastes, which can be used to understand the slump behaviour in solder pastes. In addition, the results from the thixotropic and viscosity test were unsuccessful in determining the differences in the rheological flow behaviour in the solder pastes and the flux medium samples. Research limitations/implications – More extensive rheological and printing testing is needed in order to correlate the findings from this study with the printing performance of the pastes. Practical implications – The rheological test method presented in the paper will provide important information for research and development, quality control and production staff to facilitate the manufacture of solder pastes and flux media. Originality/value – The paper explains how the rheological test can be used as a quality control tool to identify the suitability of a developmental solder paste and flux media used for the printing process.

Assessment of data quality in a multi-centre cross-sectional study of participation and quality of life of children with cerebral palsy

Background: SPARCLE is a cross-sectional survey in nine European regions, examining the relationship of the environment of children with cerebral palsy to their participation and quality of life. The objective of this report is to assess data quality, in particular heterogeneity between regions, family and item non-response and potential for bias. Methods: 1,174 children aged 8–12 years were selected from eight population-based registers of children with cerebral palsy; one further centre recruited 75 children from multiple sources. Families were visited by trained researchers who administered psychometric questionnaires. Logistic regression was used to assess factors related to family non-response and self-completion of questionnaires by children. Results: 431/1,174 (37%) families identified from registers did not respond: 146 (12%) were not traced; of the 1,028 traced families, 250 (24%) declined to participate and 35 (3%) were not approached. Families whose disabled children could walk unaided were more likely to decline to participate. 818 children entered the study of which 500 (61%) self-reported their quality of life; children with low IQ, seizures or inability to walk were less likely to self-report. There was substantial heterogeneity between regions in response rates and socio-demographic characteristics of families but not in age or gender of children. Item non-response was 2% for children and ranged from 0.4% to 5% for questionnaires completed by parents. Conclusion: While the proportion of untraced families was higher than in similar surveys, the refusal rate was comparable. To reduce bias, all analyses should allow for region, walking ability, age and socio-demographic characteristics. The 75 children in the region without a population based register are unlikely to introduce bias