Assessing and Improving the Quality of Knowledge Discovery Data

View Sample PDF

Author(s): Herna L. Viktor (University of Pretoria, South Africa)and Niek F. du Plooy (University of Pretoria, South Africa)
Copyright: 2002
Pages: 8
Source title: Data Warehousing and Web Engineering
Source Author(s)/Editor(s): Shirley Becker (Northern Arizona University, USA)
DOI: 10.4018/978-1-931777-02-5.ch010

Keywords: Data Mining and Databases / Data Warehousing / Information Science Reference / Library & Information Science

Purchase

View Assessing and Improving the Quality of Knowledge Discovery Data on the publisher's website for pricing and purchasing information.

Abstract

Data quality has a substantial impact on the quality of the results of a Knowledge Discovery from Data (KDD) effort. The poor quality of real-world data, as contained in many large data repositories, poses a serious threat to the future adoption of this new technology. Unfortunately, data quality assessment and improvement are often ignored in many KDD efforts, leading to disappointing results. This chapter discusses the use of data mining and data generation techniques, including feature selection, case selection and outlier detection, to assess and improve the quality of the data. In this approach, redundant low quality data are removed from the data repository and new high quality data patterns are dynamically added to the data set. We also point out that data capturing is part of the social practices of office work, and this fact must be taken into account in designing the data capturing processes.

The IRMA Community

Research IRM

Assessing and Improving the Quality of Knowledge Discovery Data

Purchase

Abstract

Related Content

IRMA Sponsors