Creator of Knowledge
Information Resources Management Association
Advancing the Concepts & Practices of Information Resources Management in Modern Organizations

Data Profiling and Data Quality Metric Measurement as a Proactive Input into the Operation of Business Intelligence Systems

Data Profiling and Data Quality Metric Measurement as a Proactive Input into the Operation of Business Intelligence Systems
View Sample PDF
Author(s): Scott Delaney (Hydro Tasmania, Australia)
Copyright: 2014
Pages: 18
Source title: Information Quality and Governance for Business Intelligence
Source Author(s)/Editor(s): William Yeoh (Deakin University, Australia), John R. Talburt (University of Arkansas at Little Rock, USA) and Yinle Zhou (IBM Corporation, USA)
DOI: 10.4018/978-1-4666-4892-0.ch013



Business intelligence systems have reached business critical status within many companies. It is not uncommon for such systems to be central to the decision-making effectiveness of these enterprises. However, the processes used to load data into these systems often do not exhibit a level of robustness in line with their criticality to the organisation. The processes of loading business intelligence systems with data are subject to compromised execution, delays, or failures as a result of changes in the source system data. These ETL processes are not designed to recognise nor deal with such shifts in data shape. This chapter proposes the use of data profiling techniques as a means of early discovery of issues and changes within the source system data and examines how this knowledge can be applied to guard against reductions in the decision making capability and effectiveness of an organisation caused by interruptions to business intelligence system availability or compromised data quality. It does so by examining issues such as where profiling can be best be applied to get appropriate benefit and value, the techniques of establishing profiling, and the types of actions that may be taken once the results of profiling are available. The chapter describes components able to be drawn together to provide a system of control that can be applied around a business intelligence system to enhance the quality of organisational decision making through monitoring the characteristics of arriving data and taking action when values are materially different than those expected.

Related Content

Ana Azevedo. © 2021. 12 pages.
Atik Kulakli. © 2021. 31 pages.
Mouhib Alnoukari. © 2021. 19 pages.
Arun Thotapalli Sundararaman. © 2021. 28 pages.
Mohammad Kamel Daradkeh. © 2021. 22 pages.
Roumiana Ilieva, Malinka Ivanova, Tzvetilina Peycheva, Yoto Nikolov. © 2021. 30 pages.
Walisson Ferreira Carvalho, Luis Zarate. © 2021. 16 pages.
Body Bottom