REVIEW 2 cited by
A survey of open-source data quality tools: shedding light on the materialization of data quality dimensions in practice
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Data Quality (DQ) describes the degree to which data characteristics meet requirements and are fit for use by humans and/or systems. There are several aspects in which DQ can be measured, called DQ dimensions (i.e. accuracy, completeness, consistency, etc.), also referred to as characteristics in literature. ISO/IEC 25012 Standard defines a data quality model with fifteen such dimensions, setting the requirements a data product should meet. In this short report, we aim to bridge the gap between lower-level functionalities offered by DQ tools and higher-level dimensions in a systematic manner, revealing the many-to-many relationships between them. To this end, we examine 6 open-source DQ tools and we emphasize on providing a mapping between the functionalities they offer and the DQ dimensions, as defined by the ISO standard. Wherever applicable, we also provide insights into the software engineering details that tools leverage, in order to address DQ challenges.
Forward citations
Cited by 2 Pith papers
-
Stream DaQ: Stream-First Data Quality Monitoring
Stream DaQ introduces a window-based, compositional model for streaming data quality monitoring and shows its implementation runs faster than a Spark-based Deequ adaptation on small windows.
-
Unfolding Data Quality Dimensions in Practice: A Survey
A systematic survey maps low-level data quality checks in seven open-source tools to six ISO/IEC 25012 data quality dimensions, revealing many-to-many relationships and fragmented terminology.
Discussion (0). Continue with ORCID to comment.