Pith. sign in

REVIEW 2 cited by

A survey of open-source data quality tools: shedding light on the materialization of data quality dimensions in practice

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2407.18649 v1 pith:BIZ6PR4R submitted 2024-07-26 cs.DB

classification cs.DB
keywords datadimensionsqualitytoolscharacteristicsfunctionalitiesmeetopen-source
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Data Quality (DQ) describes the degree to which data characteristics meet requirements and are fit for use by humans and/or systems. There are several aspects in which DQ can be measured, called DQ dimensions (i.e. accuracy, completeness, consistency, etc.), also referred to as characteristics in literature. ISO/IEC 25012 Standard defines a data quality model with fifteen such dimensions, setting the requirements a data product should meet. In this short report, we aim to bridge the gap between lower-level functionalities offered by DQ tools and higher-level dimensions in a systematic manner, revealing the many-to-many relationships between them. To this end, we examine 6 open-source DQ tools and we emphasize on providing a mapping between the functionalities they offer and the DQ dimensions, as defined by the ISO standard. Wherever applicable, we also provide insights into the software engineering details that tools leverage, in order to address DQ challenges.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Stream DaQ: Stream-First Data Quality Monitoring

    cs.DB 2025-06 conditional novelty 6.0 of 10

    Stream DaQ introduces a window-based, compositional model for streaming data quality monitoring and shows its implementation runs faster than a Spark-based Deequ adaptation on small windows.

  2. Unfolding Data Quality Dimensions in Practice: A Survey

    cs.DB 2025-07 accept novelty 4.0 of 10

    A systematic survey maps low-level data quality checks in seven open-source tools to six ISO/IEC 25012 data quality dimensions, revealing many-to-many relationships and fragmented terminology.

Pith tools