Metadata-first approach uses Iceberg write-time stats for zero-scan DQ observability covering ~60% of rules at zero cost (50% profiling reduction) on 200k+ tables, extendable to ~90% via added sketches.
Data tests
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.DB 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Zero-Scan Data Quality: Leveraging Table Format Metadata for Continuous Observability at Scale
Metadata-first approach uses Iceberg write-time stats for zero-scan DQ observability covering ~60% of rules at zero cost (50% profiling reduction) on 200k+ tables, extendable to ~90% via added sketches.