REVIEW 2 minor 25 references
The intersection profile of a distribution over subsets requires Ω(n²) bits to sketch to constant additive error.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · grok-4.3
2026-06-27 05:13 UTC pith:CQZ3SAGO
load-bearing objection The paper settles three sketching lower bounds at Ω(n²) via an elementary proof for intersection profiles.
Sketching Intersection Profiles: A Simple Proof and Three Applications
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Sketching the intersection profile of a distribution D on 2^[n] requires Ω(n²) bits to approximate Pr[T ∩ S ≠ ∅] to within constant additive error for every query S. This directly yields Ω(n²) lower bounds for vertex neighborhood sketching, coverage function sketching, and ℓ∞ sketching of random utility models. An alternative elementary probability proof is given for the intersection profile lower bound.
What carries the argument
The intersection profile sketching problem: a succinct data structure that approximates Pr_{T ~ D}[T ∩ S ≠ ∅] to small constant additive error for any query S ⊆ [n].
Load-bearing premise
The known Ω(n²) lower bound for itemset frequency estimation translates directly to the constant-additive-error intersection-profile sketching problem without extra assumptions on the distribution.
What would settle it
Finding a sketching data structure that uses o(n²) bits while approximating the intersection probability to constant additive error for all queries would falsify the claim.
If this is right
- Sketching vertex neighborhood sizes in graphs requires Ω(n²) bits, unlike the Õ(n) for edge cuts.
- Sketching coverage functions requires tight Θ̃(n²) bits for both additive and multiplicative errors.
- Sketching random utility models under the ℓ∞-norm requires Ω(n²) bits, improving the previous Ω(n log n) bound.
Where Pith is reading between the lines
- The simple elementary proof may allow easier extensions of constant-error lower bounds to related problems.
- The quadratic space requirement separates intersection-based sketching from simpler linear-space graph problems like edge cuts.
- These bounds suggest that database-style frequency problems underlie the hardness of several set-query sketching tasks.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript claims to settle the sketching complexity of three problems by reducing them to sketching the intersection profile Pr[T ∩ S ≠ ∅] (constant additive error) of a distribution D on 2^[n]: it proves Ω(n²) lower bounds for (i) vertex neighborhood sketching in graphs (contrasting with Õ(n) edge-cut sketching), (ii) coverage-function sketching (tight ãΘ(n²) for additive/multiplicative error), and (iii) ℓ_∞ sketching of random utility models (improving prior Ω(n log n) to match known upper bounds up to logs). Lower bounds follow from itemset frequency estimation, but the paper supplies an independent elementary-probability proof of the Ω(n²) intersection-profile lower bound that avoids database machinery.
Significance. If the central claims hold, the work supplies tight, load-bearing lower bounds that cleanly separate the complexity of these sketching tasks from related problems such as edge-cut sketching. The provision of an independent elementary proof (distinct from the itemset-frequency reduction) is a concrete strength: it renders the lower bound self-contained within basic probability and directly addresses the reduction assumption flagged in the reader report. No machine-checked proofs or reproducible code are mentioned, but the falsifiable Ω(n²) predictions and parameter-free nature of the elementary argument add value.
minor comments (2)
- [Abstract] Abstract, paragraph beginning 'One can obtain lower bounds...': the sentence introducing the elementary proof does not name the section in which the argument appears, making it harder for readers to locate the self-contained proof.
- The manuscript does not explicitly compare the new elementary proof's assumptions or error regime to the database reduction (e.g., whether the elementary argument also works for non-constant accuracy parameters).
Simulated Author's Rebuttal
We thank the referee for their positive assessment, accurate summary of the contributions, and recommendation to accept. We are pleased that the elementary proof and the separation from related sketching problems were viewed as strengths.
Circularity Check
No significant circularity identified
full rationale
The paper connects its three sketching lower bounds to the intersection-profile sketching problem and notes that Ω(n²) bounds follow directly from known itemset-frequency results; however, it supplies a fully independent elementary-probability proof of the same Ω(n²) lower bound for constant additive error that relies on no external results, no self-citations, and no fitted parameters. Because this self-contained proof bears the central claim, the derivation chain contains no self-definitional, fitted-input, or self-citation reductions.
Axiom & Free-Parameter Ledger
axioms (1)
- standard math Standard axioms of probability (expectation, union bound, etc.)
read the original abstract
In this work we settle the complexity of three sketching problems. (i) We show that sketching vertex neighborhood sizes in graphs requires $\Omega(n^2)$ bits, standing in sharp contrast to the $\tilde{O}(n)$ complexity of sketching edge cuts. (ii) We obtain tight lower and upper bounds of $\tilde{\Theta}(n^2)$ for sketching coverage functions with additive and multiplicative errors. (iii) We prove an $\Omega(n^2)$ lower bound for sketching Random Utility Models under the $\ell_\infty$-norm, improving upon the previous $\Omega(n \log n)$ bound and matching a known upper bound to within logarithmic factors. These bounds are obtained through a connection with the problem of sketching the intersection profile of a distribution $D$ on $2^{[n]}$. Specifically, we seek a succinct data structure that, for any query set $S \subseteq [n]$, approximates the quantity $\Pr_{T \sim D}[T \cap S \neq \varnothing]$ to within a small constant additive error. One can obtain lower bounds for this latter problem directly from known results about the itemset frequency estimation problem in databases for which tight bounds are known. As an additional contribution, we also provide an alternative proof for the intersection profile sketching lower bound, in the setting in which the accuracy parameter is constant. This proof relies solely on elementary probability avoiding the heavier machinery used in previous proofs.
Figures
Reference graph
Works this paper leans on
-
[1]
Spectral sparsification and regret minimization beyond matrix multiplicative updates
Zeyuan Allen-Zhu, Zhenyu Liao, and Lorenzo Orecchia. Spectral sparsification and regret minimization beyond matrix multiplicative updates. In STOC, pages 237--245, 2015
2015
-
[2]
Learning with submodular functions: A convex optimization perspective
Francis Bach. Learning with submodular functions: A convex optimization perspective. Foundations and Trends in Machine Learning , 6 0 (2-3): 0 145--373, 2013
2013
-
[3]
Sketching valuation functions
Ashwinkumar Badanidiyuru, Shahar Dobzinski, Hu Fu, Robert Kleinberg, Noam Nisan, and Tim Roughgarden. Sketching valuation functions. In SODA, pages 1025--1035, 2012
2012
-
[4]
Maria-Florina Balcan and Nicholas J. A. Harvey. Submodular functions: Learnability, structure, and optimization. SICOMP, 47 0 (3): 0 703--754, 2018
2018
-
[5]
Ziv Bar-Yossef, T. S. Jayram, Ravi Kumar, D. Sivakumar, and Luca Trevisan. Counting distinct elements in a data stream. In RANDOM, pages 1--10, 2002
2002
-
[6]
Almost optimal streaming algorithms for coverage problems
MohammadHossein Bateni, Hossein Esfandiari, and Vahab Mirrokni. Almost optimal streaming algorithms for coverage problems. In SPAA, 2017
2017
-
[7]
Spielman, and Nikhil Srivastava
Joshua Batson, Daniel A. Spielman, and Nikhil Srivastava. Twice- R amanujan sparsifiers. SICOMP, 41 0 (6): 0 1704--1721, 2012
2012
-
[8]
Approximating st minimum cuts in O (n^2) time
Andr \'a s A Bencz \'u r and David R Karger. Approximating st minimum cuts in O (n^2) time. In STOC, pages 47--55, 1996
1996
-
[9]
Optimal lower bounds for sketching graph cuts
Charles Carlson, Alexandra Kolla, Nikhil Srivastava, and Luca Trevisan. Optimal lower bounds for sketching graph cuts. In SODA, pages 2565--2569, 2019
2019
-
[10]
Recognizing coverage functions
Deeparnab Chakrabarty and Zhiyi Huang. Recognizing coverage functions. SICOMP, 29 0 (3): 0 1585--1599, 2015
2015
-
[11]
Light RUM s
Flavio Chierichetti, Ravi Kumar, and Andrew Tomkins. Light RUM s. In ICML, pages 1888--1897, 2021
2021
-
[12]
Muthukrishnan
Graham Cormode, Mayur Datar, Piotr Indyk, and S. Muthukrishnan. Comparing data streams using hamming norms (how to zero in). In VLDB, 2002
2002
-
[13]
Concentration of Measure for the Analysis of Randomized Algorithms
Devdatt P Dubhashi and Alessandro Panconesi. Concentration of Measure for the Analysis of Randomized Algorithms. Cambridge University Press, 2009
2009
-
[14]
Learning coverage functions and private release of marginals
Vitaly Feldman and Pravesh Kothari. Learning coverage functions and private release of marginals. In COLT, pages 679--702, 2014
2014
-
[15]
A B ayesian analysis of some nonparametric problems
Thomas S Ferguson. A B ayesian analysis of some nonparametric problems. Ann. Stat., pages 209--230, 1973
1973
-
[16]
Global min-cuts in RNC , and other ramifications of a simple min-cut algorithm
David R Karger. Global min-cuts in RNC , and other ramifications of a simple min-cut algorithm. In SODA, pages 21--30, 1993
1993
-
[17]
Constructing linear-sized spectral sparsification in almost-linear time
Yin Tat Lee and He Sun. Constructing linear-sized spectral sparsification in almost-linear time. SICOMP, 47 0 (6): 0 2315--2336, 2018
2018
-
[18]
Space lower bounds for itemset frequency sketches
Edo Liberty, Michael Mitzenmacher, Justin Thaler, and Jonathan Ullman. Space lower bounds for itemset frequency sketches. In PODS, 2016
2016
-
[19]
On the sub- G aussianity of the beta and D irichlet distributions
Olivier Marchal and Julyan Arbel. On the sub- G aussianity of the beta and D irichlet distributions. Electronic Communications in Probability, 22 0 (54): 0 1--14, 2017
2017
-
[20]
Serfling
Robert J. Serfling. Probability inequalities for the sum in sampling without replacement. Ann. Stat., 2 0 (1): 0 39 -- 48, 1974
1974
-
[21]
Graph sparsification by effective resistances
Daniel A Spielman and Nikhil Srivastava. Graph sparsification by effective resistances. In STOC, pages 563--568, 2008
2008
-
[22]
Spectral sparsification of graphs
Daniel A Spielman and Shang-Hua Teng. Spectral sparsification of graphs. SICOMP, 40 0 (4): 0 981--1025, 2011
2011
-
[23]
Discrete Choice Methods with Simulation
Kenneth E Train. Discrete Choice Methods with Simulation. Cambridge University Press, 2009
2009
-
[24]
Learning interpretable decision rule sets: A submodular optimization approach
Fan Yang, Kai He, Linxiao Yang, Hongxia Du, Jingbang Yang, Bo Yang, and Liang Sun. Learning interpretable decision rule sets: A submodular optimization approach. In NeurIPS, pages 27890--27902, 2021
2021
-
[25]
Approximate F_2 -Sketching of Valuation Functions
Grigory Yaroslavtsev and Samson Zhou. Approximate F_2 -Sketching of Valuation Functions . In APPROX/RANDOM, 2019
2019
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.