pith. sign in

arxiv: 1704.06710 · v3 · pith:KHDQDBJPnew · submitted 2017-04-21 · 💻 cs.DS

Continuous monitoring of ell_p norms in data streams

classification 💻 cs.DS
keywords streamboundcontinuousestimatesfrequencyguaranteeldotsmonitoring
0
0 comments X
read the original abstract

In insertion-only streaming, one sees a sequence of indices $a_1, a_2, \ldots, a_m\in [n]$. The stream defines a sequence of $m$ frequency vectors $x^{(1)},\ldots,x^{(m)}\in\mathbb{R}^n$ with $(x^{(t)})_i = |\{j : j\in[t], a_j = i\}|$. That is, $x^{(t)}$ is the frequency vector after seeing the first $t$ items in the stream. Much work in the streaming literature focuses on estimating some function $f(x^{(m)})$. Many applications though require obtaining estimates at time $t$ of $f(x^{(t)})$, for every $t\in[m]$. Naively this guarantee is obtained by devising an algorithm with failure probability $\ll 1/m$, then performing a union bound over all stream updates to guarantee that all $m$ estimates are simultaneously accurate with good probability. When $f(x)$ is some $\ell_p$ norm of $x$, recent works have shown that this union bound is wasteful and better space complexity is possible for the continuous monitoring problem, with the strongest known results being for $p=2$ [HTY14, BCIW16, BCINWW17]. In this work, we improve the state of the art for all $0<p<2$, which we obtain via a novel analysis of Indyk's $p$-stable sketch [Indyk06].

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Towards Optimal Moment Estimation in Streaming and Distributed Models

    cs.DS 2019-07 unverdicted novelty 7.0

    For p-moments with positive updates, achieves Õ(ε^{-2} + log n) space for p ≤ 1 without random order and Õ(ε^{-2}) max-communication for p in (1,2] in coordinator/blackboard models.