Pith. sign in

REVIEW 3 cited by

Distributed Estimation and Inference with Statistical Guarantees

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1509.05457 v1 pith:DBBSYNDM submitted 2015-09-17 math.ST stat.TH

Heather Battey , Jianqing Fan , Han Liu , Junwei Lu , Ziwei Zhu This is my paper · ORCID
classification math.STstat.TH
keywords estimationalgorithmconquerdimensionaldivideestimatorssamplesize
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
abstract

This paper studies hypothesis testing and parameter estimation in the context of the divide and conquer algorithm. In a unified likelihood based framework, we propose new test statistics and point estimators obtained by aggregating various statistics from $k$ subsamples of size $n/k$, where $n$ is the sample size. In both low dimensional and high dimensional settings, we address the important question of how to choose $k$ as $n$ grows large, providing a theoretical upper bound on $k$ such that the information loss due to the divide and conquer algorithm is negligible. In other words, the resulting estimators have the same inferential efficiencies and estimation rates as a practically infeasible oracle with access to the full sample. Thorough numerical results are provided to back up the theory.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Rates of Convergence for Large-scale Nearest Neighbor Classification

    stat.ML 2019-09 conditional novelty 6.0 of 10

    A distributed k-nearest-neighbor classifier that pools local predictions by majority vote attains the same minimax-optimal excess risk and instability rates as the oracle full-data kNN classifier.

  2. Least Squares Approximation for a Distributed System

    stat.ME 2019-08 conditional novelty 5.0 of 10

    A distributed least squares approximation combines local estimators weighted by inverse covariance to match global estimator efficiency with one communication round.

  3. Sample Splitting as an M-Estimator with Application to Physical Activity Scoring

    stat.ME 2019-08 conditional novelty 5.0 of 10

    Repeated random sample splits in a two-stage model asymptotically produce the same estimates as solving one stacked estimating equation on the full data set.

Pith tools