PocketGS: On-Device Training of 3D Gaussian Splatting for High Perceptual Modeling
read the original abstract
While 3D Gaussian Splatting (3DGS) enables real-time rendering, its training demands workstation-level compute and memory, making mobile deployment impractical under minute-scale time budgets and limited peak memory. We present PocketGS, a mobile scene modeling paradigm that enables on-device 3DGS training under these tightly coupled constraints while preserving high-fidelity reconstruction. PocketGS resolves the fundamental tension between training efficiency, memory compactness, and modeling quality through three co-designed operators: $\mathcal{G}$ builds geometry-faithful point-cloud priors; $\mathcal{I}$ injects local surface statistics to seed anisotropic Gaussians, thereby reducing early conditioning gaps; and $\mathcal{T}$ unrolls alpha compositing with cached intermediates and index-mapped gradient scattering for stable mobile backpropagation. Extensive experiments demonstrate that PocketGS outperforms the powerful mainstream workstation 3DGS baseline under mobile budgets, delivering high-quality reconstructions and enabling a fully on-device, practical capture-to-rendering workflow.
This paper has not been read by Pith yet.
Forward citations
Cited by 1 Pith paper
-
A Single Atlas is All You Need: Decoder-Side Gaussian Splatting for Immersive Video
DSGS performs feed-forward 3D Gaussian Splatting on the decoder from one compressed 2D atlas of four views, yielding +5.79 dB BD-PSNR and lower inter-view variance than decoder-side depth estimation.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.