Patchwork: A compact representation for 3D polygonal shapes
Pith reviewed 2026-05-21 10:27 UTC · model grok-4.3
The pith
Patchwork represents arbitrary 2D and 3D shapes with a small number of parameters and provable approximation guarantees in any dimension.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Patchwork is a compact shape representation for 2D and 3D polygonal geometry that uses a small number of parameters, rests on a rigorous mathematical framework with provable complexity bounds, and can approximate arbitrary shapes to arbitrary precision in any dimension; it is fitted via gradient-based optimization and a novel regularization loss that prunes redundant elements while preserving inside-outside classification.
What carries the argument
The Patchwork representation, a parametric collection of elements optimized by gradient descent and progressively pruned by regularization loss to achieve compactness while retaining approximation power and inside-outside queries.
If this is right
- Arbitrary shapes in any dimension can be approximated to any precision with bounded complexity.
- Fitting to data requires only a fraction of the parameters used by current alternatives.
- Inside-outside classification is available natively without extra computation.
- The same representation supports both reconstruction and downstream geometric learning tasks.
- The approach extends naturally to potential 3D generation pipelines due to its compactness.
Where Pith is reading between the lines
- The same element-pruning mechanism could be adapted to time-varying or higher-dimensional data for compact 4D models.
- Parameters learned across many shapes might serve as a compact latent space for generative models.
- The provable bounds suggest Patchwork could replace denser representations in memory-constrained settings such as mobile rendering.
- Regularization that removes elements during training might transfer to other parametric models to improve sparsity.
Load-bearing premise
The gradient-based optimization scheme combined with the novel regularization loss will reliably converge to a compact yet accurate representation that preserves the claimed approximation guarantees and inside-outside classification property for arbitrary input shapes.
What would settle it
A concrete 2D or 3D shape for which no Patchwork with the claimed small parameter count reaches a target approximation error, or a fitted Patchwork whose inside-outside decisions disagree with the true geometry on a measurable set.
Figures
read the original abstract
We introduce Patchwork, a new general-purpose shape representation capable of modeling 2D and 3D geometry with a small number of parameters. Patchwork is grounded in a rigorous mathematical framework, providing provable complexity bounds and the ability to approximate arbitrary shapes with arbitrary precision in any dimension. We propose an efficient gradient-based optimization scheme to fit Patchwork representations to 2D and 3D data, along with a novel regularization loss that progressively prunes redundant elements, yielding high compactness after convergence. Our approach offers fast fitting performance, a fraction of the required parameters compared to existing alternatives, and native support for inside-outside classification, making it a versatile and compact representation for geometric learning and reconstruction tasks, with future potential for 3D generation. Our implementation is available at: https://github.com/Ankbzpx/patchwork-experiment.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces Patchwork, a compact representation for 2D and 3D polygonal shapes grounded in a mathematical framework that provides provable complexity bounds and allows approximation of arbitrary shapes with arbitrary precision in any dimension. It describes an efficient gradient-based optimization scheme combined with a novel regularization loss for pruning redundant elements to achieve compactness, offering fast fitting, fewer parameters than alternatives, and native inside-outside classification.
Significance. If the provable bounds and the reliability of the optimization in preserving approximation guarantees hold, Patchwork could offer a valuable compact alternative for shape representation in geometric learning and reconstruction, with advantages in parameter efficiency and classification support. The open implementation supports further exploration.
major comments (3)
- [Mathematical Framework] The abstract asserts provable complexity bounds and arbitrary-precision approximation, yet the manuscript provides no theorem statements, proof sketches, or formal derivations to support these claims, which are central to the contribution.
- [Optimization Scheme] §4: The gradient-based fitting with regularization is presented as preserving the inside-outside classification and complexity bounds, but no convergence analysis or experiments demonstrate that local minima do not violate these properties for arbitrary input shapes.
- [Experiments] No error metrics, ablation results on the pruning regularization, or quantitative comparisons validating the claimed parameter reduction and approximation quality are included, undermining the empirical support for the method's efficiency.
minor comments (2)
- [Introduction] The notation for the Patchwork representation could be clarified with more explicit definitions early in the text.
- [Related Work] Additional references to recent compact shape representations in 3D learning would strengthen the positioning.
Simulated Author's Rebuttal
We thank the referee for the constructive feedback. We address each major comment below and describe the changes planned for the revised manuscript.
read point-by-point responses
-
Referee: [Mathematical Framework] The abstract asserts provable complexity bounds and arbitrary-precision approximation, yet the manuscript provides no theorem statements, proof sketches, or formal derivations to support these claims, which are central to the contribution.
Authors: We agree that the manuscript would benefit from greater formality. In the revision we will add a dedicated subsection that states the complexity bounds and approximation guarantees as theorems, together with concise proof sketches that derive the results from the underlying Patchwork construction. This will directly substantiate the claims made in the abstract. revision: yes
-
Referee: [Optimization Scheme] §4: The gradient-based fitting with regularization is presented as preserving the inside-outside classification and complexity bounds, but no convergence analysis or experiments demonstrate that local minima do not violate these properties for arbitrary input shapes.
Authors: We will augment the experimental section with targeted tests that measure preservation of inside-outside classification and bound compliance after convergence on diverse input shapes. A complete theoretical convergence analysis lies beyond the scope of the current work and will be listed as future research; the added experiments will nevertheless provide practical evidence that the observed local minima respect the representation properties. revision: partial
-
Referee: [Experiments] No error metrics, ablation results on the pruning regularization, or quantitative comparisons validating the claimed parameter reduction and approximation quality are included, undermining the empirical support for the method's efficiency.
Authors: We accept this observation. The revised manuscript will report standard error metrics (e.g., symmetric Hausdorff distance and volumetric IoU), include an ablation isolating the pruning-regularization term, and provide quantitative tables comparing parameter counts and approximation accuracy against representative baselines such as neural implicits and compact mesh encodings. revision: yes
- A complete theoretical convergence analysis of the gradient-based optimization for arbitrary input shapes
Circularity Check
No circularity: derivation is self-contained against external mathematical framework
full rationale
The paper introduces Patchwork as a representation grounded in an external rigorous mathematical framework that supplies provable complexity bounds and arbitrary-precision approximation guarantees in any dimension. The optimization scheme and regularization loss are presented as a practical fitting procedure applied to this pre-existing construction, not as the source of the bounds themselves. No equations or claims in the provided text reduce the stated guarantees to a self-definition, a fitted parameter renamed as prediction, or a self-citation chain that bears the central load. The inside-outside classification and compactness claims are therefore independent of the fitting process and rest on the cited mathematical framework.
Axiom & Free-Parameter Ledger
Lean theorems connected to this paper
-
IndisputableMonolith/Foundation/AlexanderDuality.leanalexander_duality_circle_linking (D=3 forcing) contradicts?
contradictsCONTRADICTS: the theorem conflicts with this paper passage, or marks a claim that would need revision before publication.
Patchwork is grounded in a rigorous mathematical framework, providing provable complexity bounds and the ability to approximate arbitrary shapes with arbitrary precision in any dimension.
-
IndisputableMonolith/Cost/FunctionalEquation.leanwashburn_uniqueness_aczel (J-cost uniqueness) unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
F(x) = 1/β log ∑ s_i exp(β (a_i x + b_i y + c_i)) ... limiting case β→+∞ ... f(x,y) = max ... − max ...
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Reference graph
Works this paper leans on
-
[1]
Alfarra, M., Bibi, A., Hammoud, H., Gaafar, M., Ghanem, B.: On the decision boundariesofneuralnetworks:Atropicalgeometryperspective.IEEETransactions on Pattern Analysis and Machine Intelligence45(4), 5027–5037 (2022) 4
work page 2022
-
[2]
Barber, C.B., Dobkin, D.P., Huhdanpaa, H.: The quickhull algorithm for con- vex hulls22(4), 469–483 (Dec 1996).https://doi.org/10.1145/235815.235821, https://doi.org/10.1145/235815.23582123
-
[3]
Bradbury, J., Frostig, R., Hawkins, P., Johnson, M.J., Leary, C., Maclaurin, D., Necula, G., Paszke, A., VanderPlas, J., Wanderman-Milne, S., Zhang, Q.: JAX: composabletransformationsofPython+NumPyprograms(2018),http://github. com/jax-ml/jax10
work page 2018
-
[4]
Transactions on Machine Learning Research (2024) 3, 4
Brandenburg, M.C., Loho, G., Montufar, G.: The real tropical geometry of neu- ral networks for binary classification. Transactions on Machine Learning Research (2024) 3, 4
work page 2024
-
[5]
In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition
Chen, Z., Tagliasacchi, A., Zhang, H.: Bsp-net: Generating compact meshes via bi- nary space partitioning. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 45–54 (2020) 4
work page 2020
-
[6]
Advances in Neural Information Pro- cessing Systems35, 16344–16359 (2022) 10
Dao, T., Fu, D., Ermon, S., Rudra, A., Ré, C.: Flashattention: Fast and memory- efficient exact attention with io-awareness. Advances in Neural Information Pro- cessing Systems35, 16344–16359 (2022) 10
work page 2022
-
[7]
Deng, B., Genova, K., Yazdani, S., Bouaziz, S., Hinton, G., Tagliasacchi, A.: Cvxnet: Learnable convex decomposition. In: Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition (CVPR) (June 2020) 1, 4
work page 2020
-
[8]
In: European conference on computer vision
Erler, P., Guerrero, P., Ohrhallinger, S., Mitra, N.J., Wimmer, M.: Points2surf learning implicit surfaces from point clouds. In: European conference on computer vision. pp. 108–124. Springer (2020) 11
work page 2020
-
[9]
Russian Math- ematical Surveys29(4), 1–79 (1974).https://doi.org/https://doi.org/10
Gudkov, D.A.: The topology of real projective algebraic varieties. Russian Math- ematical Surveys29(4), 1–79 (1974).https://doi.org/https://doi.org/10. 1070/RM1974v029n04ABEH0012883
work page 1974
-
[10]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Huang, J., Gojcic, Z., Atzmon, M., Litany, O., Fidler, S., Williams, F.: Neural kernel surface reconstruction. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 4369–4379 (2023) 11
work page 2023
-
[11]
Mathematical Intelligencer18(4) (1996) 2, 3, 4
Itenberg, I., Viro, O.: Patchworking algebraic curves disproves the Ragsdale con- jecture. Mathematical Intelligencer18(4) (1996) 2, 3, 4
work page 1996
-
[12]
In: Gökova Geometry/Topology conference
Itenberg, I., Viro, O.: Asymptotically maximal real algebraic hypersurfaces of pro- jective space. In: Gökova Geometry/Topology conference. pp. 91–105 (2006) 3, 4, 20, 21
work page 2006
-
[13]
Kazhdan, M., Hoppe, H.: Screened poisson surface reconstruction. ACM Trans. Graph.32(3) (Jul 2013).https://doi.org/10.1145/2487228.2487237,https: //doi.org/10.1145/2487228.248723712
-
[14]
Communications in Mathematical Physics406(5), 105 (2025) 6, 18
Khristoforov, M., Skopenkov, M., Smirnov, S.: A generalization of Cardy’s and Schramm’s formulae. Communications in Mathematical Physics406(5), 105 (2025) 6, 18
work page 2025
-
[15]
In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (June 2019) 11 28 R
Koch, S., Matveev, A., Jiang, Z., Williams, F., Artemov, A., Burnaev, E., Alexa, M., Zorin, D., Panozzo, D.: Abc: A big cad model dataset for geometric deep learning. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (June 2019) 11 28 R. Zheng et al
work page 2019
- [16]
-
[17]
Lorensen, W.E., Cline, H.E.: Marching cubes: A high resolution 3d surface con- struction algorithm. SIGGRAPH Comput. Graph.21(4), 163–169 (Aug 1987). https://doi.org/10.1145/37402.37422,https://doi.org/10.1145/37402. 3742211
-
[18]
Maclagan, D., Sturmfels, B.: Introduction to tropical geometry, vol. 161. American Mathematical Soc. (2015) 3, 4
work page 2015
-
[19]
Proceedings of the IEEE109(5), 728–755 (2021) 4
Maragos, P., Charisopoulos, V., Theodosis, E.: Tropical geometry and machine learning. Proceedings of the IEEE109(5), 728–755 (2021) 4
work page 2021
-
[20]
In: Proceedings of the IEEE/CVF international conference on computer vision
Maruani, N., Klokov, R., Ovsjanikov, M., Alliez, P., Desbrun, M.: Voromesh: Learning watertight surface meshes with voronoi diagrams. In: Proceedings of the IEEE/CVF international conference on computer vision. pp. 14565–14574 (2023) 12
work page 2023
-
[21]
In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition
Maruani, N., Ovsjanikov, M., Alliez, P., Desbrun, M.: Ponq: a neural qem-based mesh representation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 3647–3657 (2024) 12
work page 2024
-
[22]
Forum of Mathematics, Pi 5, e4 (2017).https://doi.org/10.1017/fmp.2017.518
Miller, J., Sheffield, S., Werner, W.: CLE percolations. Forum of Mathematics, Pi 5, e4 (2017).https://doi.org/10.1017/fmp.2017.518
-
[23]
Müller,T.,Evans,A.,Schied,C.,Keller,A.:Instantneuralgraphicsprimitiveswith a multiresolution hash encoding. ACM Trans. Graph.41(4) (Jul 2022).https: //doi.org/10.1145/3528223.3530127,https://doi.org/10.1145/3528223. 35301271, 4
-
[24]
Pirahmad, O., Pottmann, H., Skopenkov, M.: Flexible polyhedral nets in isotropic geometry. Beitr. Algebra Geom. (2025),https://doi.org/10.1007/s13366-025- 00820-y6, 18
-
[25]
Project starline: A high-fidelity telepresence system,
Ren,J.,Zhang,B.,Wu,B.,Huang,J.,Fan,L.,Ovsjanikov,M.,Wonka,P.:Intuitive and efficient roof modeling for reconstruction and synthesis. ACM Trans. Graph. 40(6) (Dec 2021).https://doi.org/10.1145/3478513.3480494,https://doi. org/10.1145/3478513.348049411
-
[26]
In: SIGGRAPH 2024 Conference Papers (2024) 11
Sellán, S., Ren, Y., Batty, C., Stein, O.: Reach for the arcs: Reconstructing surfaces from sdfs via tangent points. In: SIGGRAPH 2024 Conference Papers (2024) 11
work page 2024
- [27]
-
[28]
Sharp, N., et al.: Polyscope (2019), www.polyscope.run 23
work page 2019
-
[29]
In: International conference on machine learning
Siahkamari, A., Gangrade, A., Kulis, B., Saligrama, V.: Piecewise linear regres- sion via a difference of convex functions. In: International conference on machine learning. pp. 8895–8904. PMLR (2020) 2, 9, 18
work page 2020
-
[30]
Advances in neural information processing systems33, 7462–7473 (2020) 3, 12
Sitzmann, V., Martel, J., Bergman, A., Lindell, D., Wetzstein, G.: Implicit neural representations with periodic activation functions. Advances in neural information processing systems33, 7462–7473 (2020) 3, 12
work page 2020
- [31]
-
[32]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Takikawa, T., Litalien, J., Yin, K., Kreis, K., Loop, C., Nowrouzezahrai, D., Ja- cobson, A., McGuire, M., Fidler, S.: Neural geometric level of detail: Real-time rendering with implicit 3d shapes. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 11358–11367 (2021) 1, 4
work page 2021
-
[33]
Tancik, M., Srinivasan, P., Mildenhall, B., Fridovich-Keil, S., Raghavan, N., Sing- hal, U., Ramamoorthi, R., Barron, J., Ng, R.: Fourier features let networks learn high frequency functions in low dimensional domains. Advances in neural informa- tion processing systems33, 7537–7547 (2020) 3 Patchwork: A compact representation for 3D polygonal shapes 29
work page 2020
-
[34]
Tillet, P., Kung, H.T., Cox, D.: Triton: an intermediate language and compiler for tiled neural network computations. In: Proceedings of the 3rd ACM SIG- PLANInternationalWorkshoponMachineLearningandProgrammingLanguages. p. 10–19. MAPL 2019, Association for Computing Machinery, New York, NY, USA (2019).https://doi.org/10.1145/3315508.3329973,https://doi.o...
-
[35]
In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
Tulsiani, S., Su, H., Guibas, L.J., Efros, A.A., Malik, J.: Learning shape abstrac- tions by assembling volumetric primitives. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 2635–2643 (2017) 4
work page 2017
-
[36]
Viro, O.: Progress in the topology of real algebraic varieties over the last six years. Russian Mathematical Surveys41(3), 55–82 (1986).https://doi.org/https: //doi.org/10.1070/RM1986v041n03ABEH0033173, 4
-
[37]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Yariv, L., Puny, O., Gafni, O., Lipman, Y.: Mosaic-sdf for 3d generative models. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 4630–4639 (2024) 4
work page 2024
- [38]
-
[39]
ACM Transactions On Graphics (TOG)42(4), 1–16 (2023) 4
Zhang, B., Tang, J., Niessner, M., Wonka, P.: 3DShape2VecSet: A 3d shape repre- sentation for neural fields and generative diffusion models. ACM Transactions On Graphics (TOG)42(4), 1–16 (2023) 4
work page 2023
-
[40]
arXiv preprint arXiv:2505.21319 (2025) 4, 10
Zhang, B., Wonka, P.: efunc: An efficient function representation without neural networks. arXiv preprint arXiv:2505.21319 (2025) 4, 10
-
[41]
In: International Conference on Machine Learning
Zhang, L., Naitzat, G., Lim, L.H.: Tropical geometry of deep neural networks. In: International Conference on Machine Learning. pp. 5824–5832. PMLR (2018) 4
work page 2018
-
[42]
Thingi10K: A Dataset of 10,000 3D-Printing Models
Zhou, Q., Jacobson, A.: Thingi10k: A dataset of 10,000 3d-printing models. arXiv preprint arXiv:1605.04797 (2016) 11
work page internal anchor Pith review Pith/arXiv arXiv 2016
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.