Kaolin: A PyTorch Library for Accelerating 3D Deep Learning Research
Reviewed by Pithpith:TEVH2UZ7open to challenge →
read the original abstract
We present Kaolin, a PyTorch library aiming to accelerate 3D deep learning research. Kaolin provides efficient implementations of differentiable 3D modules for use in deep learning systems. With functionality to load and preprocess several popular 3D datasets, and native functions to manipulate meshes, pointclouds, signed distance functions, and voxel grids, Kaolin mitigates the need to write wasteful boilerplate code. Kaolin packages together several differentiable graphics modules including rendering, lighting, shading, and view warping. Kaolin also supports an array of loss functions and evaluation metrics for seamless evaluation and provides visualization functionality to render the 3D results. Importantly, we curate a comprehensive model zoo comprising many state-of-the-art 3D deep learning architectures, to serve as a starting point for future research endeavours. Kaolin is available as open-source software at https://github.com/NVIDIAGameWorks/kaolin/.
This paper has not been read by Pith yet.
Forward citations
Cited by 3 Pith papers
-
Registration-Free Learnable Multi-View Capture of Faces in Dense Semantic Correspondence
MOCHI enables registration-free training of multi-view 3D face reconstruction by enforcing topological consistency via a pseudo-linear inverse kinematic solver, using synthetic-data-trained 2D landmarks for alignment,...
-
PacTure: Efficient PBR Texture Generation on Packed Views with Visual Autoregressive Models
PacTure uses view packing and next-scale autoregressive prediction to generate consistent multi-view PBR textures faster than prior sequential or cross-attention methods.
-
Real-to-Sim for Highly Cluttered Environments via Physics-Consistent Inter-Object Reasoning
A differentiable optimization pipeline uses a contact graph and rigid-body simulation to jointly refine object poses and physical properties, producing physically valid 3D scene reconstructions from single-view RGB-D ...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.