Differentiable Rendering: A Survey
read the original abstract
Deep neural networks (DNNs) have shown remarkable performance improvements on vision-related tasks such as object detection or image segmentation. Despite their success, they generally lack the understanding of 3D objects which form the image, as it is not always possible to collect 3D information about the scene or to easily annotate it. Differentiable rendering is a novel field which allows the gradients of 3D objects to be calculated and propagated through images. It also reduces the requirement of 3D data collection and annotation, while enabling higher success rate in various applications. This paper reviews existing literature and discusses the current state of differentiable rendering, its applications and open research problems.
This paper has not been read by Pith yet.
Forward citations
Cited by 6 Pith papers
-
MAOAM: Unified Object and Material Selection with Vision-Language Models
MAOAM unifies object and material selection via a VLM with segmentation head, supporting text and click interactions through multi-task training on VLM-generated material data.
-
Simulation-Ready Cluttered Scene Estimation via Physics-aware Joint Shape and Pose Optimization
SPARCS uses a differentiable contact model and sparse Hessian solver to jointly optimize shapes and poses of up to five interacting objects, producing physically valid simulation-ready reconstructions.
-
Materialist: Physically Based Editing Using Single-Image Inverse Rendering
Materialist performs single-image inverse rendering via neural-initialized progressive differentiable rendering to enable physically consistent material editing, object insertion, relighting, and transparency edits wi...
-
Mosaic: A Benchmark Suite for Differentiable Physics Solvers
Mosaic is a benchmark suite evaluating 14 differentiable PDE solvers across fluids, structures, and heat transfer, showing large variations in cost and conditioning but similar convergence behavior.
-
Rendering Separoid Information: Rate-Distortion Reconstruction of Convex Apartness Scenes
The paper casts apartness tables of convex scenes as a source and develops a differentiable rate-distortion rendering objective that recovers the separoid structure from images at high accuracy.
-
Implicit Neural Representations: A Signal Processing Perspective
INRs parameterize signals as neural networks to enable continuous representations, analytical differentiation, and adaptive approximation spaces that address spectral bias through specialized activations and structure...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.