REVIEW 22 cited by
Implicit Neural Representations with Periodic Activation Functions
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Implicitly defined, continuous, differentiable signal representations parameterized by neural networks have emerged as a powerful paradigm, offering many possible benefits over conventional representations. However, current network architectures for such implicit neural representations are incapable of modeling signals with fine detail, and fail to represent a signal's spatial and temporal derivatives, despite the fact that these are essential to many physical signals defined implicitly as the solution to partial differential equations. We propose to leverage periodic activation functions for implicit neural representations and demonstrate that these networks, dubbed sinusoidal representation networks or Sirens, are ideally suited for representing complex natural signals and their derivatives. We analyze Siren activation statistics to propose a principled initialization scheme and demonstrate the representation of images, wavefields, video, sound, and their derivatives. Further, we show how Sirens can be leveraged to solve challenging boundary value problems, such as particular Eikonal equations (yielding signed distance functions), the Poisson equation, and the Helmholtz and wave equations. Lastly, we combine Sirens with hypernetworks to learn priors over the space of Siren functions.
Forward citations
Cited by 22 Pith papers
-
Fourier Neural Operator for Parametric Partial Differential Equations
Fourier Neural Operator parameterizes integral kernels in Fourier space to learn parametric PDE solution operators, delivering up to 1000x speedups and zero-shot super-resolution on turbulent Navier-Stokes flows.
-
Render, Don't Decode: Weight-Space World Models with Latent Structural Disentanglement
NOVA represents world states as INR weights for decoder-free rendering, compactness, and unsupervised disentanglement of background, foreground, and motion in video world models.
-
DiV-INR: Extreme Low-Bitrate Diffusion Video Compression with INR Conditioning
DiV-INR integrates implicit neural representations as conditioning signals for diffusion models to achieve better perceptual quality than HEVC, VVC, and prior neural codecs at extremely low bitrates under 0.05 bpp.
-
Cosmo-SPINN: Fuzzy Dark Matter Simulations with Physics-Informed Generative Networks
Physics-informed generative U-Nets evolve and super-resolve fuzzy dark matter fields under Schrödinger–Poisson constraints with far less supervised data than pure data-driven baselines.
-
Fast, accurate, and differentiable: a neural-network surrogate for NRSur7dq4 precessing binary black hole waveforms
A piecewise MLP surrogate emulates NRSur7dq4 over its full domain at NR-faithful accuracy with ~1 ms GPU latency and a fully differentiable JAX likelihood pipeline.
-
From Scalars to Time Series: Rethinking Implicit Neural Representations for Time-Varying Volumetric Data
Time-varying volumes are compressed by mapping each spatial coordinate directly to its full temporal sequence, using mixture-of-experts routing and low-rank decoders.
-
PRIME-SVR: Physics-infoRmed Implicit Multi-Echo Slice-to-Volume Reconstruction for Fetal T2 mapping
A self-supervised, physics-regularized neural reconstruction produces high-resolution fetal brain T2 maps at 0.55 T and 1.5 T from multi-echo MRI, with reduced acquisition time.
-
Chebyshev Manifold Adaptation
ChebyMA uses Chebyshev polynomial surfaces to parameterize weight updates, claiming a better parameter-accuracy trade-off than LoRA, TLoRA, and StelLA on CIFAR and text classification.
-
IV-Net: A neural network for elliptic PDEs with random and highly varying coefficients
IV-Net is a multigrid-inspired convolutional neural operator that approximates solutions to linear elliptic PDEs with high-contrast coefficients and shows better accuracy than POD and other neural operators on heterog...
-
Render, Don't Decode: Weight-Space World Models with Latent Structural Disentanglement
NOVA represents scene states as INR weights for analytical rendering without decoders and achieves structural disentanglement of content and dynamics in video world models.
-
Exterior complex scaling enables physics-informed neural networks for quantum scattering
Exterior complex scaling turns oscillatory scattering waves into decaying waves, letting physics-informed neural networks solve nuclear scattering benchmarks.
-
Deformable Medical Image Registration with KAN-based Implicit Neural Representations
KAN-based implicit neural networks with randomized basis sampling outperform existing INR registration methods on three medical imaging datasets at lower computational cost.
-
Deep Learning Alternatives of the Kolmogorov Superposition Theorem
ActNet is a new KST-based neural network that outperforms KANs and competes with MLPs in PINN benchmarks for PDE simulation tasks.
-
SurfSurg6D: Geometry Consistent Dense Correspondence for Textureless Surgical Instrument Pose Estimation
A new synthetic dataset and geometry-consistent dense correspondence framework improve RGB-only pose estimation accuracy for surgical instruments on three evaluation datasets.
-
First Shape, Then Meaning: Efficient Geometry and Semantics Learning for Indoor Reconstruction
FSTM improves indoor reconstruction by training geometry first without semantic supervision, then adding semantics, achieving 2.3x faster training and higher object surface recall than joint optimization.
-
Physics-Informed Neural Networks for Solving Two-Flavor Neutrino Oscillations in Vacuum and Matter Environments for Atmospheric and Reactor Neutrinos
Physics-informed neural networks solve two-flavor neutrino oscillation equations in vacuum and matter with mean squared errors of order 10^{-3} to 10^{-4}, matching analytical results.
-
Physics-Informed Neural Networks for Solving Two-Flavor Neutrino Oscillations in Vacuum and Matter Environments for Atmospheric and Reactor Neutrinos
PINNs solve two-flavor neutrino oscillation equations in vacuum and matter with mean squared errors of 10^{-3} to 10^{-4}, matching analytical solutions.
-
Multi-Modal Learning meets Genetic Programming: Analyzing Alignment in Latent Space Optimization
SNIP's symbolic-numeric alignment stays coarse and does not improve during optimization, so multi-modal LSO does not yet deliver effective bi-modal search for symbolic regression.
-
Gaussian Field Representations for Turbulent Flow: Compression, Scale Separation, and Physical Fidelity
Anisotropic Gaussian primitives compress 3D Taylor–Green turbulence at 1e3–1e4× while recovering more intermediate- and high-wavenumber content than isotropic kernels.
-
Generative Latent Diffusion Model for Inverse Modeling and Uncertainty Analysis in Geological Carbon Sequestration
A conditional neural field plus latent diffusion model jointly generates geological models and flow responses, enabling zero-shot Bayesian inversion for CO2 storage.
-
Multi-Modal Learning meets Genetic Programming: Analyzing Alignment in Latent Space Optimization
Experiments reveal that cross-modal alignment in SNIP does not improve with increasing fitness and is too coarse for effective symbolic search in latent space optimization for symbolic regression.
-
Gaussian Field Representations for Turbulent Flow: Compression, Scale Separation, and Physical Fidelity
Gaussian primitives compress 3D Taylor-Green vortex flows at ratios over 1000x while preserving velocity but degrading enstrophy, with anisotropic extensions recovering small-scale vortical structures better than base...
Discussion (0). Sign in to comment.