pith. sign in

hub

Forward-Mode Automatic Differentiation in Julia

15 Pith papers cite this work. Polarity classification is still indexing.

15 Pith papers citing it
abstract

We present ForwardDiff, a Julia package for forward-mode automatic differentiation (AD) featuring performance competitive with low-level languages like C++. Unlike recently developed AD tools in other popular high-level languages such as Python and MATLAB, ForwardDiff takes advantage of just-in-time (JIT) compilation to transparently recompile AD-unaware user code, enabling efficient support for higher-order differentiation and differentiation using custom number types (including complex numbers). For gradient and Jacobian calculations, ForwardDiff provides a variant of vector-forward mode that avoids expensive heap allocation and makes better use of memory bandwidth than traditional vector mode. In our numerical experiments, we demonstrate that for nontrivially large dimensions, ForwardDiff's gradient computations can be faster than a reverse-mode implementation from the Python-based autograd package. We also illustrate how ForwardDiff is used effectively within JuMP, a modeling language for optimization. According to our usage statistics, 41 unique repositories on GitHub depend on ForwardDiff, with users from diverse fields such as astronomy, optimization, finite element analysis, and statistics. This document is an extended abstract that has been accepted for presentation at the AD2016 7th International Conference on Algorithmic Differentiation.

hub tools

citation-role summary

method 3 background 1

citation-polarity summary

representative citing papers

Optimal linear response for Anosov diffeomorphisms

math.DS · 2025-04-23 · unverdicted · novelty 7.0

Develops an optimization framework for the linear response of SRB measures to perturbations of Anosov diffeomorphisms, proving uniqueness of the optimal perturbation for non-degenerate cases, giving explicit Fourier coefficients, and providing a convergent Fourier-based numerical scheme.

ModelPredictiveControl.jl: advanced process control made easy in Julia

eess.SY · 2024-11-14 · accept · novelty 7.0

The paper presents ModelPredictiveControl.jl, an open-source Julia toolkit for model predictive control including nonlinear, economic, and successive linearization variants, illustrated with CSTR and inverted pendulum simulations and benchmarked against MATLAB.

Universal Differential Equations for Scientific Machine Learning

cs.LG · 2020-01-13 · unverdicted · novelty 7.0

Universal Differential Equations unify scientific models with machine learning by embedding flexible approximators into differential equations, enabling applications from biological mechanism discovery to high-dimensional optimization.

Automatic Differentiation for Adjoint Stencil Loops

cs.DC · 2019-07-05 · unverdicted · novelty 6.0

A method for adjoint differentiation of stencil loops that preserves their structure and parallelizability via combined AD and loop transformations, released as the PerforAD tool with seismic and CFD test cases.

Sensitivities of Black Hole Images from GRMHD Simulations

astro-ph.HE · 2026-04-13 · unverdicted · novelty 6.0

Differentiable GRMHD image sensitivities create a structured error landscape that supports gradient-based parameter recovery for black hole imaging under idealized and noisy conditions.

citing papers explorer

Showing 15 of 15 citing papers.