Paper Citation Record · LEDGER

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis

As of 19 August 2026, this Paper Citation Record lists 26 of 26 outbound references and 1 inbound Pith citation observation for arXiv:2504.20096.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2504.20096 v1

Coverage vector

measured 26 of 26 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-16T10:14:11.850502Z

measured 27 of 27 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-19T06:32:44.657259+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-16T04:35:57.972902Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-16T04:35:58.182125Z

Reference resolution

26 of 26 outbound references displayed

verified exact1
verified fuzzy5
unresolved19
parse uncertain0
malformed identifier1
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation e9a05c2c-a496-425a-8bf7-f8b80a30d826 · outbound

This paper cites an unresolved cited work.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis Unresolved cited work

Reference 1

Resolution: unresolved; raw_fallback, observed 2026-08-16T10:14:12.338057Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation c63504d3-00a6-4d3b-8688-35c578c1a4eb · outbound

This paper cites A., & Johnson, C.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis A., & Johnson, C

Reference 2

Resolution: malformed identifier; doi_truncated, observed 2026-08-16T10:14:12.100355Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 3ffdb0a1-9af7-4ca0-8827-a22facc1720e · outbound

This paper cites (2001, 08).

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis (2001, 08)

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-16T10:14:11.821981Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 11fd87f7-ecb2-4186-bb1e-ab0cdde108d1 · outbound

This paper cites B., & LeCun, Y.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis B., & LeCun, Y

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:14:12.285426Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 8375cf43-f2b8-4556-9b16-a097c5197789 · outbound

This paper cites an unresolved cited work.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis Unresolved cited work

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-16T10:14:11.793680Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a97ee11e-805d-47db-9f55-c087f094178b · outbound

This paper cites Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-16T10:14:11.800801Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1921bbe3-db85-4c09-aa2e-011f9532bb01 · outbound

This paper cites an unresolved cited work.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis Unresolved cited work

Reference 13

Resolution: unresolved; raw_fallback, observed 2026-08-16T10:14:12.258134Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation e4bd7e1c-91b0-47d6-ad71-83eb98473554 · outbound

This paper cites an unresolved cited work.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis Unresolved cited work

Reference 15

Resolution: unresolved; raw_fallback, observed 2026-08-16T10:14:12.247275Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation fc49d36e-ddd2-49e4-b7d2-feb86f26558a · outbound

This paper cites Adam: A Method for Stochastic Optimization.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis Adam: A Method for Stochastic Optimization

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-16T10:14:11.814394Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 05b89b84-bcf4-4292-8a66-21cbe4141ab1 · outbound

This paper cites 578–594).

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis 578–594)

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:14:12.306043Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 09322ef1-6833-4cf9-adcc-942a01b62910 · outbound

This paper cites Apollo: An Adaptive Parameter-wise Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis Apollo: An Adaptive Parameter-wise Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-16T10:14:11.828573Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f29a9900-c887-4b86-a04d-194054c52bf0 · outbound

This paper cites Normalization: A Preprocessing Stage.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis Normalization: A Preprocessing Stage

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-16T10:14:11.832441Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f0704b5f-3215-487c-bedd-5d93dbf05548 · outbound

This paper cites Glow: Graph Lowering Compiler Techniques for Neural Networks.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis Glow: Graph Lowering Compiler Techniques for Neural Networks

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-16T10:14:11.836058Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a736e3c3-b44b-472c-a30d-2c5ea664b677 · outbound

This paper cites S., Gunasekar, S., & Srebro, N.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis S., Gunasekar, S., & Srebro, N

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-16T10:14:11.839600Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 35267b79-32a4-45c3-ae60-da299e6db87b · outbound

This paper cites an unresolved cited work.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis Unresolved cited work

Reference 24

Resolution: unresolved; raw_fallback, observed 2026-08-16T10:14:12.215850Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 55cb03a9-2936-48f5-a029-b740dc2acaee · outbound

This paper cites an unresolved cited work.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis Unresolved cited work

Reference 25

Resolution: unresolved; raw_fallback, observed 2026-08-16T10:14:12.236379Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 246afcd7-1fc8-4a68-88fb-6e75c8b2e8b1 · outbound

This paper cites an unresolved cited work.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis Unresolved cited work

Reference 26

Resolution: unresolved; raw_fallback, observed 2026-08-16T10:14:12.205199Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 1d719f8a-4a3c-4cd6-8a6f-1a18407c87ee · outbound

This paper cites an unresolved cited work.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis Unresolved cited work

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-16T10:14:11.790182Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cda69bea-cfbc-47be-80e1-cb00ac95417a · outbound

This paper cites N., Pascanu, R., Gulcehre, C., Cho, K., Ganguli, S., & Bengio, Y.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis N., Pascanu, R., Gulcehre, C., Cho, K., Ganguli, S., & Bengio, Y

Reference 28

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:14:12.275094Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 1373d28b-67e9-475b-9df6-b34d7027b4d2 · outbound

This paper cites E., & Makhzani, A.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis E., & Makhzani, A

Reference 29

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:14:12.226197Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation cb5e9ee9-2000-490a-82db-e71343a2aa12 · outbound

This paper cites A second-order-like optimizer with adaptive gradient scaling for deep learning.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis A second-order-like optimizer with adaptive gradient scaling for deep learning

Reference 30

Resolution: verified exact; local_arxiv, observed 2026-08-16T10:14:12.183526Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 365c5fb9-9db7-4514-8c56-495740b76619 · outbound

This paper cites (2021, February).

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis (2021, February)

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-16T10:14:11.797213Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f320229a-10ee-4446-9ceb-ae06ccacdb58 · outbound

This paper cites an unresolved cited work.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis Unresolved cited work

Reference 32

Resolution: unresolved; raw_fallback, observed 2026-08-16T10:14:12.327760Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation a4a6b763-6ffc-4c4c-8090-03170fd127ff · outbound

This paper cites an unresolved cited work.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis Unresolved cited work

Reference 33

Resolution: unresolved; raw_fallback, observed 2026-08-16T10:14:12.194492Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation bdc9b9b6-6e30-4a63-8989-2dc5b398ca08 · outbound

This paper cites an unresolved cited work.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis Unresolved cited work

Reference 36

Resolution: unresolved; raw_fallback, observed 2026-08-16T10:14:12.295610Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 93c23b87-dbd6-415e-8b0c-e5f3e8ce7bff · outbound

This paper cites D., Dhariwal, P.,.

Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis D., Dhariwal, P.,

Reference 450

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:14:12.316973Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Pith citing papers

Observation 5e6b71ba-4433-4fc9-9ab6-712b34b1295d · inbound

DHO$_2$: Accelerating Distributed Hybrid Order Optimization via Model Parallelism and ADMM cites this paper.

DHO$_2$: Accelerating Distributed Hybrid Order Optimization via Model Parallelism and ADMM Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information Analysis

Reference 18

Resolution: verified exact; local_arxiv, observed 2026-08-16T04:35:58.186612Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.