Pith. sign in

REVIEW 1 cited by

Non-Determinism in TensorFlow ResNets

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2001.11396 v1 pith:SIJ6X2UF submitted 2020-01-30 cs.LG cs.NEstat.ML

Miguel Morin , Matthew Willetts This is my paper · ORCID
classification cs.LGcs.NEstat.ML
keywords standarddeviationgpusnon-determinismresnetsresultstensorflowtest
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We show that the stochasticity in training ResNets for image classification on GPUs in TensorFlow is dominated by the non-determinism from GPUs, rather than by the initialisation of the weights and biases of the network or by the sequence of minibatches given. The standard deviation of test set accuracy is 0.02 with fixed seeds, compared to 0.027 with different seeds---nearly 74\% of the standard deviation of a ResNet model is non-deterministic. For test set loss the ratio of standard deviations is more than 80\%. These results call for more robust evaluation strategies of deep learning models, as a significant amount of the variation in results across runs can arise simply from GPU randomness.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Omega-S: A Functional Resilience Index for LLM Fine-Tuning

    cs.LG 2026-08 conditional novelty 6.0 of 10

    Omega-S, a penalty on node-degree variance in the weight matrix, improves code retention during LoRA fine-tuning of Llama-3-8B, while its advertised clustering/topological channel is inert.

Pith tools