Mixed precision training uses FP16 for most computations, FP32 master weights for accumulation, and loss scaling to enable accurate training of large DNNs with halved memory usage.
hub
Title resolution pending
2 Pith papers cite this work, alongside 4,146 external citations. Polarity classification is still indexing.
2
Pith papers citing it
4,146
external citations · OpenAlex
hub tools
representative citing papers
NEURON-Fabric provides a profile-guided runtime for controlled low-bit gradient communication that preserves accuracy near full-precision levels while reducing modeled communication traffic across vision, transformer, and language model workloads.
citing papers explorer
-
Mixed Precision Training
Mixed precision training uses FP16 for most computations, FP32 master weights for accumulation, and loss scaling to enable accurate training of large DNNs with halved memory usage.
-
NEURON-Fabric: Architecture-Runtime Co-Design for Controlled Low-Bit Gradient Communication
NEURON-Fabric provides a profile-guided runtime for controlled low-bit gradient communication that preserves accuracy near full-precision levels while reducing modeled communication traffic across vision, transformer, and language model workloads.