REVIEW 1 cited by
Reduced Softmax Unit for Deep Neural Network Accelerators
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
The Softmax activation layer is a very popular Deep Neural Network (DNN) component when dealing with multi-class prediction problems. However, in DNN accelerator implementations it creates additional complexities due to the need for computation of the exponential for each of its inputs. In this brief we propose a simplified version of the activation unit for accelerators, where only a comparator unit produces the classification result, by choosing the maximum among its inputs. Due to the nature of the activation function, we show that this result is always identical to the classification produced by the Softmax layer.
Forward citations
Cited by 1 Pith paper
-
Pushing the Limits of BFP on Narrow Precision LLM Inference
A dynamic block floating-point format with pivot-focus and adaptive grouping, plus a hierarchical lookup table, lets attention Softmax run in integer-only hardware with negligible accuracy loss.
Discussion (0). Continue with ORCID to comment.