Speed and Conversational Large Language Models: Not All Is About Tokens per Second

Fabrizio Lombardi; Javier Conde; Miguel Gonz\'alez; Pedro Reviriego; Shanshan Liu; Zhen Gao

REVIEW

Speed and Conversational Large Language Models: Not All Is About Tokens per Second

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2502.16721 v1 pith:NT6JEFIZ submitted 2025-02-23 cs.CL cs.AI

Javier Conde , Miguel González , Pedro Reviriego , Zhen Gao , Shanshan Liu , Fabrizio Lombardi This is my paper

classification cs.CLcs.AI

keywords speedlanguagelargellmsmodelsanalysiscomparativeconversational

verification ladder T0 review T1 audit T2 compute T3 formal

0 comments

read the original abstract

The speed of open-weights large language models (LLMs) and its dependency on the task at hand, when run on GPUs, is studied to present a comparative analysis of the speed of the most popular open LLMs.

Discussion (0). Sign in to comment.

Pith tools