Pith. sign in

REVIEW

Why only Micro-F1? Class Weighting of Measures for Relation Classification

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2205.09460 v1 pith:542NLGWA submitted 2022-05-19 cs.CL cs.LG

Why only Micro-F1? Class Weighting of Measures for Relation Classification

David Harbecke , Yuxuan Chen , Leonhard Hennig , Christoph Alt This is my paper
classification cs.CL cs.LG
keywords schemesweightingclassificationmicro-f1onlyrelationanalyzebetter
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
Share X Bluesky LinkedIn Reddit HN
read the original abstract

Relation classification models are conventionally evaluated using only a single measure, e.g., micro-F1, macro-F1 or AUC. In this work, we analyze weighting schemes, such as micro and macro, for imbalanced datasets. We introduce a framework for weighting schemes, where existing schemes are extremes, and two new intermediate schemes. We show that reporting results of different weighting schemes better highlights strengths and weaknesses of a model.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.