Pith. sign in

REVIEW 12 cited by

Active Learning by Acquiring Contrastive Examples

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2109.03764 v1 pith:WXM3UFDF submitted 2021-09-08 cs.CL cs.AIcs.LG

Katerina Margatina , Giorgos Vernikos , Loïc Barrault , Nikolaos Aletras This is my paper · ORCID
classification cs.CLcs.AIcs.LG
keywords dataacquisitionactivecontrastivelearningbestbetterdatasets
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

Common acquisition functions for active learning use either uncertainty or diversity sampling, aiming to select difficult and diverse data points from the pool of unlabeled data, respectively. In this work, leveraging the best of both worlds, we propose an acquisition function that opts for selecting \textit{contrastive examples}, i.e. data points that are similar in the model feature space and yet the model outputs maximally different predictive likelihoods. We compare our approach, CAL (Contrastive Active Learning), with a diverse set of acquisition functions in four natural language understanding tasks and seven datasets. Our experiments show that CAL performs consistently better or equal than the best performing baseline across all tasks, on both in-domain and out-of-domain data. We also conduct an extensive ablation study of our method and we further analyze all actively acquired datasets showing that CAL achieves a better trade-off between uncertainty and diversity compared to other strategies.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 12 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Data Lineage Inference: Uncovering Privacy Vulnerabilities of Dataset Pruning

    cs.CR 2024-11 conditional novelty 7.0 of 10

    Data pruned before model training can be re-identified through a new class of membership inference attacks that run on datasets alone.

  2. A computational fluid dynamics model for the simulation of flashboiling flow inside pressurized metered dose inhalers

    physics.flu-dyn 2025-08 unverdicted novelty 6.0 of 10

    The abstract claims a first-of-kind open-source CFD model, combining Volume-of-Fluid and cavitation modeling, that quantitatively predicts flashboiling flow in pressurized metered dose inhalers, but the supplied text ...

  3. Decouple before Align: Visual Disentanglement Enhances Prompt Tuning

    cs.CV 2025-08 conditional novelty 6.0 of 10

    Decoupling images into foreground and background before aligning them with text improves CLIP prompt tuning on few-shot and generalization benchmarks.

  4. Foundation Model Insights and a Multi-Model Approach for Superior Fine-Grained One-shot Subset Selection

    cs.CV 2025-06 conditional novelty 6.0 of 10

    RAM-APL combines distance rankings and pseudo-class label accuracy from two foundation models to select training subsets, outperforming twelve baselines on fine-grained image datasets.

  5. Info-Coevolution: An Efficient Framework for Data Model Coevolution

    cs.LG 2025-06 conditional novelty 6.0 of 10

    A data-model coevolution framework that fuses model and nearest-neighbor predictions to select labels, reaching ImageNet-1K accuracy with 68% of annotations and 50% under semi-supervised training.

  6. Model Performance-Guided Evaluation Data Selection for Effective Prompt Optimization

    cs.CL 2025-05 conditional novelty 6.0 of 10

    An evaluation-set selection method that adds real-time model feedback to semantic sampling improves the accuracy and stability of three prompt optimization methods on two datasets.

  7. ALPET: Active Few-shot Learning for Citation Worthiness Detection in Low-Resource Wikipedia Languages

    cs.CL 2025-02 conditional novelty 6.0 of 10

    ALPET, an active-learning plus PET pipeline, detects citation-worthy sentences in Catalan, Basque and Albanian while needing roughly 58-72% fewer labeled examples than its CCW baseline.

  8. Distributionally Robust Coreset Selection under Covariate Shift

    stat.ML 2025-01 conditional novelty 6.0 of 10

    DRCS derives an upper bound on worst-case validation error under covariate shift and greedily chooses a coreset that minimizes this bound.

  9. Integrating Deep Metric Learning with Coreset for Active Learning in 3D Segmentation

    cs.CV 2024-11 conditional novelty 6.0 of 10

    Group-aware contrastive embeddings improve Coreset-based slice selection for 3D medical segmentation at low annotation budgets.

  10. \emph{FoQuS}: A Forgetting-Quality Coreset Selection Framework for Automatic Modulation Recognition

    cs.LG 2025-09 reject novelty 5.0 of 10

    FoQuS uses three training-dynamics scores to select a 1% to 30% coreset for AMR and claims higher accuracy than ten existing coreset methods.

  11. NMS: Efficient Edge DNN Training via Near-Memory Sampling on Manifolds

    cs.LG 2025-08 reject novelty 5.0 of 10

    A t-SNE-based sampling algorithm with differential evolution and near-memory hardware is claimed to speed up edge DNN training and reduce memory energy.

  12. The Power of Adaptation: Boosting In-Context Learning through Adaptive Prompting

    cs.CL 2024-12 conditional novelty 4.0 of 10

    Sequentially choosing the most uncertain training question given previously chosen exemplars improves few-shot chain-of-thought accuracy by about 0.7 points on average over non-adaptive active prompting.

Pith tools