Pith. sign in

REVIEW 6 cited by

Adversarial Training Methods for Semi-Supervised Text Classification

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1605.07725 v4 pith:UAYK5VTL submitted 2016-05-25 stat.ML cs.LG

Takeru Miyato , Andrew M. Dai , Ian Goodfellow This is my paper
classification stat.MLcs.LG
keywords adversarialtrainingsemi-supervisedsupervisedtextwordalgorithmsembeddings
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Adversarial training provides a means of regularizing supervised learning algorithms while virtual adversarial training is able to extend supervised learning algorithms to the semi-supervised setting. However, both methods require making small perturbations to numerous entries of the input vector, which is inappropriate for sparse high-dimensional inputs such as one-hot word representations. We extend adversarial and virtual adversarial training to the text domain by applying perturbations to the word embeddings in a recurrent neural network rather than to the original input itself. The proposed method achieves state of the art results on multiple benchmark semi-supervised and purely supervised tasks. We provide visualizations and analysis showing that the learned word embeddings have improved in quality and that while training, the model is less prone to overfitting. Code is available at https://github.com/tensorflow/models/tree/master/research/adversarial_text.

Discussion (0). Sign in to comment.

Forward citations

Cited by 6 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. XLNet: Generalized Autoregressive Pretraining for Language Understanding

    cs.CL 2019-06 accept novelty 7.0 of 10

    XLNet is a generalized autoregressive pretraining method that learns bidirectional contexts via permutation-based factorization and outperforms BERT on 20 NLP tasks.

  2. SmoothLLM: Defending Large Language Models Against Jailbreaking Attacks

    cs.LG 2023-10 accept novelty 6.0 of 10

    SmoothLLM mitigates jailbreaking attacks on LLMs by randomly perturbing multiple copies of a prompt at the character level and aggregating the outputs to detect adversarial inputs.

  3. ROBAD: Robust Adversary-aware Local-Global Attended Bad Actor Detection Sequential Model

    cs.LG 2025-07 conditional novelty 5.0 of 10

    ROBAD combines a transformer encoder-decoder with contrastive adversarial training to detect bad actors from user post sequences, achieving higher F1 and lower F1 drop under next-post attacks than baselines.

  4. AutoTail-BSFGM: Class-Balance-Aware Fine-Tuning for Chinese Scholarly Text Classification

    cs.CL 2026-06 unverdicted novelty 4.0 of 10

    AutoTail-BSFGM combines gated tail-prior adjustment, weak balanced softmax auxiliary loss, and FGM regularization to improve class-balance-aware performance on Chinese scholarly abstract and title classification, with...

  5. OneSearch-V2: The Latent Reasoning Enhanced Self-distillation Generative Search Framework

    cs.IR 2026-03 unverdicted novelty 4.0 of 10

    OneSearch-V2 improves generative retrieval via latent reasoning and self-distillation, achieving +3.98% item CTR, +2.07% buyer volume, and +2.11% order volume in online A/B tests.

  6. Unifying Adversarial Perturbation for Graph Neural Networks

    cs.LG 2025-08 reject novelty 3.0 of 10

    Adding perturbations directly to every hidden embedding of a GNN is claimed to subsume existing feature-, edge-, and weight-perturbation defenses, but the claim rests on simplifications that the experiments do not act...

Pith tools