Pith. sign in

REVIEW 1 cited by

BeamClean: Language Aware Embedding Reconstruction

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2505.13758 v1 pith:L5CMHKT2 submitted 2025-05-19 cs.CR

classification cs.CR
keywords beamcleanlanguagemodelattackembeddingembeddingsinversionobfuscated
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

In this work, we consider an inversion attack on the obfuscated input embeddings sent to a language model on a server, where the adversary has no access to the language model or the obfuscation mechanism and sees only the obfuscated embeddings along with the model's embedding table. We propose BeamClean, an inversion attack that jointly estimates the noise parameters and decodes token sequences by integrating a language-model prior. Against Laplacian and Gaussian obfuscation mechanisms, BeamClean always surpasses naive distance-based attacks. This work highlights the necessity for and robustness of more advanced learned, input-dependent methods.

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Learning Obfuscations Of LLM Embedding Sequences: Stained Glass Transform

    cs.LG 2025-06 conditional novelty 6.0 of 10

    A learned stochastic embedding obfuscator, the Stained Glass Transform, is claimed to reduce mutual information between prompts and their server-side representations while preserving LLM utility.

Pith tools