PANORAMIA: Privacy Auditing of Machine Learning Models without Retraining

Alireza Akbari; Hadrien Lautraite; Mathias L\'ecuyer; Mauricio Soroco; Mishaal Kazmi; Qiaoyue Tang; S\'ebastien Gambs; Tao Wang

PANORAMIA: Privacy Auditing of Machine Learning Models without Retraining

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2402.09477 v2 pith:HVOKA4M3 submitted 2024-02-12 cs.CR cs.LG

PANORAMIA: Privacy Auditing of Machine Learning Models without Retraining

Mishaal Kazmi , Hadrien Lautraite , Alireza Akbari , Qiaoyue Tang , Mauricio Soroco , Tao Wang , S\'ebastien Gambs , Mathias L\'ecuyer This is my paper

classification cs.CR cs.LG

keywords datapanoramiamodelsprivacytraininggeneratedlearningmachine

verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

0 comments

read the original abstract

We present PANORAMIA, a privacy leakage measurement framework for machine learning models that relies on membership inference attacks using generated data as non-members. By relying on generated non-member data, PANORAMIA eliminates the common dependency of privacy measurement tools on in-distribution non-member data. As a result, PANORAMIA does not modify the model, training data, or training process, and only requires access to a subset of the training data. We evaluate PANORAMIA on ML models for image and tabular data classification, as well as on large-scale language models.

discussion (0)

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

In-Context Probing for Membership Inference in Fine-Tuned Language Models
cs.CR 2025-12 conditional novelty 6.0

ICP-MIA infers membership in fine-tuned LLMs by measuring confidence improvement under in-context probes, beating prior black-box attacks at low false-positive rates.