Pith. sign in

REVIEW 3 cited by

Question Answering for Privacy Policies: Combining Computational and Legal Perspectives

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1911.00841 v1 pith:NNOEBRCV submitted 2019-11-03 cs.CL

Question Answering for Privacy Policies: Combining Computational and Legal Perspectives

Abhilasha Ravichander , Alan W Black , Shomir Wilson , Thomas Norton , Norman Sadeh This is my paper
classification cs.CL
keywords questionansweringcorpuspoliciesprivacyprivacyqaissueslegal
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

Privacy policies are long and complex documents that are difficult for users to read and understand, and yet, they have legal effects on how user data is collected, managed and used. Ideally, we would like to empower users to inform themselves about issues that matter to them, and enable them to selectively explore those issues. We present PrivacyQA, a corpus consisting of 1750 questions about the privacy policies of mobile applications, and over 3500 expert annotations of relevant answers. We observe that a strong neural baseline underperforms human performance by almost 0.3 F1 on PrivacyQA, suggesting considerable room for improvement for future systems. Further, we use this dataset to shed light on challenges to question answerability, with domain-general implications for any question answering system. The PrivacyQA corpus offers a challenging corpus for question answering, with genuine real-world utility.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Non-vacuous Generalization Bounds for Reinforcement Learning with Verifiable Rewards

    cs.LG 2026-07 reject novelty 6.0

    Non-vacuous PAC-Bayes generalization bounds for billion-parameter RLVR models, obtained by a Gumbel-max reparameterization and aggressive TinyLoRA distillation/quantization, are claimed for four tasks.

  2. Do Privacy Policies Match with the Logs? An Empirical Study of Privacy Disclosure in Android Application Logs

    cs.CR 2026-04 unverdicted novelty 5.0

    Only 0.4% of 1,000 Android apps show consistent alignment between their privacy policies and actual log contents, while 67.6% leak sensitive information not mentioned in policies.

  3. AILQA: Evaluating AI-Driven Legal Question Answering Systems for the Indian Legal System

    cs.CL 2026-07 conditional novelty 4.0

    RAG with top-3 chunk retrieval lifts smaller LLMs on Indian legal QA (Llama2-70B: 45.7% to 51.7% on AIBE) but often hurts large models, and under the study's own rating protocol some AI answers outscored the reference...