Pith. sign in

REVIEW 8 cited by

Operationalizing Contextual Integrity in Privacy-Conscious Assistants

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2408.02373 v2 pith:6BSF46MY submitted 2024-08-05 cs.AI

Operationalizing Contextual Integrity in Privacy-Conscious Assistants

classification cs.AI
keywords assistantsinformationprivacyaccesscontextualfrontierinformation-sharingintegrity
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
Share X Bluesky LinkedIn Reddit HN
read the original abstract

Advanced AI assistants combine frontier LLMs and tool access to autonomously perform complex tasks on behalf of users. While the helpfulness of such assistants can increase dramatically with access to user information including emails and documents, this raises privacy concerns about assistants sharing inappropriate information with third parties without user supervision. To steer information-sharing assistants to behave in accordance with privacy expectations, we propose to operationalize contextual integrity (CI), a framework that equates privacy with the appropriate flow of information in a given context. In particular, we design and evaluate a number of strategies to steer assistants' information-sharing actions to be CI compliant. Our evaluation is based on a novel form filling benchmark composed of human annotations of common webform applications, and it reveals that prompting frontier LLMs to perform CI-based reasoning yields strong results.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 8 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Whose Side Is Your Agent On? Multi-Party Principal Loyalty in LLM Agents

    cs.AI 2026-06 unverdicted novelty 7.0

    PrincipalBench exposes a sharp split in frontier LLMs between selective and over-refusing behavior on multi-party loyalty, with prompt scaffolding and KL distillation reducing harm rates but only along an existing lea...

  2. Remembering More, Risking More: Longitudinal Safety Risks in Memory-Equipped LLM Agents

    cs.AI 2026-05 unverdicted novelty 6.0

    Memory-equipped LLM agents exhibit increasing safety violation rates as memory accumulates across independent tasks, termed temporal memory contamination, detected via a new trigger-probe protocol.

  3. PrivScope: Task-scoped Disclosure Control for Hybrid Agentic Systems

    cs.CR 2026-05 unverdicted novelty 6.0

    PrivScope enforces task-scoped disclosure at the local-cloud boundary in hybrid agents, eliminating profile leakage and halving re-identification risk on medical workflows while preserving task success.

  4. NeuroFilter: Activation-Based Guardrails for Privacy-Conscious LLM Agents

    cs.CR 2026-01 conditional novelty 6.0

    Private-information-extraction intent can be detected by a linear probe on LLM activations, including via a new 'activation velocity' signal for multi-turn attacks.

  5. CaMeLs Can Use Computers Too: System-level Security for Computer Use Agents

    cs.AI 2026-01 conditional novelty 6.0

    Computer-use agents can run under Dual-LLM isolation with single-shot branching plans, preserving partial utility while blocking instruction injection, but remain open to branch-steering attacks.

  6. Agents That Know Too Much: A Data-Centric Survey of Privacy in LLM Agents

    cs.CR 2026-06 unverdicted novelty 5.0

    A data-centric survey finds that only information-flow control covers compositional and cross-session leakage in LLM agents and that no single benchmark tests an agent across all its data surfaces under one policy.

  7. It Takes Two: Complementary Self-Distillation for Contextual Integrity in LLMs

    cs.LG 2026-05 unverdicted novelty 4.0

    SELFCI uses complementary self-distillation with two reverse KL divergences to align LLMs to contextual integrity while preserving utility, outperforming RL baselines like GRPO in agentic settings.

  8. Towards trustworthy agentic AI: a comprehensive survey of safety, robustness, privacy, and system security

    cs.AI 2026-05 unverdicted novelty 2.0

    A survey that maps risks along the agent workflow and consolidates metrics and benchmarks for safety, robustness, privacy, and security in agentic AI.