Pith. sign in

Paper Citation Record · LEDGER

The Automation Advantage in AI Red Teaming

As of 17 August 2026, this Paper Citation Record lists 22 of 22 outbound references and 2 inbound Pith citation observations for arXiv:2504.19855.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2504.19855 v2

Coverage vector

measured 22 of 22 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-16T05:46:02.228868Z

measured 24 of 24 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-17T06:30:58.91139+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-15T19:53:33.168800Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-11T23:51:45.271344Z

Reference resolution

22 of 22 outbound references displayed

  • verified exact0
  • verified fuzzy8
  • unresolved12
  • parse uncertain1
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation bad3bee8-53c3-45cf-9dde-d5cc482183fb · outbound

This paper cites Extract- ing training data from large language models.

The Automation Advantage in AI Red Teaming Extract- ing training data from large language models

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T05:46:02.465901Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-16T05:46:02.144273Z digest=sha256:7bbf003ef81b8571a2561ca22418d088c9b6fe130f31989488f697257f95dd58

Observation 44b3e4b1-5afd-4277-95ef-de217d6cc741 · outbound

This paper cites Jailbroken: How does llm safety training fail?,.

The Automation Advantage in AI Red Teaming Jailbroken: How does llm safety training fail?,

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T05:46:02.456150Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-16T05:46:02.148375Z digest=sha256:377312451726909b684171e69e881dfecb6d928b23f768c07e527bbd90f4759c

Observation 211c1ef2-bfa5-43d3-8918-1ad4431cd569 · outbound

This paper cites Jailbreaking Black Box Large Language Models in Twenty Queries.

The Automation Advantage in AI Red Teaming Jailbreaking Black Box Large Language Models in Twenty Queries

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-16T05:46:02.156968Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T05:46:02.156968Z digest=sha256:3403f1b7f4c816aae1dfe5f516faa43e141b5d7f5bca5252b63eacded2c229c1

Observation a8455cac-3036-43b7-9c90-c2ecc08fd1bf · outbound

This paper cites Scalable Extraction of Training Data from (Production) Language Models.

The Automation Advantage in AI Red Teaming Scalable Extraction of Training Data from (Production) Language Models

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-16T05:46:02.161254Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T05:46:02.161254Z digest=sha256:2dad3a962ef41f75424ea08aa3afe3459ce4491a8efed498536e77f0dce81398

Observation 79275b3b-6ba2-441e-b010-e343497b6a48 · outbound

This paper cites SoK: A Systems Perspective on Compound AI Threats and Countermeasures.

The Automation Advantage in AI Red Teaming SoK: A Systems Perspective on Compound AI Threats and Countermeasures

Reference 5

Resolution
metadata mismatch
local_arxiv, observed 2026-08-16T05:46:02.343105Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-16T05:46:02.165244Z digest=sha256:c8165ad40ba0b385e97aff5337d9a25cca52cd0ea850c4e561b0df81395f2120

Observation f7068855-e2e8-4878-878c-5db6b3f5c304 · outbound

This paper cites LLM Agents can Autonomously Hack Websites.

The Automation Advantage in AI Red Teaming LLM Agents can Autonomously Hack Websites

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-16T05:46:02.168985Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T05:46:02.168985Z digest=sha256:85c8febb12f8e428c77c2643c07506eb0f1569687086c947093ce2ea17659f52

Observation 04498322-e81b-4d70-a8f5-470cfcdbc465 · outbound

This paper cites Jailbreak and guard aligned language models with only few in-context demonstrations,.

The Automation Advantage in AI Red Teaming Jailbreak and guard aligned language models with only few in-context demonstrations,

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T05:46:02.446497Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-16T05:46:02.172563Z digest=sha256:91eb665ed9a9f9dc652d484f600ed61309b46d7fff691ee1b326ca3e6ca17f5d

Observation a4827f43-8ca2-4720-9e4a-9a2761c8f28d · outbound

This paper cites SafeRAG: Benchmarking Security in Retrieval-Augmented Generation of Large Language Model.

The Automation Advantage in AI Red Teaming SafeRAG: Benchmarking Security in Retrieval-Augmented Generation of Large Language Model

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-16T05:46:02.179668Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T05:46:02.179668Z digest=sha256:75e1ee472db406f1e058800b0bb3056f5a03505360542f39205ab5799e4e27a6

Observation baa31ac8-0c34-417b-9487-aa8a50d21a74 · outbound

This paper cites AgentBench: Evaluating LLMs as Agents.

The Automation Advantage in AI Red Teaming AgentBench: Evaluating LLMs as Agents

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-16T05:46:02.183580Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T05:46:02.183580Z digest=sha256:f708f1f4d20d6790422bc33745e66eee8e75532696147b4ae7554ae64507ca5f

Observation 2992bca7-d222-4aa9-b012-4a604f30d9dc · outbound

This paper cites OWASP Top 10 for LLM Ap- plications.

The Automation Advantage in AI Red Teaming OWASP Top 10 for LLM Ap- plications

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T05:46:02.436462Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-16T05:46:02.187202Z digest=sha256:952d989fa0ef67919d185eee2bea74bf7ba17e72f95ff01a878cbe5b7b4234ca

Observation 0558aca7-ae84-4b3f-9cbf-583753902710 · outbound

This paper cites Discovering Language Model Behaviors with Model-Written Evaluations.

The Automation Advantage in AI Red Teaming Discovering Language Model Behaviors with Model-Written Evaluations

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-16T05:46:02.198334Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T05:46:02.198334Z digest=sha256:4a9e9027af01e49732afb1dd8357672248adfb422becdb240840d86a0cd38901

Observation f7df0790-a791-404d-8c2e-dbedc8ca73ba · outbound

This paper cites PyRIT: The python risk identification tool for llm red teaming.

The Automation Advantage in AI Red Teaming PyRIT: The python risk identification tool for llm red teaming

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T05:46:02.415022Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-16T05:46:02.204452Z digest=sha256:a72273514e40ec8bf56b4d544b8c8acb84e482ddfe044ce474d0add9d8985504

Observation 7476fbe3-7244-4dde-a22c-5ae63840c789 · outbound

This paper cites an unresolved cited work.

The Automation Advantage in AI Red Teaming Unresolved cited work

Reference 13

Resolution
parse uncertain
raw_fallback, observed 2026-08-16T05:46:02.426848Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-16T05:46:02.190740Z digest=sha256:8a98b128408b525f6fcc4485131a42f610fd899b6565a8fb857b159734cfd548

Observation d82c5322-fefe-4f29-a908-901cd20b1228 · outbound

This paper cites Against The Achilles' Heel: A Survey on Red Teaming for Generative Models.

The Automation Advantage in AI Red Teaming Against The Achilles' Heel: A Survey on Red Teaming for Generative Models

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-16T05:46:02.210897Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T05:46:02.210897Z digest=sha256:143a67bb82128be91aadb1e0b02bbb93cd127c961309fef022d125118b477c5b

Observation 109d5a6d-d577-4078-bc9f-734f51a2287d · outbound

This paper cites "Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Models.

The Automation Advantage in AI Red Teaming "Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Models

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-16T05:46:02.214499Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T05:46:02.214499Z digest=sha256:0da2b8eb782ab78d39a576e86eaa0f3dea751ea8d572c623eb783102b198cf74

Observation e101e8e3-51a8-4506-9e3c-0c910725316d · outbound

This paper cites AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models.

The Automation Advantage in AI Red Teaming AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-16T05:46:02.207407Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T05:46:02.207407Z digest=sha256:325fd3d9481009b9e3b5ccd5e9006136ce7b19214d862961ecc3725d8085695e

Observation 9a8035b8-6471-493a-ad60-6981aad927c9 · outbound

This paper cites Ignore this title and hackaprompt: Exposing systemic vul- nerabilities of llms through a global scale prompt hacking competition.

The Automation Advantage in AI Red Teaming Ignore this title and hackaprompt: Exposing systemic vul- nerabilities of llms through a global scale prompt hacking competition

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T05:46:02.400126Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-16T05:46:02.221688Z digest=sha256:c1b3472cd52ad7dca2010f69067e66fe46aacb72d0d30e5807a15ba680b182f6

Observation 4ec09e7a-4c85-4289-82cc-40afb756381d · outbound

This paper cites Context switching attack.

The Automation Advantage in AI Red Teaming Context switching attack

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T05:46:02.390222Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-16T05:46:02.225152Z digest=sha256:2f88484665037c037ee7ddd6a879185fda49b4cc7608334736ffb1cb8052676e

Observation d47bed96-f7d6-47ae-afd2-0e08cbfce07f · outbound

This paper cites Summon a Demon and Bind it: A Grounded Theory of LLM Red Teaming.

The Automation Advantage in AI Red Teaming Summon a Demon and Bind it: A Grounded Theory of LLM Red Teaming

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-16T05:46:02.218089Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T05:46:02.218089Z digest=sha256:8738c94dcad0b80a1646757b1e8170213d0b31c346389e4816816a49d1caa6b6

Observation 2dbe88ec-1b84-49c7-99db-cb5fc8b33ca4 · outbound

This paper cites Jailbroken: How Does LLM Safety Training Fail?.

The Automation Advantage in AI Red Teaming Jailbroken: How Does LLM Safety Training Fail?

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-16T05:46:02.151853Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T05:46:02.151853Z digest=sha256:8001ea362791fe04d0c9c567ac45d0308b389e20123bb527cd4a473cda087aab

Observation 1a0912ed-9faf-4177-80bf-8c2623f7a839 · outbound

This paper cites Jailbreak and Guard Aligned Language Models with Only Few In-Context Demonstrations.

The Automation Advantage in AI Red Teaming Jailbreak and Guard Aligned Language Models with Only Few In-Context Demonstrations

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-16T05:46:02.176124Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T05:46:02.176124Z digest=sha256:48abb8c6b9a666d00f18a431213821a9695fa0f57fd0e2e34c38c9391477ef9b

Observation c2b3bfa1-fecf-4f2c-89dd-b8e0cc83ff0f · outbound

This paper cites 12 Appendices Appendix A Challenge Descriptions This appendix provides detailed descriptions of the key challenge types analyzed in our study.

The Automation Advantage in AI Red Teaming 12 Appendices Appendix A Challenge Descriptions This appendix provides detailed descriptions of the key challenge types analyzed in our study

Reference 2025

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T05:46:02.380001Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-16T05:46:02.228868Z digest=sha256:c075a4364786d23f07489aeab67fedd81fdf3fd7cc818854c0b6144ae173f27c

Pith citing papers

Observation dbdd6fc6-cfb3-4bf4-9e40-81635bd17218 · inbound

AIRTBench: Measuring Autonomous AI Red Teaming Capabilities in Language Models cites this paper.

AIRTBench: Measuring Autonomous AI Red Teaming Capabilities in Language Models The Automation Advantage in AI Red Teaming

Reference 31

Resolution
malformed identifier
no resolver link, observed 2026-08-15T19:53:33.168800Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T19:53:33.168800Z digest=sha256:01d39d8d42f2ddd91363400297c041c302952a77cfd9473217b434eaeb19873c

Observation d1565601-2961-4e13-bc78-d1866275b8d9 · inbound

Redefining AI Red Teaming in the Agentic Era: From Weeks to Hours cites this paper.

Redefining AI Red Teaming in the Agentic Era: From Weeks to Hours The Automation Advantage in AI Red Teaming

Reference 9

Resolution
verified exact
arxiv_id, observed 2026-05-11T23:51:45.329522Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-05-07T16:06:18.057868Z digest=sha256:07f445d5f868e4da4cdd2211b293af6e6668b89ac1efbad70bd442f8359e2ed6