The Agentic Web Requires New Normative Infrastructure
Pith reviewed 2026-06-27 11:53 UTC · model grok-4.3
The pith
The agentic web needs new laws, norms, and practices to let user-delegated AI agents access online properties without being treated as malicious bots.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The agentic web is technically feasible but obstructed by laws, terms of service, and practices that fail to separate malicious bots from AI agents acting with express delegated authority of a user. Realizing its benefits therefore requires normative infrastructure consisting of a broadly-accepted and socially-beneficial set of laws, norms, and practices governing agentic access to online properties, built through a society-wide conversation that identifies guiding principles and advocates enabling policies.
What carries the argument
Normative infrastructure: the set of laws, norms, and practices that distinguish authorized user-delegated agents from malicious bots and permit appropriate online access.
If this is right
- Delegated agents could perform more online tasks on users' behalf without secret blocking by platforms.
- Platforms would adopt practices and policies that allow legitimate agent access alongside other interests.
- Consumer benefits such as efficient service interactions and reduced friction would become available.
- A society-wide discussion would establish principles for governing agent behavior and access rights.
- Policies would emerge that minimize curbs on agents while addressing legitimate platform concerns.
Where Pith is reading between the lines
- New technical standards for verifying delegated authority could emerge as a practical requirement.
- Tensions between agent access and existing anti-bot security systems would need explicit resolution.
- Cross-border operation of agents might require harmonized international norms beyond single jurisdictions.
- User consent mechanisms for delegation could become a focal point for liability and accountability rules.
Load-bearing premise
That the primary obstruction to agent benefits is the lack of distinction in current laws and practices between malicious bots and authorized agents, rather than technical or security concerns.
What would settle it
A clear demonstration that platforms continue to block or degrade agent access at the same rates even after legal distinctions and new norms are adopted, showing security or technical limits as the dominant barrier.
Figures
read the original abstract
The agentic web, in which users interact with the internet largely through agents acting on their behalf, is now technically feasible. However, many of the consumer and social benefits that could be realized by online AI agents acting scrupulously in their principals' interest are currently obstructed by outdated laws, terms of service, and other less formal practices which allow online platforms to block and degrade agent access, often in secret. No distinction is currently drawn between "malicious bots" and AI agents acting with the express delegated authority of a user. For the agentic web to realize its promise, it needs not only the technical infrastructure of protocols and interfaces, but the normative infrastructure of a broadly-accepted and socially-beneficial set of laws, norms and practices governing agentic access to online properties. Building that normative infrastructure requires a society-wide conversation. This paper aims to help precipitate that conversation, to identify normative principles that can guide it, and to advocate for policies that enable users' appropriately delegated agents to act online on their behalf, with as few curbs on their doing so as is reasonable given the other legitimate interests at stake.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper claims that the technically feasible agentic web—where users interact online primarily through AI agents acting on their behalf—is obstructed from realizing consumer and social benefits by outdated laws, terms of service, and informal practices that fail to distinguish malicious bots from agents operating with explicit user-delegated authority. It argues that realizing the agentic web's promise requires not only technical protocols but also new normative infrastructure of broadly accepted laws, norms, and practices, and positions the manuscript as a contribution to initiating the necessary society-wide conversation to identify guiding principles and advocate enabling policies while balancing other legitimate interests.
Significance. If the central position holds, the paper could help frame an important policy discussion at the intersection of AI deployment, web access controls, and user autonomy. It explicitly acknowledges competing interests and frames its contribution as starting rather than concluding a debate, which aligns with the needs of the cs.CY community for thoughtful normative analysis.
major comments (1)
- [Abstract] Abstract: The factual premise that 'No distinction is currently drawn between "malicious bots" and AI agents acting with the express delegated authority of a user' and that outdated laws/practices are the primary obstruction is presented without citations, examples from specific platforms or jurisdictions, or analysis of existing mechanisms (e.g., robots.txt extensions, API authentication, or emerging agent standards). This premise is load-bearing for the claim that new normative infrastructure is required.
Simulated Author's Rebuttal
We thank the referee for their constructive feedback, which highlights an opportunity to strengthen the presentation of our core premise. We address the single major comment below and confirm that revisions will be incorporated in the next version of the manuscript.
read point-by-point responses
-
Referee: [Abstract] Abstract: The factual premise that 'No distinction is currently drawn between "malicious bots" and AI agents acting with the express delegated authority of a user' and that outdated laws/practices are the primary obstruction is presented without citations, examples from specific platforms or jurisdictions, or analysis of existing mechanisms (e.g., robots.txt extensions, API authentication, or emerging agent standards). This premise is load-bearing for the claim that new normative infrastructure is required.
Authors: We agree that the abstract states the premise at a high level without supporting citations or concrete examples, which limits its standalone strength. The body of the manuscript analyzes current practices, including the application of robots.txt, rate limiting, CAPTCHA challenges, and API terms that do not accommodate explicit user delegation. To address the concern directly, we will revise the abstract to incorporate brief, specific examples of platforms and mechanisms (e.g., references to social media API restrictions and the absence of delegation verification in existing access controls) while preserving brevity. This change will better ground the load-bearing claim without altering the paper's normative focus. revision: yes
Circularity Check
No significant circularity identified
full rationale
The paper is a normative policy advocacy piece calling for societal conversation on laws and practices for AI agents. It contains no equations, derivations, models, or technical claims that could reduce to inputs by construction. The central argument rests on stated observations about current practices and a recommendation to distinguish authorized agents from bots; no self-definitional steps, fitted predictions, or load-bearing self-citation chains appear. The text explicitly positions its contribution as starting discussion rather than asserting a closed empirical or mathematical result.
Axiom & Free-Parameter Ledger
axioms (2)
- domain assumption Current laws, terms of service, and practices do not distinguish between malicious bots and user-delegated AI agents.
- domain assumption The agentic web is now technically feasible.
Reference graph
Works this paper leans on
-
[1]
Kapoor, Sayash and Kolt, Noam and Lazar, Seth , month = jun, year =. Build. doi:10.48550/arXiv.2505.04345 , abstract =
-
[2]
Wu, Tim , month = jun, year =. Network. doi:10.2139/ssrn.388863 , abstract =
-
[4]
Hadfield, and Markus Anderljung
Chan, Alan and Wei, Kevin and Huang, Sihao and Rajkumar, Nitarshan and Perrier, Elija and Lazar, Seth and Hadfield, Gillian K. and Anderljung, Markus , month = jun, year =. Infrastructure for. doi:10.48550/arXiv.2501.10114 , abstract =
-
[5]
Regulating advanced artificial agents , volume =. Science , author =. 2024 , pages =. doi:10.1126/science.adl0625 , abstract =
-
[6]
SSRN Electronic Journal , author =
Between. SSRN Electronic Journal , author =. 2024 , file =. doi:10.2139/ssrn.4994390 , language =
-
[7]
Dafoe, Allan and Hughes, Edward and Bachrach, Yoram and Collins, Tantum and McKee, Kevin R. and Leibo, Joel Z. and Larson, Kate and Graepel, Thore , month = dec, year =. Open. doi:10.48550/arXiv.2012.08630 , abstract =
-
[8]
Gabriel, Iason and Manzini, Arianna and Keeling, Geoff and Hendricks, Lisa Anne and Rieser, Verena and Iqbal, Hasan and Tomašev, Nenad and Ktena, Ira and Kenton, Zachary and Rodriguez, Mikel and El-Sayed, Seliem and Brown, Sasha and Akbulut, Canfer and Trask, Andrew and Hughes, Edward and Bergman, A. Stevie and Shelby, Renee and Marchal, Nahema and Griffi...
-
[9]
Harvard Journal of Law & Technology , author =
Algorithmic. Harvard Journal of Law & Technology , author =. 2017 , file =
2017
-
[10]
Coastal wave refraction in variable currents over a varying bathymetry , url =
Halsne, Trygve and Li, Yan , month = jan, year =. Coastal wave refraction in variable currents over a varying bathymetry , url =. doi:10.48550/arXiv.2501.07132 , abstract =
-
[11]
Gupta, Ritwik and Walker, Leah and Corona, Rodolfo and Fu, Stephanie and Petryk, Suzanne and Napolitano, Janet and Darrell, Trevor and Reddie, Andrew W. , month = sep, year =. Data-. doi:10.48550/arXiv.2409.17216 , abstract =
-
[12]
Hammond, Lewis and Chan, Alan and Clifton, Jesse and Hoelscher-Obermaier, Jason and Khan, Akbir and McLean, Euan and Smith, Chandler and Barfuss, Wolfram and Foerster, Jakob and Gavenčiak, Tomáš and Han, The Anh and Hughes, Edward and Kovařík, Vojtěch and Kulveit, Jan and Leibo, Joel Z. and Oesterheld, Caspar and Witt, Christian Schroeder de and Shah, Nis...
-
[13]
Jakesch, Maurice and Bhat, Advait and Buschek, Daniel and Zalmanson, Lior and Naaman, Mor , month = apr, year =. Co-. Proceedings of the 2023. doi:10.1145/3544548.3581196 , abstract =
-
[14]
and Liang, Percy and Narayanan, Arvind , month = feb, year =
Kapoor, Sayash and Bommasani, Rishi and Klyman, Kevin and Longpre, Shayne and Ramaswami, Ashwin and Cihon, Peter and Hopkins, Aspen and Bankston, Kevin and Biderman, Stella and Bogen, Miranda and Chowdhury, Rumman and Engler, Alex and Henderson, Peter and Jernite, Yacine and Lazar, Seth and Maffulli, Stefano and Nelson, Alondra and Pineau, Joelle and Skow...
-
[15]
and Nadgir, Nitya and Narayanan, Arvind , month = jul, year =
Kapoor, Sayash and Stroebl, Benedikt and Siegel, Zachary S. and Nadgir, Nitya and Narayanan, Arvind , month = jul, year =. doi:10.48550/arXiv.2407.01502 , abstract =
-
[17]
Lessons from complexity theory for
Kolt, Noam and Shur-Ofry, Michal and Cohen, Reuven , month = mar, year =. Lessons from complexity theory for. doi:10.48550/arXiv.2502.00012 , abstract =
-
[18]
Lazar, Seth , file =
-
[19]
Lazar, Seth and Thorburn, Luke and Jin, Tian and Belli, Luca , year =. Large. doi:10.48550/ARXIV.2410.12123 , abstract =
-
[20]
Marro, Samuele and Malfa, Emanuele La and Wright, Jesse and Li, Guohao and Shadbolt, Nigel and Wooldridge, Michael and Torr, Philip , month = oct, year =. A. doi:10.48550/arXiv.2410.11905 , abstract =
-
[21]
Mitchell, Margaret and Ghosh, Avijit and Luccioni, Alexandra Sasha and Pistilli, Giada , month = oct, year =. Fully. doi:10.48550/arXiv.2502.02649 , abstract =
-
[22]
SSRN Electronic Journal , author =
An. SSRN Electronic Journal , author =. 2023 , file =. doi:10.2139/ssrn.4597080 , language =
-
[23]
Uncommon
Reid, Blake E , year =. Uncommon
-
[24]
Riedl, Mark O and Desai, Deven R , file =
-
[25]
Practices for
Shavit, Yonadav and Agarwal, Sandhini and Brundage, Miles and Adler, Steven and O’Keefe, Cullen and Campbell, Rosie and Lee, Teddy and Mishkin, Pamela and Eloundou, Tyna and Hickey, Alan and Slama, Katarina and Ahmad, Lama and McMillan, Paul and Beutel, Alex and Passos, Alexandre and Robinson, David G , year =. Practices for
-
[26]
Authenticated
South, Tobin and Marro, Samuele and Hardjono, Thomas and Mahari, Robert and Whitney, Cedric Deslandes and Greenwood, Dazza and Chan, Alan and Pentland, Alex , file =. Authenticated
-
[27]
SSRN Electronic Journal , author =
Online. SSRN Electronic Journal , author =. 2018 , file =. doi:10.2139/ssrn.3306006 , language =
-
[28]
Tur, Ada Defne and Meade, Nicholas and Lù, Xing Han and Zambrano, Alejandra and Patel, Arkil and Durmus, Esin and Gella, Spandana and Stańczak, Karolina and Reddy, Siva , file =
-
[29]
and Nadhamuni, Srikanth and Rozenshtein, Alan Z
Adler, Steven and Hitzig, Zoë and Jain, Shrey and Brewer, Catherine and Chang, Wayne and DiResta, Renée and Lazzarin, Eddy and McGregor, Sean and Seltzer, Wendy and Siddarth, Divya and Soliman, Nouran and South, Tobin and Spelliscy, Connor and Sporny, Manu and Srivastava, Varya and Bailey, John and Christian, Brian and Critch, Andrew and Falcon, Ronnie an...
-
[30]
IEEE Transactions on Technology and Society , author =. 2020 , pages =. doi:10.1109/TTS.2020.3013490 , abstract =
-
[31]
AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents
Andriushchenko, Maksym and Souly, Alexandra and Dziemian, Mateusz and Duenas, Derek and Lin, Maxwell and Wang, Justin and Hendrycks, Dan and Zou, Andy and Kolter, Zico and Fredrikson, Matt and Winsor, Eric and Wynne, Jerome and Gal, Yarin and Davies, Xander , month = apr, year =. doi:10.48550/arXiv.2410.09024 , abstract =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2410.09024
-
[32]
Information
Balkin, Jack M , file =. Information
-
[33]
Canadian Journal of Philosophy , author =
What’s. Canadian Journal of Philosophy , author =. 2022 , pages =. doi:10.1017/can.2021.23 , abstract =
-
[34]
Benthall, Sebastian and Shekman, David , month = jul, year =. Designing. doi:10.48550/arXiv.2308.02435 , abstract =
-
[35]
Carroll, Micah and Chan, Alan and Ashton, Henry and Krueger, David , month = oct, year =. Characterizing. doi:10.48550/arXiv.2303.09387 , abstract =
-
[36]
Casper, Stephen and Bailey, Luke and Hunter, Rosco and Ezell, Carson and Cabalé, Emma and Gerovitch, Michael and Slocum, Stewart and Wei, Kevin and Jurkovic, Nikola and Khan, Ariba and Christoffersen, Phillip J. K. and Ozisik, A. Pinar and Trivedi, Rakshit and Hadfield-Menell, Dylan and Kolt, Noam , month = feb, year =. The. doi:10.48550/arXiv.2502.01635 ...
-
[37]
Chaffer, Tomer Jordi and Goins, Charles von and Okusanya, Bayo and Cotlage, Dontrail and Goldston, Justin , month = jan, year =. Decentralized. doi:10.48550/arXiv.2412.17114 , abstract =
-
[38]
Chan, Alan and Salganik, Rebecca and Markelius, Alva and Pang, Chris and Rajkumar, Nitarshan and Krasheninnikov, Dmitrii and Langosco, Lauro and He, Zhonghao and Duan, Yawen and Carroll, Micah and Lin, Michelle and Mayhew, Alex and Collins, Katherine and Molamohammadi, Maryam and Burden, John and Zhao, Wanru and Rismani, Shalaleh and Voudouris, Konstantin...
-
[40]
the yale law journal , author =
Amazon’s. the yale law journal , author =. 2017 , file =
2017
-
[41]
Khan, Lina M and Pozen, David E , file =. A
-
[42]
doi:10.48550/arXiv.2406.12137 , abstract =
Chan, Alan and Kolt, Noam and Wills, Peter and Anwar, Usman and Witt, Christian Schroeder de and Rajkumar, Nitarshan and Hammond, Lewis and Krueger, David and Heim, Lennart and Anderljung, Markus , month = oct, year =. doi:10.48550/arXiv.2406.12137 , abstract =
-
[43]
Concentrating. 2024 , file =. doi:10.36687/inetwp228 , abstract =
-
[44]
arXiv preprint arXiv:2510.16853 , year=
Agentic Inequality , author=. arXiv preprint arXiv:2510.16853 , year=
-
[45]
Platforms are not intermediaries , author=. Geo. L. Tech. Rev. , volume=. 2017 , publisher=
2017
-
[46]
Communicative
Lazar, Seth , file =. Communicative
-
[47]
Frontier
Lazar, Seth , year = 2024, file =. Frontier
2024
-
[48]
The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearning
Li, Nathaniel and Pan, Alexander and Gopal, Anjali and Yue, Summer and Berrios, Daniel and Gatti, Alice and Li, Justin D. and Dombrowski, Ann-Kathrin and Goel, Shashwat and Phan, Long and Mukobi, Gabriel and Helm-Burger, Nathan and Lababidi, Rassin and Justen, Lennart and Liu, Andrew B. and Chen, Michael and Barrass, Isabelle and Zhang, Oliver and Zhu, Xi...
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2403.03218
-
[49]
Ngo, Richard and Chan, Lawrence and Mindermann, Sören , month = may, year =. The. doi:10.48550/arXiv.2209.00626 , abstract =
-
[50]
Marro, Samuele and Chan, Alan and Ren, Xinxing and Hammond, Lewis and Wright, Jesse and Wanga, Gurjyot and Piccardi, Tiziano and Campos, Nuno and South, Tobin and Yu, Jialin and Sengupta, Sunando and Sommerlade, Eric and Pentland, Alex and Torr, Philip and Pei, Jiaxin , year =. Permission. doi:10.48550/ARXIV.2601.02371 , abstract =
-
[51]
Rahaman, Nasim and Weiss, Martin and Wüthrich, Manuel and Bengio, Yoshua and Li, Li Erran and Pal, Chris and Schölkopf, Bernhard , month = mar, year =. Language. doi:10.48550/arXiv.2403.14443 , abstract =
-
[52]
Protocols,
Masnick, Mike , year =. Protocols,
-
[53]
The New Yorker , author =
Silicon. The New Yorker , author =. 2024 , note =
2024
-
[54]
2025 , file =
Amazon.com. 2025 , file =
2025
-
[55]
Boilerplate:
Radin, Margaret Jane , year =. Boilerplate:
-
[56]
Zuboff, Professor Shoshana , year =. The
-
[57]
Kim, Taein and Bock, Karstan and Luo, Claire and Liswood, Amanda and Poroslay, Chloe and Wenger, Emily , month = oct, year =. Scrapers selectively respect robots.txt directives: evidence from a large-scale empirical study , shorttitle =. doi:10.48550/arXiv.2505.21733 , abstract =
-
[58]
REALM: Retrieval-Augmented Language Model Pre-Training
Guu, Kelvin and Lee, Kenton and Tung, Zora and Pasupat, Panupong and Chang, Ming-Wei , month = feb, year =. doi:10.48550/arXiv.2002.08909 , abstract =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2002.08909 2002
-
[59]
Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering
Izacard, Gautier and Grave, Edouard , month = feb, year =. Leveraging. doi:10.48550/arXiv.2007.01282 , abstract =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2007.01282 2007
-
[60]
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Lewis, Patrick and Perez, Ethan and Piktus, Aleksandra and Petroni, Fabio and Karpukhin, Vladimir and Goyal, Naman and Küttler, Heinrich and Lewis, Mike and Yih, Wen-tau and Rocktäschel, Tim and Riedel, Sebastian and Kiela, Douwe , month = apr, year =. Retrieval-. doi:10.48550/arXiv.2005.11401 , abstract =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2005.11401 2005
-
[61]
The Cloudflare Blog , author =
From. The Cloudflare Blog , author =
-
[62]
Symbols of One-Loop Integrals From Mixed Tate Motives
Plesner, Andreas and Vontobel, Tobias and Wattenhofer, Roger , month = jul, year =. Breaking. 2024. doi:10.1109/COMPSAC61105.2024.00142 , abstract =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.1109/compsac61105.2024.00142 2024
-
[63]
DataDome , author =
2025. DataDome , author =
2025
-
[64]
WhatsApp.com , author =
-
[65]
The Cloudflare Blog , author =
Trapping misbehaving bots in an. The Cloudflare Blog , author =
-
[66]
Lazar, Seth , month = oct, year =. Lecture. doi:10.48550/arXiv.2410.20718 , abstract =
-
[69]
LLM Agents Are the Antidote to Walled Gardens
Marro, Samuele and Torr, Philip , month = jun, year =. doi:10.48550/arXiv.2506.23978 , abstract =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2506.23978
-
[70]
South, Tobin and Marro, Samuele and Hardjono, Thomas and Mahari, Robert and Whitney, Cedric Deslandes and Greenwood, Dazza and Chan, Alan and Pentland, Alex , month = jan, year =. Authenticated. doi:10.48550/arXiv.2501.09674 , abstract =
-
[71]
Taylor, Isaac , month = jun, year =. Representative. Free & Equal: A Journal of Ethics and Public Affairs , publisher =. doi:10.16995/fe.18626 , abstract =
-
[72]
Federal Trade Commission , author =
National Automobile Dealers Association; Texas Automobile Dealers Association v. Federal Trade Commission , author =. 2025 , month = jan, note =
2025
-
[73]
Verizon Communications, Inc. v. Law Offices of Curtis V. Trinko, LLP , author =. 2004 , note =
2004
-
[74]
Custom Communications, Inc. v. Federal Trade Commission , author =. 2025 , month = jul, note =
2025
-
[75]
Aspen Skiing Co. v. Aspen Highlands Skiing Corp. , author =. 1985 , note =
1985
-
[76]
, author =
In the Matter of Cliffdale Associates, Inc., et al. , author =. 1984 , note =
1984
-
[77]
Orkin Exterminating Company, Inc. v. Federal Trade Commission , author =. 1988 , month = jul, note =
1988
-
[79]
Journal of Economic Perspectives , author =
Systems. Journal of Economic Perspectives , author =. 1994 , pages =. doi:10.1257/jep.8.2.93 , abstract =
-
[80]
Farrell, Joseph and Klemperer, Paul , year =. Chapter 31. Handbook of. doi:10.1016/S1573-448X(06)03031-7 , abstract =
-
[81]
Review of Industrial Organization , author =
Digital. Review of Industrial Organization , author =. 2019 , keywords =. doi:10.1007/s11151-019-09693-7 , abstract =
-
[82]
Concentrating intelligence: scaling and market structure in artificial intelligence* , volume =. Economic Policy , author =. 2025 , pages =. doi:10.1093/epolic/eiae057 , abstract =
-
[83]
1958 , note =
Restatement of the Law, Second: Agency 2d , volume =. 1958 , note =
1958
-
[84]
and Brock, Dan W
Buchanan, Allen E. and Brock, Dan W. , year =. Deciding for others: the ethics of surrogate decision making , isbn =
-
[85]
Legal Alignment for Safe and Ethical AI
Kolt, Noam and Caputo, Nicholas and Boeglin, Jack and O'Keefe, Cullen and Bommasani, Rishi and Casper, Stephen and Cuéllar, Mariano-Florentino and Feldman, Noah and Gabriel, Iason and Hadfield, Gillian K. and Hammond, Lewis and Henderson, Peter and Kasirzadeh, Atoosa and Lazar, Seth and Reuel, Anka and Wei, Kevin L. and Zittrain, Jonathan , month = jan, y...
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2601.04175
-
[86]
Kolt, Noam , month = mar, year =. Superintelligence and. doi:10.48550/arXiv.2603.28669 , abstract =
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.