{"paper":{"title":"From Procedures to Permissions: Learning Precise Subagent Authorization from Agent Skills","arxiv_id":"2611.08905","primary_cat":"cs.CL","submitted_at":"2026-11-06T02:46:06+00:00","version_compiled":"v1"},"notice":"Every quoted sentence is the authors' text from the arXiv listing abstract. Labels and probabilities are the outputs of classifier-1.13.0 on the question bank abstract-p1-20260923, exactly as returned. No sentence in this record was written by a language model.","schema":"pith.compiled-record/v0","status":"compiled","abstract":{"source":"arXiv listing abstract v1","sentences":[{"i":0,"p":1.0,"id":"s0","own":false,"role":"background","text":"As language agents tackle increasingly complex tasks, they increasingly rely on multiple agents to coordinate specialized work, requiring decisions not only about what each subagent should do but also which tools and workspace resources it should access.","hedge":{"p":1.0,"label":"asserted"},"own_p":0.07,"main_claim_p":0.02,"quantitative":false,"quantitative_p":0.04,"role_probabilities":{"gap":0.0,"method":0.0,"result":0.0,"background":1.0,"limitation":0.0,"future_work":0.0,"contribution":0.0,"interpretation":0.0}},{"i":1,"p":0.84,"id":"s1","own":false,"role":"gap","text":"Existing agent systems provide mechanisms for controlling tools and execution environments, but do not directly specify the resources required by each delegated subtask.","hedge":{"p":1.0,"label":"asserted"},"own_p":0.05,"main_claim_p":0.02,"quantitative":false,"quantitative_p":0.04,"role_probabilities":{"gap":0.84,"method":0.0,"result":0.0,"background":0.16,"limitation":0.0,"future_work":0.0,"contribution":0.0,"interpretation":0.0}},{"i":2,"p":0.93,"id":"s2","own":false,"role":"gap","text":"Moreover, task outcomes and execution trajectories alone provide limited supervision for determining whether a subagent has received appropriate permissions.","hedge":{"p":0.93,"label":"asserted"},"own_p":0.16,"main_claim_p":0.03,"quantitative":false,"quantitative_p":0.06,"role_probabilities":{"gap":0.93,"method":0.0,"result":0.0,"background":0.07,"limitation":0.0,"future_work":0.0,"contribution":0.0,"interpretation":0.0}},{"i":3,"p":0.26,"id":"s3","own":true,"role":"background","text":"We observe that Agent Skills encode procedural knowledge describing the operations, tools, and files required at each step, providing a natural source of supervision for authorization.","hedge":{"p":0.98,"label":"asserted"},"own_p":0.73,"main_claim_p":0.11,"quantitative":false,"quantitative_p":0.03,"role_probabilities":{"gap":0.06,"method":0.11,"result":0.25,"background":0.26,"limitation":0.0,"future_work":0.0,"contribution":0.25,"interpretation":0.07}},{"i":4,"p":0.97,"id":"s4","own":true,"role":"method","text":"Building on this observation, we synthesize tasks and step-by-step procedures from Skills, execute them through subagent delegation in interactive environments, and use verified trajectories to construct training data for task execution and authorization.","hedge":{"p":0.97,"label":"asserted"},"own_p":0.97,"main_claim_p":0.07,"quantitative":false,"quantitative_p":0.03,"role_probabilities":{"gap":0.0,"method":0.97,"result":0.0,"background":0.0,"limitation":0.0,"future_work":0.0,"contribution":0.03,"interpretation":0.0}},{"i":5,"p":1.0,"id":"s5","own":true,"role":"result","text":"On ClawArena-Team, our method improves tool permission precision by 13.4 percentage points and workspace permission precision by 24.1 percentage points, while increasing overall task success by 11.6 percentage points for Qwen3.5-35B-A3B.","hedge":{"p":1.0,"label":"asserted"},"own_p":0.96,"main_claim_p":0.12,"quantitative":true,"quantitative_p":0.99,"role_probabilities":{"gap":0.0,"method":0.0,"result":1.0,"background":0.0,"limitation":0.0,"future_work":0.0,"contribution":0.0,"interpretation":0.0}},{"i":6,"p":1.0,"id":"s6","own":true,"role":"result","text":"On Terminal-Bench 2.1 and SkillsBench, our method remains competitive with existing agent data synthesis approaches.","hedge":{"p":0.99,"label":"asserted"},"own_p":0.91,"main_claim_p":0.04,"quantitative":true,"quantitative_p":0.73,"role_probabilities":{"gap":0.0,"method":0.0,"result":1.0,"background":0.0,"limitation":0.0,"future_work":0.0,"contribution":0.0,"interpretation":0.0}},{"i":7,"p":1.0,"id":"s7","own":true,"role":"interpretation","text":"These results show that the procedural knowledge embedded in Agent Skills provides a source of supervision for precise subagent orchestration that task outcomes alone cannot provide.","hedge":{"p":1.0,"label":"asserted"},"own_p":0.88,"main_claim_p":0.9,"quantitative":false,"quantitative_p":0.11,"role_probabilities":{"gap":0.0,"method":0.0,"result":0.0,"background":0.0,"limitation":0.0,"future_work":0.0,"contribution":0.0,"interpretation":1.0}}]},"compiled":{"main_claim":{"p":1.0,"text":"These results show that the procedural knowledge embedded in Agent Skills provides a source of supervision for precise subagent orchestration that task outcomes alone cannot provide.","location":"abstract s7","hedge_strength":{"p":1.0,"label":"asserted"}},"provenance":{"route":{"via":"TypeSafe API","model":"classifier-1.13.0","endpoint":"https://api.typesafe.ai/v1/systemone","provider":"TypeSafe"},"packing":"one request per paper","requests":1,"input_tokens":6362,"cost_usd_reported":0.0},"compiled_at":"2026-11-09","bank_version":"abstract-p1-20260923","model_version":"classifier-1.13.0","abstract_states":{"claims_first":0.07,"states_limitation":0.25,"human_participants":0.04,"controlled_comparison":0.69,"randomized_assignment":0.02,"states_quantitative_result":0.99,"compares_with_prior_results":0.94,"mentions_code_or_data_availability":0.04},"evidential_basis":{"p":0.99,"value":"observation or experiment","probabilities":{"argument":0.0,"literature":0.0,"proof_or_derivation":0.0,"analysis_of_existing_data":0.0,"observation_or_experiment":0.99,"simulation_or_computation":0.01}},"contribution_type":{"p":1.0,"value":"method or tool","probabilities":{"review":0.0,"method_or_tool":1.0,"empirical_study":0.0,"simulation_study":0.0,"theoretical_result":0.0,"dataset_or_benchmark":0.0,"position_or_commentary":0.0}},"contribution_statement":{"p":1.0,"text":"Building on this observation, we synthesize tasks and step-by-step procedures from Skills, execute them through subagent delegation in interactive environments, and use verified trajectories to construct training data for task execution and authorization.","location":"abstract s4"}},"coverage":{"tier":"abstract","levels_run":["P abstract"],"not_examined":["full text","figures and tables","references and citing sentences","relations to other papers"],"sources_read":["arXiv listing abstract v1"],"levels_not_run":["S sections","T body sentences","C citations","R cross-paper relations"],"sentences_examined":8,"sentences_in_abstract":8},"measured_accuracy":{"url":"https://pith.science/accuracy","measured_on":"2026-10-02","method":"two independent model families labelled a fresh random sample blind; the figure is how often the published label matches their consensus","sentence_role_agreement":0.92,"main_claim_agreement":0.908,"typed_citation_agreement":0.933,"typed_citation_agreement_95_interval":[0.917,0.945],"review_comments_accurate":0.758,"review_comments_accurate_95_interval":[0.684,0.82],"review_caught_admitted_error_found_or_related":0.448,"review_comments_judged":{"judged_by":["gpt-5.6-luna","grok-4.7"],"judged_against":"Pith's own text copy of each paper: text extracted from the PDF, the first 90,000 characters","measured_on":"2026-10-04","accurate":113,"decided":149,"sampled_reviews":200,"split_by_lane":false,"by_lane":"https://pith.science/accuracy#by-lane"}}}