{"paper":{"title":"Scaling Agentic Data for Long-Horizon Terminal Intelligence","arxiv_id":"2610.13166","primary_cat":"cs.CL","submitted_at":"2026-10-09T07:55:55+00:00","version_compiled":"v1"},"notice":"Every quoted sentence is the authors' text from the arXiv listing abstract. Labels and probabilities are the outputs of classifier-1.13.0 on the question bank abstract-p1-20260923, exactly as returned. No sentence in this record was written by a language model.","schema":"pith.compiled-record/v0","status":"compiled","abstract":{"source":"arXiv listing abstract v1","sentences":[{"i":0,"p":1.0,"id":"s0","own":false,"role":"background","text":"Terminal agents are moving beyond local operations toward completing real-world professional tasks.","hedge":{"p":1.0,"label":"asserted"},"own_p":0.06,"main_claim_p":0.03,"quantitative":false,"quantitative_p":0.11,"role_probabilities":{"gap":0.0,"method":0.0,"result":0.0,"background":1.0,"limitation":0.0,"future_work":0.0,"contribution":0.0,"interpretation":0.0}},{"i":1,"p":0.86,"id":"s1","own":false,"role":"gap","text":"Short trajectories can demonstrate commands and tool calls, but they do not fully show how agents accumulate evidence through exploration, use it to inform judgments, continually adjust strategies based on feedback, and turn intermediate results into final deliverables.","hedge":{"p":1.0,"label":"asserted"},"own_p":0.13,"main_claim_p":0.04,"quantitative":false,"quantitative_p":0.22,"role_probabilities":{"gap":0.86,"method":0.0,"result":0.0,"background":0.14,"limitation":0.0,"future_work":0.0,"contribution":0.0,"interpretation":0.0}},{"i":2,"p":0.89,"id":"s2","own":false,"role":"background","text":"High-quality long-horizon trajectories capture these agentic behavioral patterns and their connections within a single problem-solving process, providing richer experience for sustained autonomous work.","hedge":{"p":1.0,"label":"asserted"},"own_p":0.11,"main_claim_p":0.09,"quantitative":false,"quantitative_p":0.06,"role_probabilities":{"gap":0.05,"method":0.0,"result":0.0,"background":0.89,"limitation":0.0,"future_work":0.0,"contribution":0.01,"interpretation":0.05}},{"i":3,"p":0.71,"id":"s3","own":false,"role":"gap","text":"However, environment synthesis may complete or simplify the key work underlying these patterns in advance and thus remove the need for exploration, implementation, and verification that the agent was meant to perform.","hedge":{"p":1.0,"label":"hedged_possibility"},"own_p":0.08,"main_claim_p":0.03,"quantitative":false,"quantitative_p":0.04,"role_probabilities":{"gap":0.71,"method":0.0,"result":0.0,"background":0.2,"limitation":0.09,"future_work":0.0,"contribution":0.0,"interpretation":0.0}},{"i":4,"p":0.96,"id":"s4","own":true,"role":"contribution","text":"To address this, we introduce TerminalHorizon, a fully automated data synthesis engine for long-horizon terminal agents.","hedge":{"p":1.0,"label":"asserted"},"own_p":0.92,"main_claim_p":0.05,"quantitative":false,"quantitative_p":0.04,"role_probabilities":{"gap":0.0,"method":0.04,"result":0.0,"background":0.0,"limitation":0.0,"future_work":0.0,"contribution":0.96,"interpretation":0.0}},{"i":5,"p":0.99,"id":"s5","own":true,"role":"method","text":"Starting from real-world professional work, it uses independent execution to identify key work omitted during construction and uses the resulting evidence to guide environment reconstruction.","hedge":{"p":1.0,"label":"asserted"},"own_p":0.89,"main_claim_p":0.04,"quantitative":false,"quantitative_p":0.03,"role_probabilities":{"gap":0.0,"method":0.99,"result":0.0,"background":0.0,"limitation":0.0,"future_work":0.0,"contribution":0.01,"interpretation":0.0}},{"i":6,"p":0.99,"id":"s6","own":true,"role":"method","text":"To extend these patterns across stages, it progressively expands tasks under the same goal, introducing new requirements that build on prior results and call for further exploration and improvement.","hedge":{"p":1.0,"label":"asserted"},"own_p":0.83,"main_claim_p":0.05,"quantitative":false,"quantitative_p":0.04,"role_probabilities":{"gap":0.0,"method":0.99,"result":0.0,"background":0.0,"limitation":0.0,"future_work":0.0,"contribution":0.01,"interpretation":0.0}},{"i":7,"p":0.76,"id":"s7","own":true,"role":"method","text":"Using this engine, we construct 1.5K task environments and perform supervised fine-tuning of Qwen3.5-27B on the resulting dataset to obtain TerminalHorizon-27B.","hedge":{"p":1.0,"label":"asserted"},"own_p":0.97,"main_claim_p":0.09,"quantitative":true,"quantitative_p":0.98,"role_probabilities":{"gap":0.0,"method":0.76,"result":0.02,"background":0.0,"limitation":0.0,"future_work":0.0,"contribution":0.22,"interpretation":0.0}},{"i":8,"p":1.0,"id":"s8","own":true,"role":"result","text":"We achieve substantial performance gains on all 12 benchmarks spanning coding-agent tasks, agentic tasks in real-world production settings, and general reasoning.","hedge":{"p":1.0,"label":"asserted"},"own_p":0.96,"main_claim_p":0.51,"quantitative":true,"quantitative_p":0.95,"role_probabilities":{"gap":0.0,"method":0.0,"result":1.0,"background":0.0,"limitation":0.0,"future_work":0.0,"contribution":0.0,"interpretation":0.0}},{"i":9,"p":0.94,"id":"s9","own":true,"role":"result","text":"Multiple RSI case studies, each with a 12-hour research budget, further demonstrate the model's ability to continue experimenting beyond an initial solution, improve its methods based on feedback, and retain effective improvements in its final deliverables.","hedge":{"p":1.0,"label":"asserted"},"own_p":0.94,"main_claim_p":0.18,"quantitative":true,"quantitative_p":0.96,"role_probabilities":{"gap":0.0,"method":0.0,"result":0.94,"background":0.0,"limitation":0.0,"future_work":0.0,"contribution":0.01,"interpretation":0.05}}]},"compiled":{"main_claim":{"p":0.99,"text":"We achieve substantial performance gains on all 12 benchmarks spanning coding-agent tasks, agentic tasks in real-world production settings, and general reasoning.","location":"abstract s8","hedge_strength":{"p":1.0,"label":"asserted"}},"provenance":{"route":{"via":"TypeSafe API","model":"classifier-1.13.0","endpoint":"https://api.typesafe.ai/v1/systemone","provider":"TypeSafe"},"packing":"one request per paper","requests":1,"input_tokens":7667,"cost_usd_reported":0.0},"compiled_at":"2026-10-12","bank_version":"abstract-p1-20260923","model_version":"classifier-1.13.0","abstract_states":{"claims_first":0.07,"states_limitation":0.25,"human_participants":0.1,"controlled_comparison":0.19,"randomized_assignment":0.01,"states_quantitative_result":0.97,"compares_with_prior_results":0.35,"mentions_code_or_data_availability":0.06},"evidential_basis":{"p":0.93,"value":"observation or experiment","probabilities":{"argument":0.0,"literature":0.0,"proof_or_derivation":0.0,"analysis_of_existing_data":0.0,"observation_or_experiment":0.93,"simulation_or_computation":0.07}},"contribution_type":{"p":0.92,"value":"method or tool","probabilities":{"review":0.0,"method_or_tool":0.92,"empirical_study":0.0,"simulation_study":0.0,"theoretical_result":0.0,"dataset_or_benchmark":0.08,"position_or_commentary":0.0}},"contribution_statement":{"p":0.99,"text":"To address this, we introduce TerminalHorizon, a fully automated data synthesis engine for long-horizon terminal agents.","location":"abstract s4"}},"coverage":{"tier":"abstract","levels_run":["P abstract"],"not_examined":["full text","figures and tables","references and citing sentences","relations to other papers"],"sources_read":["arXiv listing abstract v1"],"levels_not_run":["S sections","T body sentences","C citations","R cross-paper relations"],"sentences_examined":10,"sentences_in_abstract":10},"measured_accuracy":{"url":"https://pith.science/accuracy","measured_on":"2026-10-02","method":"two independent model families labelled a fresh random sample blind; the figure is how often the published label matches their consensus","sentence_role_agreement":0.92,"main_claim_agreement":0.908,"typed_citation_agreement":0.933,"typed_citation_agreement_95_interval":[0.917,0.945],"review_comments_accurate":0.758,"review_comments_accurate_95_interval":[0.684,0.82],"review_caught_admitted_error_found_or_related":0.448,"review_comments_judged":{"judged_by":["gpt-5.6-luna","grok-4.7"],"judged_against":"Pith's own text copy of each paper: text extracted from the PDF, the first 90,000 characters","measured_on":"2026-10-04","accurate":113,"decided":149,"sampled_reviews":200,"split_by_lane":false,"by_lane":"https://pith.science/accuracy#by-lane"}}}