REVIEW 13 cited by
Open Deep Search: Democratizing Search with Open-source Reasoning Agents
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We introduce Open Deep Search (ODS) to close the increasing gap between the proprietary search AI solutions, such as Perplexity's Sonar Reasoning Pro and OpenAI's GPT-4o Search Preview, and their open-source counterparts. The main innovation introduced in ODS is to augment the reasoning capabilities of the latest open-source LLMs with reasoning agents that can judiciously use web search tools to answer queries. Concretely, ODS consists of two components that work with a base LLM chosen by the user: Open Search Tool and Open Reasoning Agent. Open Reasoning Agent interprets the given task and completes it by orchestrating a sequence of actions that includes calling tools, one of which is the Open Search Tool. Open Search Tool is a novel web search tool that outperforms proprietary counterparts. Together with powerful open-source reasoning LLMs, such as DeepSeek-R1, ODS nearly matches and sometimes surpasses the existing state-of-the-art baselines on two benchmarks: SimpleQA and FRAMES. For example, on the FRAMES evaluation benchmark, ODS improves the best existing baseline of the recently released GPT-4o Search Preview by 9.7% in accuracy. ODS is a general framework for seamlessly augmenting any LLMs -- for example, DeepSeek-R1 that achieves 82.4% on SimpleQA and 30.1% on FRAMES -- with search and reasoning capabilities to achieve state-of-the-art performance: 88.3% on SimpleQA and 75.3% on FRAMES.
Forward citations
Cited by 13 Pith papers
-
SciDataSailor: Deep Scientific Data Exploring
SciDataSailor uses Monte Carlo tree search to synthesize tool-use trajectories for training and benchmarking LLM agents that explore raw scientific repositories.
-
Fishing Out Free Riders: Shapley-Based Reward Attribution for Parallel Reasoning via Reinforcement Learning
Rewarding each parallel reasoning path by Monte-Carlo-Shapley marginal contribution, scored by a generative reward model, lifts Pass@16 on AIME24/AIME25/AMC23 by 4-90% relative over Parallel-R1 with a fifth of the tra...
-
SFR-DeepResearch: Towards Effective Reinforcement Learning for Autonomously Reasoning Single Agents
A 20B autonomously reasoning deep-research agent trained with synthetic-data RL reaches 28.7% on Humanity's Last Exam, exceeding several larger and proprietary baselines.
-
CHANCERY: Evaluating Corporate Governance Reasoning Capabilities in Language Models
A 502-question benchmark for corporate governance reasoning shows current language models reach at most 78.1 percent accuracy.
-
MaskSearch: A Universal Pre-Training Framework to Enhance Agentic Search Capability
A pre-training task called RAMP, where models practice searching to fill masked text spans, improves downstream agentic open-domain QA performance across Qwen and LLaMA models.
-
One Interaction Is Worth a Thousand Guesses: Benchmarking the Interactive Capabilities of Deep Research Agents
IDRBench provides a reusable benchmark showing that interactive clarification improves deep-research report quality across seven LLMs, while revealing large differences in interaction efficiency.
-
Harnessing Uncertainty: Entropy-Modulated Policy Gradients for Long-Horizon LLM Agents
EMPG re-weights policy-gradient updates by step-level token entropy, amplifying confident correct actions and muting uncertain ones, and adds a future-clarity bonus.
-
Atom-Searcher: Enhancing Agentic Deep Research via Fine-Grained Atomic Thought Reward
A new RL framework that rewards fine-grained reasoning steps, called Atomic Thoughts, claims better agentic deep research on seven benchmarks.
-
Deep Researcher with Test-Time Diffusion
A test-time 'denoising' loop that repeatedly revises a draft report using fresh web retrieval, plus a component-wise self-evolution step, beats existing deep research agents on several benchmarks.
-
KnowCoder-V2: Deep Knowledge Analysis
KnowCoder-V2 augments deep research with offline knowledge organization and code-based knowledge computation, reporting gains on information extraction, KBQA, and LLM-judged report generation.
-
AgentDNS: A Root Domain Naming System for LLM Agents
AgentDNS is a proposed system that gives LLM agents a DNS-like namespace and discovery service for finding and invoking third-party tools and agents across vendors.
-
ManuSearch: Democratizing Deep Search in Large Language Models with a Transparent and Open Multi-Agent Framework
ManuSearch's three-agent design brings open-source LLMs to parity or better with proprietary web-search agents on three reasoning benchmarks, and ORION adds 310 long-tail EN/ZH questions for testing them.
-
A Comprehensive Survey of Deep Research: Systems, Methodologies, and Applications
A survey of 80+ Deep Research systems that proposes a four-layer taxonomy (foundation models, tool use, planning, synthesis) and compares commercial and open-source implementations.
Discussion (0). Sign in to comment.