Pith. sign in

REVIEW 2 cited by

Autonomous LLM-driven research from data to human-verifiable research papers

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2404.17605 v1 pith:62WHMUNZ submitted 2024-04-24 q-bio.OT cs.AI

classification q-bio.OTcs.AI
keywords researchdatascientifichumanprocessai-drivenautonomouscomplete
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

As AI promises to accelerate scientific discovery, it remains unclear whether fully AI-driven research is possible and whether it can adhere to key scientific values, such as transparency, traceability and verifiability. Mimicking human scientific practices, we built data-to-paper, an automation platform that guides interacting LLM agents through a complete stepwise research process, while programmatically back-tracing information flow and allowing human oversight and interactions. In autopilot mode, provided with annotated data alone, data-to-paper raised hypotheses, designed research plans, wrote and debugged analysis codes, generated and interpreted results, and created complete and information-traceable research papers. Even though research novelty was relatively limited, the process demonstrated autonomous generation of de novo quantitative insights from data. For simple research goals, a fully-autonomous cycle can create manuscripts which recapitulate peer-reviewed publications without major errors in about 80-90%, yet as goal complexity increases, human co-piloting becomes critical for assuring accuracy. Beyond the process itself, created manuscripts too are inherently verifiable, as information-tracing allows to programmatically chain results, methods and data. Our work thereby demonstrates a potential for AI-driven acceleration of scientific discovery while enhancing, rather than jeopardizing, traceability, transparency and verifiability.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Automated Hypothesis Validation with Agentic Sequential Falsifications

    cs.LG 2025-02 conditional novelty 6.0 of 10

    An LLM-agent framework validates free-form hypotheses through sequential falsification experiments aggregated with e-values to control Type-I error.

  2. A Multi-Layered Framework for Modeling Human Biology: From Basic AI Agents to a Full-Body AI Agent

    q-bio.TO 2025-08 reject novelty 4.0 of 10

    The paper proposes, but does not implement or validate, a multi-agent AI framework for cross-scale modeling of human biology from molecules to whole body, with sketches of metastasis scoring and drug development.

Pith tools