Pith. sign in

REVIEW 3 major objections 1 minor 61 references

STRUCTSURVEY: Structured Agentic Retrieval for Automated Survey Paper Generation

T0 review · 3 major / 1 minor · reviewed 2026-07-04 · grok-4.3

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read A hierarchical multi-agent system builds entity-relation graphs at retrieval time to generate survey papers with higher recall and better logical structure than embedding baselines.

desk verdict STRUCTSURVEY adds graph construction via multi-agent retrieval for survey generation and reports modest ROUGE gains, but the evidence stays at downstream metrics without checking graph quality. read the letter →

arxiv 2607.01243 v1 pith:KVZICX7G submitted 2026-05-12 cs.IR

Paolo Pedinotti , Enrico Santus This is my paper · ORCID
classification cs.IR
keywords structuredretrievalmulti-agentframeworksurveygenerationgraphrepresentationsscientificsummarizationROUGEmetricsACLbenchmarkLLMjudgeevaluation
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper presents STRUCTSURVEY as a framework that moves the task of inferring conceptual, methodological, and taxonomic relations out of the final generation step and into the retrieval process. It does this by having agents dynamically assemble graph representations of research entities and their connections from retrieved documents. Evaluated against embedding-only methods on a new benchmark of ACL survey papers, the approach raises average ROUGE-1 recall by 2.9 points and ROUGE-2 recall by 1.0 points while holding precision steady and lifting human-aligned ratings for organization and depth. A reader would care if the result holds because survey writing is currently limited by the difficulty of recovering explicit structure from raw text at generation time.

What carries the argument

Hierarchical multi-agent framework that dynamically constructs graph-based representations of entities, relations, and topical taxonomies during retrieval.

What would settle it

An experiment that supplies manually validated relation graphs for the same documents and shows that the automatically constructed graphs miss key methodological or taxonomic links, resulting in no gain or a drop in ROUGE recall and judge ratings on the ACL benchmark.

Watch

Extended reading notes

Core claim

STRUCTSURVEY is a hierarchical multi-agent framework that shifts structural reasoning from generation to retrieval by dynamically constructing graph-based representations of entities, relations, and topical taxonomies. On a reference-grounded benchmark of ACL survey papers, this yields surveys whose ROUGE-1 recall improves by +2.9 and ROUGE-2 recall by +1.0 on average without loss of precision, together with higher LLM-as-a-Judge scores for logical structure, depth, and synthesis relative to embedding-only retrieval baselines.

Load-bearing premise

Dynamically building graph representations from retrieved data accurately captures the conceptual, methodological, and taxonomic relations required for high-quality survey generation, and the ACL survey benchmark is representative of general long-form scientific summarization.

Editorial extensions

If this is right

  • Surveys produced this way exhibit organization and reasoning closer to human-written examples.
  • Explicit structural retrieval improves both surface overlap metrics and higher-order quality judgments without trading one for the other.
  • The new reference-grounded ACL benchmark enables reproducible evaluation of long-form scientific summarization methods.
  • Moving relation inference to retrieval reduces the burden on the final generation model to discover structure from raw text.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The same graph-construction step could be applied to other long-form synthesis tasks such as literature reviews in non-ACL domains.
  • If the constructed graphs prove reliable, downstream generation models may require less capacity for implicit reasoning.
  • The approach suggests that intermediate structured representations can serve as a general lever for improving factual grounding in multi-document summarization.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

3 major / 1 minor

Summary. The manuscript introduces STRUCTSURVEY, a hierarchical multi-agent framework for automated survey paper generation. It dynamically constructs graph-based representations of entities, relations, and topical taxonomies from retrieved papers, shifting structural reasoning from the generation stage to retrieval. The system is evaluated on a new reference-grounded benchmark consisting of ACL survey papers, where it reports average improvements of +2.9 ROUGE-1 recall and +1.0 ROUGE-2 recall over embedding-only baselines without loss of precision, plus higher LLM-as-a-Judge scores on logical structure, depth, and synthesis.

Significance. If the central claims hold, the work provides evidence that explicit structural retrieval can improve the organization and synthesis quality of LLM-generated surveys relative to unstructured embedding retrieval. The new ACL-based benchmark contributes a reproducible testbed for long-form scientific summarization. These elements would be of interest to the information retrieval and NLP communities working on automated literature synthesis.

major comments (3)
  1. [Evaluation] Evaluation section: The reported ROUGE-1/2 recall gains (+2.9 and +1.0) and LLM-as-a-Judge improvements are presented only as averages with no accompanying statistical significance tests, variance across runs, or details on baseline implementations and potential confounds such as retrieval volume or prompting differences. This leaves open whether the gains are attributable to the graph structure or to other factors.
  2. [Method] Method and Experiments sections: The central claim that graph construction of entities, relations, and taxonomies accurately captures conceptual and methodological relations (thereby improving survey quality) lacks any direct validation metrics, such as relation extraction precision or graph fidelity against gold taxonomies derived from the human-written reference surveys. Without these, it is unclear whether the observed downstream gains stem from structural accuracy or from multi-agent prompting volume.
  3. [Benchmark] Benchmark description: The construction details, selection criteria, and coverage analysis for the new reference-grounded ACL survey benchmark are not provided, leaving its representativeness for general long-form scientific summarization (beyond ACL) untested and potentially subject to domain-specific biases.
minor comments (1)
  1. [Abstract] The abstract states improvements 'on average' but does not specify the number of test instances or aggregation method; this should be clarified for reproducibility.

Simulated Author's Rebuttal

3 responses · 0 unresolved

We thank the referee for the constructive feedback on evaluation rigor, method validation, and benchmark transparency. We address each major comment below, indicating planned revisions to strengthen the manuscript.

read point-by-point responses

  1. Referee: [Evaluation] Evaluation section: The reported ROUGE-1/2 recall gains (+2.9 and +1.0) and LLM-as-a-Judge improvements are presented only as averages with no accompanying statistical significance tests, variance across runs, or details on baseline implementations and potential confounds such as retrieval volume or prompting differences. This leaves open whether the gains are attributable to the graph structure or to other factors.

    Authors: We agree that statistical analysis and implementation details are needed to support the claims. In the revised manuscript, we will report standard deviations across multiple runs (with different random seeds), include paired statistical significance tests (e.g., t-tests) on the ROUGE scores, and expand the baseline descriptions to specify retrieval volume, prompting templates, and other hyperparameters. This will help isolate the contribution of the graph-based structure. revision: yes

  2. Referee: [Method] Method and Experiments sections: The central claim that graph construction of entities, relations, and taxonomies accurately captures conceptual and methodological relations (thereby improving survey quality) lacks any direct validation metrics, such as relation extraction precision or graph fidelity against gold taxonomies derived from the human-written reference surveys. Without these, it is unclear whether the observed downstream gains stem from structural accuracy or from multi-agent prompting volume.

    Authors: We acknowledge the value of direct graph validation metrics. However, creating gold-standard taxonomies from the reference surveys would require substantial new human annotation beyond the scope of the current study. In revision, we will add a partial analysis reporting aggregate statistics on extracted entities/relations and a qualitative comparison to reference survey structures, while noting the limitation that downstream LLM-as-a-Judge improvements on structure and synthesis serve as indirect evidence only. We will also discuss the potential role of multi-agent prompting volume as a confound. revision: partial

  3. Referee: [Benchmark] Benchmark description: The construction details, selection criteria, and coverage analysis for the new reference-grounded ACL survey benchmark are not provided, leaving its representativeness for general long-form scientific summarization (beyond ACL) untested and potentially subject to domain-specific biases.

    Authors: We will revise the benchmark section to include explicit selection criteria (ACL surveys published 2018–2023 with citation thresholds), the process for identifying reference papers, and coverage statistics (e.g., average number of cited papers per survey and subfield distribution within NLP). We agree this benchmark is ACL/NLP-focused and will explicitly note its domain specificity as a limitation, while arguing it provides a reproducible testbed for the targeted community. revision: yes

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity; empirical gains rest on external baselines and new benchmark

full rationale

The paper presents an empirical method (hierarchical multi-agent graph construction for retrieval) evaluated via ROUGE recall/precision and LLM-as-Judge scores against embedding-only baselines on a newly introduced ACL-survey benchmark. No equations, fitted parameters renamed as predictions, self-definitional loops, or load-bearing self-citations appear in the derivation. The central claim reduces to measured downstream improvements rather than any input being redefined or forced by prior author work. The graph-construction assumption is tested only indirectly via end-task metrics, but this is a standard empirical limitation rather than circularity.

Assumptions & free parameters 0 free parameters · 0 assumptions · 0 invented entities

Abstract-only review provides no explicit free parameters, axioms, or invented entities; ledger left empty.

how reviews work

0 comments
Cite this review

Pith. "Pith review of STRUCTSURVEY: Structured Agentic Retrieval for Automated Survey Paper Generation." pith.science (2026). https://pith.science/paper/KVZICX7G

@misc{pith2026260701243,
  author       = {Pith},
  title        = {Pith review of: STRUCTSURVEY: Structured Agentic Retrieval for Automated Survey Paper Generation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/KVZICX7G}},
  note         = {Machine review of arXiv:2607.01243}
}
read the original abstract

The rapid growth of scientific publications makes it increasingly difficult to track and synthesize research progress. While Large Language Models (LLMs) can support automated survey generation, existing methods retrieve unstructured data and require models to infer conceptual, methodological, and taxonomic relations from raw text at generation time. We introduce STRUCTSURVEY, a hierarchical multi-agent framework that shifts structural reasoning from generation to retrieval by dynamically constructing graph-based representations of entities, relations, and topical taxonomies. We evaluate STRUCTSURVEY on a new reference-grounded benchmark of ACL survey papers for reproducible long-form scientific summarization. Compared with embedding-only retrieval baselines, STRUCTSURVEY improves ROUGE-1 recall by +2.9 and ROUGE-2 recall by +1.0 on average, without reducing precision. It also improves LLM-as-a-Judge ratings for logical structure, depth, and synthesis, showing that explicit structural retrieval yields surveys closer to human-written organization and reasoning.

Figures

Figures reproduced from arXiv: 2607.01243 by the authors.

Figure 1
Figure 1. STRUCTSURVEY process. Unlike vector-only retrieval systems (yellow), STRUCTSURVEY extracts structured information (green), merges retrieved subgraphs into an evolving domain graph, and uses it to guide generation. This reference-grounded benchmark enables repro￾ducible comparison of survey-generation systems under controlled evidence conditions. On this benchmark, STRUCTSURVEY improves over embedding-only retrieval … view at source ↗

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

61 extracted references · 61 canonical work pages

  1. [1]

    From Local to Global: A Graph RAG Approach to Query-Focused Summarization

    The faiss library.IEEE Transactions on Big Data. Darren Edge, Ha Trinh, Newman Cheng, Joshua Bradley, Alex Chao, Apurva Mody, Steven Truitt, Dasha Metropolitansky, Robert Osazuwa Ness, and Jonathan Larson. 2024. From local to global: A graph rag approach to query-focused summarization. arXiv preprint arXiv:2404.16130. GraphRAG con- structs an LLM-derived ...

    work page Pith review arXiv 2024

  2. [2]

    LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods

    Llms-as-judges: A comprehensive sur- vey on llm-based evaluation methods.Preprint, arXiv:2412.05579. Boci Peng, Yun Zhu, Yongchao Liu, Xiaohe Bo, Haizhou Shi, Chuntao Hong, Yan Zhang, and Siliang Tang. 2025. Graph retrieval-augmented generation: A survey.ACM Transactions on Information Systems, 44(2):1–52. Mengting Wan, Tara Safavi, Sujay Kumar Jauhar, Yu...

    work page Pith review arXiv 2025

  3. [3]

    (2021).A Review of Hu- man Evaluation for Style Transfer

    Briakou, E., Agrawal, S., Zhang, K., Tetreault, J., and Carpuat, M. (2021).A Review of Hu- man Evaluation for Style Transfer. Proceed- ings of the First Workshop on Natural Lan- guage Generation, Evaluation, and Metrics (GEM), 58–67

    work page 2021

  4. [4]

    (2024).Recent Trends in Per- sonalized Dialogue Generation: A Review of Datasets, Methodologies, and Evaluations

    Chen, Y .-P., Nishida, N., Nakayama, H., and Matsumoto, Y . (2024).Recent Trends in Per- sonalized Dialogue Generation: A Review of Datasets, Methodologies, and Evaluations. Proceedings of LREC–COLING 2024, 13650– 13665

    work page 2024

  5. [5]

    (2018).A Survey of Domain Adaptation for Neural Machine Translation

    Chu, C., and Wang, R. (2018).A Survey of Domain Adaptation for Neural Machine Translation. Proceedings of the 27th Interna- tional Conference on Computational Linguis- tics, 1304–1319

    work page 2018

  6. [6]

    Y ., and King, I

    Cui, W., Yu, D., Jiao, X., Meng, Z., Zhang, G., Wang, Q., Guo, S. Y ., and King, I. (2025). Recent Advances in Speech Language Models: A Survey. Proceedings of ACL 2025 (Long Papers), 13943–13970

    work page 2025

  7. [7]

    (2024).A Survey on In-Context Learning

    Dong, Q., Li, L., Dai, D., Zheng, C., Ma, J., Li, R., Xia, H., Xu, J., Wu, Z., Chang, B., Sun, X., Li, L., and Sui, Z. (2024).A Survey on In-Context Learning. Proceedings of EMNLP 2024, 1107–1128

    work page 2024

  8. [8]

    (2024).Attacks, Defenses and Evalu- ations for LLM Conversation Safety: A Survey

    Dong, Z., Zhou, Z., Yang, C., Shao, J., and Qiao, Y . (2024).Attacks, Defenses and Evalu- ations for LLM Conversation Safety: A Survey. Proceedings of NAACL 2024, 6734–6747

    work page 2024

Show all 61 references
  1. [9]

    (2024).A Survey of Con- fidence Estimation and Calibration in Large Language Models

    Geng, J., Cai, F., Wang, Y ., Koeppl, H., Nakov, P., and Gurevych, I. (2024).A Survey of Con- fidence Estimation and Calibration in Large Language Models. Proceedings of NAACL 2024, 6577–6595

    2024

  2. [10]

    Iacob, R. C. A., Brad, F., Apostol, E.-S., Tru- ic˘a, C.-O., Hosu, I. A., and Rebedea, T. (2020). Neural Approaches for Natural Language In- terfaces to Databases: A Survey. Proceedings of COLING 2020, 381–395

    2020

  3. [11]

    Kim, M., Kim, M., Kim, H., Kwak, B.-W., Kang, S., Yu, Y ., Yeo, J., and Lee, D. (2024). Pearl: A Review-driven Persona-Knowledge Grounded Conversational Recommendation Dataset. Findings of ACL 2024, 1105–1120

    2024

  4. [12]

    (2022).Meta Learning for Natural Language Processing: A Survey

    Lee, H.-Y ., Li, S.-W., and Vu, T. (2022).Meta Learning for Natural Language Processing: A Survey. Proceedings of NAACL 2022, 666– 684

    2022

  5. [13]

    (2025).Knowledge Boundary of Large Lan- guage Models: A Survey

    Li, M., Zhao, Y ., Zhang, W., Li, S., Xie, W., Ng, S.-K., Chua, T.-S., and Deng, Y . (2025).Knowledge Boundary of Large Lan- guage Models: A Survey. Proceedings of ACL 2025 (Long Papers), 5131–5157

    2025

  6. [14]

    (2020).Con- text Dependent Semantic Parsing: A Survey

    Li, Z., Qu, L., and Haffari, G. (2020).Con- text Dependent Semantic Parsing: A Survey. Proceedings of COLING 2020, 2509–2521

    2020

  7. [15]

    (2023).A Survey of Deep Learning for Mathematical Reasoning

    Lu, P., Qiu, L., Yu, W., Welleck, S., and Chang, K.-W. (2023).A Survey of Deep Learning for Mathematical Reasoning. Pro- ceedings of ACL 2023 (Long Papers), 14605– 14631

    2023

  8. [16]

    (2023).End- to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directions

    Qin, L., Pan, W., Chen, Q., Liao, L., Yu, Z., Zhang, Y ., Che, W., and Li, M. (2023).End- to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directions. Pro- ceedings of EMNLP 2023, 5925–5941

    2023

  9. [17]

    (2023).A Survey of MWE Identification Experiments: The Devil is in the Details

    Ramisch, C., Walsh, A., Blanchard, T., and Taslimipoor, S. (2023).A Survey of MWE Identification Experiments: The Devil is in the Details. Proceedings of the MWE Workshop 2023, 106–120

    2023

  10. [18]

    (2024).A Survey of Meaning Representations: From Theory to Practical Utility

    Sadeddine, Z., Opitz, J., and Suchanek, F. (2024).A Survey of Meaning Representations: From Theory to Practical Utility. Proceedings of NAACL 2024, 2877–2892

    2024

  11. [19]

    (2023).Neural Ranking with Weak Supervi- sion for Open-Domain Question Answering: A Survey

    Shen, X., Vakulenko, S., del Tredici, M., Barlacchi, G., Byrne, B., and de Gispert, A. (2023).Neural Ranking with Weak Supervi- sion for Open-Domain Question Answering: A Survey. Findings of EACL 2023, 1736– 1750

    2023

  12. [20]

    (2024).Controllable Text Summariza- tion: Unraveling Challenges, Approaches, and Prospects

    Urlana, A., Mishra, P., Roy, T., and Mishra, R. (2024).Controllable Text Summariza- tion: Unraveling Challenges, Approaches, and Prospects. Findings of ACL 2024, 1603– 1623

    2024

  13. [21]

    (2023).A Survey on Zero Pronoun Translation

    Wang, L., Liu, S., Xu, M., Song, L., Shi, S., and Tu, Z. (2023).A Survey on Zero Pronoun Translation. Proceedings of ACL 2023 (Long Papers), 3325–3339

    2023

  14. [22]

    Wang, X., Wang, H., and Yang, D. (2022). Measure and Improve Robustness in NLP Models: A Survey. Proceedings of NAACL 2022, 4569–4586

    2022

  15. [23]

    A., Liu, F., Georgiev, G

    Wang, Y ., Wang, M., Manzoor, M. A., Liu, F., Georgiev, G. N., Das, R. J., and Nakov, P. (2024).Factuality of Large Language Mod- els: A Survey. Proceedings of EMNLP 2024, 19519–19529

    2024

  16. [24]

    Xia, P., Wu, S., and Van Durme, B. (2020). Which *BERT? A Survey Organizing Contex- tualized Encoders. Proceedings of EMNLP 2020, 7516–7533

    2020

  17. [25]

    Xia, Z., Xu, J., Zhang, Y ., and Liu, H. (2025). A Survey of Uncertainty Estimation Methods on Large Language Models. Findings of ACL 2025, 21381–21396

    2025

  18. [26]

    (2025).A Survey of Mathematical Reason- ing in the Era of Multimodal Large Language Models: Benchmark, Method & Challenges

    Yan, Y ., Su, J., He, J., Fu, F., Zheng, X., Lyu, Y ., Wang, K., Wang, S., Wen, Q., and Hu, X. (2025).A Survey of Mathematical Reason- ing in the Era of Multimodal Large Language Models: Benchmark, Method & Challenges. Findings of ACL 2025, 11798–11827

    2025

  19. [27]

    (2022).Generative Knowledge Graph Con- struction: A Review

    Ye, H., Zhang, N., Chen, H., and Chen, H. (2022).Generative Knowledge Graph Con- struction: A Review. Proceedings of EMNLP 2022, 1–17

    2022

  20. [28]

    (2022).Beyond Counting Datasets: A Survey of Multilingual Dataset Construc- tion and Necessary Resources

    Yu, X., Chatterjee, T., Asai, A., Hu, J, and Choi, E. (2022).Beyond Counting Datasets: A Survey of Multilingual Dataset Construc- tion and Necessary Resources. Findings of EMNLP 2022, 3725–3743

    2022

  21. [29]

    (2023).Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained Language Models

    Youssef, P., Kora¸ s, O., Li, M., Schlötterer, J., and Seifert, C. (2023).Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained Language Models. Findings of EMNLP 2023, 15588–15605

    2023

  22. [30]

    (2023).How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Ad- vances

    Zhang, Z., Fang, M., Chen, L., Namazi-Rad, M.-R., and Wang, J. (2023).How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Ad- vances. Proceedings of EMNLP 2023, 8289– 8311

    2023

  23. [31]

    (2023).A Survey of Multi-task Learning in Natural Language Processing: Regarding Task Relatedness and Training Methods

    Zhang, Z., Yu, W., Yu, M., Guo, Z., and Jiang, M. (2023).A Survey of Multi-task Learning in Natural Language Processing: Regarding Task Relatedness and Training Methods. Pro- ceedings of EACL 2023, 943–956

    2023

  24. [32]

    (2023).A Survey for Efficient Open Domain Question Answer- ing

    Zhang, Q., Chen, S., Xu, D., Cao, Q., Chen, X., Cohn, T., and Fang, M. (2023).A Survey for Efficient Open Domain Question Answer- ing. Proceedings of ACL 2023 (Long Papers), 14447–14465

    2023

  25. [33]

    L., Qin, C., Ding, B., Guo, X., Li, M., Li, X., and Joty, S

    Zhao, R., Chen, H., Wang, W., Jiao, F., Do, X. L., Qin, C., Ding, B., Guo, X., Li, M., Li, X., and Joty, S. (2023).Retrieving Mul- timodal Information for Augmented Genera- tion: A Survey. Findings of EMNLP 2023, 4736–4756

    2023

  26. [34]

    (2021).Paraphrase Generation: A Survey of the State of the Art

    Zhou, J., and Bhat, S. (2021).Paraphrase Generation: A Survey of the State of the Art. Proceedings of EMNLP 2021, 5075–5086

    2021

  27. [35]

    Zhou, Y ., Ringeval, F., and Portet, F. (2023). A Survey of Evaluation Methods of Gener- ated Medical Textual Reports. Proceedings of the 5th Clinical Natural Language Process- ing Workshop, 447–459. B Prompts B.0.1 Entity Extraction Prompt System Prompt: System Prompt: You ar...

    2023

  28. [37]

    {find_entities}

    Describe its role or use in the abstract (1-2 sentences) Format your response EXACTLY as follows (one entity per block): ENTITY: [entity name] DESCRIPTION: [brief description of its role] ENTITY: [entity name] DESCRIPTION: [brief description of its role] If you find NO entitie...

  29. [38]

    Identify the specific name/type of the entity

  30. [39]

    {fixed_entity}

    Describe its relationship with "{fixed_entity}" in detail (2-3 sentences)

  31. [40]

    [paper_title]

    Include the paper context to clarify where this information comes from Format your response EXACTLY as follows (one entity per block): ENTITY: [entity name] DESCRIPTION: In the paper "[paper_title]", [detailed description of how this entity relates to {fixed_entity}, including...

  32. [41]

    Identify the specific name/type of Entity A

  33. [42]

    Identify the specific name/type of Entity B

  34. [43]

    Describe their relationship in detail (2-3 sentences)

  35. [44]

    [paper_title]

    Include the paper context to clarify where this information comes from Format your response EXACTLY as follows (one pair per block): ENTITY_A: [entity A name] ENTITY_B: [entity B name] DESCRIPTION: In the paper "[paper_title]", [detailed description of how these entities relat...

  36. [45]

    Provide a clear, descriptive title

  37. [46]

    Choose a query type (vector or graph) that best suits the section's needs

  38. [49]

    BERT model

    GRAPH QUERY: A structured query for finding and categorizing entities/relationships Three patterns available: PATTERN 1 - Find and categorize entities of a given type: TYPE: graph_pattern_1 QUERY: [entity type or property to find] CATEGORIZE_BY: [categorization criterion] PATT...

  39. [50]

    Provide a clear, descriptive title that fits within the scope of the main section

  40. [51]

    Choose a query type (vector or graph) that best suits the subsection's needs

  41. [52]

    Generate the appropriate query based on the chosen type QUERY TYPES: You can generate two types of queries:

  42. [54]

    BERT model

    GRAPH QUERY: A structured query for finding and categorizing entities/relationships Three patterns available: PATTERN 1 - Find and categorize entities of a given type: TYPE: graph_pattern_1 QUERY: [entity type or property to find] CATEGORIZE_BY: [categorization criterion] PATT...

  43. [55]

    VECTOR QUERY: A traditional semantic search query for retrieving relevant papers Format: TYPE: vector QUERY: [semantic search query text]

  44. [56]

    BERT model

    GRAPH QUERY: A structured query for finding and categorizing entities/relationships Three patterns available: PATTERN 1 - Find and categorize entities of a given type: TYPE: graph_pattern_1 QUERY: [entity type or property to find] CATEGORIZE_BY: [categorization criterion] PATT...

  45. [57]

    Covers all subsections naturally (don't use subsection titles as headers)

  46. [58]

    Synthesizes information from multiple papers

  47. [59]

    If structured entity analysis is provided above, USE IT to organize and structure your discussion - Mention the categories and how they relate to each other - Use the entity counts to show prevalence of different approaches - Reference specific entities when discussing techniques

  48. [60]

    Provides clear explanations and comparisons

  49. [61]

    Uses proper academic writing style

  50. [62]

    Is approximately 500-800 words

  51. [63]

    The work'Retrieval-Augmented Generation'introduces

    IMPORTANT: Cite papers by their ACTUAL TITLES when referencing them - Good examples: * "The work'Retrieval-Augmented Generation'introduces..." * "As shown in'BERT: Pre-training of Deep Bidirectional Transformers', ..." * "Recent work on multimodal learning ('CLIP','DALL-E') ha...

  52. [64]

    When multiple papers address the same topic, mention their titles together

  53. [65]

    ## {section_title}

    Use the paper titles as natural references in your writing CRITICAL FORMATTING INSTRUCTIONS: - DO NOT include the section title as a heading (e.g., "## {section_title}") in your output - Start directly with the section content - The section title will be added automatically by...

Pith tools

Reviewed July 4, 2026 · model on record in the stance chip above.