REVIEW 1 major objections 4 minor 152 references
Foundations of GenIR
T0 review · 1 major / 4 minor · reviewed 2026-08-10 · deepseek-v4-flash
Pith's one-line read Generative AI brings two new information-access paradigms: creating responses directly and grounding them in external sources.
desk verdict A competent, useful GenIR survey whose two-paradigm taxonomy is plausible but over-sold as theoretically grounded; worth a careful referee to fix a factual slip and qualify the hallucination claim. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The organizing device is the two-paradigm distinction, defined by where the output's information comes from: the model's internal knowledge for generation, external sources for synthesis. Within synthesis, the operational machinery is retrieval-augmented generation (RAG), analyzed through the three questions of when to retrieve, what to retrieve, and where to retrieve, with joint optimization of retriever, generator, and augmentation method as the open frontier. Within generation, the machinery is the Transformer stack, the scaling-law relation $L(x)=L_\infty + k x^{-\alpha}$, the pretraining–SFT–RLHF training pipeline, and prompt optimization. The chapter also treats generative retrieval's differentiable index and document-ID generation as an alternative synthesis-oriented machinery, and notes its theoretical equivalence to multi-vector dense retrieval.
What would settle it
Run the same language model on factoid questions with and without retrieved evidence under matched conditions; if adding grounding does not reduce factual errors, the reliability advantage the chapter assigns to synthesis collapses. The stronger theoretical claim would be refuted by any decoding, training, or verification scheme that provably blocks ungrounded claims on a held-out factual benchmark.
Extended reading notes
Core claim
The chapter's central claim, stated in its own terms, is that modern generative AI creates two new information-access paradigms. In information generation, the model itself is the source: it creates tailored content that answers a user's request directly, covering long-tail and creative needs. In information synthesis, the model is an integrator: it receives information from external sources and reorganizes it into a grounded response, with retrieval-augmented generation as the representative technique. The authors justify the distinction by information source, and they use it to organize the foundations of generative models — architecture, scaling, training, multimodal application — plus the main synthesis avenues of RAG, generative retrieval, and domain-specific modeling. They conclude that the field should move from unit information tasks toward composite tasks with multi-step planning, and toward deeper, jointly optimized coupling of retrieval and generation.
Load-bearing premise
The argument depends on the stated premise, supported only by a citation to a hallucination survey, that probabilistic next-token prediction makes it theoretically impossible to prevent large language models from generating ungrounded content.
Editorial extensions
If this is right
- Information access systems will increasingly be judged by whether they produce the requested content or answer directly, not by whether they return a ranked list of documents.
- Precision-critical and knowledge-heavy applications will default to synthesis (RAG-style grounding) rather than relying on the model's parametric memory, because the chapter holds hallucination to be unavoidable.
- IR research should expand from unit information needs to composite tasks with multi-step planning, such as planning a wedding or writing a survey by retrieving and analyzing multiple sources.
- Retrieval and generation need joint optimization — training the retriever against the generator's autoregressive loss — which the chapter identifies as an open problem rather than a solved one.
- Alternatives to RAG, including generative retrieval with differentiable indexes and domain-specific companion models, will remain attractive in specific niches but face controllability and cost barriers.
Reading between the lines
- A natural extension of the two-paradigm taxonomy is to treat generation and synthesis as endpoints of a spectrum; agentic systems that retrieve, generate, verify, and retrieve again during a single task would sit between them.
- If hallucination is truly unavoidable, then the practical ceiling for grounded systems is set by retrieval quality and grounding verification rather than by generator scale; this could be tested by holding retrieval fixed while scaling the generator and watching whether factual-error rates plateau.
- The theoretical equivalence drawn between implicit-token generative retrieval and multi-vector dense retrieval suggests a direct benchmark confrontation: if generative retrieval cannot beat a strong dense retriever, its remaining justification would be explainability or index-storage properties.
- The 'when/what/where to retrieve' decomposition could transfer to evaluating multi-source routing in LLM agents, a setting the chapter mentions but does not give an evaluation methodology.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This arXiv manuscript, framed as a book chapter, argues that generative AI creates two new information access paradigms: information generation (producing tailored content directly from user requests) and information synthesis (grounding responses in externally retrieved information, as in RAG). Section 1 surveys model architecture, scaling laws, training stages, and multimodal extension; Section 2 discusses RAG, generative retrieval, and domain-specific corpus modeling; Section 3 outlines future directions centered on composite information needs and tighter retrieval-generation integration. The chapter is expository and makes no new experimental claims.
Significance. As an expository chapter, its main contribution is a two-paradigm taxonomy—generation versus synthesis—that is likely useful for organizing teaching and research in generative information access. The chapter is balanced in places, presenting both sides of the emergent-abilities debate and acknowledging open problems in RAG, generative retrieval, and joint optimization. Its usefulness, however, depends on the reliability distinction between the two paradigms being well grounded, which makes the treatment of hallucination in Section 2 a load-bearing point. The paper ships no code, proofs, or datasets; its value is conceptual and organizational.
major comments (1)
- [Section 2, opening paragraphs] The claim that hallucination is 'theoretically impossible to prevent' (citing [80]) is not supported by the cited survey and does not follow from the probabilistic next-token prediction model. Probabilistic sampling from a distribution does not imply that decoded outputs cannot be made factually accurate; constrained decoding, verification, and retrieval grounding can bound factual error in practice even when the base distribution is stochastic. This matters because Section 2 uses the theoretical-impossibility premise to justify why information synthesis is qualitatively more reliable than information generation. Please replace this with a more cautious empirical claim (e.g., 'empirically difficult to suppress') or provide a formal argument for impossibility.
minor comments (4)
- [Section 1.2, Eq. (1)] The prose says scaling laws describe loss decreasing in a 'log-linear manner,' but Eq. (1), L(x) = L∞ + k·x^{-α}, is a power law with an offset; it is linear in log-log coordinates only for the asymptotic term k·x^{-α}. Please correct the wording to 'power-law' or specify the log-log linearity of the asymptotic term.
- [Section 3 and throughout] There are numerous typos and grammatical slips, e.g., 'generaive' (Section 3), 'seach engines' (Section 2.2.2), 'theyll' (abstract), 'explanability' (Section 2), 'SoRA' (Section 1.1), 'T raining' headings, 'necessaite' (Section 1.3.2), and 'analysis the intents' (Section 2.1.2). A careful proofreading pass is needed.
- [Section 3, first paragraph] The phrase 'the two new paradigms brought by generative AI models' could be read as claiming exhaustiveness; the abstract more cautiously says 'two of them.' Please align the wording to avoid implying that the taxonomy is complete.
- [Section 2.2.2] The statement 'It is widely acknowledged that the phenomenon of emergent abilities only present in large-scale models' contradicts the unresolved status of emergent abilities presented in Section 1.2, where both supporting and refuting evidence are discussed. Please reconcile the two passages.
Circularity Check
No significant circularity: the chapter is an expository taxonomy whose load-bearing claims rest on external citations and independently published experiments, not on a self-referential derivation.
full rationale
The paper is a survey chapter, not a derivation. Its two paradigms, information generation and information synthesis, are introduced as stipulated organizing categories ('we identify and introduce two of them in details') rather than as predictions derived from equations. The key difference between the paradigms is definitional ('the source of information'), but no empirical conclusion is shown to follow solely from that definition. The reliability advantage of synthesis is supported by an external citation to a hallucination survey [80]; even if that cited premise is contestable, it is imported from outside the paper rather than constructed from the paper's own outputs. The many self-citations in the chapter (e.g., [28], [83], [96], [111], [112], [127], [139], [143], [152]) point to published, benchmark-based experimental results that are externally falsifiable and independent of the taxonomy itself. There is no fitted parameter relabeled as a prediction, no uniqueness theorem imported from the authors' prior work, and no equation whose output equals its input by construction. The uncovered premise about the theoretical impossibility of preventing hallucination is a correctness risk rather than a circularity, because the chapter does not redefine hallucination to make its conclusion true by fiat.
Assumptions & free parameters
assumptions (3)
- ad hoc to paper The two new paradigms, information generation and information synthesis, capture the novel opportunities generative AI brings to information access.
- domain assumption Hallucination is theoretically impossible to prevent because LLM generation is probabilistic next-token prediction.
- domain assumption Scaling laws take the power-law form L(x)=L∞+k·x^(-α).
invented entities (2)
-
information generation
-
information synthesis
Cite this review
Pith. "Pith review of Foundations of GenIR." pith.science (2026). https://pith.science/paper/YLDRJFF2
@misc{pith2026250102842,
author = {Pith},
title = {Pith review of: Foundations of GenIR},
year = {2026},
howpublished = {\url{https://pith.science/paper/YLDRJFF2}},
note = {Machine review of arXiv:2501.02842}
}
read the original abstract
The chapter discusses the foundational impact of modern generative AI models on information access (IA) systems. In contrast to traditional AI, the large-scale training and superior data modeling of generative AI models enable them to produce high-quality, human-like responses, which brings brand new opportunities for the development of IA paradigms. In this chapter, we identify and introduce two of them in details, i.e., information generation and information synthesis. Information generation allows AI to create tailored content addressing user needs directly, enhancing user experience with immediate, relevant outputs. Information synthesis leverages the ability of generative AI to integrate and reorganize existing information, providing grounded responses and mitigating issues like model hallucination, which is particularly valuable in scenarios requiring precision and external knowledge. This chapter delves into the foundational aspects of generative models, including architecture, scaling, and training, and discusses their applications in multi-modal scenarios. Additionally, it examines the retrieval-augmented generation paradigm and other methods for corpus modeling and understanding, demonstrating how generative AI can enhance information access systems. It also summarizes potential challenges and fruitful directions for future studies.
Reference graph
Works this paper leans on
-
[80]
ACM Computing Surveys 55(12), 1–38 (2023)
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y.J., Madotto, A., Fung, P.: Survey of hallucination in natural language generation. ACM Computing Surveys 55(12), 1–38 (2023)
2023
-
[1]
CoRR abs/2303.08774 (2023) https://doi
OpenAI: GPT-4 technical report. CoRR abs/2303.08774 (2023) https://doi. 21 org/10.48550/ARXIV.2303.08774 2303.08774
-
[2]
CoRR abs/2303.18223 (2023) https://doi.org/10.48550/ARXIV.2303
Zhao, W.X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., Dong, Z., Du, Y., Yang, C., Chen, Y., Chen, Z., Jiang, J., Ren, R., Li, Y., Tang, X., Liu, Z., Liu, P., Nie, J., Wen, J.: A survey of large language models. CoRR abs/2303.18223 (2023) https://doi.org/10.48550/ARXIV.2303. 18223 2303.18223
-
[3]
arXiv preprint arXiv:2302.13971 (2023)
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozi` ere, B., Goyal, N., Hambro, E., Azhar, F., et al.: Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971 (2023)
arXiv 2023
-
[4]
In: Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., Garnett, R
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L.u., Polosukhin, I.: Attention is all you need. In: Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol. 30. Curran Associates, Inc., ??? (2017)
2017
-
[5]
IEEE transactions on Signal Processing 45(11), 2673–2681 (1997)
Schuster, M., Paliwal, K.K.: Bidirectional recurrent neural networks. IEEE transactions on Signal Processing 45(11), 2673–2681 (1997)
1997
-
[6]
arXiv preprint arXiv:2210.02414 (2022)
Zeng, A., Liu, X., Du, Z., Wang, Z., Lai, H., Ding, M., Yang, Z., Xu, Y., Zheng, W., Xia, X., et al.: Glm-130b: An open bilingual pre-trained model. arXiv preprint arXiv:2210.02414 (2022)
arXiv 2022
-
[7]
Le Scao, T., Fan, A., Akiki, C., Pavlick, E., Ili´ c, S., Hesslow, D., Castagn´ e, R., Luccioni, A.S., Yvon, F., Gall´ e, M., et al.: Bloom: A 176b-parameter open-access multilingual language model (2023)
2023
Show all 152 references
-
[8]
In: NAACL-HLT (1), pp
Devlin, J., Chang, M., Lee, K., Toutanova, K.: BERT: pre-training of deep bidi- rectional transformers for language understanding. In: NAACL-HLT (1), pp. 4171–4186. Association for Computational Linguistics, ??? (2019)
2019
-
[9]
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., Liu, P.J.: Exploring the limits of transfer learning with a unified text-to-text transformer. J. Mach. Learn. Res. 21, 140–114067 (2020)
2020
-
[10]
arXiv preprint arXiv:2108.12409 (2021)
Press, O., Smith, N.A., Lewis, M.: Train short, test long: Attention with lin- ear biases enables input length extrapolation. arXiv preprint arXiv:2108.12409 (2021)
2021 arXiv
-
[11]
DOI: https://doi
Su, J., Lu, Y., Pan, S., Wen, B., RoFormer, Y.L.: Enhanced transformer with rotary position embedding., 2021. DOI: https://doi. org/10.1016/j. neucom (2023)
2023 doi
-
[12]
arXiv preprint arXiv:2204.06745 (2022)
Black, S., Biderman, S., Hallahan, E., Anthony, Q., Gao, L., Golding, L., He, H., Leahy, C., McDonell, K., Phang, J., et al.: Gpt-neox-20b: An open-source 22 autoregressive language model. arXiv preprint arXiv:2204.06745 (2022)
2022 arXiv
-
[13]
arXiv preprint arXiv:1904.10509 (2019)
Child, R., Gray, S., Radford, A., Sutskever, I.: Generating long sequences with sparse transformers. arXiv preprint arXiv:1904.10509 (2019)
2019 arXiv
-
[14]
arXiv preprint arXiv:2001.04451 (2020)
Kitaev, N., Kaiser, L., Levskaya, A.: Reformer: The efficient transformer. arXiv preprint arXiv:2001.04451 (2020)
2020 arXiv
-
[15]
arXiv preprint arXiv:2404.07143 (2024)
Munkhdalai, T., Faruqui, M., Gopal, S.: Leave no context behind: Efficient infi- nite context transformers with infini-attention. arXiv preprint arXiv:2404.07143 (2024)
2024 arXiv
-
[16]
arXiv preprint arXiv:1612.04426 (2016)
Grave, E., Joulin, A., Usunier, N.: Improving neural language models with a continuous cache. arXiv preprint arXiv:1612.04426 (2016)
2016 arXiv
-
[17]
arXiv (2020)
Izacard, G., Grave, E.: Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering. arXiv (2020). https://arxiv.org/abs/2007. 0128
2020
-
[18]
arXiv preprint arXiv:1911.02150 (2019)
Shazeer, N.: Fast transformer decoding: One write-head is all you need. arXiv preprint arXiv:1911.02150 (2019)
2019 arXiv
-
[19]
arXiv preprint arXiv:2305.13245 (2023)
Ainslie, J., Lee-Thorp, J., Jong, M., Zemlyanskiy, Y., Lebr´ on, F., Sanghai, S.: Gqa: Training generalized multi-query transformer models from multi-head checkpoints. arXiv preprint arXiv:2305.13245 (2023)
2023 arXiv
-
[20]
DeepSeek-AI: DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of- Experts Language Model (2024)
2024
-
[21]
In: International Conference on Machine Learning, pp
Xiong, R., Yang, Y., He, D., Zheng, K., Zheng, S., Xing, C., Zhang, H., Lan, Y., Wang, L., Liu, T.: On layer normalization in the transformer architecture. In: International Conference on Machine Learning, pp. 10524–10533 (2020). PMLR
2020
-
[22]
Advances in Neural Information Processing Systems 34, 19822– 19835 (2021)
Ding, M., Yang, Z., Hong, W., Zheng, W., Zhou, C., Yin, D., Lin, J., Zou, X., Shao, Z., Yang, H., et al.: Cogview: Mastering text-to-image generation via transformers. Advances in Neural Information Processing Systems 34, 19822– 19835 (2021)
2021
-
[23]
IEEE Transactions on Pattern Analysis and Machine Intelligence (2024)
Wang, H., Ma, S., Dong, L., Huang, S., Zhang, D., Wei, F.: Deepnet: Scal- ing transformers to 1,000 layers. IEEE Transactions on Pattern Analysis and Machine Intelligence (2024)
2024
-
[24]
arXiv preprint arXiv:2001.08361 (2020)
Kaplan, J., McCandlish, S., Henighan, T., Brown, T.B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., Amodei, D.: Scaling laws for neural language models. arXiv preprint arXiv:2001.08361 (2020)
2020 arXiv
-
[25]
arXiv preprint arXiv:2203.15556 (2022)
Hoffmann, J., Borgeaud, S., Mensch, A., Buchatskaya, E., Cai, T., Rutherford, 23 E., Casas, D.d.L., Hendricks, L.A., Welbl, J., Clark, A., et al.: Training compute- optimal large language models. arXiv preprint arXiv:2203.15556 (2022)
2022 arXiv
-
[26]
arXiv preprint arXiv:2403.16952 (2024)
Ye, J., Liu, P., Sun, T., Zhou, Y., Zhan, J., Qiu, X.: Data mixing laws: Optimizing data mixtures by predicting language modeling performance. arXiv preprint arXiv:2403.16952 (2024)
2024 arXiv
-
[27]
arXiv preprint arXiv:2010.14701 (2020)
Henighan, T., Kaplan, J., Katz, M., Chen, M., Hesse, C., Jackson, J., Jun, H., Brown, T.B., Dhariwal, P., Gray, S., et al.: Scaling laws for autoregressive generative modeling. arXiv preprint arXiv:2010.14701 (2020)
2020 arXiv
-
[29]
arXiv preprint arXiv:2206.07682 (2022)
Wei, J., Tay, Y., Bommasani, R., Raffel, C., Zoph, B., Borgeaud, S., Yogatama, D., Bosma, M., Zhou, D., Metzler, D., et al.: Emergent abilities of large language models. arXiv preprint arXiv:2206.07682 (2022)
2022 arXiv
-
[30]
arXiv preprint arXiv:2403.15796 (2024)
Du, Z., Zeng, A., Dong, Y., Tang, J.: Understanding emergent abilities of language models from the loss perspective. arXiv preprint arXiv:2403.15796 (2024)
2024 arXiv
-
[31]
arXiv preprint arXiv:2201.02177 (2022)
Power, A., Burda, Y., Edwards, H., Babuschkin, I., Misra, V.: Grokking: Gen- eralization beyond overfitting on small algorithmic datasets. arXiv preprint arXiv:2201.02177 (2022)
2022 arXiv
-
[32]
NIPS ’23, pp
Schaeffer, R., Miranda, B., Koyejo, S.: Are emergent abilities of large language models a mirage? In: Proceedings of the 37th International Conference on Neural Information Processing Systems. NIPS ’23, pp. 1–13. Curran Associates Inc., Red Hook, NY, USA (2024)
2024
-
[33]
arXiv preprint arXiv:2306.09479 (2023)
McKenzie, I.R., Lyzhov, A., Pieler, M., Parrish, A., Mueller, A., Prabhu, A., McLean, E., Kirtland, A., Ross, A., Liu, A., et al.: Inverse scaling: When bigger isn’t better. arXiv preprint arXiv:2306.09479 (2023)
2023 arXiv
-
[34]
arXiv preprint arXiv:2404.01367 (2024)
Mei, K., Tu, Z., Delbracio, M., Talebi, H., Patel, V.M., Milanfar, P.: Bigger is not always better: Scaling properties of latent diffusion models. arXiv preprint arXiv:2404.01367 (2024)
2024 arXiv
-
[35]
arXiv preprint arXiv:2404.06395 (2024) 24
Hu, S., Tu, Y., Han, X., He, C., Cui, G., Long, X., Zheng, Z., Fang, Y., Huang, Y., Zhao, W., et al.: Minicpm: Unveiling the potential of small language models with scalable training strategies. arXiv preprint arXiv:2404.06395 (2024) 24
2024 arXiv
-
[36]
OpenAI blog 1(8), 9 (2019)
Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., Sutskever, I., et al.: Language models are unsupervised multitask learners. OpenAI blog 1(8), 9 (2019)
2019
-
[37]
arXiv preprint arXiv:2205.01068 (2022)
Zhang, S., Roller, S., Goyal, N., Artetxe, M., Chen, M., Chen, S., Dewan, C., Diab, M., Li, X., Lin, X.V., et al.: Opt: Open pre-trained transformer language models. arXiv preprint arXiv:2205.01068 (2022)
2022 arXiv
-
[38]
Journal of Machine Learning Research 24(240), 1–113 (2023)
Chowdhery, A., Narang, S., Devlin, J., Bosma, M., Mishra, G., Roberts, A., Barham, P., Chung, H.W., Sutton, C., Gehrmann, S., et al.: Palm: Scaling lan- guage modeling with pathways. Journal of Machine Learning Research 24(240), 1–113 (2023)
2023
-
[39]
arXiv preprint arXiv:2306.11644 (2023)
Gunasekar, S., Zhang, Y., Aneja, J., Mendes, C.C.T., Del Giorno, A., Gopi, S., Javaheripi, M., Kauffmann, P., Rosa, G., Saarikivi, O., et al.: Textbooks are all you need. arXiv preprint arXiv:2306.11644 (2023)
2023 arXiv
-
[40]
arXiv preprint arXiv:2309.10305 (2023)
Yang, A., Xiao, B., Wang, B., Zhang, B., Bian, C., Yin, C., Lv, C., Pan, D., Wang, D., Yan, D., et al.: Baichuan 2: Open large-scale language models. arXiv preprint arXiv:2309.10305 (2023)
2023 arXiv
-
[41]
arXiv preprint arXiv:2401.02954 (2024)
Bi, X., Chen, D., Chen, G., Chen, S., Dai, D., Deng, C., Ding, H., Dong, K., Du, Q., Fu, Z., et al.: Deepseek llm: Scaling open-source language models with longtermism. arXiv preprint arXiv:2401.02954 (2024)
2024 arXiv
-
[42]
ArXiv abs/2210.11416 (2022)
Chung, H.W., Hou, L., Longpre, S., Zoph, B., Tay, Y., Fedus, W., Li, E., Wang, X., Dehghani, M., Brahma, S., Webson, A., Gu, S.S., Dai, Z., Suzgun, M., Chen, X., Chowdhery, A., Valter, D., Narang, S., Mishra, G., Yu, A.W., Zhao, V., Huang, Y., Dai, A.M., Yu, H., Petrov, S., Ch...
2022 arXiv
-
[43]
Advances in neural information processing systems 35, 27730–27744 (2022)
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al.: Training language models to follow instructions with human feedback. Advances in neural information processing systems 35, 27730–27744 (2022)
2022
-
[44]
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., Klimov, O.: Proximal Policy Optimization Algorithms (2017)
2017
-
[45]
In: Oh, A., Neumann, T., Globerson, A., Saenko, K., Hardt, M., Levine, S
Rafailov, R., Sharma, A., Mitchell, E., Manning, C.D., Ermon, S., Finn, C.: Direct preference optimization: Your language model is secretly a reward model. In: Oh, A., Neumann, T., Globerson, A., Saenko, K., Hardt, M., Levine, S. (eds.) Advances in Neural Information Processin...
2023
-
[46]
arXiv preprint arXiv:2404.10719 (2024)
Xu, S., Fu, W., Gao, J., Ye, W., Liu, W., Mei, Z., Wang, G., Yu, C., Wu, Y.: Is 25 dpo superior to ppo for llm alignment? a comprehensive study. arXiv preprint arXiv:2404.10719 (2024)
2024 arXiv
-
[47]
ACM Computing Surveys 55(9), 1–35 (2023)
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., Neubig, G.: Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing. ACM Computing Surveys 55(9), 1–35 (2023)
2023
-
[48]
Advances in neural information processing systems 35, 24824–24837 (2022)
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Xia, F., Chi, E., Le, Q.V., Zhou, D., et al.: Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems 35, 24824–24837 (2022)
2022
-
[49]
In: Proceedings of the 37th International Conference on Neural Information Processing Systems
Yao, S., Yu, D., Zhao, J., Shafran, I., Griffiths, T.L., Cao, Y., Narasimhan, K.: Tree of thoughts: deliberate problem solving with large language models. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. NIPS ’23, pp. 1–14. Curran ...
2024
-
[50]
In: 11th International Conference on Learning Representations, ICLR 2023, pp
Wang, X., Wei, J., Schuurmans, D., Le, Q., Chi, E., Zhou, D.: Self-consistency improves chain of thought reasoning in language models. In: 11th International Conference on Learning Representations, ICLR 2023, pp. 1–15 (2023)
2023
-
[51]
arXiv preprint arXiv:2211.01910 (2022)
Zhou, Y., Muresanu, A.I., Han, Z., Paster, K., Pitis, S., Chan, H., Ba, J.: Large language models are human-level prompt engineers. arXiv preprint arXiv:2211.01910 (2022)
2022 arXiv
-
[52]
arXiv preprint arXiv:2309.03409 (2023)
Yang, C., Wang, X., Lu, Y., Liu, H., Le, Q.V., Zhou, D., Chen, X.: Large language models as optimizers. arXiv preprint arXiv:2309.03409 (2023)
2023 arXiv
-
[53]
In: Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Infor- mation Retrieval
Zhan, J., Ai, Q., Liu, Y., Chen, J., Ma, S.: Capability-aware prompt refor- mulation learning for text-to-image generation. In: Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Infor- mation Retrieval. SIGIR ’24, pp. 2145–2155. Associat...
2024
-
[54]
In: Ku, L.-W., Martins, A., Srikumar, V
Zhan, J., Ai, Q., Liu, Y., Pan, Y., Yao, T., Mao, J., Ma, S., Mei, T.: Prompt refinement with image pivot for text-to-image generation. In: Ku, L.-W., Martins, A., Srikumar, V. (eds.) Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Vol-...
2024 doi
-
[55]
Advances in neural information processing systems 32 (2019) 26
Lu, J., Batra, D., Parikh, D., Lee, S.: Vilbert: Pretraining task-agnostic visi- olinguistic representations for vision-and-language tasks. Advances in neural information processing systems 32 (2019) 26
2019
-
[56]
In: European Conference on Computer Vision, pp
Chen, Y.-C., Li, L., Yu, L., El Kholy, A., Ahmed, F., Gan, Z., Cheng, Y., Liu, J.: Uniter: Universal image-text representation learning. In: European Conference on Computer Vision, pp. 104–120 (2020). Springer
2020
-
[57]
arXiv preprint arXiv:2004.00849 (2020)
Huang, Z., Zeng, Z., Liu, B., Fu, D., Fu, J.: Pixel-bert: Aligning image pixels with text by deep multi-modal transformers. arXiv preprint arXiv:2004.00849 (2020)
2020 arXiv
-
[58]
In: International Conference on Machine Learning, pp
Wang, P., Yang, A., Men, R., Lin, J., Bai, S., Li, Z., Ma, J., Zhou, C., Zhou, J., Yang, H.: Ofa: Unifying architectures, tasks, and modalities through a sim- ple sequence-to-sequence learning framework. In: International Conference on Machine Learning, pp. 23318–23340 (2022). PMLR
2022
-
[59]
Advances in neural information processing systems 35, 23716–23736 (2022)
Alayrac, J.-B., Donahue, J., Luc, P., Miech, A., Barr, I., Hasson, Y., Lenc, K., Mensch, A., Millican, K., Reynolds, M.,et al.: Flamingo: a visual language model for few-shot learning. Advances in neural information processing systems 35, 23716–23736 (2022)
2022
-
[60]
arXiv preprint arXiv:2311.03079 (2023)
Wang, W., Lv, Q., Yu, W., Hong, W., Qi, J., Wang, Y., Ji, J., Yang, Z., Zhao, L., Song, X., et al.: Cogvlm: Visual expert for pretrained language models. arXiv preprint arXiv:2311.03079 (2023)
2023 arXiv
-
[61]
In: International Conference on Machine Learning, pp
Li, J., Li, D., Savarese, S., Hoi, S.: Blip-2: Bootstrapping language-image pre- training with frozen image encoders and large language models. In: International Conference on Machine Learning, pp. 19730–19742 (2023). PMLR
2023
-
[62]
In: International Conference on Machine Learning, pp
Kim, W., Son, B., Kim, I.: Vilt: Vision-and-language transformer without convo- lution or region supervision. In: International Conference on Machine Learning, pp. 5583–5594 (2021). PMLR
2021
-
[63]
Advances in neural information processing systems 34, 9694–9705 (2021)
Li, J., Selvaraju, R., Gotmare, A., Joty, S., Xiong, C., Hoi, S.C.H.: Align before fuse: Vision and language representation learning with momentum distillation. Advances in neural information processing systems 34, 9694–9705 (2021)
2021
-
[64]
In: International Conference on Machine Learning, pp
Radford, A., Kim, J.W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al.: Learning transferable visual mod- els from natural language supervision. In: International Conference on Machine Learning, pp. 8748–8763 (2021). PMLR
2021
-
[65]
arXiv preprint arXiv:2312.00849 (2023)
Yu, T., Yao, Y., Zhang, H., He, T., Han, Y., Cui, G., Hu, J., Liu, Z., Zheng, H.- T., Sun, M., et al.: Rlhf-v: Towards trustworthy mllms via behavior alignment from fine-grained correctional human feedback. arXiv preprint arXiv:2312.00849 (2023)
2023 arXiv
-
[66]
arXiv preprint arXiv:2106.08254 (2021) 27
Bao, H., Dong, L., Piao, S., Wei, F.: Beit: Bert pre-training of image transform- ers. arXiv preprint arXiv:2106.08254 (2021) 27
2021 arXiv
-
[67]
In: International Conference on Machine Learning, pp
Reed, S., Akata, Z., Yan, X., Logeswaran, L., Schiele, B., Lee, H.: Generative adversarial text to image synthesis. In: International Conference on Machine Learning, pp. 1060–1069 (2016). PMLR
2016
-
[68]
In: International Conference on Machine Learning, pp
Ramesh, A., Pavlov, M., Goh, G., Gray, S., Voss, C., Radford, A., Chen, M., Sutskever, I.: Zero-shot text-to-image generation. In: International Conference on Machine Learning, pp. 8821–8831 (2021). Pmlr
2021
-
[69]
arXiv preprint arXiv:2112.10741 (2021)
Nichol, A., Dhariwal, P., Ramesh, A., Shyam, P., Mishkin, P., McGrew, B., Sutskever, I., Chen, M.: Glide: Towards photorealistic image generation and editing with text-guided diffusion models. arXiv preprint arXiv:2112.10741 (2021)
2021 arXiv
-
[70]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., Ommer, B.: High-resolution image synthesis with latent diffusion models. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10684–10695 (2022)
2022
-
[71]
Advances in neural information processing systems 33, 6840–6851 (2020)
Ho, J., Jain, A., Abbeel, P.: Denoising diffusion probabilistic models. Advances in neural information processing systems 33, 6840–6851 (2020)
2020
-
[72]
arXiv preprint arXiv:2303.07909 (2023)
Zhang, C., Zhang, C., Zhang, M., Kweon, I.S.: Text-to-image diffusion model in generative ai: A survey. arXiv preprint arXiv:2303.07909 (2023)
2023 arXiv
-
[73]
In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp
Peebles, W., Xie, S.: Scalable diffusion models with transformers. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 4195–4205 (2023)
2023
-
[74]
In: 2023 4th International Conference on Artificial Intelligence, Robotics and Control (AIRC), pp
Singh, A.: A survey of ai text-to-image and ai text-to-video generators. In: 2023 4th International Conference on Artificial Intelligence, Robotics and Control (AIRC), pp. 32–36 (2023). IEEE
2023
-
[75]
Computer Science
Betker, J., Goh, G., Jing, L., Brooks, T., Wang, J., Li, L., Ouyang, L., Zhuang, J., Lee, J., Guo, Y., et al.: Improving image generation with better captions. Computer Science. https://cdn. openai. com/papers/dall-e-3. pdf 2(3), 8 (2023)
2023
-
[76]
Brooks, T., Peebles, B., Holmes, C., DePue, W., Guo, Y., Jing, L., Schnurr, D., Taylor, J., Luhman, T., Luhman, E., Ng, C., Wang, R., Ramesh, A.: Video generation models as world simulators (2024)
2024
-
[77]
Behaviour & Information Technology, 1–14 (2023)
Oppenlaender, J.: A taxonomy of prompt modifiers for text-to-image generation. Behaviour & Information Technology, 1–14 (2023)
2023
-
[78]
In: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, pp
Liu, V., Chilton, L.B.: Design guidelines for prompt engineering text-to-image generative models. In: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, pp. 1–23 (2022) 28
2022
-
[79]
Hao, Y., Chi, Z., Dong, L., Wei, F.: Optimizing prompts for text-to-image generation, pp. 1–17. Curran Associates Inc., Red Hook, NY, USA (2024)
2024
-
[81]
Natural Language Processing Journal 7, 100065 (2024)
Arefeen, M.A., Debnath, B., Chakradhar, S.: Leancontext: Cost-efficient domain-specific question answering using llms. Natural Language Processing Journal 7, 100065 (2024)
2024
-
[82]
arXiv preprint arXiv:2004.02105 (2020)
Aharoni, R., Goldberg, Y.: Unsupervised domain clusters in pretrained language models. arXiv preprint arXiv:2004.02105 (2020)
2020 arXiv
-
[83]
arXiv preprint arXiv:2403.18365 (2024)
Li, H., Ai, Q., Chen, J., Dong, Q., Wu, Z., Liu, Y., Chen, C., Tian, Q.: Blade: Enhancing black-box large language models with small domain-specific models. arXiv preprint arXiv:2403.18365 (2024)
2024 arXiv
-
[84]
arXiv preprint arXiv:2312.10997 (2023)
Gao, Y., Xiong, Y., Gao, X., Jia, K., Pan, J., Bi, Y., Dai, Y., Sun, J., Wang, H.: Retrieval-augmented generation for large language models: A survey. arXiv preprint arXiv:2312.10997 (2023)
2023 arXiv
-
[85]
Advances in Neural Information Processing Systems 33, 9459–9474 (2020)
Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., K¨ uttler, H., Lewis, M., Yih, W.-t., Rockt¨ aschel, T., et al.: Retrieval-augmented gen- eration for knowledge-intensive nlp tasks. Advances in Neural Information Processing Systems 33, 9459–9474 (2020)
2020
-
[86]
In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoy- anov, V., Zettlemoyer, L.: Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. In: Proceedings of the 58th Annual Meeting of the Associ...
2020
-
[87]
In: 2017 International Conference on Computer, Communication and Signal Processing (ICCCSP), pp
Moratanch, N., Chitrakala, S.: A survey on extractive text summarization. In: 2017 International Conference on Computer, Communication and Signal Processing (ICCCSP), pp. 1–6 (2017). IEEE
2017
-
[88]
In: Proceedings of the AAAI Conference on Artificial Intelligence, vol
Lin, H., Ng, V.: Abstractive summarization: A survey of the state of the art. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 9815–9822 (2019)
2019
-
[89]
Bajaj, P., Campos, D., Craswell, N., Deng, L., Gao, J., Liu, X., Majumder, R., McNamara, A., Mitra, B., Nguyen, T., Rosenberg, M., Song, X., Stoica, A., Tiwary, S., Wang, T.: MS MARCO: A Human Generated MAchine Reading COmprehension Dataset (2018)
2018
-
[90]
arXiv preprint arXiv:2402.19473 (2024)
Zhao, P., Zhang, H., Yu, Q., Wang, Z., Geng, Y., Fu, F., Yang, L., Zhang, 29 W., Cui, B.: Retrieval-augmented generation for ai-generated content: A survey. arXiv preprint arXiv:2402.19473 (2024)
2024 arXiv
-
[91]
In: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 6: Tutorial Abstracts), pp
Asai, A., Min, S., Zhong, Z., Chen, D.: Retrieval-based language models and applications. In: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 6: Tutorial Abstracts), pp. 41–46 (2023)
2023
-
[92]
In: International Conference on Machine Learning, pp
Guu, K., Lee, K., Tung, Z., Pasupat, P., Chang, M.: Retrieval augmented lan- guage model pre-training. In: International Conference on Machine Learning, pp. 3929–3938 (2020). PMLR
2020
-
[93]
arXiv preprint arXiv:2305.14283 (2023)
Ma, X., Gong, Y., He, P., Zhao, H., Duan, N.: Query rewriting for retrieval- augmented large language models. arXiv preprint arXiv:2305.14283 (2023)
2023 arXiv
-
[94]
Frontiers of Computer Science 18(6), 186345 (2024)
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., et al.: A survey on large language model based autonomous agents. Frontiers of Computer Science 18(6), 186345 (2024)
2024
-
[95]
Zhang, Z., Bo, X., Ma, C., Li, R., Chen, X., Dai, Q., Zhu, J., Dong, Z., Wen, J.-R.: A Survey on the Memory Mechanism of Large Language Model based Agents (2024)
2024
-
[96]
In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp
Zhan, J., Mao, J., Liu, Y., Guo, J., Zhang, M., Ma, S.: Optimizing dense retrieval model training with hard negatives. In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1503–1512 (2021)
2021
-
[97]
Foundations and Trends® in Information Retrieval 3(4), 333–389 (2009)
Robertson, S., Zaragoza, H., et al.: The probabilistic relevance framework: Bm25 and beyond. Foundations and Trends® in Information Retrieval 3(4), 333–389 (2009)
2009
-
[98]
arXiv preprint arXiv:2405.14431 (2024)
Mao, S., Jiang, Y., Chen, B., Li, X., Wang, P., Wang, X., Xie, P., Huang, F., Chen, H., Zhang, N.: Rafe: Ranking feedback improves query rewriting for rag. arXiv preprint arXiv:2405.14431 (2024)
2024 arXiv
-
[99]
arXiv preprint arXiv:2404.00610 (2024)
Chan, C.-M., Xu, C., Yuan, R., Luo, H., Xue, W., Guo, Y., Fu, J.: Rq-rag: Learning to refine queries for retrieval augmented generation. arXiv preprint arXiv:2404.00610 (2024)
2024 arXiv
-
[100]
arXiv preprint arXiv:2404.02060 (2024)
Li, T., Zhang, G., Do, Q.D., Yue, X., Chen, W.: Long-context llms struggle with long in-context learning. arXiv preprint arXiv:2404.02060 (2024)
2024 arXiv
-
[101]
Transactions of the Association for Computational Linguistics 12, 157–173 (2024)
Liu, N.F., Lin, K., Hewitt, J., Paranjape, A., Bevilacqua, M., Petroni, F., Liang, P.: Lost in the middle: How language models use long contexts. Transactions of the Association for Computational Linguistics 12, 157–173 (2024)
2024
-
[102]
In: Proceedings of the 2023 ACM SIGIR International Conference on Theory of Information Retrieval, pp
Faggioli, G., Dietz, L., Clarke, C.L., Demartini, G., Hagen, M., Hauff, C., Kando, 30 N., Kanoulas, E., Potthast, M., Stein, B., et al.: Perspectives on large lan- guage models for relevance judgment. In: Proceedings of the 2023 ACM SIGIR International Conference on Theory of ...
2023
-
[103]
ACM Comput
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., Neubig, G.: Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing. ACM Comput. Surv. 55(9) (2023) https://doi.org/10.1145/3560815
2023 doi
-
[104]
arXiv preprint arXiv:2308.11761 (2023)
Wang, X., Yang, Q., Qiu, Y., Liang, J., He, Q., Gu, Z., Xiao, Y., Wang, W.: Knowledgpt: Enhancing large language models with retrieval and storage access on knowledge bases. arXiv preprint arXiv:2308.11761 (2023)
2023 arXiv
-
[105]
Qin, Y., Hu, S., Lin, Y., Chen, W., Ding, N., Cui, G., Zeng, Z., Huang, Y., Xiao, C., Han, C., Fung, Y.R., Su, Y., Wang, H., Qian, C., Tian, R., Zhu, K., Liang, S., Shen, X., Xu, B., Zhang, Z., Ye, Y., Li, B., Tang, Z., Yi, J., Zhu, Y., Dai, Z., Yan, L., Cong, X., Lu, Y., Zhao...
2023
-
[106]
In: Bouamor, H., Pino, J., Bali, K
Jiang, Z., Xu, F., Gao, L., Sun, Z., Liu, Q., Dwivedi-Yu, J., Yang, Y., Callan, J., Neubig, G.: Active retrieval augmented generation. In: Bouamor, H., Pino, J., Bali, K. (eds.) Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pp. 7969–79...
2023 doi
-
[107]
Transactions of the Association for Computational Linguistics 11, 1316–1331 (2023)
Ram, O., Levine, Y., Dalmedigos, I., Muhlgay, D., Shashua, A., Leyton-Brown, K., Shoham, Y.: In-context retrieval-augmented language models. Transactions of the Association for Computational Linguistics 11, 1316–1331 (2023)
2023
-
[108]
In: International Conference on Machine Learning, pp
Borgeaud, S., Mensch, A., Hoffmann, J., Cai, T., Rutherford, E., Millican, K., Van Den Driessche, G.B., Lespiau, J.-B., Damoc, B., Clark, A., et al.: Improv- ing language models by retrieving from trillions of tokens. In: International Conference on Machine Learning, pp. 2206–...
2022
-
[109]
In: Rogers, A., Boyd-Graber, J., Okazaki, N
Trivedi, H., Balasubramanian, N., Khot, T., Sabharwal, A.: Interleaving retrieval with chain-of-thought reasoning for knowledge-intensive multi-step questions. In: Rogers, A., Boyd-Graber, J., Okazaki, N. (eds.) Proceedings of the 61st Annual Meeting of the Association for Com...
2023 doi
-
[110]
arXiv preprint arXiv:2402.11457 (2024) 31
Ni, S., Bi, K., Guo, J., Cheng, X.: When do llms need retrieval augmentation? mitigating llms’ overconfidence helps retrieval augmentation. arXiv preprint arXiv:2402.11457 (2024) 31
2024 arXiv
-
[111]
In: Ku, L.-W., Martins, A., Srikumar, V
Su, W., Tang, Y., Ai, Q., Wu, Z., Liu, Y.: DRAGIN: Dynamic retrieval aug- mented generation based on the real-time information needs of large language models. In: Ku, L.-W., Martins, A., Srikumar, V. (eds.) Proceedings of the 62nd Annual Meeting of the Association for Computat...
2024 doi
-
[112]
In: Ku, L.-W., Martins, A., Srikumar, V
Su, W., Wang, C., Ai, Q., Hu, Y., Wu, Z., Zhou, Y., Liu, Y.: Unsupervised real-time hallucination detection based on the internal states of large language models. In: Ku, L.-W., Martins, A., Srikumar, V. (eds.) Findings of the Asso- ciation for Computational Linguistics: ACL 2...
2024
-
[113]
arXiv preprint arXiv:2104.08704 (2021)
Liu, T., Zhang, Y., Brockett, C., Mao, Y., Sui, Z., Chen, W., Dolan, B.: A token-level reference-free hallucination detection benchmark for free-form text generation. arXiv preprint arXiv:2104.08704 (2021)
2021 arXiv
-
[114]
arXiv preprint arXiv:2403.04696 (2024)
Fadeeva, E., Rubashevskii, A., Shelmanov, A., Petrakov, S., Li, H., Mubarak, H., Tsymbalov, E., Kuzmin, G., Panchenko, A., Baldwin, T., et al.: Fact-checking the output of large language models via token-level uncertainty quantification. arXiv preprint arXiv:2403.04696 (2024)
2024 arXiv
-
[115]
In: Proceedings of HLT, vol
Cronen-Townsend, S., Croft, W.B., et al.: Quantifying query ambiguity. In: Proceedings of HLT, vol. 2, pp. 94–98 (2002)
2002
-
[116]
International Journal of Cooperative Information Systems 02(02), 127–158 (1993) https://doi.org/10
ARENS, Y., CHEE, C.Y., HSU, C.-N., KNOBLOCK, C.A.: Retrieving and integrating data from multiple information sources. International Journal of Cooperative Information Systems 02(02), 127–158 (1993) https://doi.org/10. 1142/S0218215793000071 https://doi.org/10.1142/S0218215793000071
1993 doi
-
[117]
Wang, J., Mo, F., Ma, W., Sun, P., Zhang, M., Nie, J.-Y.: A User-Centric Benchmark for Evaluating Large Language Models (2024)
2024
-
[118]
Wang, J., Ma, W., Sun, P., Zhang, M., Nie, J.-Y.: Understanding User Experience in Large Language Model Interactions (2024)
2024
-
[119]
Journal of the American Society for Information Science and Technology 55(10), 859–868 (2004)
Beitzel, S.M., Jensen, E.C., Chowdhury, A., Grossman, D., Frieder, O., Gohar- ian, N.: Fusion of effective retrieval strategies in the same information retrieval system. Journal of the American Society for Information Science and Technology 55(10), 859–868 (2004)
2004
-
[120]
Information processing & management 42(4), 899–915 (2006) 32
Wu, S., McClean, S.: Performance prediction of data fusion for information retrieval. Information processing & management 42(4), 899–915 (2006) 32
2006
-
[121]
In: Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp
Cormack, G.V., Clarke, C.L., Buettcher, S.: Reciprocal rank fusion outper- forms condorcet and individual rank learning methods. In: Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 758–759 (2009)
2009
-
[122]
In: Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, pp
Lee, C.-J., Ai, Q., Croft, W.B., Sheldon, D.: An optimization framework for merging multiple result lists. In: Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, pp. 303–312 (2015)
2015
-
[123]
Foundations and Trends® in Information Retrieval 3(3), 225–331 (2009)
Liu, T.-Y., et al.: Learning to rank for information retrieval. Foundations and Trends® in Information Retrieval 3(3), 225–331 (2009)
2009
-
[124]
arXiv preprint arXiv:2010.10469 (2020)
Zhan, J., Mao, J., Liu, Y., Zhang, M., Ma, S.: Learning to retrieve: How to train a dense retrieval model effectively and efficiently. arXiv preprint arXiv:2010.10469 (2020)
2020 arXiv
-
[125]
arXiv preprint arXiv:2310.20158 (2023)
Arora, D., Kini, A., Chowdhury, S.R., Natarajan, N., Sinha, G., Sharma, A.: Gar-meets-rag paradigm for zero-shot information retrieval. arXiv preprint arXiv:2310.20158 (2023)
2023 arXiv
-
[126]
Zhang, T., Patil, S.G., Jain, N., Shen, S., Zaharia, M., Stoica, I., Gonzalez, J.E.: RAFT: Adapting Language Model to Domain Specific RAG (2024)
2024
-
[127]
arXiv preprint arXiv:2208.07563 (2022)
Xu, Z., Tran, A., Yang, T., Ai, Q.: Reinforcement learning to rank with coarse- grained labels. arXiv preprint arXiv:2208.07563 (2022)
2022 arXiv
-
[128]
arXiv preprint arXiv:2301.12652 (2023)
Shi, W., Min, S., Yasunaga, M., Seo, M., James, R., Lewis, M., Zettlemoyer, L., Yih, W.-t.: Replug: Retrieval-augmented black-box language models. arXiv preprint arXiv:2301.12652 (2023)
2023 arXiv
-
[129]
AI Open 4, 80–90 (2023)
Ai, Q., Bai, T., Cao, Z., Chang, Y., Chen, J., Chen, Z., Cheng, Z., Dong, S., Dou, Z., Feng, F., et al.: Information retrieval meets large language models: a strategic report from chinese ir community. AI Open 4, 80–90 (2023)
2023
-
[130]
In: Proceedings of the 23rd International Conference on World Wide Web, pp
Bota, H., Zhou, K., Jose, J.M., Lalmas, M.: Composite retrieval of heterogeneous web search. In: Proceedings of the 23rd International Conference on World Wide Web, pp. 119–130 (2014)
2014
-
[131]
IEEE Transactions on Knowledge and Data Engineering 26(11), 2662–2675 (2014)
Amer-Yahia, S., Bonchi, F., Castillo, C., Feuerstein, E., Mendez-Diaz, I., Zabala, P.: Composite retrieval of diverse and complementary bundles. IEEE Transactions on Knowledge and Data Engineering 26(11), 2662–2675 (2014)
2014
-
[132]
Information Sciences 181(24), 5412–5434 (2011)
Kolomiyets, O., Moens, M.-F.: A survey on question answering technology from an information retrieval perspective. Information Sciences 181(24), 5412–5434 (2011)
2011
-
[133]
SIGIR Forum 55(1) (2021) https://doi.org/10.1145/ 3476415.3476428
Metzler, D., Tay, Y., Bahri, D., Najork, M.: Rethinking search: making domain 33 experts out of dilettantes. SIGIR Forum 55(1) (2021) https://doi.org/10.1145/ 3476415.3476428
2021
-
[134]
https://arxiv.org/abs/2206.10128
Zhuang, S., Ren, H., Shou, L., Pei, J., Gong, M., Zuccon, G., Jiang, D.: Bridging the Gap Between Indexing and Retrieval for Differentiable Search Index with Query Generation (2023). https://arxiv.org/abs/2206.10128
2023 arXiv
-
[135]
Advances in Neural Information Processing Systems 35, 21831–21843 (2022)
Tay, Y., Tran, V., Dehghani, M., Ni, J., Bahri, D., Mehta, H., Qin, Z., Hui, K., Zhao, Z., Gupta, J., et al.: Transformer memory as a differentiable search index. Advances in Neural Information Processing Systems 35, 21831–21843 (2022)
2022
-
[136]
In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp
Tang, Y., Zhang, R., Guo, J., Chen, J., Zhu, Z., Wang, S., Yin, D., Cheng, X.: Semantic-enhanced differentiable search index inspired by learning strategies. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp. 4904–4913 (2023)
2023
-
[137]
In: Proceedings of the 37th International Conference on Neural Information Processing Systems
Sun, W., Yan, L., Chen, Z., Wang, S., Zhu, H., Ren, P., Chen, Z., Yin, D., Rijke, M., Ren, Z.: Learning to tokenize for generative retrieval. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. NIPS ’23, pp. 1–17. Curran Associates In...
2024
-
[138]
arXiv preprint arXiv:2306.11397 (2023)
Nguyen, T., Yates, A.: Generative retrieval as dense retrieval. arXiv preprint arXiv:2306.11397 (2023)
2023 arXiv
-
[139]
In: Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining
Zhan, J., Mao, J., Liu, Y., Guo, J., Zhang, M., Ma, S.: Learning discrete repre- sentations via constrained clustering for effective and efficient dense retrieval. In: Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. WSDM ’22, pp. 1328–1...
2022
-
[140]
In: Proceedings of the ACM on Web Conference 2024
Zeng, H., Luo, C., Jin, B., Sarwar, S.M., Wei, T., Zamani, H.: Scalable and effective generative information retrieval. In: Proceedings of the ACM on Web Conference 2024. WWW ’24, pp. 1441–1452. Association for Computing Machin- ery, New York, NY, USA (2024). https://doi.org/1...
2024
-
[141]
Zeng, H., Luo, C., Zamani, H.: Planning Ahead in Generative Retrieval: Guiding Autoregressive Generation through Simultaneous Decoding (2024)
2024
-
[142]
In: Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp
Wu, S., Wei, W., Zhang, M., Chen, Z., Ma, J., Ren, Z., Rijke, M., Ren, P.: Generative retrieval as multi-vector dense retrieval. In: Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1828–1838 (2024)
2024
-
[143]
In: Proceed- ings of the 30th ACM International Conference on Information & Knowledge Management
Zhan, J., Mao, J., Liu, Y., Guo, J., Zhang, M., Ma, S.: Jointly optimizing query 34 encoder and product quantization to improve retrieval performance. In: Proceed- ings of the 30th ACM International Conference on Information & Knowledge Management. CIKM ’21, pp. 2487–2496. Ass...
2021
-
[144]
arXiv preprint arXiv:2109.07460 (2021)
Sachidananda, V., Kessler, J.S., Lai, Y.-A.: Efficient domain adaptation of language models via adaptive tokenization. arXiv preprint arXiv:2109.07460 (2021)
2021 arXiv
-
[145]
arXiv preprint arXiv:2305.15062 (2023)
Huang, Q., Tao, M., Zhang, C., An, Z., Jiang, C., Chen, Z., Wu, Z., Feng, Y.: Lawyer llama technical report. arXiv preprint arXiv:2305.15062 (2023)
2023 arXiv
-
[146]
arXiv preprint arXiv:2306.16092 (2023)
Cui, J., Li, Z., Yan, Y., Chen, B., Yuan, L.: Chatlaw: Open-source legal large language model with integrated external knowledge bases. arXiv preprint arXiv:2306.16092 (2023)
2023 arXiv
-
[147]
arXiv preprint arXiv:2303.17564 (2023)
Wu, S., Irsoy, O., Lu, S., Dabravolski, V., Dredze, M., Gehrmann, S., Kambadur, P., Rosenberg, D., Mann, G.: Bloomberggpt: A large language model for finance. arXiv preprint arXiv:2303.17564 (2023)
2023 arXiv
-
[148]
arXiv preprint arXiv:2104.08696 (2021)
Dai, D., Dong, L., Hao, Y., Sui, Z., Chang, B., Wei, F.: Knowledge neurons in pretrained transformers. arXiv preprint arXiv:2104.08696 (2021)
2021 arXiv
-
[149]
Advances in Neural Information Processing Systems 35, 17359–17372 (2022)
Meng, K., Bau, D., Andonian, A., Belinkov, Y.: Locating and editing factual associations in gpt. Advances in Neural Information Processing Systems 35, 17359–17372 (2022)
2022
-
[150]
arXiv preprint arXiv:2402.11324 (2024)
Liu, J., Yu, P., Zhang, Y., Li, S., Zhang, Z., Ji, H.: Evedit: Event-based knowl- edge editing with deductive editing boundaries. arXiv preprint arXiv:2402.11324 (2024)
2024 arXiv
-
[151]
arXiv preprint arXiv:2106.09685 (2021)
Hu, E.J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., Chen, W.: Lora: Low-rank adaptation of large language models. arXiv preprint arXiv:2106.09685 (2021)
2021 arXiv
-
[152]
In: Pro- ceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp
Li, H., Ai, Q., Chen, J., Dong, Q., Wu, Y., Liu, Y., Chen, C., Tian, Q.: Sailer: structure-aware pre-trained language model for legal case retrieval. In: Pro- ceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1035...
2023
-
[153]
Generative AI in Content Creation Competition: Symbiosis or Conflict? (2024) 35
Yao, F., Li, C., Nekipelov, D., Wang, H., Xu, H.: Human vs. Generative AI in Content Creation Competition: Symbiosis or Conflict? (2024) 35
2024
Reviewed August 10, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.