Pith. sign in

REVIEW 4 major objections 6 minor 33 references

Text Summarization in the Biomedical Domain

T0 review · 4 major / 6 minor · reviewed 2026-08-14 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read Biomedical text summarization's leading edge is knowledge-rich, UMLS-based extraction.

desk verdict A readable narrative review of biomedical text summarization, useful as an entry point, but its central 'trend toward knowledge-rich methods' claim rests on a curated selection that is not systematically justified. read the letter →

arxiv 1908.02285 v1 pith:BZ2AELOX submitted 2019-08-06 cs.CL

Milad Moradi , Nasser Ghadiri This is my paper · ORCID
classification cs.CL
keywords biomedicaltextsummarizationUMLSdomainknowledgeextractiveliteratureMEDLINEabstractsfrequentitemsetminingevaluationbenchmarks
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This review chapter tries to establish that the last decade of biomedical text summarization has been defined by a shift from generic statistical features toward knowledge-rich methods: systems increasingly map texts to biomedical concepts and relations from domain resources, most often the UMLS, and use those concepts to identify topics and select sentences. It organizes the field by the challenge each method addresses, from biomedical literature and MEDLINE abstracts to evidence-based practice, data curation, and ambiguity resolution, and reports that most work is extractive summarization of literature. The review also argues that the field's main bottleneck is evaluation: there are no standard datasets or benchmarks, abstracts are routinely used as model summaries even though they are author-written and do not contain the full text's sentences, and almost all evaluation is intrinsic rather than extrinsic. A sympathetic reader would conclude that concept-based extractive summarization is the current mainstream, and that building shared benchmarks and embedding summarization in real tasks is the pressing next step.

What carries the argument

The central machinery is the Unified Medical Language System (UMLS), a compendium of over 100 biomedical vocabularies and ontologies integrated into the Metathesaurus, the Specialist Lexicon, and the Semantic Network. In the systems the review presents, UMLS supplies the concepts and semantic relations used to represent input text as a graph or as a transactional dataset; frequent itemset mining then identifies the main topics, and sentence scoring selects sentences with the best concept coverage. An important secondary mechanism is the use of semantic predications, via tools like SemRep, for summarization of MEDLINE abstracts and decision support.

What would settle it

A systematic, reproducible search of the decade's biomedical summarization publications, with explicit inclusion criteria and a count of systems that use UMLS or other domain knowledge versus those that do not, would settle the trend claim. If most recent systems are not knowledge-rich, the review's central conclusion fails; likewise, if a neural abstractive system trained on raw text outperforms UMLS-based extractive systems on a shared benchmark, the claim that domain knowledge is the route to accuracy loses force.

Watch

Extended reading notes

Core claim

On its own terms, the chapter's central claim is that recent biomedical text summarization is trending toward systems that incorporate domain knowledge to enhance the accuracy of text modeling. The evidence it marshals consists of a series of systems that map input text to UMLS concepts and semantic relations, then build graphs or transactional representations, extract main topics via clustering or frequent itemset mining, and score sentences by concept coverage rather than surface features. The review concludes that most studies address biomedical literature, that UMLS is the dominant knowledge source, that the choice of knowledge source remains unresolved, and that standard benchmarks plus extrinsic evaluation are still missing. It points to task-specific ontologies, combined knowledge resources, and neural language models as the likely next stage.

Load-bearing premise

The review assumes the systems it chose to discuss are a fair sample of the field's significant advances, but it never states a search strategy or inclusion criteria, and several of the systems it highlights as first or latest are the authors' own earlier work.

Editorial extensions

If this is right

  • Concept-based extractive methods should remain the mainstream of biomedical summarization, with UMLS mapping as the standard first step.
  • Collections of UMLS concepts are expected to keep outperforming raw word features, especially for information coverage in multi-document summarization.
  • The absence of standard benchmarks will keep reported performance numbers hard to compare until a shared evaluation corpus for biomedical summarization is built.
  • Extrinsic evaluation, where summarization is embedded in retrieval, systematic review screening, or clinical decision support, should become a standard complement to intrinsic quality measures.
  • Task-specific knowledge sources and combinations of existing ontologies should increasingly replace the generic use of UMLS alone.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The trend toward UMLS-based methods may be partly an artifact of the authors' own line of work, since several 'first' and 'latest' systems in the survey are their own; a neutrally conducted bibliometric census would be the test.
  • The review treats neural language models as a future enhancement of knowledge-rich methods, but an equally plausible reading is that such models will make explicit UMLS mapping unnecessary by learning domain semantics from raw text, which would redirect rather than continue the trend.
  • The review's suggestion to combine literature and EHR summarization for clinical decision support could be turned into a concrete testbed: summarize retrieved literature against a patient's record and measure whether clinicians make better decisions than with either source alone.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 6 minor

Summary. The manuscript is a survey chapter reviewing recent advances in biomedical text summarization. It introduces standard categorizations (extractive vs. abstractive, single- vs. multi-document, generic vs. user-oriented), describes roughly 30 systems organized by application area (biomedical literature, MEDLINE abstracts, automatic abstract generation, evidence-based practice, data curation, and ambiguity resolution), and concludes that the field has trended toward knowledge-rich methods that incorporate domain knowledge, mainly UMLS, to improve text modeling. It also identifies future directions: development of standard benchmarks, extrinsic evaluation, task-specific knowledge sources, neural language models, and combining literature summarization with EHR summarization.

Significance. The paper provides a useful orientation for newcomers, and its taxonomy and system descriptions are generally consistent with the cited sources. Its strengths are the broad coverage of medical-informatics approaches (UMLS, SemRep, MeSH, graph-based and itemset methods) and the clear articulation of evaluation deficits, especially the lack of standard datasets and extrinsic evaluation. The future research directions are sensible. The main value is pedagogical; however, the central empirical claim—a field-wide trend toward knowledge-rich methods—is plausible but not established with systematic evidence, and the survey's selection and narration appear to be shaped by the authors' own research program.

major comments (4)
  1. [Conclusion and 'Recent Advances in Biomedical Text Summarization' (pp. 4-8)] The central claim that 'there had been a trend toward devising systems that incorporate domain knowledge' is a temporal generalization, but the review does not report a search strategy, inclusion criteria, time window, or quantitative breakdown. The narrative ordering of the 33 cited works does not establish representativeness. The authors should either document an explicit search and present a year-by-year table of included systems with their knowledge-source usage, or rephrase the conclusion as an observation about the selected systems rather than a field-wide trend.
  2. [References [2], [5], [7], [8], [9]; 'Recent Advances...' pp. 4-5] Five of the thirty-three references are the authors' own works, and the text repeatedly singles them out as 'the first method', 'the latest effort', and 'recent work'. These are exactly the itemset/UMLS papers that make the knowledge-rich trend look continuous. To mitigate selection bias, the authors should explicitly declare this overlap, count or describe independent systems from the same period, and discuss whether the trend persists when self-citations are discounted.
  3. [Background (p. 3) and Future Research Directions (p. 8)] The assertion that 'there has been a tendency to developing domain-specific summarizers through utilizing sources of domain knowledge... This has led to significant improvements' is supported only by reference [3] and no effect sizes or comparative results are given. Since this assertion is the basis of the paper's main conclusion, it needs either quantitative support from the surveyed systems or a more cautious framing as a qualitative observation.
  4. [Future Research Directions (p. 8)] The paper places neural network-based language models exclusively in future work, yet as of the manuscript date, neural abstractive summarization was already an active line in biomedical and scientific text. The survey does not explain why these systems are excluded from the 'recent advances' discussion; without that justification, the claim of a dominant UMLS-centric extractive trajectory is incomplete. Adding a paragraph on neural and purely statistical systems, even if briefly, would make the survey's scope explicit.
minor comments (6)
  1. [p. 2] The phrase 'advert events' should read 'adverse events'.
  2. [p. 6] 'with respect to the other tree filters' should be 'with respect to the three filters'.
  3. [p. 4] 'Concept Frequency-Invert Paragraph Frequency' should be 'Concept Frequency-Inverse Paragraph Frequency' (CF-IPF).
  4. [Headings throughout] Section headings are inconsistently numbered: 'INTRODUCTION' is 1, 'BACKGROUND' is 2, a subsequent UMLS paragraph is labeled 4, and 'RECENT ADVANCES...' is unnumbered; the numbering should be made consistent.
  5. [Figure 1] Figure 1 adds little information; a table of classification criteria and their options would be more useful to readers.
  6. [References] Reference [8] is the authors' thesis and reference [9] is a conference paper; the text does not distinguish them from peer-reviewed journal articles, which may mislead readers about the provenance of the claims.

Circularity Check

0 steps flagged · score 2.0 of 10

No circular derivation: the survey's trend claim is an empirical generalization with independent support, though a minor self-citation pattern colors the narrative.

full rationale

This chapter is a literature review rather than a derivation: it contains no equations, fitted parameters, or first-principles results whose outputs could reduce to inputs by construction. The central claim, that 'there had been a trend toward devising systems that incorporate domain knowledge to enhance the accuracy of text modeling' (Conclusion), is an empirical generalization about the surveyed literature, not a formal consequence of a definition. That claim is supported by multiple non-self citations, including Plaza's semantic graph work [6,18,21], Plaza et al. on ambiguity resolution [31-33], Zhang et al. on semantic abstraction [10,26], Workman et al. on Semantic MEDLINE [25,30], Fiszman et al. [11], Bhattacharya et al. on MeSH [19], and Ji et al. [28]; removing the authors' own works would still leave a substantial UMLS-based, knowledge-rich literature. There is a visible self-citation pattern: five of the thirty-three references are the authors' own ([2,5,7,8,9]), and the narrative labels [2] as 'the first method in biomedical text summarization that uses frequent itemset mining' and [7] as 'the latest effort toward exploiting frequent itemsets in biomedical summarization.' That is a priority and emphasis issue, not a circular step: those itemset papers are published, externally evaluated results, and the overall trend claim does not rest on them alone. The chapter's own Future Research Directions section concedes the lack of standard benchmarks and the abstract-as-gold-standard problem, which is an evidentiary limitation of the trend claim but not evidence of circularity. The absence of a stated search strategy is a sampling concern, not a derivation-circularity concern. Overall, no step reduces to its own input, so no circular step is reported; the minor self-citation pattern justifies only a low non-zero score.

Assumptions & free parameters 0 free parameters · 2 assumptions · 0 invented entities

The paper is a review with no free parameters, no new entities, and no derivations. Its contribution is synthesis and categorization of prior work, so the ledger is minimal.

assumptions (2)
  • domain assumption The narrative selection of papers reflects the significant advances in the field.
    The review does not state its search strategy or inclusion criteria; it selects papers by the authors' judgment. The selection includes 5 self-citations (refs 2, 5, 7, 8, 9) that are consistently highlighted as first or latest contributions, which is an assumption about representativeness that could bias the review.
  • domain assumption The described systems are accurately characterized by the review.
    The review's descriptive claims about each system, such as the Itemset-based summarizer being the first to use frequent itemsets, are taken from the cited papers rather than independently verified. If any description is inaccurate, the corresponding part of the review is wrong.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Text Summarization in the Biomedical Domain." pith.science (2026). https://pith.science/paper/BZ2AELOX

@misc{pith2026190802285,
  author       = {Pith},
  title        = {Pith review of: Text Summarization in the Biomedical Domain},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/BZ2AELOX}},
  note         = {Machine review of arXiv:1908.02285}
}
read the original abstract

This chapter gives an overview of recent advances in the field of biomedical text summarization. Different types of challenges are introduced, and methods are discussed concerning the type of challenge that they address. Biomedical literature summarization is explored as a leading trend in the field, and some future lines of work are pointed out. Underlying methods of recent summarization systems are briefly explained and the most significant evaluation results are mentioned. The primary purpose of this chapter is to review the most significant research efforts made in the current decade toward new methods of biomedical text summarization. As the main parts of this chapter, current trends are discussed and new challenges are introduced.

Figures

Figures reproduced from arXiv: 1908.02285 by the authors.

Figure 1
Figure 1. Different criteria in categorizing text summarization methods Due to some limitations of general-purpose methods for summarization of biomedical texts, there has been a tendency to developing domain-specific summarizers through utilizing sources of domain knowledge in the summarization process. This has led to significant improvements in the performance of biomedical summarization [3]. Sources of biomedical knowledg… view at source ↗

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

33 extracted references · 32 canonical work pages

  1. [3]

    Text summarization in the biomedical domain: a systematic review of recent research,

    R. Mishra, J. Bian, M. Fiszman, C. R. Weir, S. Jonnalagadda, J. Mostafa, et al., "Text summarization in the biomedical domain: a systematic review of recent research," Journal of biomedical informatics, vol. 52, pp. 457-467, 2014

    work page 2014

  2. [1]

    Application of text minin g in the biomedical domain,

    W. W. Fleuren and W. Alkema, "Application of text minin g in the biomedical domain," Methods, vol. 74, pp. 97-106, 2015

    work page 2015

  3. [2]

    Quantifying the informativeness for biomedical literature summarization: An itemset mining method,

    M. Moradi and N. Ghadiri, "Quantifying the informativeness for biomedical literature summarization: An itemset mining method," Computer Methods and Programs in Biomedicine, vol. 146, pp. 77-89, 2017

    2017

  4. [4]

    Summarization from medical documents: a survey,

    S. Afantenos, V. Karkaletsis, and P. Stamatopoulos, "Summarization from medical documents: a survey," Artificial intelligence in medicine, vol. 33, pp. 157-177, 2005

    work page 2005

  5. [5]

    Different approaches for identifying important concepts in probabilistic biomedical text summarization,

    M. Moradi and N. Ghadiri, "Different approaches for identifying important concepts in probabilistic biomedical text summarization," Artificial Intelligence in Medicine, vol. 84, pp. 101- 116, 2018

    work page 2018

  6. [6]

    A semantic graph-based approach to biomedical summarisation,

    L. Plaza, A. Díaz, and P. Gervás, "A semantic graph-based approach to biomedical summarisation," Artificial intelligence in medicine, vol. 53, pp. 1-14, 2011

    work page 2011

  7. [7]

    CIBS: A biomedical text summarizer using topic -based sentence clustering,

    M. Moradi, "CIBS: A biomedical text summarizer using topic -based sentence clustering," Journal of Biomedical Informatics, vol. 88, pp. 53-61, 2018/12/01/ 2018

    work page 2018

  8. [8]

    Concept-based single- and multi-document biomedical text summarization,

    M. Moradi, "Concept-based single- and multi-document biomedical text summarization," Isfahan University of Technology, 2017

    work page 2017

Show all 33 references
  1. [9]

    Frequent Itemsets as Meaningful Events in Graphs for Summarizing Biomedical Texts,

    M. Moradi, "Frequent Itemsets as Meaningful Events in Graphs for Summarizing Biomedical Texts," in 2018 8th International Conference on Computer and Knowledge Engineering (ICCKE) , 2018, pp. 135-140

    2018

  2. [10]

    Degree centrality for semantic abstraction summarization of therapeutic studies,

    H. Zhang, M. Fiszman, D. Shin, C. M. Miller, G. Rosemblat, and T. C. Rindflesch, "Degree centrality for semantic abstraction summarization of therapeutic studies," Journal of biomedical informatics, vol. 44, pp. 830-838, 2011

    2011

  3. [11]

    Automatic summarization of MEDLINE citations for evidence -based medical treatment: A topic -oriented evaluation,

    M. Fiszman, D. Demner-Fushman, H. Kilicoglu, and T. C. Rindflesch, "Automatic summarization of MEDLINE citations for evidence -based medical treatment: A topic -oriented evaluation," Journal of Biomedical Informatics, vol. 42, pp. 801-813, 2009/10/01/ 2009

    2009

  4. [12]

    Summarizing drug information in Medline citations,

    H. Kilicoglu, "Summarizing drug information in Medline citations," 2006

    2006

  5. [13]

    Classification of clinically useful sentences in clinical evidence resources,

    M. A. Morid, M. Fiszman, K. Raja, S. R. Jonnalagadda, and G. Del Fiol, "Classification of clinically useful sentences in clinical evidence resources," Journal of biomedical informatics, vol. 60, pp. 14- 22, 2016. 11

    2016

  6. [14]

    Comparison of automatic summarisation methods for clinical free text notes,

    H. Moen, L.-M. Peltonen, J. Heimonen, A. Airola, T. Pahikkala, T. Salakoski, et al., "Comparison of automatic summarisation methods for clinical free text notes," Artificial Intelligence in Medicine, vol. 67, pp. 25-37, 2016

    2016

  7. [15]

    Automated methods for the summarization of electronic health records,

    R. Pivovarov and N. Elhadad, "Automated methods for the summarization of electronic health records," Journal of the American Medical Informatics Association, vol. 22, pp. 938-947, 2015

    2015

  8. [16]

    Recent automatic text summarization techniques: a survey,

    M. Gambhir and V. Gupta, "Recent automatic text summarization techniques: a survey," Artificial Intelligence Review, vol. 47, pp. 1-66, 2016

    2016

  9. [17]

    The unified medical language system (umls) project,

    S. J. Nelson, T. Powell, and B. Humphreys, "The unified medical language system (umls) project," Encyclopedia of library and information science, pp. 369-378, 2002

    2002

  10. [18]

    Comparing different knowledge sources for the automatic summarization of biomedical literature,

    L. Plaza, "Comparing different knowledge sources for the automatic summarization of biomedical literature," Journal of biomedical informatics, vol. 52, pp. 319-328, 2014

    2014

  11. [19]

    MeSH: a window into full text for document summarization,

    S. Bhattacharya, V. Ha−Thuc, and P. Srinivasan, "MeSH: a window into full text for document summarization," Bioinformatics, vol. 27, pp. i120-i128, 2011

    2011

  12. [20]

    Graph -based biomedical text summarization: An itemset mining and sentence clustering approach,

    M. Nasr Azadani, N. Ghadiri, and E. Davoodijam, "Graph -based biomedical text summarization: An itemset mining and sentence clustering approach," Journal of Biomedical Informatics, vol. 84, pp. 42-58, 2018/08/01/ 2018

    2018

  13. [21]

    Evaluating Different Similarity Measures for Automatic Biomedical Text Summarization,

    M. Nasr Azadani and N. Ghadiri, "Evaluating Different Similarity Measures for Automatic Biomedical Text Summarization," Cham, 2018, pp. 305-314

    2018

  14. [22]

    Evaluating the use of di fferent positional strategies for sentence selection in biomedical literature summarization,

    L. Plaza and J. Carrillo -de-Albornoz, "Evaluating the use of di fferent positional strategies for sentence selection in biomedical literature summarization," BMC bioinformatics, vol. 14, p. 1, 2013

    2013

  15. [23]

    Enhancing biomedical text summarization using semantic relation extraction,

    Y. Shang, Y. Li, H. Lin, and Z. Yang, "Enhancing biomedical text summarization using semantic relation extraction," PLoS one, vol. 6, p. e23862, 2011

    2011

  16. [24]

    Automated method for extracting “citation sentences

    I. C. Kim, D. X. Le, and G. R. Thoma, "Automated method for extracting “citation sentences” from online biomedical articles using SVM -based text summarization technique," in 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2014, pp. 1991-1996

    2014

  17. [25]

    Text summarization as a decision support aid,

    T. E. Workman, M. Fiszman, and J. F. Hurdle, "Text summarization as a decision support aid," BMC medical informatics and decision making, vol. 12, p. 41, 2012

    2012

  18. [26]

    Clustering cliques for graph - based summarization of the biomedical research literature,

    H. Zhang, M. Fiszman, D. Shin, B . Wilkowski, and T. C. Rindflesch, "Clustering cliques for graph - based summarization of the biomedical research literature," BMC bioinformatics, vol. 14, p. 1, 2013

    2013

  19. [27]

    COMPENDIUM: A text summarization system for generating abstracts of research papers,

    E. Lloret, M. T. Romá -Ferri, and M. Palomar, "COMPENDIUM: A text summarization system for generating abstracts of research papers," Data & Knowledge Engineering, vol. 88, pp. 164 -175, 2013/11/01/ 2013

    2013

  20. [28]

    Using ontology -based semantic similarity to facilitate the article screening process for systematic reviews,

    X. Ji, A. Ritter, and P. -Y. Yen, "Using ontology -based semantic similarity to facilitate the article screening process for systematic reviews," Journal of Biomedical Informatics, vol. 69, pp. 33-42, 2017/05/01/ 2017

    2017

  21. [29]

    Automatic Summarization of Results from Clinical Trials,

    R. L. Summerscales, S. Argamon, S. Bai, J. Hupert, and A. Schwartz, "Automatic Summarization of Results from Clinical Trials," in 2011 IEEE International Conference on Bioinformatics and Biomedicine, 2011, pp. 372-377

    2011

  22. [30]

    Biomedical text summarization to support genetic database curation: using Semantic MEDLINE to create a secondary database of genetic information,

    T. E. Workman, M. Fiszman, J. F. Hurdle, and T. C. Rindflesch, "Biomedical text summarization to support genetic database curation: using Semantic MEDLINE to create a secondary database of genetic information," Journal of the Medical Library Association : JMLA, vol. 98, pp. 27...

    2010

  23. [31]

    Resolving ambiguity in biomedical text to improve summarization,

    L. Plaza, M. Stevenson, and A. Díaz, "Resolving ambiguity in biomedical text to improve summarization," Information Processing & Management, vol. 48, pp. 755-766, 2012

    2012

  24. [32]

    Improving summarization of biomedical documents using word sense disambiguation,

    L. Plaza, M. Stevenson, A. D, #237, and az, "Improving summarization of biomedical documents using word sense disambiguation," presented at the Proceedings of the 2010 Workshop on Biomedical Natural Language Processing, Uppsala, Sweden, 2010. 12

    2010

  25. [33]

    Studying the correlation between different word sense disambiguation methods and summarization effectiveness in biomedical texts,

    L. Plaza, A. J. Jimeno -Yepes, A. Díaz, and A. R. Aronson, "Studying the correlation between different word sense disambiguation methods and summarization effectiveness in biomedical texts," BMC Bioinformatics, vol. 12, p. 355, August 26 2011

    2011

Pith tools

Reviewed August 14, 2026 · model on record in the stance chip above.