REVIEW 3 major objections 4 minor 10 references
Research on Medical Named Entity Identification Based On Prompt-Biomrc Model and Its Application in Intelligent Consultation System
T0 review · 3 major / 4 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read Adding hand-designed and learned prompts to BioBERT in an MRC span-extraction setup improves medical named-entity recognition over the MRCNER baseline on GENIA and over BERT-large precision on CADEC.
desk verdict A prompt-based MRC for medical NER that claims a small F1 gain but provides no usable numbers, no code, and a related-work section that reads as if assembled by keyword search; not ready for review. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the Prompt-bioMRC model: an MRC-style span extractor that concatenates a label-specific prompt with the input text and uses BioBERT—a BERT model pretrained on biomedical literature—to encode the combined string, then predicts the start and end positions of the entity span. The prompt acts as a per-entity-type query, converting a single NER model into a set of question-answering tasks; soft prompts are embeddings learned during fine-tuning rather than fixed natural-language strings. This machinery matters because it replaces the usual token-level labeling head with a span-prediction objective and because it lets the entity-type knowledge enter through the input text, which is what the paper credits for the accuracy gains.
What would settle it
Run the same data split, hyperparameters, and evaluation script for MRCNER and Prompt-bioMRC, then replace the prompt with a generic filler and re-measure. If the F1 gap over MRCNER disappears or the prompt ablation does not lower F1, the improvement is not caused by prompt engineering.
Extended reading notes
Core claim
On its own terms, the paper's central claim is that recasting medical NER as prompted machine reading comprehension improves accuracy over conventional sequence-labeling or span-classification baselines. For each entity type, the model constructs a triplet (PROMPT, ANCHOR_START, ANCHOR_END, X) in which the prompt names the entity type; BioBERT encodes the prompt and the text together, and the model locates the answer span by predicting its start and end indices. Hard templates are designed manually per dataset, while the soft prompt is a learned embedding added during fine-tuning, and both feed the same BioBERT-based MRC core. The reported consequence is that Prompt-bioMRC surpasses the MRCNER baseline by 0.86 F1 points on GENIA and, with BioBERT as the encoder, raises precision by more than two points over BERT-large on CADEC.
Load-bearing premise
The claimed 0.86-point F1 gain over MRCNER assumes the comparison used identical training data, hyperparameters, and evaluation, so that only the added prompts differ; the paper gives no details confirming this.
Editorial extensions
If this is right
- On GENIA, Prompt-bioMRC reports an F1 gain of 0.86 points over MRCNER and roughly five points over the Hyper-Graph model, placing the prompted MRC approach ahead of several earlier medical NER systems reported in the paper.
- On CADEC, using BioBERT inside the framework yields 64.85% precision, more than two points above BERT-large, meaning domain-specific pretraining continues to contribute even after prompting is added.
- Because entity types enter through prompts, a new entity category can be added by designing or learning a new prompt instead of retraining a separate classification layer.
- Hard templates and soft prompts both operate on the same BioBERT-MRC core, so the model supports a modular route from fully manual to learned prompt construction.
Reading between the lines
- The span-extraction core is label-agnostic, so if the GENIA result holds, the same prompt scaffolding could in principle be carried to untested entity types such as genes, chemicals, or procedures; the paper does not run that test.
- Because the reported edge over MRCNER is under one F1 point, run-to-run seed variance could matter; repeated runs would tell whether prompt engineering or noise explains the gap.
- A natural untested extension is to swap the BioBERT encoder for a larger or generative model, where prompts carry more of the task specification and the prompt-MRC gain might be bigger.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript proposes Prompt-bioMRC, a medical named entity recognition model that concatenates hand-designed hard prompts and learned soft prompts with BioBERT inside a machine reading comprehension (MRC) span-extraction framework. The paper describes a preprocessing pipeline that converts NER annotations into (PROMPT, ANCHOR, CONTEXT) triplets and then uses BioBERT to extract entity spans conditioned on the prompt and the original text. Experiments are reported on the CADEC and GENIA datasets, with claims that BioBERT improves precision over BERT-large by more than two percentage points on CADEC and that Prompt-bioMRC improves F1 by 0.86 percentage points over the MRCNER baseline on GENIA. The results are presented only through figures, without numerical tables, error bars, or significance tests, and the method section omits equations, prompt template examples, and implementation details. The conclusion frames the contribution as modest and acknowledges that the soft-prompt exploration is preliminary and that hard templates are dataset-specific and manually constructed.
Significance. If the reported gains were reproducible, the paper would provide modest evidence that prompt-based MRC with a medical pretrained language model improves NER on biomedical benchmarks. However, the significance as presented is low because the central comparison is unverifiable: all quantitative results live in unreadable figures, no code, data splits, trained checkpoints, or statistical significance tests are supplied, and the fairness of the MRCNER baseline comparison is not established. The contribution reduces to an assertion that adding hand-designed prompts to an existing MRC framework helps, which is not falsifiable from the manuscript as written. The paper ships no reproducible assets, machine-checked proofs, or parameter-free derivations that would offset the missing experimental evidence.
major comments (3)
- [§4, Figures 4 and 5] The central claim that 'in contrast to the baseline MRCNER model, our approach demonstrates an enhanced F1 score by 0.86 percentage points' cannot be checked, because no numerical result table, error bar, standard deviation, or significance test is reported anywhere in the manuscript. The same applies to the stated 64.85% precision for BioBERT and the improvement of more than two percentage points over BERT-large, which appear in prose without a reproducible data source. Provide for every dataset and every model: precision, recall, and F1 with standard deviations across at least three seeds, the number of runs, and the exact evaluation split. Without this, the improvement over MRCNER is an unsupported assertion rather than an experimental result.
- [§3.1–3.2] The method description is insufficient to reproduce the model. The text does not specify the hard-template strings, the length or initialization of the soft-prompt vectors, the span start and end probability equations, the loss function, or the exact sequence construction around the [CLS] and [SEP] markers. Figure 2 is a generic diagram without parameter counts or tensor shapes. Because the only claimed contribution is the prompt integration, omitting the prompt design is load-bearing and leaves open the possibility that differences from the MRCNER baseline arise from unspecified implementation choices rather than from prompting.
- [§3.3 and Table 1] The experimental setup is underreported. Table 1 lists only generic BERT hyperparameters such as hidden size, attention heads, and number of layers; it omits learning rate, optimizer, batch size, warmup, random seeds, and the exact training and evaluation data splits for CADEC and GENIA. The paper also does not state whether the MRCNER baseline was reimplemented under identical conditions or taken from a prior publication, so the reported 0.86 F1 gain could be an artifact of differing evaluation protocols rather than an effect of prompting. State the provenance of each baseline number and confirm identical preprocessing, hyperparameters, and splits, or report newly reimplemented baseline results. In addition, because the hard prompts are manually designed, the comparison should address how baseline models were given an equivalent amount of prompt or hyperparameter tuning.
minor comments (4)
- [§2.2] The section titled 'Tips for learning' is unrelated to prompt learning and cites works on remote patient monitoring and neural architecture search; this section should either be rewritten to cover actual prompt-based NER literature or removed.
- [Figures 4 and 5] The comparative results appear only as image placeholders with no legible numeric labels in the manuscript text; replace them with high-resolution figures and, more importantly, with tables listing exact numeric values.
- [Throughout] The manuscript contains numerous grammatical errors and typos, including 'Experimental desig' in §3.3 and inconsistent capitalization such as 'Prompt bioMRC' versus 'Prompt-bioMRC'; the text should be edited by a native speaker before resubmission.
- [§5, Conclusion] The conclusion admits that soft-prompt exploration is preliminary and that hard templates require dataset-specific manual construction; this concession should appear in the abstract and introduction, which currently claim that the approach consistently surpasses traditional models across diverse datasets.
Circularity Check
No circularity found: the paper is an empirical comparison, not a derivation, so its claims do not reduce to their own inputs.
full rationale
The paper's central claim is that Prompt-bioMRC, a BioBERT-based MRC model with concatenated hand-designed prompts, outperforms baselines such as MRCNER on GENIA and BERT-large on CADEC. This is an empirical evaluation claim, not a derivation from first principles, and there is no fitted parameter that is later renamed as a prediction. The method section describes a standard MRC span-extraction setup in which prompts are concatenated with input text and BioBERT produces a contextual embedding matrix; no equation in the paper defines the result in terms of the input, and no uniqueness theorem or load-bearing self-citation is invoked. The reported 0.86 F1 improvement over MRCNER is presented as an observed experimental outcome from Figure 5, not as something forced by construction. The main weaknesses of the paper are reproducibility-related: numeric tables, prompt templates, and evaluation details are absent, and the comparative claims rest on figures with no readable values. Those are correctness and evidence-quality concerns, not circular reasoning. Because the paper is self-contained as an empirical comparison and makes no derivation chain that reduces to its own inputs, the appropriate circularity score is 0.
Assumptions & free parameters
free parameters (2)
- Hard template prompts =
not specified
- Soft prompt parameters =
not specified
assumptions (2)
- domain assumption MRC formulation for NER
- domain assumption BioBERT as a suitable encoder
Cite this review
Pith. "Pith review of Research on Medical Named Entity Identification Based On Prompt-Biomrc Model and Its Application in Intelligent Consultation System." pith.science (2026). https://pith.science/paper/JCU6JPV4
@misc{pith2026250601961,
author = {Pith},
title = {Pith review of: Research on Medical Named Entity Identification Based On Prompt-Biomrc Model and Its Application in Intelligent Consultation System},
year = {2026},
howpublished = {\url{https://pith.science/paper/JCU6JPV4}},
note = {Machine review of arXiv:2506.01961}
}
read the original abstract
This study is dedicated to exploring the application of prompt learning methods to advance Named Entity Recognition (NER) within the medical domain. In recent years, the emergence of large-scale models has driven significant progress in NER tasks, particularly with the introduction of the BioBERT language model, which has greatly enhanced NER capabilities in medical texts. Our research introduces the Prompt-bioMRC model, which integrates both hard template and soft prompt designs aimed at refining the precision and efficiency of medical entity recognition. Through extensive experimentation across diverse medical datasets, our findings consistently demonstrate that our approach surpasses traditional models. This enhancement not only validates the efficacy of our methodology but also highlights its potential to provide reliable technological support for applications like intelligent diagnosis systems. By leveraging advanced NER techniques, this study contributes to advancing automated medical data processing, facilitating more accurate medical information extraction, and supporting efficient healthcare decision-making processes.
Reference graph
Works this paper leans on
-
[1]
Medical Named Entity Recognition in Arabic Text using SVM
Hamad R, Abushaala A M. Medical Named Entity Recognition in Arabic Text using SVM. 2023 IEEE 3rd International Maghreb Meeting of the Conference on Sciences and Techniques of Automatic Control and Computer Engineering (MI-STA), 2023:200-205. DOI:10.1109/MI-STA57575.2023.10169454
arXiv 2023
-
[2]
Medical Named Entity Recognition Model Based on Knowledge Graph Enhancement
Lu Y, Zhao R, Wen X ,et al. Medical Named Entity Recognition Model Based on Knowledge Graph Enhancement. International Journal of Pattern Recognition and Artificial Intelligence, 2024, 38(04).DOI:10.1142/S0218001424500046
-
[3]
Chen P, Zhang M, Yu X ,et al. Named entity recognition of Chinese electronic medical records based on a hybrid neural network and medical MC-BERT.BMC Medical Informatics and Decision Making, 2022, 22(1):1-13.DOI:10.1186/s12911-022-02059-2
-
[4]
Named Entity Recognition of Medical Text Based on the Deep Neural Network
Yang T, He Y, Yang N. Named Entity Recognition of Medical Text Based on the Deep Neural Network. Journal of healthcare engineering, 2022, 2022:3990563.DOI:10.1155/2022/3990563
-
[5]
Gadekallu T R, Alazab M, Hemanth J ,et al. Guest Editorial Federated Learning for Privacy Preservation of Healthcare Data in Internet of Medical Things and Patient Monitoring. IEEE journal of biomedical and health informatics, 2023.DOI:10.1109/JBHI.2023.3234604
arXiv 2023
-
[6]
W-procer: Weighted Prototypical Contrastive Learning for Medical Few-Shot Named Entity Recognition
Li M, Ye Y, Yeung J ,et al. W-procer: Weighted Prototypical Contrastive Learning for Medical Few-Shot Named Entity Recognition. ArXiv, 2023.DOI:10.48550/arXiv.2305.18624
work page Pith review arXiv doi:10.48550/arxiv.2305.18624 2023
-
[8]
MRC-Based Medical NER with Multi-task Learning and Multi-strategies
Du X, Jia Y, Zan H. MRC-Based Medical NER with Multi-task Learning and Multi-strategies. China National Conference on Chinese Computational Linguistics. Springer, Cham, 2022.DOI:10.1007/978-3-031-18315-7_10
-
[9]
Cheng P, Xi Y, Aokun C ,et al. Generative large language models are all-purpose text analytics engines: text-to-text learning is all your need. Journal of the American Medical Informatics Association, 2024.DOI:10.1093/jamia/ocae078
Show all 10 references
-
[10]
A Novel Deep Learning Model for Medical Image Segmentation with Convolutional Neural Network and Transformer
Zhang Z, Wu H, Zhao H S B. A Novel Deep Learning Model for Medical Image Segmentation with Convolutional Neural Network and Transformer. Interdisciplinary Sciences: Computational Life Sciences, 2023, 15(4):663-677
2023
- [2022]
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.