Pith. sign in

REVIEW 9 cited by

A Continued Pretrained LLM Approach for Automatic Medical Note Generation

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2403.09057 v3 pith:MOYDLAEE submitted 2024-03-14 cs.CL cs.AI

classification cs.CLcs.AI
keywords gpt-4medicalhealllmsaccuracyachievesadvancedapproach
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

LLMs are revolutionizing NLP tasks. However, the use of the most advanced LLMs, such as GPT-4, is often prohibitively expensive for most specialized fields. We introduce HEAL, the first continuously trained 13B LLaMA2-based LLM that is purpose-built for medical conversations and measured on automated scribing. Our results demonstrate that HEAL outperforms GPT-4 and PMC-LLaMA in PubMedQA, with an accuracy of 78.4\%. It also achieves parity with GPT-4 in generating medical notes. Remarkably, HEAL surpasses GPT-4 and Med-PaLM 2 in identifying more correct medical concepts and exceeds the performance of human scribes and other comparable models in correctness and completeness.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 9 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. ChiMed 2.0: Advancing Chinese Medical Dataset in Facilitating Large Language Modeling

    cs.CL 2025-07 conditional novelty 5.0 of 10

    ChiMed 2.0 is a 204.4M-character Chinese medical dataset spanning pretraining, SFT, and preference data that yields small gains on CMMLU and CEval medical subsets.

  2. Can LLM Improve for Expert Forecast Combination? Evidence from the European Central Bank Survey

    stat.AP 2025-06 reject novelty 5.0 of 10

    A zero-shot LLM prompt beats equal-weighted averaging for one-year ECB SPF forecasts in one regression, but the result is fragile, the comparison is asymmetric, and no code or data are provided.

  3. MedTVT-R1: A Multimodal LLM Empowering Medical Reasoning and Diagnosis

    eess.IV 2025-06 reject novelty 5.0 of 10

    MedTVT-R1 integrates ECG, CXR, and lab data with a modality perception layer and GRPO-based reinforcement fine-tuning, claiming improved multi-disease diagnosis, but the evidence is weakened by unfair baselines and an...

  4. Llama-3.1-FoundationAI-SecurityLLM-Base-8B Technical Report

    cs.CR 2025-04 reject novelty 4.0 of 10

    A continued-pretrained 8B cybersecurity LLM claims to match GPT-4o-mini and Llama 3.1-70B on certain cyber threat intelligence benchmarks, but the decisive benchmark overlaps with its training corpus.

  5. A Case Study Exploring the Current Landscape of Synthetic Medical Record Generation with Commercial LLMs

    cs.CL 2025-04 conditional novelty 4.0 of 10

    Commercial LLMs generate usable synthetic ICU records only for small feature sets, with fidelity and downstream prediction quality degrading sharply as dimensionality grows.

  6. GeneSUM: Large Language Model-based Gene Summary Extraction

    q-bio.GN 2024-12 reject novelty 4.0 of 10

    A two-stage LLM pipeline that selects key sentences from gene literature via GO annotations and fine-tunes Gemma-7B to generate gene summaries, reporting large ROUGE gains that may be inflated by training/evaluation overlap.

  7. ALKAFI-LLAMA3: Fine-Tuning LLMs for Precise Legal Understanding in Palestine

    cs.CL 2024-12 conditional novelty 4.0 of 10

    A fine-tuned 1B-parameter Llama model answers questions about Palestinian law using a synthetic dataset of 243,841 QA pairs, but with only anecdotal evaluation.

  8. Synthetic Data Generation with LLM for Improved Depression Prediction

    cs.LG 2024-11 conditional novelty 4.0 of 10

    LLM-generated synthetic synopses conditioned on target PHQ-8 scores, added to real DAIC-WOZ synopses, reduce PHQ-8 regression error (RMSE 4.64, MAE 3.66) in a single-run BERT evaluation.

  9. Medalyze: Lightweight Medical Report Summarization Application Using FLAN-T5-Large

    cs.CL 2025-05 reject novelty 3.0 of 10

    A lightweight medical summarization app built by fine-tuning three FLAN-T5-Large models reportedly beats GPT-4 on structured medical report summaries, while GPT-4 wins the question-extraction task and is mixed on conv...

Pith tools