Pith. sign in

REVIEW 3 cited by

MedINST: Meta Dataset of Biomedical Instructions

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2410.13458 v1 pith:GNTQTFIE submitted 2024-10-17 cs.CL

Wenhan Han , Meng Fang , Zihan Zhang , Yu Yin , Zirui Song , Ling Chen , Mykola Pechenizkiy , Qingyu Chen This is my paper · ORCID
classification cs.CL
keywords medinstbiomedicaldatasetllmsmetaevaluategeneralizationinstructions
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

The integration of large language model (LLM) techniques in the field of medical analysis has brought about significant advancements, yet the scarcity of large, diverse, and well-annotated datasets remains a major challenge. Medical data and tasks, which vary in format, size, and other parameters, require extensive preprocessing and standardization for effective use in training LLMs. To address these challenges, we introduce MedINST, the Meta Dataset of Biomedical Instructions, a novel multi-domain, multi-task instructional meta-dataset. MedINST comprises 133 biomedical NLP tasks and over 7 million training samples, making it the most comprehensive biomedical instruction dataset to date. Using MedINST as the meta dataset, we curate MedINST32, a challenging benchmark with different task difficulties aiming to evaluate LLMs' generalization ability. We fine-tune several LLMs on MedINST and evaluate on MedINST32, showcasing enhanced cross-task generalization.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. MedPath: Multi-Domain Cross-Vocabulary Hierarchical Paths for Biomedical Entity Linking

    cs.CL 2025-11 conditional novelty 6.0 of 10

    MedPath combines 513k+ expert-annotated biomedical mentions into a UMLS-normalized dataset with cross-vocabulary mappings and hierarchical paths for 11 vocabularies.

  2. Audio Jailbreak: An Open Comprehensive Benchmark for Jailbreaking Large Audio-Language Models

    cs.SD 2025-05 conditional novelty 6.0 of 10

    AJailBench is an open benchmark showing that large audio-language models can be jailbroken through TTS-converted text attacks and through subtle acoustic perturbations that preserve speech semantics.

  3. ManipLVM-R1: Reinforcement Learning for Reasoning in Embodied Manipulation with Large Vision-Language Models

    cs.RO 2025-05 conditional novelty 5.0 of 10

    ManipLVM-R1 applies RLVR with IoU and trajectory-distance rewards to train a 3B VLM for affordance perception and trajectory prediction, claiming better performance and generalization than SFT on 50% of the data.

Pith tools