REVIEW 2 cited by
DNAGPT: A Generalized Pre-trained Tool for Versatile DNA Sequence Analysis Tasks
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Pre-trained large language models demonstrate potential in extracting information from DNA sequences, yet adapting to a variety of tasks and data modalities remains a challenge. To address this, we propose DNAGPT, a generalized DNA pre-training model trained on over 200 billion base pairs from all mammals. By enhancing the classic GPT model with a binary classification task (DNA sequence order), a numerical regression task (guanine-cytosine content prediction), and a comprehensive token language, DNAGPT can handle versatile DNA analysis tasks while processing both sequence and numerical data. Our evaluation of genomic signal and region recognition, mRNA abundance regression, and artificial genomes generation tasks demonstrates DNAGPT's superior performance compared to existing models designed for specific downstream tasks, benefiting from pre-training using the newly designed model structure.
Forward citations
Cited by 2 Pith papers
-
GeneBreaker: Jailbreak Attacks against DNA Language Models with Pathogenicity Guidance
GeneBreaker, a new attack framework, steers DNA language models to generate sequences with over 90% identity to human pathogens, with success rates up to 60% on the largest Evo2 model.
-
Evaluation of Coding Schemes for Transformer-based Gene Sequence Modeling
BPE tokenization and rotary position embeddings usually outperform k-mers and other positional encodings in from-scratch Transformer DNA classifiers, but the advantage is task-dependent.
Discussion (0). Continue with ORCID to comment.