REVIEW 19 cited by
ProGen: Language Modeling for Protein Generation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Generative modeling for protein engineering is key to solving fundamental problems in synthetic biology, medicine, and material science. We pose protein engineering as an unsupervised sequence generation problem in order to leverage the exponentially growing set of proteins that lack costly, structural annotations. We train a 1.2B-parameter language model, ProGen, on ~280M protein sequences conditioned on taxonomic and keyword tags such as molecular function and cellular component. This provides ProGen with an unprecedented range of evolutionary sequence diversity and allows it to generate with fine-grained control as demonstrated by metrics based on primary sequence similarity, secondary structure accuracy, and conformational energy.
Forward citations
Cited by 19 Pith papers
-
DisProtEdit: Exploring Disentangled Representations for Multi-Attribute Protein Editing
DisProtEdit learns disentangled protein representations from separate structural and functional text descriptions, enabling controllable single- and multi-attribute protein editing via latent interpolation.
-
Steering Protein Language Models
Activation steering can guide protein language models to generate and optimize sequences with higher predicted thermostability, solubility, or GFP brightness, but only in surrogate-based evaluation.
-
Protriever: End-to-End Differentiable Protein Homology Search for Fitness Prediction
Protriever trains a retriever and a protein language model together so the model learns which homologs to retrieve, reaching state-of-the-art zero-shot fitness prediction on ProteinGym with much faster retrieval.
-
NbBench: Benchmarking Language Models for Comprehensive Nanobody Tasks
NbBench provides the first unified nanobody benchmark and shows that antibody language models lead on binding tasks while affinity and stability regressions remain hard for all tested models.
-
An All-Atom Generative Model for Designing Protein Complexes
APM generates multi-chain protein complexes at all-atom resolution via a three-module flow-matching design, achieving strong computed binding affinities in antibody and peptide design benchmarks.
-
Steering Protein Family Design through Profile Bayesian Flow
ProfileBFN adapts Bayesian flow networks to accept protein-family profiles, enabling diverse, novel, and apparently functional family protein generation from single-sequence training.
-
Hotspot-Driven Peptide Design via Multi-Fragment Autoregressive Extension
PepHAR generates peptide binders by first sampling hot-spot residues from a learned energy model, then autoregressively extending fragments via dihedral angles, then refining the full structure.
-
Preference-based Antibody Expression Ranking: Scaling with Large-scale Weak Supervision
A two-stage recipe — camelid-sequence continual pretraining plus DPO-style preference fine-tuning with weak positive pairs — improves antibody expression ranking over supervised baselines on an internal 1254-sequence ...
-
Ankh3: Multi-Task Pretraining with Sequence Denoising and Completion Enhances Protein Representations
Ankh3 shows that combining multiple masking probabilities with sequence completion improves protein language model performance downstream, but the causal role of multi-task pretraining is not proven by a matched ablation.
-
GLProtein: Global-and-Local Structure Aware Protein Representation Learning
GLProtein pre-trains a BERT-style protein model with triplet contrastive learning on structural similarity, 3D distance encoding, and substructure-based amino acid embeddings, improving contact and PPI prediction.
-
Generative Artificial Intelligence in Bioinformatics: A Systematic Review of Models, Applications, and Methodological Advances
Across the 68 papers it surveys, domain-specialized generative models usually outperform general-purpose LLMs on biological tasks, and agentic/conversational workflows are the least-covered topics.
-
AnnoDPO: Protein Functional Annotation Learning with Direct Preference Optimization
DPO with contrastive sequence-annotation alignment improves GO term prediction by 2 to 4 percent relative F1-Max over supervised fine-tuning alone.
-
Protein Inverse Folding From Structure Feedback
DPO fine-tuning with ESMFold TM-Score preferences raises sequence recovery and predicted TM-Score of inverse folding models, and multi-round refinement produces large gains on hard targets.
-
Towards More Accurate Full-Atom Antibody Co-Design
Igformer co-designs antibody CDR sequences and structures by adding personalized propagation, global attention, and dual equivariant message passing to dyMEAN, with modest benchmark improvements.
-
DrugGen: Advancing Drug Discovery with Large Language Models and Reinforcement Learning Feedback
A DrugGPT-derived model, fine-tuned on approved drugs and optimized with reinforcement learning, produces more valid molecules and higher purported binding affinities, though the affinity metric is the training reward.
-
Open-Source Protein Language Models for Function Prediction and Protein Design
A 1M-sequence ProtBERT in DeepChem scores below the original 216M-sequence ProtBERT on all four benchmarks, and a VAE-based enzyme generation pilot yields candidates with low structural similarity to known plastic-deg...
-
Aligning Large Language Models with Healthcare Stakeholders: A Pathway to Trustworthy AI Integration
A narrative review arguing that stakeholder involvement throughout LLM development and use is essential for trustworthy healthcare AI, with a taxonomy of applications and an outlook on regulation.
-
A Comprehensive Review of Protein Language Models
A survey paper that catalogs protein language models, their architectures, training data, benchmarks, and tools, but lacks a systematic methodology and contains several factual errors.
-
Leveraging Natural Language Processing to Unravel the Mystery of Life: A Review of NLP Approaches in Genomics, Transcriptomics, and Proteomics
A review maps how NLP architectures from word2vec to Evo 2 are applied to DNA, RNA, protein, and genome sequences, with tokenization and context choices shaping performance.
Discussion (0). Continue with ORCID to comment.