REVIEW 4 major objections 6 minor 23 references
The paper claims that transcriptional responses to unseen genetic perturbations can be predicted accurately by conditioning on a sparse, perturbation-specific subgraph of a knowledge graph and by explicitly separating signal from noise duri
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · deepseek-v4-flash
2026-08-02 21:50 UTC pith:QFCLLEX2
load-bearing objection A genuinely new mechanism for sparsity in perturbation prediction, with real K562 gains, but the 'consistently best' claim overreaches and the DEG-aware metrics are partly aligned with the training signal. the 4 major comments →
Learning Adaptive Perturbation-Conditioned Contexts for Robust Transcriptional Response Prediction
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The central discovery is that mean-collapse in perturbation response prediction can be reduced by making both graph context and supervision perturbation-specific. Standard models pass the perturbed gene through a dense, static knowledge graph embedding, and train with a mean-squared reconstruction loss that is dominated by the many non-responsive genes; this drives predictions toward the global average. AdaPert instead scores every graph node against a text-derived embedding of the perturbed gene, applies differentiable Gumbel-Softmax sampling to select a small subgraph, and uses that subgraph's summed embeddings as the perturbation context. Training then combines a global reconstruction los
What carries the argument
Perturbation-conditioned subgraph extraction: a language model embeds the perturbed gene's textual description, each node in a protein-interaction knowledge graph is scored by an MLP combining its structural embedding with that semantic embedding, and Gumbel-Softmax sampling selects a sparse node set, summarized by summing selected node embeddings. This subgraph is trained with an adaptive objective consisting of three losses: global reconstruction, a Huber penalty on predicted changes of non-DEG genes, and a cosine alignment between the subgraph representation and a response target made from DEG effects.
Load-bearing premise
The claim presupposes that the DEG/non-DEG partition computed from training-data p-values sensibly separates true signal from noise; if those labels are noisy or statistically underpowered, the adaptive losses will suppress real effects and the reported DEG-aware gains may be artifacts of the supervision.
What would settle it
Re-run the same training pipeline with DEG masks computed from an independent, higher-powered call on held-out perturbation data, then compare DES@50 with the paper's masks; if the DEG-aware advantage disappears or reverses, the gain was driven by the choice of training labels rather than by the subgraph context.
If this is right
- Unseen-perturbation predictions will rank differentially expressed genes more accurately, so high-confidence predictions can be prioritized for experimental follow-up.
- The non-DEG suppression and context alignment act as explicit anti-mean-collapse mechanisms, so the gains should concentrate in small-effect perturbations, which are exactly those where the average response is most misleading.
- Because the subgraph is conditioned on the perturbed gene, the model can give a per-perturbation list of network-relevant genes, improving interpretability over dense global embeddings.
- Pathway-level enrichment of predicted responses correlates with ground truth, suggesting the model preserves coordinated regulatory signatures, not just individual gene statistics.
Where Pith is reading between the lines
- Extending beyond the paper: the same adaptive-loss recipe could be applied to any autoencoder-based perturbation predictor, with or without a knowledge graph, by masking non-responsive genes during training.
- The method's reliance on training-derived DEG labels suggests an extension: iteratively refine or self-train the masks to avoid entrenching false negatives from underpowered single-cell data.
- The sparse-subgraph readout is a simple sum; a natural next step would be attention-weighted aggregation or multiple subgraphs to capture several pathways of response.
- The framework should transfer to other condition-specific predictions, such as drug responses or combinatorial perturbations, whenever a per-condition relational subgraph can be defined.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes AdaPert, a perturbation-conditioned framework for predicting transcriptional responses to unseen genetic perturbations. AdaPert extracts a sparse, perturbation-specific subgraph from a biological knowledge graph via differentiable Gumbel-Softmax node selection and applies an adaptive learning scheme with three losses: a global reconstruction loss, a Huber loss that suppresses predicted changes on genes labeled as non-DEGs, and an alignment loss that matches the selected subgraph representation to a DEG-masked response vector. The authors evaluate on the K562.Replogle and RPE1.Replogle datasets under an unseen-perturbation split, reporting gains over baselines such as TxPert and MorPH on global metrics and DEG-aware metrics, with particular emphasis on reduced mean-collapse and improved DEG recovery.
Significance. If the reported results are robust, AdaPert makes a useful contribution to perturbation-response prediction by replacing dense, static knowledge-graph priors with adaptive sparse subgraph selection and by explicitly separating signal from noise in a way that mitigates mean-collapse. The work has concrete strengths: it evaluates perturbation discrimination with PDS in addition to correlation, provides an effect-size-stratified analysis, includes an ablation separating the non-DEG loss and the context module, and offers a pathway-level validation. These design choices go beyond simple benchmark reporting. However, the headline claim of consistent, substantial improvement is weakened by the RPE1 numbers, particularly the PDS score, and the DEG-aware metrics are partially aligned with the training supervision, so additional evidence is needed to establish that the reported DEG gains reflect genuine biological signal recovery rather than threshold-matching artifacts.
major comments (4)
- [§5.1, Table 1] The text states that AdaPert achieves the best performance on both datasets, but Table 1 shows MorPH has higher PDS on RPE1 (0.688 vs. 0.663). The K562 PDS gain is large and meaningful, but on RPE1 the Pearson-Δ margin over TxPert (0.674 vs. 0.655) is also small. The claim of consistent superiority should be qualified per metric/dataset, or supported with significance tests or confidence intervals.
- [§3.4 (Eqs. 14–21) and §B.2 (Eq. 27)] The DEG-aware evaluation is partially aligned with the training signal. The sets D(p) and complement used for L_non and L_align are defined from training p<0.05 calls, while DES and the DE metrics use the same p-value/FDR threshold on test perturbations. Because test perturbations are unseen, this is not flatly circular, but the reported DES improvements could partly reflect the model being optimized to reproduce the statistical threshold's noise structure. To make the central claim load-bearing, please evaluate with alternative DEG definitions (e.g., different FDR thresholds, absolute effect-size cutoffs, or an independent DEG-calling method) and report whether the DEG-aware gains persist.
- [Appendix F, Table 10] The RPE1 DEG-aware advantages over TxPert are numerically marginal: DES@50 is 0.244 vs. 0.242 and DES@100 is 0.320 vs. 0.314. The text nonetheless claims AdaPert 'achieves the best performance across all reported metrics' and shows 'consistent improvements.' Without error bars or significance testing, these differences are within likely noise, and the claim of substantial DEG-aware improvement is not supported on RPE1.
- [§3.4, Eq. (17); Appendix E] The Huber threshold δ is stated to be 'set proportional to the empirical standard deviation of non-DEG effects' and fixed across perturbations, but the proportionality constant is not reported. The main free hyperparameters (λ_non, λ_align, τ, T, k, DEG p-value threshold) are not given for the AdaPert model; Appendix Table 8 lists only the TxPert search space. Reporting final hyperparameter values for all datasets is necessary for reproducibility.
minor comments (6)
- [Fig. 2] The figure contains garbled labels ('0+0000-00 DEG', 'Differential Expressed Analysis') and inconsistent use of 'DEG' versus 'DE'; these should be cleaned up.
- [Table 2 caption] The caption says 'DEG overlap@k' while the metric in §B.2 is 'Differential Expression Score (DES)'. Please unify the terminology.
- [Table 3] The table reports means without standard deviations despite the main tables using mean ± std; add the same uncertainty information or state why it is omitted.
- [Eq. (10)] The dimensions of the weights w and W_c are not defined; please specify so the node-scoring MLP is unambiguous.
- [Appendix A.2, Fig. 9] The description of 'DEG coverage as a function of graph hop distance' is vague. Please define what 'predicted genes' are in this figure and how the coverage numerator/denominator are computed.
- [Appendix E] No code repository or model checkpoint is provided. Given the number of hyperparameters and the use of GPT-4o embeddings, a public implementation would strengthen reproducibility.
Circularity Check
DEG-aware gains are partly entangled with the training DEG supervision, but the core prediction task is not circular.
specific steps
-
fitted input called prediction
[§3.4 (Eq. 14, 16, 18, 20) and §B.2 (Eq. 27)]
""Using the training data, we perform a statistical test for each gene and obtain a p-value q(p)i. We define the DEG and non-DEG sets as D(p)={i|q(p)i<0.05}, D̄(p)={i|q(p)i≥0.05}." ... "we penalize predicted perturbation changes on D̄(p) using a Huber loss" ... "y(p)i = ΔXpi, i∈D(p); 0, i∈D̄(p)" ... "The Differential Expression Score ... DES(p)=|Gtrue(p)∩Gpred(p)|/|Gtrue(p)|""
The training supervision is built from the same statistical DEG concept used by the headline evaluation. Eq. 14 defines D(p)/D̄(p) from p<0.05; Lnon shrinks predicted changes on D̄(p) toward zero, and Lalign makes the context representation encode only D(p)-masked effects. DES (Eq. 27) then rewards recovery of genes that are significant DEGs on held-out perturbations under the same threshold-style definition. This does not make the test predictions equal to the training labels, since test perturbations are unseen, but it means the reported DES improvements are partially aligned with the training signal rather than being an independent confirmation of biological signal recovery. The metric family is not purely external: the model is explicitly optimized to match the noise structure of a p<0
full rationale
There is no equation that reduces by construction to its inputs, no self-citation chain, and no imported uniqueness theorem. The central derivation is self-contained: AdaPert is trained on control/perturbed expression profiles and evaluated on unseen perturbations. The main concern is the DEG-aware evaluation: the training losses Lnon and Lalign use training-data DEG masks defined by p<0.05 (Eq. 14), while DES and related DEG metrics use the same kind of differential-expression threshold on test data (Eq. 27). This creates a partial statistical alignment between the training objective and the headline metric family, so the DES improvements are not fully independent evidence that true perturbation-specific signal is recovered. However, the test perturbations are unseen, PDS and Pearson-Δ gains do not use DEG labels, the HIRA GSEA is an external functional check, and no fitted parameter is renamed as a prediction. The circularity is therefore partial and metric-specific rather than a collapse of the whole derivation.
Axiom & Free-Parameter Ledger
free parameters (7)
- λ_non (non-DEG loss weight) =
not stated; Fig. 5 sweeps 0–0.1
- λ_align (alignment loss weight) =
not stated
- δ (Huber threshold) =
proportional to empirical SD of non-DEG effects; proportion unspecified
- τ (Gumbel temperature) =
not stated
- T (node selection threshold) =
not stated
- k (STRING top-k edge filtering) =
10 or 20 (Table 6)
- DEG p-value threshold =
0.05
axioms (5)
- domain assumption STRING PPI edges (top-k filtered) capture functional relationships relevant to perturbation response
- domain assumption GenePT/GPT-4o semantic embeddings of NCBI gene descriptions are predictive of perturbation-relevant function
- domain assumption DEG calls at p<0.05 on training data are a correct binary split of signal vs noise
- standard math Gumbel-Softmax with hard threshold T is a valid differentiable subgraph selection
- domain assumption cell-eval metrics and ground-truth test DEGs are the right measure of biological fidelity
read the original abstract
Predicting high-dimensional transcriptional responses to genetic perturbations is challenging because signals are sparse and experimental noise is severe. Existing methods often suffer from mean collapse, achieving high correlation by predicting the global average expression rather than perturbation-specific responses, which yields false positives and poor interpretability. Methods that add biological knowledge graphs typically treat them as dense, static priors shared across perturbations, propagating noise. We propose AdaPert, which counters mean collapse by extracting a sparse, perturbation-specific subgraph via differentiable node selection, then suppressing spurious variation in non-responsive genes while emphasizing differentially expressed ones. Across multiple benchmarks, \textsc{AdaPert} outperforms existing baselines, with the largest gains on DEG-aware metrics.
Figures
Reference graph
Works this paper leans on
-
[1]
K., Gautam, D., Bevilacqua, B., Imran, A., Shah, R., Naghipourfar, M., Teyssier, N., Ilango, R., Nagaraj, S., Dong, M., et al
Adduri, A. K., Gautam, D., Bevilacqua, B., Imran, A., Shah, R., Naghipourfar, M., Teyssier, N., Ilango, R., Nagaraj, S., Dong, M., et al. Predicting cellular responses to perturbation across diverse contexts with state.BioRxiv, pp. 2025–06,
2025
-
[3]
M., Zhou, Y ., Crepaldi, L., Usluer, S., Dunham, A., Braunger, J
Feng, C., Peets, E. M., Zhou, Y ., Crepaldi, L., Usluer, S., Dunham, A., Braunger, J. M., Su, J., Strauss, M. E., Muraro, D., et al. A genome-scale single cell crispri map of trans gene regulation across human pluripotent stem cell lines.bioRxiv, pp. 2024–11,
2024
-
[5]
M., Torkar, M., Li, D., and Karaletsos, T
Istrate, A.-M., Milletari, F., Castrotorres, F., Tomczak, J. M., Torkar, M., Li, D., and Karaletsos, T. rbio1-training scientific reasoning llms with biological world models as soft verifiers.bioRxiv, pp. 2025–08,
2025
-
[9]
D., Simmonds, S
Pearce, J. D., Simmonds, S. E., Mahmoudabadi, G., Krish- nan, L., Palla, G., Istrate, A.-M., Tarashansky, A., Nelson, B., Valenzuela, O., Li, D., et al. A cross-species genera- tive cell atlas across 1.5 billion years of evolution: The transcriptformer single-cell model.bioRxiv, pp. 2025–04,
2025
-
[10]
S., Quake, S
Rosen, Y ., Roohani, Y ., Agarwal, A., Samotorˇcan, L., Con- sortium, T. S., Quake, S. R., and Leskovec, J. Universal cell embeddings: A foundation model for cell biology. bioRxiv, pp. 2023–11,
2023
-
[12]
E., Huang, Q., Fang, T., et al
Szklarczyk, D., Nastou, K., Koutrouli, M., Kirsch, R., Mehryary, F., Hachilif, R., Hu, D., Peluso, M. E., Huang, Q., Fang, T., et al. The string database in 2025: protein networks with directionality of regulation.Nucleic Acids Research, 53(D1):D730–D737,
2025
-
[14]
P., Ektefaie, Y ., et al
Wenteler, A., Occhetta, M., Branson, N., Huebner, M., Curean, V ., Dee, W., Connell, W., Hawkins-Hooker, A., Chung, S. P., Ektefaie, Y ., et al. Perteval-scfm: bench- marking single-cell foundation models for perturbation effect prediction.bioRxiv, pp. 2024–10,
2024
-
[16]
Data Statistics A.1
10 Learning Adaptive Perturbation-Conditioned Contexts for Robust Transcriptional Response Prediction A. Data Statistics A.1. Single-Cell Genetic Perturbation Data Predicting how cells respond to genetic perturbations is a key problem in functional genomics (Shalem et al., 2015). It supports many downstream tasks, such as understanding gene function, anal...
2015
-
[17]
Gene expression profiles are measured under single-gene perturbations with matched control cells
datasets generated using Perturb-seq experiments (Dixit et al., 2016; Replogle et al., 2022; Lotfollahi et al., 2023). Gene expression profiles are measured under single-gene perturbations with matched control cells. Differential expression relative to controls is used as the prediction target. We evaluate on theK562.ReplogleandRPE1.Replogledatasets (Repl...
2016
-
[18]
Perturbations are grouped into small-, medium-, and large-effect categories based on the fraction of differentially expressed genes identified at a significance threshold of p <0.05. This stratification reflects substantial heterogeneity in perturbation responses and enables a more fine-grained evaluation under both sparse and strong transcriptional effec...
2022
-
[20]
The embeddings are available in two variants: Ada (1,536-dim) and Model 3 (3,072-dim), covering 93,800 and 133,736 genes respectively
embeddings derived from NCBI and UniProt gene descriptions encoded via OpenAI’s text embedding models (Dunefsky et al., 2024). The embeddings are available in two variants: Ada (1,536-dim) and Model 3 (3,072-dim), covering 93,800 and 133,736 genes respectively. Coverage for our datasets is high: 95.8% for K562 and 98.6% for RPE1 HVGs. Table 7.Statistics a...
2024
-
[22]
While effective at capturing global expression shifts, these methods are not explicitly designed to recover sparse gene-level effects
aim to align control and perturbed cell populations at the distribution level. While effective at capturing global expression shifts, these methods are not explicitly designed to recover sparse gene-level effects. More recently, large-scalefoundation modelshave been introduced for single-cell biology, including (Cui et al., 2024; Hao et al., 2024; Theodor...
2024
-
[23]
Recent studies further explore the integration oftextual and semantic biological knowledge
leverage gene–gene interaction networks or pathway graphs to propagate perturbation signals through known biological relationships, improving generalization to unseen perturbations. Recent studies further explore the integration oftextual and semantic biological knowledge. Approaches including (Chen & Zou, 2024; Istrate et al., 2024; Wu et al.; Istrate et al.,
2024
-
[228]
exhibit substantially higher expression (mean = 1.34) and a more symmetric distribution. Red and green dashed lines indicate the mean and median, respectively.(2) Perturbation effect size and DEG distributions.To describe variation in perturbation responses, we group perturbations into three categories: small, medium, and large. Effect size is defined as ...
2000
-
[1992]
scgenept: Is lan- guage all you need for modeling single-cell perturbations? bioRxiv, pp
Istrate, A.-M., Li, D., and Karaletsos, T. scgenept: Is lan- guage all you need for modeling single-cell perturbations? bioRxiv, pp. 2024–10,
2024
-
[2009]
M., Nassar, M., Osi´nski, B., Eksi, R., Yan, Z., Stark, R., Zhang, K., and Grae- pel, T
Wu, Y ., Wershof, E., Schmon, S. M., Nassar, M., Osi´nski, B., Eksi, R., Yan, Z., Stark, R., Zhang, K., and Grae- pel, T. Perturbench: Benchmarking machine learning models for cellular perturbation analysis.arXiv preprint arXiv:2408.10609,
-
[2015]
L., Fang, T., Doncheva, N
Szklarczyk, D., Kirsch, R., Koutrouli, M., Nastou, K., Mehryary, F., Hachilif, R., Gable, A. L., Fang, T., Doncheva, N. T., Pyysalo, S., et al. The string database in 2023: protein–protein association networks and func- tional enrichment analyses for any sequenced genome of interest.Nucleic acids research, 51(D1):D638–D646,
2023
-
[2017]
A systematic comparison 9 Learning Adaptive Perturbation-Conditioned Contexts for Robust Transcriptional Response Prediction of single-cell perturbation response prediction models
Li, L., You, Y ., Fu, Y ., Liao, W., Fan, X., Lu, S., Cao, Y ., Li, B., Ren, W., Kong, J., et al. A systematic comparison 9 Learning Adaptive Perturbation-Conditioned Contexts for Robust Transcriptional Response Prediction of single-cell perturbation response prediction models. bioRxiv, pp. 2024–12,
2024
-
[2018]
T., Bendidi, I., Russell, C., Hodgson, L., Mesbahi, Y
Wenkel, F., Tu, W., Masschelein, C., Shirzad, H., Eastwood, C., Whitfield, S. T., Bendidi, I., Russell, C., Hodgson, L., Mesbahi, Y . E., et al. Txpert: Leveraging biochemical relationships for out-of-distribution transcriptomic per- turbation prediction.arXiv preprint arXiv:2505.14919,
-
[2019]
Subsequent methods, including (Lotfollahi et al., 2023; Adduri et al., 2025), extend this paradigm by conditioning latent variables on perturbation identities and cellular contexts
learn latent representations of gene expression and infer perturbation effects through shifts in latent space. Subsequent methods, including (Lotfollahi et al., 2023; Adduri et al., 2025), extend this paradigm by conditioning latent variables on perturbation identities and cellular contexts. Related to these approaches, several models formulate perturbati...
2023
-
[2023]
Mejia, G. M., Miller, H. E., Leblanc, F. J., Wang, B., Swain, B., and Camillo, L. P. d. L. Diversity by design: Ad- dressing mode collapse improves scrna-seq perturbation modeling on well-calibrated metrics.arXiv preprint arXiv:2506.22641,
-
[2024]
and Zou, J
Chen, Y . and Zou, J. Genept: a simple but effective founda- tion model for genes and cells built from chatgpt.bioRxiv, pp. 2023–10,
2023
-
[2025]
Categorical repa- rameterization with Gumbel-Softmax.arXiv preprint arXiv:1611.01144,
Jang, E., Gu, S., and Poole, B. Categorical repa- rameterization with Gumbel-Softmax.arXiv preprint arXiv:1611.01144,
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.