Pith. sign in

REVIEW 3 major objections 4 minor 43 references

DynImmune-BERT: Dynamic Immune Repertoire Modeling with Neural ODE Driven Continuous Transformers

T0 review · 3 major / 4 minor · reviewed 2026-08-04 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read Modeling longitudinal T-cell receptor repertoires as event-aware continuous trajectories improves cancer detection over static bag-of-sequences encoders, with internally matched AUC gains to 0.982 (lung) and 0.984 (thyroid).

desk verdict A credible architecture paper for longitudinal TCR modeling whose temporal-value claim is supported internally, but whose 'ODE core drives the gains' claim is not yet isolated by the experiments. read the letter →

arxiv 2607.17244 v2 pith:CKLH5ECX submitted 2026-07-19 cs.LG

Rong Fu , Yongtai Liu , Xiaowen Ma , Haoyu Zhao , Shuo Yin , Yiqing Lyu , Long Zhang , Wangyu Wu This is my paper · ORCID
classification cs.LG
keywords TCRrepertoireneuralODEcontinuoustransformerlongitudinalimmunemonitoringcancerdetectionevent-awaremodelingcenteredlog-ratiooptimaltransport
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper tries to establish that the temporal structure of a patient's T-cell receptor repertoire—when clones expand, contract, disappear, and reappear across irregular sampling times—contains signal for cancer detection that static models throw away. It proposes a continuous-time transformer in which each clone's compositional state evolves under a presence-gated neural ODE, interrupted by event-based restarts when clones reappear. In internally controlled comparisons that match patient splits and preprocessing, the full model reaches AUC 0.982 for lung cancer and 0.984 for thyroid cancer, with ablations attributing most of the gain to the ODE core. A sympathetic reader would care because this offers a practical path to using serial immune sequencing for cancer status prediction, while the paper's emphasis on matched controls and calibration diagnostics keeps the claim honest.

What carries the argument

The central mechanism is a presence-gated neural ODE vector field Fθ that transports a clone's stabilized centered-log-ratio state between irregularly spaced observations, interrupted by restart events for reappearing clones. Supporting machinery includes depth-adaptive pseudocounts for compositional stability, bounded-neighborhood self-attention over abundance, sequence-similarity, and tail-sampled neighbors, low-rank meta-adapter initialization for reappearing clones, and a hybrid transport loss that supervises both dominant and rare clone mass via entropic and sliced-Wasserstein terms.

What would settle it

A strictly matched comparison in which a simpler temporal encoder (e.g., a GRU or time-aware transformer without ODE) is equipped with the same event restarts, bounded-neighborhood attention, and hybrid transport loss, and matches or exceeds the reported AUC on the same patient-level splits, would show the ODE core is not the driver. A large external cohort where the ODE-based model fails to beat a static BertTCR-style baseline would further weaken the general claim.

Watch

Extended reading notes

Core claim

On its own terms, DynImmune-BERT claims that immune repertoire classification should be treated as a patient-level trajectory problem rather than a single-sample bag-of-sequences problem. The core discovery is that an event-aware continuous transformer, where clone states are integrated by a neural ODE between irregular observations and restarted when clones reappear, outperforms static encoders and simpler temporal encoders under strictly matched protocols. The largest internal comparison shows the full model achieving mean AUC 0.982 on lung cancer and 0.984 on thyroid cancer, with the ODE-driven temporal propagation being the dominant contributor to the improvement over ignoring ordering.

Load-bearing premise

A single shared vector field, gated by clone presence, can transport each clone's compositional state across gaps of weeks to months without distorting the signal, and the observed accuracy gain comes from this ODE integration rather than from the event restarts, pseudocounts, or hybrid transport supervision that surround it.

Editorial extensions

If this is right

  • If the central claim holds, longitudinal TCR repertoires become a viable input modality for noninvasive cancer detection, with temporal dynamics adding information beyond static diversity and clonality features.
  • The ODE-driven temporal propagation provides a template for other irregularly sampled molecular measurements, such as B-cell receptor repertoires or serial methylation profiles, where clone presence patterns matter.
  • The matched-control protocol demonstrates a fair way to evaluate temporal models against static baselines, reducing the risk that cohort or preprocessing differences are mistaken for modeling gains.
  • The reported calibration and threshold diagnostics suggest that the model's probability outputs can be used for decision-making, not just ranking, if validated prospectively on larger cohorts.
  • The computational cost estimates indicate the continuous-time approach is practical on modest hardware, keeping overhead small relative to sequencing turnaround.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The ODE integration may be functioning as an interpolation plus depth-normalization mechanism rather than as a faithful model of biological clone dynamics; a test comparing it to a non-ODE smooth interpolation with the same event restarts and transport loss would isolate what the ODE actually contributes beyond the surrounding design.
  • The bounded-neighborhood attention could be extended to incorporate epitope or HLA context, which the paper leaves for future work but which would likely sharpen the rare-clone tail supervision that the transport loss already emphasizes.
  • The reappearance-restart mechanism suggests a direct clinical extension: using the timing and magnitude of clone re-emergence as a biomarker for immune response to therapy, a signal the current binary cancer-status setting only partially captures.
  • The paper's small external cohorts limit the generalizability claim; a larger prospective multi-disease study with standardized preprocessing would be the natural next test of whether the ODE-driven gain persists beyond the two internal cancer types.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 4 minor

Summary. The paper proposes DynImmune-BERT, a continuous-time model for longitudinal T-cell receptor repertoires that combines a depth-adaptive centered log-ratio initialization, clone-presence-gated Neural ODE dynamics, bounded-neighborhood self-attention, event-based restart for reappearing clonotypes, a low-rank meta-adapter, and a hybrid transport objective over dominant and rare clone mass. The model is evaluated for cancer status prediction on lung and thyroid cancer cohorts. The evaluation is deliberately separated into literature-reported cross-study comparisons (Table 2), internally matched temporal controls (Table 3), and small external/universal detection cohorts (Table 4), with additional calibration and threshold diagnostics. The main claimed findings are that temporal structure improves over static encoders under matched patient-level splits, and that the ODE core is the largest driver of the accuracy gain.

Significance. If the central claims are supported, the paper would make a useful contribution by showing that irregular sampling time, clone presence events, and sequencing depth can be modeled explicitly rather than treating each repertoire as a static bag of sequences. The internal matched comparisons in Table 3 and the formal patient-level split condition in Eq. 3 are strengths; the paper also honestly reports uncertainty on small external cohorts and provides calibration and threshold diagnostics, which is more careful than many related papers. However, the paper's headline architectural contribution is specifically 'Neural ODE Driven', so the claim that the ODE core is responsible for most of the accuracy gain is load-bearing. That claim is not currently supported by a controlled ablation, and one data provenance issue further weakens the cross-study comparison. The temporal-structure claim itself is better supported.

major comments (3)
  1. [§4.3, Table 3, Fig. 4, Eq. (17)] The claim that 'the ODE core drives most of the accuracy gain' is not supported by a controlled ablation. The 'Latent ODE control' row in Table 3 differs from 'Full DynImmune-BERT' simultaneously in at least three design dimensions: presence-gated event restart (Eqs. 12–14), hybrid transport supervision (Eqs. 15–16), and the full bounded-neighborhood attention stack; it may also use a different loss, since Eq. (17) includes transport and regularizers that may not be present in the controls. Figure 4 is described only in prose and no numeric ablation table or exact variant definitions are given. Therefore, removing the ODE integration alone, while keeping event restart, transport, attention, and loss terms identical, is not shown to preserve the gain. Please provide a numeric ablation table with all one-factor-at-a-time variants and report which loss each variant uses.
  2. [§4.2, Table 2] The data provenance for Table 2 is unclear. The caption says both THCA and lung cancer test samples are from [43], but reference [43] is a lung cancer study ('Spatial heterogeneity of the T cell receptor repertoire reflects the mutational landscape in lung cancer') and does not appear to contain thyroid cancer (THCA) data. Please cite the actual THCA data source, or correct the table if the citation is erroneous. Without this, the THCA numbers in Table 2 and any claims built on them cannot be verified.
  3. [§4.4, Table 4] The external detection check is not sufficiently documented for evaluation. The text mentions a universal setting with 2296 samples from 17 cancer types, but Table 4 reports only five disease subsets with n between 8 and 24, and does not state how these subsets were selected, how healthy controls were chosen, whether the model was trained on the same disease classes, or how thresholds were applied in each subset. The paper appropriately warns that small cohorts limit conclusions, but the missing protocol details prevent the reader from assessing possible selection or threshold effects. Please provide cohort composition, split rules, and threshold definitions for each row.
minor comments (4)
  1. [§3.5, Eq. (16)] The supports T and U used in the hybrid transport loss are not defined in the text. Please state explicitly how 'top clones' and 'tail clones' are selected, including any hyperparameters such as tail sampling size.
  2. [§4.6, §3.6] The paper states that implicit Runge-Kutta solvers are used for 'stable event handling', but no implementation detail is given and standard torchdiffeq does not by default provide implicit RK event handling. Please specify the solver, event detection mechanism, and how restart discontinuities are handled numerically.
  3. [Table 4] The uncertainty notation is inconsistent: THCA is reported as a confidence interval, while the other diseases are reported as standard errors. Please standardize or explicitly label the quantities.
  4. [General] No code repository or data access statement is provided. Given the number of custom components (event restart, low-rank adapter, hybrid transport, neighborhood construction), a code release or detailed pseudocode for the event handling would substantially improve reproducibility.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the model's components are trained objectives and the evaluation is matched/external; the ODE-core attribution is under-supported but not definitionally circular.

full rationale

I walked the derivation chain from the input representation (Eqs. 1–7), through the gated ODE dynamics (Eq. 12), event restart (Eqs. 13–14), bounded attention (Eqs. 9–11), and the training losses (Eqs. 15–17). Each step is a defined model component rather than a result claimed to be derived from first principles. The hybrid transport loss (Eq. 16) compares a latent readout \(bpc(t)\) with the observed clone distribution \(p\), but the paper uses this only as an auxiliary training regularizer; it does not claim to predict unseen clone mass as an evaluation result. No parameter is fitted to a subset and then reported as a prediction of that same subset. There are no self-citations or imported uniqueness theorems that do load-bearing work. The external benchmarks in Table 2 and the internally matched temporal comparisons in Table 3 provide independent evidence, though the claim that “the ODE core drives most of the accuracy gain” is presented in prose and Fig. 4 without a fully isolated numeric ablation. That is an experimental-support weakness, not a circularity by construction. The paper also explicitly concedes limitations (small external subsets, sequencing-depth confounds, and the need to recheck latency on larger repertoires), which further supports the conclusion that its central claims are not circular.

Assumptions & free parameters 5 free parameters · 5 assumptions · 3 invented entities

The model is an architecture with several hand-tuned hyperparameters and modeling assumptions. No physical constants or externally verified quantities are derived. The 'prediction' is a patient classification and an input-reconstruction style transport loss.

free parameters (5)
  • Pseudocount κ = 0.5
    Controls depth-adaptive smoothing in Eq. (6); reported as a hyperparameter fixed before final test reporting.
  • Transport weights ω_top, ω_tail = 0.65, 0.35
    Mixture weights in the hybrid transport loss (16); reported as fixed hyperparameters.
  • Regularization weights λ_W, λ_temp, λ_spec = 0.2, 1e-3, 1e-4
    Balance CE, transport, temporal, and spectral losses in Eq. (17).
  • Neighborhood bound B = 96
    Limits attention support per clone in Eq. (10); chosen for scalability and reported as a fixed hyperparameter.
  • ODE solver tolerances = rtol=1e-4, atol=1e-6
    Integration accuracy settings reported in Section 4.1; affect restart and dynamics.
assumptions (5)
  • domain assumption A latent clone state can be propagated by a single learned vector field Fθ integrated with a neural ODE between irregular observation times.
    The central modeling premise of Section 3.4; the paper explicitly disclaims mechanistic smoothness, but still assumes the latent interpolation is informative for classification.
  • domain assumption Sequence embeddings via a pretrained encoder capture clone similarity relevant to immune status.
    Neighborhood construction in Eq. (9) relies on embedding nearest neighbors; the chosen encoder is not specified in detail.
  • domain assumption The compositional log-ratio transform with a depth-adaptive pseudocount stabilizes zero counts well enough for ODE dynamics.
    Section 3.2, Eq. (6)-(7); the choice of S_t support and mean centering is an input structure.
  • domain assumption The distributional supervision in Eq. (15)-(16) is a meaningful training signal for patient-level labels.
    It couples reconstructed clone mass to the dynamic states; the paper does not prove the transport term improves generalization beyond the cross-entropy term.
  • domain assumption The reported public TCR cohorts [43] and external cohorts have comparable sequencing and annotation quality.
    Table 2 and Table 4 depend on these cohorts; protocol differences are acknowledged by the authors.
invented entities (3)
  • Latent clone state y_c(t) with event-based restart
    purpose: To encode clone abundance and presence in a continuous-time state that can be interrupted at appearance/reappearance events.
    This is a modeling construct, not a measurable biological quantity; its validity is judged only through downstream AUC.
  • Low-rank meta-adapter Δ_φ for reappearing clonotypes
    purpose: Initializes restart states for clones that appear again after absence.
    An architectural invention without an external falsifiable handle.
  • Presence gate I_c(t)
    purpose: Prevents absent clones from drifting under the vector field; encodes presence events.
    A modeling device, no independent measurement.

how reviews work

0 comments
Cite this review

Pith. "Pith review of DynImmune-BERT: Dynamic Immune Repertoire Modeling with Neural ODE Driven Continuous Transformers." pith.science (2026). https://pith.science/paper/CKLH5ECX

@misc{pith2026260717244,
  author       = {Pith},
  title        = {Pith review of: DynImmune-BERT: Dynamic Immune Repertoire Modeling with Neural ODE Driven Continuous Transformers},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/CKLH5ECX}},
  note         = {Machine review of arXiv:2607.17244}
}
read the original abstract

Longitudinal T cell receptor repertoires contain signals of clonal expansion, contraction, disappearance, and reappearance after immune perturbation. Static repertoire language models usually summarize a sample as a bag of sequences, so the sampling interval, sequencing depth, and clone presence pattern are only weakly represented. This paper presents DynImmune-BERT, a continuous time repertoire model for patient level immune status prediction. The method combines depth adaptive centered log ratio initialization, clone presence gated Neural ordinary differential equation dynamics, bounded neighborhood self attention, event based state restart, and a hybrid transport objective that supervises dominant and rare clone mass. A low rank meta adapter initializes reappearing clonotypes while keeping the parameter count independent of the number of observed clones. The evaluation separates literature reported baselines from internally controlled temporal comparisons, reports uncertainty for small external cohorts, adds calibration and threshold diagnostics, and visualizes latent clone trajectories and attention neighborhoods. The results indicate that event aware temporal modeling can complement strong static encoders when longitudinal repertoire structure is available, while small external cohorts and protocol differences require cautious interpretation.

Figures

Figures reproduced from arXiv: 2607.17244 by the authors.

Figure 1
Figure 1. Overview of DynImmune-BERT. Input TCR sequences, read counts, sampling times, and patient labels are [PITH_FULL_IMAGE:figures/full_fig_p003_1.png] view at source ↗
Figure 2
Figure 2. Latent trajectory and attention diagnostics. The trajectory panel visualizes clone evolution and restart behavior, [PITH_FULL_IMAGE:figures/full_fig_p006_2.png] view at source ↗
Figure 3
Figure 3. ROC consistency check for DynImmune-BERT. The displayed AUC values correspond to the DynImmune [PITH_FULL_IMAGE:figures/full_fig_p008_3.png] view at source ↗
Figures from the paper (5 more)
Figure 4
Figure 4. Figure 4: Ablation with seed variability. The ODE core is the largest driver of AUC, while event restart and adaptive [PITH_FULL_IMAGE:figures/full_fig_p009_4.png]
Figure 5
Figure 5. Figure 5: Validation threshold selection using Youden’s index with bootstrap uncertainty. [PITH_FULL_IMAGE:figures/full_fig_p010_5.png]
Figure 5
Figure 5. Figure 5: Validation threshold selection using Youden’s index with bootstrap uncertainty. [PITH_FULL_IMAGE:figures/full_fig_p009_5.png]
Figure 6
Figure 6. Figure 6: Reliability diagram for predicted cancer probability. The diagonal line indicates perfect calibration. [PITH_FULL_IMAGE:figures/full_fig_p011_6.png]
Figure 6
Figure 6. Figure 6: Reliability diagram for predicted cancer probability. The diagonal line indicates perfect calibration. [PITH_FULL_IMAGE:figures/full_fig_p010_6.png]

Review history (2 revisions) →

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

43 extracted references · 6 linked inside Pith

  1. [43]

    Spatial heterogeneity of the t cell receptor repertoire reflects the mutational landscape in lung cancer.Nature medicine, 25(10):1549–1559, 2019

    Kroopa Joshi, Marc Robert de Massy, Mazlina Ismail, James L Reading, Imran Uddin, Annemarie Woolston, Emine Hatipoglu, Theres Oakes, Rachel Rosenthal, Thomas Peacock, et al. Spatial heterogeneity of the t cell receptor repertoire reflects the mutational landscape in lung cancer.Nature medicine, 25(10):1549–1559, 2019. 13

    2019

  2. [1]

    Longitudinal analysis of t and b cell receptor repertoire transcripts reveal dynamic immune response in covid-19 patients.Frontiers in Immunology, 11:582010, 2020

    Xuefeng Niu, Song Li, Pingchao Li, Wenjing Pan, Qian Wang, Ying Feng, Xiaoneng Mo, Qihong Yan, Xianmiao Ye, Jia Luo, et al. Longitudinal analysis of t and b cell receptor repertoire transcripts reveal dynamic immune response in covid-19 patients.Frontiers in Immunology, 11:582010, 2020

    2020

  3. [2]

    Longitudinal analysis reveals age-related changes in the t cell receptor repertoire of human t cell subsets.The Journal of clinical investigation, 132(17), 2022

    Xiaoping Sun, Thomas Nguyen, Achouak Achour, Annette Ko, Jeffrey Cifello, Chen Ling, Jay Sharma, Toyoko Hiroi, Yongqing Zhang, Chee W Chia, et al. Longitudinal analysis reveals age-related changes in the t cell receptor repertoire of human t cell subsets.The Journal of clinical investigation, 132(17), 2022. 10 DynImmune-BERT

    2022

  4. [3]

    Longitudinal high- throughput tcr repertoire profiling reveals the dynamics of t-cell memory formation after mild covid-19 infection

    Anastasia A Minervina, Ekaterina A Komech, Aleksei Titov, Meriem Bensouda Koraichi, Elisa Rosati, Ilgar Z Mamedov, Andre Franke, Grigory A Efimov, Dmitriy M Chudakov, Thierry Mora, et al. Longitudinal high- throughput tcr repertoire profiling reveals the dynamics of t-cell memory formation after mild covid-19 infection. Elife, 10:e63502, 2021

    2021

  5. [4]

    Temporal development of t cell receptor repertoires during childhood in health and disease.JCI insight, 7(18):e161885, 2022

    Angela M Mitchell, Erin E Baschal, Kristen A McDaniel, Kimber M Simmons, Laura Pyle, Kathleen Waugh, Andrea K Steck, Liping Yu, Peter A Gottlieb, Marian J Rewers, et al. Temporal development of t cell receptor repertoires during childhood in health and disease.JCI insight, 7(18):e161885, 2022

    2022

  6. [5]

    Yi-Tung Chen, Hung-Chih Hsu, Yun-Shien Lee, Hsuan Liu, Bertrand Chin-Ming Tan, Chia-Yin Chin, Ian Yi-Feng Chang, and Chia-Yu Yang. Longitudinal high-throughput sequencing of the t-cell receptor repertoire reveals dynamic change and prognostic significance of peripheral blood tcr diversity in metastatic colorectal cancer during chemotherapy.Frontiers in Im...

    2022

  7. [6]

    NH Servaas, Fatiha Zaaraoui-Boutahar, CGK Wichers, Andrea Ottria, Eleni Chouri, AJ Affandi, Sandra Silva- Cardoso, Maarten van der Kroef, T Carvalheiro, Femke van Wijk, et al. Longitudinal analysis of t-cell receptor repertoires reveals persistence of antigen-driven cd4+ and cd8+ t-cell clusters in systemic sclerosis.Journal of Autoimmunity, 117:102574, 2021

    2021

  8. [7]

    Low t cell diversity associates with poor outcome in bladder cancer: A comprehensive longitudinal analysis of the t cell receptor repertoire.Cell Reports Medicine, 6(5), 2025

    Asbjørn Kjær, Nanna Kristjánsdóttir, Randi Istrup Juul, Iver Nordentoft, Karin Birkenkamp-Demtröder, Johanne Ahrenfeldt, Trine Strandgaard, Deema Radif, Darren Hodgson, Christopher Abbosh, et al. Low t cell diversity associates with poor outcome in bladder cancer: A comprehensive longitudinal analysis of the t cell receptor repertoire.Cell Reports Medicin...

    2025

Show all 43 references
  1. [8]

    Longitudinal t cell repertoire analysis reveals dynamic clonal t cell populations in ulcerative colitis.bioRxiv, pages 2025–01, 2025

    Kristi C Briggs, Jessica S Lin, Lara Chaaban, Alyssa Parian, Mark Lazarev, Florin Selaru, Franck Housseau, Kellie N Smith, and Joanna MP Melia. Longitudinal t cell repertoire analysis reveals dynamic clonal t cell populations in ulcerative colitis.bioRxiv, pages 2025–01, 2025

    2025

  2. [9]

    De novo prediction of cancer-associated t cell receptors for noninvasive cancer detection.Science translational medicine, 12(557):eaaz3738, 2020

    Daria Beshnova, Jianfeng Ye, Oreoluwa Onabolu, Benjamin Moon, Wenxin Zheng, Yang-Xin Fu, James Bru- garolas, Jayanthi Lea, and Bo Li. De novo prediction of cancer-associated t cell receptors for noninvasive cancer detection.Science translational medicine, 12(557):eaaz3738, 2020

    2020

  3. [10]

    Deeplion: deep multi-instance learning improves the prediction of cancer-associated t cell receptors for accurate cancer detection.Frontiers in genetics, 13:860510, 2022

    Ying Xu, Xinyang Qian, Xuanping Zhang, Xin Lai, Yuqian Liu, and Jiayin Wang. Deeplion: deep multi-instance learning improves the prediction of cancer-associated t cell receptors for accurate cancer detection.Frontiers in genetics, 13:860510, 2022

    2022

  4. [11]

    Xinyang Qian, Guang Yang, Fan Li, Xuanping Zhang, Xiaoyan Zhu, Xin Lai, Xiao Xiao, Tao Wang, and Jiayin Wang. Deeplion2: deep multi-instance contrastive learning framework enhancing the prediction of cancer- associated t cell receptors by attention strategy on motifs.Frontiers...

    2024

  5. [12]

    Deeptcr is a deep learning framework for revealing sequence concepts within t-cell repertoires.Nature communications, 12(1):1605, 2021

    John-William Sidhom, H Benjamin Larman, Drew M Pardoll, and Alexander S Baras. Deeptcr is a deep learning framework for revealing sequence concepts within t-cell repertoires.Nature communications, 12(1):1605, 2021

    2021

  6. [13]

    Berttcr: a bert-based deep learning framework for predicting cancer-related immune status based on t cell receptor repertoire.Briefings in Bioinformatics, 25(5):bbae420, 2024

    Min Zhang, Qi Cheng, Zhenyu Wei, Jiayu Xu, Shiwei Wu, Nan Xu, Chengkui Zhao, Lei Yu, and Weixing Feng. Berttcr: a bert-based deep learning framework for predicting cancer-related immune status based on t cell receptor repertoire.Briefings in Bioinformatics, 25(5):bbae420, 2024

    2024

  7. [14]

    Methpriorgcn: a deep learning tool for inferring dna methylation prior knowledge and guiding personalized medicine.Briefings in Bioinformatics, 26(2):bbaf131, 2025

    Jie Ni, Bin Li, Shumei Miao, Xinting Zhang, Donghui Yan, Shengqi Jing, Shan Lu, Zhuoying Xie, Xin Zhang, and Yun Liu. Methpriorgcn: a deep learning tool for inferring dna methylation prior knowledge and guiding personalized medicine.Briefings in Bioinformatics, 26(2):bbaf131, 2025

    2025

  8. [15]

    Learning immune receptor representations with protein language models.arXiv preprint arXiv:2402.03823, 2024

    Andreas Dounas, Tudor-Stefan Cotet, and Alexander Yermanos. Learning immune receptor representations with protein language models.arXiv preprint arXiv:2402.03823, 2024

    2024 arXiv

  9. [16]

    Sequence-based tcr-peptide representations using cross-epitope contrastive fine-tuning of protein language models

    Chiho Im, Ryan Zhao, Scott D Boyd, and Anshul Kundaje. Sequence-based tcr-peptide representations using cross-epitope contrastive fine-tuning of protein language models. InInternational Conference on Research in Computational Molecular Biology, pages 34–48. Springer, 2025

    2025

  10. [17]

    A large language model for predicting t cell receptor-antigen binding specificity

    Xing Fang, Chenpeng Yu, Shiye Tian, and Hui Liu. A large language model for predicting t cell receptor-antigen binding specificity. In2024 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pages 1489–1492. IEEE, 2024

    2024

  11. [18]

    Deciphering the language of antibodies using self-supervised learning.Patterns, 3(7), 2022

    Jinwoo Leem, Laura S Mitchell, James HR Farmery, Justin Barton, and Jacob D Galson. Deciphering the language of antibodies using self-supervised learning.Patterns, 3(7), 2022. 11 DynImmune-BERT

    2022

  12. [19]

    Deep learning-based prediction of the t cell receptor–antigen binding specificity

    Tianshi Lu, Ze Zhang, James Zhu, Yunguan Wang, Peixin Jiang, Xue Xiao, Chantale Bernatchez, John V Heymach, Don L Gibbons, Jun Wang, et al. Deep learning-based prediction of the t cell receptor–antigen binding specificity. Nature machine intelligence, 3(10):864–875, 2021

    2021

  13. [20]

    The deep learning framework icantcr enables early cancer detection using the t-cell receptor repertoire in peripheral blood.Cancer Research, 84(11):1915–1928, 2024

    Yideng Cai, Meng Luo, Wenyi Yang, Chang Xu, Pingping Wang, Guangfu Xue, Xiyun Jin, Rui Cheng, Jinhao Que, Wenyang Zhou, et al. The deep learning framework icantcr enables early cancer detection using the t-cell receptor repertoire in peripheral blood.Cancer Research, 84(11):19...

    1915

  14. [21]

    Machine learning for cancer immunotherapies based on epitope recognition by t cell receptors.Frontiers in genetics, 10:1141, 2019

    Anja Mösch, Silke Raffegerst, Manon Weis, Dolores J Schendel, and Dmitrij Frishman. Machine learning for cancer immunotherapies based on epitope recognition by t cell receptors.Frontiers in genetics, 10:1141, 2019

    2019

  15. [22]

    Circulating t-cell receptor repertoire for cancer early detection.NPJ Precision Oncology, 9(1):245, 2025

    Yilong Li, Michelle Nahas, Dennis Stephens, Kate Froburg, Emma Hintz, Devin Champagne, Amaneet Lochab, Markus Brown, Jasper Braun, María Antonia Fortuño, et al. Circulating t-cell receptor repertoire for cancer early detection.NPJ Precision Oncology, 9(1):245, 2025

    2025

  16. [23]

    Disease diagnostics using machine learning of b cell and t cell receptor sequences.Science, 387(6736):eadp2407, 2025

    Maxim E Zaslavsky, Erin Craig, Jackson K Michuda, Nidhi Sehgal, Nikhil Ram-Mohan, Ji-Yeun Lee, Khoa D Nguyen, Ramona A Hoh, Tho D Pham, Katharina Röltgen, et al. Disease diagnostics using machine learning of b cell and t cell receptor sequences.Science, 387(6736):eadp2407, 2025

    2025

  17. [24]

    Reading the repertoire: Progress in adaptive immune receptor analysis using machine learning.Cell Systems, 15(12):1168–1189, 2024

    Timothy J O’Donnell, Chakravarthi Kanduri, Giulio Isacchini, Julien P Limenitakis, Rebecca A Brachman, Raymond A Alvarez, Ingrid H Haff, Geir K Sandve, and Victor Greiff. Reading the repertoire: Progress in adaptive immune receptor analysis using machine learning.Cell Systems,...

    2024

  18. [25]

    Neural ordinary differential equations.Advances in neural information processing systems, 31, 2018

    Ricky TQ Chen, Yulia Rubanova, Jesse Bettencourt, and David K Duvenaud. Neural ordinary differential equations.Advances in neural information processing systems, 31, 2018

    2018

  19. [26]

    Attention is all you need.Advances in neural information processing systems, 30, 2017

    Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need.Advances in neural information processing systems, 30, 2017

    2017

  20. [27]

    Continuous self-attention models with neural ode networks

    Jing Zhang, Peng Zhang, Baiwen Kong, Junqiu Wei, and Xin Jiang. Continuous self-attention models with neural ode networks. InProceedings of the AAAI conference on artificial intelligence, volume 35, pages 14393–14401, 2021

    2021

  21. [28]

    Contiformer: Continuous- time transformer for irregular time series modeling.Advances in Neural Information Processing Systems, 36: 47143–47175, 2023

    Yuqi Chen, Kan Ren, Yansen Wang, Yuchen Fang, Weiwei Sun, and Dongsheng Li. Contiformer: Continuous- time transformer for irregular time series modeling.Advances in Neural Information Processing Systems, 36: 47143–47175, 2023

    2023

  22. [29]

    Diffode: Neural ode with differentiable hidden state for irregular time series analysis

    Yudong Zhang, Xu Wang, Xuan Yu, Zhengyang Zhou, Xing Xu, Lei Bai, and Yang Wang. Diffode: Neural ode with differentiable hidden state for irregular time series analysis. In2025 IEEE 41st International Conference on Data Engineering (ICDE), pages 1–14. IEEE, 2025

    2025

  23. [30]

    T-cell repertoire analysis and metrics of diversity and clonality.Current opinion in biotechnology, 65:284–295, 2020

    Johanna Chiffelle, Raphael Genolet, Marta AS Perez, George Coukos, Vincent Zoete, and Alexandre Harari. T-cell repertoire analysis and metrics of diversity and clonality.Current opinion in biotechnology, 65:284–295, 2020

    2020

  24. [31]

    High-throughput and single-cell t cell receptor sequencing technologies

    Joy A Pai and Ansuman T Satpathy. High-throughput and single-cell t cell receptor sequencing technologies. Nature methods, 18(8):881–892, 2021

    2021

  25. [32]

    Multiple instance neural networks based on sparse attention for cancer detection using t-cell receptor sequences.BMC bioinformatics, 23(1):469, 2022

    Younghoon Kim, Tao Wang, Danyi Xiong, Xinlei Wang, and Seongoh Park. Multiple instance neural networks based on sparse attention for cancer detection using t-cell receptor sequences.BMC bioinformatics, 23(1):469, 2022

    2022

  26. [33]

    Transmil: Transformer based correlated multiple instance learning for whole slide image classification.Advances in neural information processing systems, 34:2136–2147, 2021

    Zhuchen Shao, Hao Bian, Yang Chen, Yifeng Wang, Jian Zhang, Xiangyang Ji, et al. Transmil: Transformer based correlated multiple instance learning for whole slide image classification.Advances in neural information processing systems, 34:2136–2147, 2021

    2021

  27. [34]

    Biformer: Vision transformer with bi-level routing attention

    Lei Zhu, Xinjiang Wang, Zhanghan Ke, Wayne Zhang, and Rynson WH Lau. Biformer: Vision transformer with bi-level routing attention. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10323–10333, 2023

    2023

  28. [35]

    Neural ode transformers: Analyzing internal dynamics and adaptive fine-tuning.arXiv preprint arXiv:2503.01329, 2025

    Anh Tong, Thanh Nguyen-Tang, Dongeun Lee, Duc Nguyen, Toan Tran, David Hall, Cheongwoong Kang, and Jaesik Choi. Neural ode transformers: Analyzing internal dynamics and adaptive fine-tuning.arXiv preprint arXiv:2503.01329, 2025. 12 DynImmune-BERT

    2025 arXiv

  29. [36]

    Online sinkhorn: Optimal transport distances from sample streams.Advances in Neural Information Processing Systems, 33:1657–1667, 2020

    Arthur Mensch and Gabriel Peyré. Online sinkhorn: Optimal transport distances from sample streams.Advances in Neural Information Processing Systems, 33:1657–1667, 2020

    2020

  30. [37]

    A trainable optimal transport embedding for feature aggregation and its relationship to attention.arXiv preprint arXiv:2006.12065, 2020

    Grégoire Mialon, Dexiong Chen, Alexandre d’Aspremont, and Julien Mairal. A trainable optimal transport embedding for feature aggregation and its relationship to attention.arXiv preprint arXiv:2006.12065, 2020

    2006 arXiv

  31. [38]

    Energy-based sliced wasserstein distance.Advances in Neural Information Processing Systems, 36:18046–18075, 2023

    Khai Nguyen and Nhat Ho. Energy-based sliced wasserstein distance.Advances in Neural Information Processing Systems, 36:18046–18075, 2023

    2023

  32. [39]

    A sliced wasserstein loss for neural texture synthesis

    Eric Heitz, Kenneth Vanhoey, Thomas Chambon, and Laurent Belcour. A sliced wasserstein loss for neural texture synthesis. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 9412–9420, 2021

    2021

  33. [40]

    Lora-fa: Memory-efficient low-rank adaptation for large language models fine-tuning.arXiv preprint arXiv:2308.03303, 2023

    Longteng Zhang, Lin Zhang, Shaohuai Shi, Xiaowen Chu, and Bo Li. Lora-fa: Memory-efficient low-rank adaptation for large language models fine-tuning.arXiv preprint arXiv:2308.03303, 2023

    2023 arXiv

  34. [41]

    Autolora: Automatically tuning matrix ranks in low-rank adaptation based on meta learning.arXiv preprint arXiv:2403.09113, 2024

    Ruiyi Zhang, Rushi Qiang, Sai Ashish Somayajula, and Pengtao Xie. Autolora: Automatically tuning matrix ranks in low-rank adaptation based on meta learning.arXiv preprint arXiv:2403.09113, 2024

    2024 arXiv

  35. [42]

    Lora+: Efficient low rank adaptation of large models.arXiv preprint arXiv:2402.12354, 2024

    Soufiane Hayou, Nikhil Ghosh, and Bin Yu. Lora+: Efficient low rank adaptation of large models.arXiv preprint arXiv:2402.12354, 2024

    2024 arXiv

Pith tools

Reviewed August 4, 2026 · model on record in the stance chip above.