Pith. Sign in

REVIEW

Applications of Knot Theory for the Improvement of the AlphaFold Protein Database

Biomolecules · Submitted 15 Dec 2024 · 2 references

Pith's verdict: A clear, earnest short paper whose Alexander-Briggs comparison is fine but whose headline Gauss-code mismatch claim is invalid because the comparison ignores that Gauss codes are representation-dependent.

T0 · AI review

How this review was made: An AI referee (deepseek-v4-flash) read the paper on August 11, 2026 and answered a fixed list of questions about it. T0 is the starting level every paper gets. The levels describe how deeply Pith has checked the paper, never the authors.

  1. T0 AI review An AI read the paper and answered a fixed list of questions.
  2. T1 Audit Automatic checks that the references and files the paper relies on exist and match.
  3. T2 Compute The paper's code or calculations re-run with the same results.
  4. T3 Formal statement The claims written out in a formal math language a computer can read.
  5. T4 Proof Those claims proved, and the proof checked by computer.

How Pith checks papers →

· 4 major objections · 5 minor · Ask about this paper · The compiled record · Read the full review →
Challenge this review Comment (0) Read on arXiv ↗
Cite ▾
arXiv ID2412.11229 (version 1)
Pith ID73WUZ4FT, Pith's permanent record of this paper and its review
CitationPranshu Jahagirdar. "Applications of Knot Theory for the Improvement of the AlphaFold Protein Database." arXiv:2412.11229 (2024). https://pith.science/paper/73WUZ4FT
Cite this reviewBibTeX for Pith's review of this paper
Claim paper

Why Pith says this

Highlight any text to comment on it.

Referee report
The paper

The paper claims

AlphaFold usually predicts the correct overall knot type for knotted proteins but misrepresents the knot's orientation and directionality in more than half of the cases examined, and the paper estimates that up to millions of database…

The reading

This paper is trying to determine whether the widely used artificial-intelligence structure predictor AlphaFold can be trusted when the protein in question contains a knot. The author compares 45 experimentally verified knotted proteins from the KnotProt database with their AlphaFold-generated counterparts and analyzes the knots in two mathematical notations. In the coarse Alexander-Briggs notation, 95.6% of the predicted knots match the experimental ones; in the finer Gauss-code notation, 55.6% do not. The paper concludes that AlphaFold captures the general shape of a knot but frequently misrepresents its orientation and directionality, and it estimates that between 188,320 and 2,379,680 entries in the AlphaFold Protein Database may be incorrectly modeled as a result. A sympathetic reader would care because anyone who uses a mispredicted knotted structure for drug development could be working from a protein with the wrong topology.

What carries the argument

The carrying mechanism is the comparison of two knot invariants computed for each experimental-predicted pair. The Alexander-Briggs notation labels a knot by its minimum crossing number plus an index (for example $3_1$ for the trefoil), giving a coarse type; the Gauss code lists every crossing in order with a sign for over/under and a letter identifying the strand, giving a finer record of orientation and direction. The paper uses the PyKnot analysis plugin to compute both invariants, compares the outputs pairwise, and treats a Gauss-code match as evidence that the knot's orientation is preserved. It deliberately ignores the numeric crossing indices in Gauss codes on the grounds that exact crossing locations are not expected to match between independently computed structures, while keeping the sign and strand-order sequence. The striking divergence between the 95.6% Alexander-Briggs agreement and the 44.4% Gauss-code agreement is the observable that carries the paper's argument.

Extended reading notes

Core claim

The central claim is that AlphaFold's knot predictions are topologically correct in overall type but often wrong in directional detail. Out of 45 experimentally verified knotted proteins, 43 AlphaFold models matched in Alexander-Briggs classification (for example $3_1$, the trefoil), a 95.6% agreement, whereas only 44.4% of the Gauss codes matched, giving a 55.6% mismatch rate. The paper reads this gap as evidence that AlphaFold can reproduce the general shape of a knot but cannot reliably reproduce the order, orientation, and directionality of its crossings. It further extrapolates the mismatch percentages to the whole AlphaFold Protein Database using the estimate that about 2% of protein structures contain non-trivial topologies, producing a range of 188,320 to 2,379,680 potentially incorrectly modeled proteins. The paper also reports that the two Alexander-Briggs failures were both trefoils predicted as unknotted with high confidence, which it takes as evidence that the pLDDT confidence score does not catch knot errors.

Load-bearing premise

The comparison assumes that two Gauss codes that differ only in starting position, travel direction, or strand labeling are topologically different, even though the same knot can be written in many equivalent ways.

Editorial extensions

If this is right

  • If the mismatch rates hold, any screen of the AlphaFold Database for knotted proteins will carry an orientation error rate near 55.6% for the knotted subset, not just for the 45 proteins tested.
  • The pLDDT confidence score cannot be used to filter these failures, since the paper found confidently scored trefoils that were predicted as unknotted.
  • A knot-aware post-processing step, or removal of the roughly 25 confirmed mismatches, would improve the reliability of the database without retraining the model.
  • The estimated scale of 188,320 to 2,379,680 wrongly modeled entries means downstream high-throughput studies that use AlphaFold structures without checking topology may systematically inherit knot-orientation errors.
  • Switching AlphaFold to a single-module design for sequences suspected of being knotted could reduce physically impossible knots, at the cost of computational efficiency.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A normalized Gauss-code comparison, in which the starting point is cyclically rotated, the travel direction is reversed, and strand labels are swapped before matching, would give a cleaner estimate of true directional error; the paper does not perform that normalization.
  • The 188,320 to 2,379,680 range should be read as an extrapolation that assumes the 45 selected proteins represent the full knotted population of the database, rather than as a precise point estimate.
  • Applying the same experimental-versus-predicted knot comparison to other artificial-intelligence structure predictors would show whether the orientation problem is specific to AlphaFold or generic to current prediction methods.
  • A topological invariant that does not depend on starting position or direction could serve as an independent check on the Gauss-code result.
Original abstract

AlphaFold, a groundbreaking protein prediction model, has revolutionized protein structure prediction, populating the AlphaFold Protein Database (AFDB) with millions of predicted structures. However, AlphaFold's accuracy in predicting proteins with intricate topologies, such as knots, remains a concern. This study investigates AlphaFold's performance in predicting knotted proteins and explores potential solutions to enhance the AFDB's reliability. Forty-five experimentally verified knotted protein structures from the KnotProt database were compared to their AlphaFold-generated counterparts. Knot analysis was performed using PyKnot, a PyMOL plugin, employing both Gauss codes and Alexander-Briggs knot notations. Results showed 95.6% accuracy in predicting the general shape of knots using Alexander-Briggs notation. However, Gauss code analysis revealed a 55.6% discrepancy, indicating AlphaFold's limitations in accurately representing the intricate orientation and directionality of knots. This Applications of Knot Theory for the improvement of the AlphaFold Protein Database suggests potential inaccuracies in a significant portion of the AFDB's knotted protein structures. The study underscores the need for improved knot representation in AlphaFold and proposes potential solutions, including transitioning to a single-module design or removing incorrectly predicted structures from the AFDB. These findings highlight the importance of continuous refinement for AI-based protein structure prediction tools to ensure the accuracy and reliability of protein databases for research and drug development.

The compiled record

The paper's own sentences, arranged, kept beside the review and separate from it. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.

Compiled by classifier-1.13.0 via TypeSafe API, question bank abstract-p1-20260923, 2026-09-23: 1 request, 7,596 input tokens.

What the abstract itself states, as probabilities: claims first 0.04 · states limitation 0.40 · human participants 0.03 · controlled comparison 0.41 · randomized assignment 0.01 · states quantitative result 0.99 · compares with prior results 0.38 · mentions code or data availability 0.03.

The abstract, sentence by sentence

arXiv listing abstract v1. Results and the main claim are underlined; .

AlphaFold, a groundbreaking protein prediction model, has revolutionized protein structure prediction, populating the AlphaFold Protein Database (AFDB) with millions of predicted structures. However, AlphaFold's accuracy in predicting proteins with intricate topologies, such as knots, remains a concern. This study investigates AlphaFold's performance in predicting knotted proteins and explores potential solutions to enhance the AFDB's reliability. Forty-five experimentally verified knotted protein structures from the KnotProt database were compared to their AlphaFold-generated counterparts. Knot analysis was performed using PyKnot, a PyMOL plugin, employing both Gauss codes and Alexander-Briggs knot notations. Results showed 95.6% accuracy in predicting the general shape of knots using Alexander-Briggs notation. However, Gauss code analysis revealed a 55.6% discrepancy, indicating AlphaFold's limitations in accurately representing the intricate orientation and directionality of knots. This Applications of Knot Theory for the improvement of the AlphaFold Protein Database suggests potential inaccuracies in a significant portion of the AFDB's knotted protein structures. The study underscores the need for improved knot representation in AlphaFold and proposes potential solutions, including transitioning to a single-module design or removing incorrectly predicted structures from the AFDB. These findings highlight the importance of continuous refinement for AI-based protein structure prediction tools to ensure the accuracy and reliability of protein databases for research and drug development.

background contribution method result interpretation main claim

What the classifier reports for each sentence. The number is the probability it gave the label.
#sentencerolethe authors' own workstates the main conclusionstrength
s0 AlphaFold, a groundbreaking protein prediction model, has revolutionized protein structure prediction, populating the AlphaFold Protein Database (AFDB) with millions of predicted structures. background 1.00 0.05 0.02 asserted 1.00
s1 However, AlphaFold's accuracy in predicting proteins with intricate topologies, such as knots, remains a concern. gap 0.73 0.05 0.04 asserted 0.83
s2 This study investigates AlphaFold's performance in predicting knotted proteins and explores potential solutions to enhance the AFDB's reliability. contribution 0.98 0.58 0.04 asserted 0.77
s3 Forty-five experimentally verified knotted protein structures from the KnotProt database were compared to their AlphaFold-generated counterparts. method 0.95 0.90 0.02 asserted 0.99
s4 Knot analysis was performed using PyKnot, a PyMOL plugin, employing both Gauss codes and Alexander-Briggs knot notations. method 1.00 0.87 0.02 asserted 0.99
s5 Results showed 95.6% accuracy in predicting the general shape of knots using Alexander-Briggs notation. result 1.00 0.89 0.10 asserted 1.00
s6 However, Gauss code analysis revealed a 55.6% discrepancy, indicating AlphaFold's limitations in accurately representing the intricate orientation and directionality of knots. result 0.82 0.93 0.23 hedged possibility 0.52
s7 This Applications of Knot Theory for the improvement of the AlphaFold Protein Database suggests potential inaccuracies in a significant portion of the AFDB's knotted protein structures. interpretation 0.97 0.69 0.75 hedged possibility 1.00
s8 The study underscores the need for improved knot representation in AlphaFold and proposes potential solutions, including transitioning to a single-module design or removing incorrectly predicted structures from the AFDB. future work 0.98 0.64 0.32 asserted 0.59
s9 These findings highlight the importance of continuous refinement for AI-based protein structure prediction tools to ensure the accuracy and reliability of protein databases for research and drug development. interpretation 0.70 0.34 0.16 asserted 0.99

What kind of paper the classifier reports this is: empirical study 0.97 · evidence from analysis of existing data 0.89.

What was examined, and what was not

sources read
  • arXiv listing abstract v1
not examined
  • full text
  • figures and tables
  • references and citing sentences
  • relations to other papers
levels run
  • P abstract
not run
  • S sections
  • T body sentences
  • C citations
  • R cross-paper relations

Every quoted sentence on this record is the authors'. Every label is from Pith's closed vocabulary, with the probability shown beside it. Every number in the measurements table is the authors', checked by code. Record as JSON

Figures
Figure 1. The most common knot type found in proteins is written as 3₁ in the Alexander–Briggs notation (Perlinska et al., 2023)
Figure 2. The KnotProt database Protein Structure Search To obtain the AI-generated counterparts of the selected KnotProt proteins, this study utilized Foldseek, a search engine developed to help researchers find proteins across multiple databases. Foldseek offers the functionality of uploading PDB (Protein Data Bank File) files to their search server which allows for the lookup of the previously downloaded KnotProt proteins across a variety of protein databases. Out of the list of possible protein matches within the search results, models that were stored on the AlphaFold Database specif
Figure 3. Foldseek Search Server Knot Analysis The initial method for performing knot analysis was to use a scripting approach using Topoly, a polymer topology analysis tool, in order to compare the qualities of the knots, if any are present, within the AlphaFold predicted models against the KnotProt models, as recommended by Dabrowski-Tumanski et al. While Topoly supports a wider range of knot notations, it lacks protein visualization capabilities because it is restricted to the command line and produces numerous import errors during use. The alternative to Topoly used in this study wa
Figure 4. The PyMOL program with an imported protein model, having knot analysis performed on it
Figure 5. The PyMOL terminal depicting errors in the knot analysis output
Figure 6. The PyMOL terminal shows appropriate knot analysis results without errors

Figures reproduced from arXiv:2412.11229 by the authors.

References

Discussion

Disagree with the review, or know something it missed? Leave a comment, highlight any passage above to comment on it, or challenge this review formally.