{"id":"6d4ca023-d2b1-4f1d-9c6f-0139a33b9c7b","arxiv_id":"2508.06506","paper_version":2,"verdict":"REJECT","confidence":"MODERATE","novelty_score":3.0,"correctness_risk":"high","formal_verification":"none","parameter_count":4,"one_line_summary":"A PINN is trained to solve a scalar angular Teukolsky equation with fixed parameters, yet no real spin inference or quantitative benchmarking is presented.","lead":"This paper trains a physics-informed neural network to solve a simplified scalar version of the angular Teukolsky equation for one fixed set of black hole parameters. It claims this hybrid approach advances black hole spin estimation, but it does not actually estimate spin from any data and provides no quantitative comparisons.","discovery_kind":"incremental","skeptic_critique":{"model":"deepseek-v4-flash","headline":"Central claim of spin estimation is unsupported by any experiment: no spin is inferred from data, no AUC/sensitivity is computed, and the boundary conditions are likely wrong for m=0.","rationale":"The reader's verdict is REJECT, and I agree. The most load-bearing problem is not merely the missing benchmarking metrics (which alone would justify rejection of the title claim 'black hole spin estimation') but that the PINN is solving a different boundary value problem due to incorrect boundary conditions. The manuscript asserts that psi(0)=psi(pi)=0 for the s=0, m=0 scalar spheroidal equation; this is false for generic spheroidal harmonics, which are regular (finite) at the poles but not zero. The m=0, s=0 spheroidal harmonics are not the same as Legendre polynomials when a^2 omega^2 is nonzero; they are oblate/prolate spheroidal functions and are nonzero at the poles. Therefore the reported small residual and RMSE against 'the analytical solution' are consistent with the network learning the wrong solution. The 5.4e-8 loss is a PDE-residual loss, not a measure of physical accuracy. This makes the already-unsupported central claim (AUC/sensitivity outperformance) doubly unsupported: neither the benchmarking nor the physical fidelity of the forward solver is established. I see no reason to soften the verdict: the abstract overclaims, Section 5 presents no quantitative comparison, and the boundary condition error is a concrete physics flaw. Even as a proof-of-concept for solving the angular Teukolsky equation, the paper would need corrected boundary conditions and a comparison to the actual spheroidal harmonic to establish validity. The paper itself contains limitation statements that partially acknowledge the simplified scalar setup, but none of these caveats rescue the headline claim of spin estimation superiority.","tokens_in":6292,"tokens_out":2162,"duration_ms":20416,"concrete_test":"Compute the exact scalar spheroidal angular function for a=0.7, m=0, omega=0.5 (e.g., with SpinWeightedSpheroidalHarmonics in Mathematica or the scipy-based package) and evaluate it at theta=0 and theta=pi. If the exact solution is nonzero at the poles, retrain the PINN with regularity boundary conditions (e.g., dpsi/dtheta=0 at the poles, or no Dirichlet BC) and compare the RMSE against the same exact solution. In addition, if the AUC/sensitivity claim is to be tested, define a spin-inference task: generate synthetic Teukolsky angular solutions or ringdown data for a grid of spin values, train the PINN or a surrogate, and apply it to held-out data; report the ROC curve and AUC. If no AUC is produced, the benchmarking claim in the abstract and Section 5 should be retracted.","verdict_should_be":"REJECT","load_bearing_attack":"The paper's central claim, in the abstract and Section 5, is that the proposed PINN-based method 'outperforms both classical and data-driven machine learning approaches in terms of AUC and sensitivity' for black hole spin estimation. However, no such result is presented anywhere in the manuscript. Section 4 solves the angular Teukolsky equation at fixed a=0.7, m=0, omega=0.5 and reports residual loss. Section 4.3 reports an RMSE of ~8.4e-7 against the analytical solution, Section 5 qualitatively compares methods in a table and radar chart, but no AUC is computed, no sensitivity is defined or measured, and no spin is estimated from any data. The stated claim is therefore not supported by any quantitative evidence. An independent, load-bearing concern is the boundary condition in Eq. 4: psi(0)=psi(pi)=0. For the scalar (s=0), m=0 spheroidal angular equation that is regular on S^2, the correct regularity conditions are finiteness at the poles, and the m=0 spheroidal harmonics do not vanish at the poles in general (for a^2 omega^2 > 0). The paper explicitly asserts the opposite in Section 3.3, claiming 'For the scalar (s=0) and m=0 case, regularity at the poles means that psi(0)=psi(pi)=0' and that these Dirichlet conditions 'match the symmetry of the scalar spheroidal harmonics and make the problem well-posed.' That assertion is a physics error: the spheroidal harmonics are eigenfunctions of a Sturm-Liouville problem with regularity (boundedness) at the poles, not Dirichlet zero conditions. If the true solution is nonzero at the poles, the enforced BC changes the solution; the small residual and RMSE then measure convergence to a different boundary value problem, not to the physical scalar Teukolsky angular solution, and the hybrid method has no demonstrated connection to spin estimation.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper proposes a hybrid approach to black hole spin estimation by combining the Teukolsky formalism with physics-informed neural networks (PINNs). The authors train a fully connected PINN to solve a scalar, m=0 angular Teukolsky equation at fixed parameters (a=0.7, omega=0.5), using a loss that penalizes the PDE residual and boundary conditions psi(0)=psi(pi)=0. They report a residual loss that decreases to about 5.4e-8 and an RMSE of about 8.4e-7 relative to an analytical solution, and then provide a qualitative comparison of PINNs with continuum-fitting, X-ray reflection spectroscopy, QPO models, and CNN/LSTM methods. The abstract and Section 5 state that the method outperforms classical and data-driven approaches in terms of AUC and sensitivity and offers superior interpretability, generalizability, and physical consistency.","tokens_in":6583,"tokens_out":10915,"duration_ms":121877,"significance":"The intended contribution—a physics-informed neural solver for Teukolsky-type angular equations that could be embedded in a spin-estimation pipeline—is reasonable and sits in an active literature. If the solver were validated against the correct boundary value problem and paired with an actual inverse-problem experiment, it could be a useful tool. However, the manuscript as written does not deliver a spin estimator: no spin is inferred from data, no AUC or sensitivity is computed, and the reported validation is for a forward problem with an apparently incorrect boundary condition. The central claims of outperformance therefore rest on qualitative self-assessments rather than measurements. The paper also provides no code or data, so the numerical claims cannot be independently checked.","major_comments":[{"comment":"The claim that the proposed method 'outperforms both classical and data-driven machine learning approaches in terms of AUC and sensitivity' is not supported by any quantitative result. Section 5 presents only a qualitative table (Table 4) and radar chart (Figure 4) with categorical ratings such as 'High' and 'Moderate'; no AUC values, no sensitivity values, no dataset, and no spin-inference experiment are provided. A benchmark that measures RMSE of the angular mode function for a in {0.5, 0.7, 0.9} is not a comparison of spin-estimation performance. This is a load-bearing unsupported claim in the abstract.","section":"Section 5 and Abstract"},{"comment":"The Dirichlet boundary conditions psi(0)=psi(pi)=0 are not the correct regularity conditions for the scalar m=0 spheroidal equation. Regular solutions on S^2 are bounded at the poles, and for m=0 they generically take nonzero finite values there (for c=0 they are the Legendre polynomials, which do not vanish at theta=0,pi). The sentence 'regularity at the poles means that psi(0)=psi(pi)=0' is a physics error. If the PINN is trained with these conditions while the RMSE in Section 4.3 is computed against an analytical solution that satisfies the true regularity conditions, the comparison is against solutions of different boundary value problems.","section":"Section 3.3, Eq. (4)"},{"comment":"As written, Eq. (1) is not the standard scalar Teukolsky angular equation. The Sturm-Liouville derivative term should be (1/sin theta) d/dtheta (sin theta dpsi/dtheta), and the relation between the separation constant lambda used here and the standard spheroidal eigenvalue is not stated (the sign of the a^2 omega^2 cos^2 theta term depends on this convention). Because the PINN residual is defined as the left-hand side of Eq. (1), a literal implementation with the missing 1/sin theta factor would train on a different operator and the reported losses and RMSE would not demonstrate convergence to the target equation.","section":"Section 3.1, Eq. (1)"},{"comment":"The reported experiments validate a forward solver, not a spin estimator. In Section 3.1, lambda is supplied externally from the scalar spheroidal formalism, and the RMSE in Section 4.3 is measured against the analytical solution of the same equation with the same lambda. That is a reasonable self-consistency check, but it is not circular in a damaging sense; rather, it is insufficient for the paper's stated goal. To support the spin-estimation claim, the authors would need an inverse experiment that recovers a (and possibly omega) from synthetic or real data and compares the recovered values with a classical estimator using defined metrics such as AUC or sensitivity.","section":"Section 4.3 and Section 5"},{"comment":"The conclusion introduces 'semi-classical and quantum estimators,' but no quantum estimator is presented or cited in the body of the paper, and the methods described (continuum fitting, reflection spectroscopy, QPO models) are classical. This characterization is inaccurate and should be corrected.","section":"Section 6/7"}],"minor_comments":[{"comment":"The text states that '200 sampling points are Gaussian points in theta in (0, pi) direction and are sampled in uniform space,' which is contradictory; Table 3 says the collocation points are uniformly sampled. Please clarify the actual sampling scheme.","section":"Section 3.4"},{"comment":"The abstract conflates the residual loss (approximately 5.4e-8) with the RMSE (approximately 8.4e-7). These are different quantities; please report them separately.","section":"Abstract and Section 4.3"},{"comment":"Figures 1, 2, and 3 are all described as showing loss convergence, and the text refers to 'Figure 3' for results that appear in Table 2. The figure numbering and in-text references need to be made consistent.","section":"Figures 1-3"},{"comment":"The 'Spin Sensitivity' and other ratings in Table 4 are presented as though they were measured, but no protocol is given for assigning these categorical values, and the PINN row is not backed by a spin-inference experiment. Either provide the scoring rubric or label the table as an author assessment.","section":"Table 4"},{"comment":"Several claims lack citations (e.g., the assertion in Section 4.1 that the setup is 'based on the experimental setups reported by [8]' is not specific), and some references are incomplete or not given full bibliographic details. Please check all citations.","section":"References"},{"comment":"There are numerous typographical and grammatical errors (e.g., 'Bencmark' in Section 5, 'V alue' in Table 3, 'semi-classicaI' in Section 7, and several missing words). The manuscript would benefit from careful proofreading.","section":"Throughout"}],"recommendation":"reject","confidential_remarks":"The manuscript reads like an early draft. The abstract makes claims that the body does not support, and the boundary-condition issue is a genuine physics error. I would not recommend resubmission unless the authors substantially rework the paper into a forward-solver validation with corrected equations and drop or properly support the spin-estimation benchmarking claims."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Here's the short version: this paper is a PINN exercise for the m=0 scalar angular Teukolsky equation, and it is not a spin-estimation paper. The abstract and Section 5 claim the method 'outperforms both classical and data-driven machine learning approaches in terms of AUC and sensitivity,' but no AUC, sensitivity, or spin inference appears anywhere in the manuscript. That is the load-bearing problem.\n\nThe paper does have some merit. It is transparent about being a proof of concept, openly lists limitations (1D scalar reduction, computational cost, degradation near extremal spin), and cites the relevant PINN–Teukolsky work (Luna et al. 2023, Cornell et al. 2024). The loss convergence and RMSE numbers are at least reported, and the experimental setup is reproducible.\n\nThe soft spots are serious, though. First, the boundary conditions. Equation (4) imposes ψ(0)=ψ(π)=0, and Section 3.3 claims this is what regularity at the poles means for the s=0, m=0 scalar spheroidal harmonics. That is not right. Regular solutions to the Sturm–Liouville problem are finite at the poles, not zero; the standard m=0 spheroidal harmonics don't vanish there. If the PINN is trained with homogeneous Dirichlet conditions, it's solving a different boundary value problem, and the tiny RMSE against the analytical solution is puzzling – it suggests the comparison may be against the wrong solution or the BC term is being ignored. This isn't a minor bug; it calls into question the physical relevance of the whole exercise.\n\nSecond, the comparison with other spin-estimation methods is a qualitative table and radar chart. There are no numbers behind 'AUC' or 'sensitivity', and no synthetic or real data are used. The novelty over Luna et al. is also thin: reducing to m=0 and one parameter set is a simplification, not a new result.\n\nOn the circularity concern: having λ computed externally is standard practice and not itself circular. But the validation is self-referential in the weaker sense that you're checking the network against the same equation it was trained on – that's fine for a PDE solver sanity check, not for a claim about spin measurement.\n\nWho is this for? Someone curious about PINN pitfalls might get a warning out of it. As a contribution to black hole spin estimation, it doesn't work. I would not send it to peer review in its current form; the correct next step is for the author to fix the BC, actually estimate spin from mock data, and report a measured AUC or sensitivity. Until then, desk rejection is right.","headline":"A transparent but thin PINN exercise for the scalar angular Teukolsky equation that claims AUC/sensitivity gains it never computes, and whose pole boundary conditions are likely wrong for m=0.","tokens_in":7224,"tokens_out":4308,"would_cite":false,"duration_ms":47597,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":false},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"The paper claims that a physics-informed neural network solves the scalar angular Teukolsky equation to a residual near $10^{-8}$ and that this yields a more interpretable, still spin-sensitive route to black hole spin estimation.","keywords":["black hole spin","Teukolsky equation","physics-informed neural networks","quasi-normal modes","X-ray reflection spectroscopy","continuum fitting","quasi-periodic oscillations","Kerr spacetime"],"falsifier":"Solve the same scalar angular Teukolsky equation for $a=0.7$, $m=0$, $\\omega=0.5$ with the known regular boundary condition (finite at $\\theta=0,\\pi$) instead of Dirichlet zeroes, and compare the PINN's $\\hat\\psi$ at the poles and at interior collocation points against the exact spheroidal harmonic; if the network's output vanishes at the poles while the true solution is finite, the physical claim fails. A second check: recompute the RMSE with polar sampling points included, since the current RMSE is measured across interior collocation points that cannot see a boundary-condition mismatch.","tokens_in":6012,"feed_emoji":"🕳️","tokens_out":9797,"duration_ms":103943,"temperature":0.7,"pith_summary":"The paper is a proof of concept for a hybrid black-hole-spin estimator: instead of fitting data with a black-box network, it trains a physics-informed neural network to solve the scalar angular Teukolsky equation, with the differential operator and boundary conditions as the only supervision. The author claims the network converges reliably, reaching a final residual loss around $5.4\\times10^{-8}$ and an RMSE near $8.4\\times10^{-7}$ against the analytical spheroidal solution, and that this outperforms continuum fitting, X-ray reflection spectroscopy, QPO models, and CNN/LSTM approaches on a blend of physical consistency, interpretability, generalizability, and spin sensitivity. The paper states that the method wins on AUC and sensitivity against both classical and data-driven alternatives. If true, black hole spin estimation would become a physics-constrained learning problem rather than a choice between expensive analytic solvers and uninterpretable machine learning. The paper is explicit that this is a simplified scalar, one-dimensional version of the full Kerr perturbation problem, with degradation noted near extremal spin.","feed_headline":"Physics-trained network solves black hole spin equation to 1e-8","feed_subtitle":"Trained only on the differential operator, the PINN matches scalar Teukolsky solutions to RMSE below 1e-6.","key_machinery":"The load-bearing object is the scalar angular Teukolsky equation, the angular piece of Kerr perturbation theory governing the mode function $\\psi(\\theta)$: $$\\frac{d}{d\\$\\theta$}\\left(\\sin\\$\\theta$\\,\\frac{d\\psi}{d\\$\\theta$}\\right)+\\left(\\$\\lambda$-\\frac{$m^{{2}}$}{\\$sin^{{2}}$\\$\\theta$}-$a^{{2}}$\\$omega^{{2}}$\\$cos^{{2}}$\\$\\theta$\\right)\\psi=0,$$ with the spin parameter $a$ entering through the term $a^{2}\\omega^{2}\\cos^{2}\\theta$. The network is a four-layer, 50-neuron-per-layer tanh MLP; it is trained by minimizing $L_{\\mathrm{total}}=L_{\\mathrm{PDE}}+L_{\\mathrm{BC}}$, where $L_{\\mathrm{PDE}}$ averages the squared residual of this operator over 200 collocation points in $\\theta\\in(0,\\pi)$ and $L_{\\mathrm{BC}}$ enforces $\\psi(0)=\\psi(\\pi)=0$. Automatic differentiation computes the exact gradients of the residual, the separation constant $\\lambda$ is fixed from the scalar spheroidal formalism, and no labeled data enter the training.","core_discovery":"The central claim is that spin information encoded in the angular Teukolsky equation can be recovered by a PINN trained purely on the PDE residual and pole boundary conditions. For the scalar, axisymmetric case with spin $a=0.7$, azimuthal number $m=0$, and frequency $\\omega=0.5$, the learned mode function $\\hat\\psi(\\theta)$ agrees with the analytical scalar spheroidal harmonic to an RMSE of about $8.4\\times10^{-7}$, while the total residual loss drops to roughly $5.4\\times10^{-8}$. The author presents these numbers as evidence that physics-informed learning can act as an accurate, interpretable, and generalizable estimator of black hole spin at moderate computational cost, and that on the paper's qualitative benchmark it dominates classical spectroscopy methods and black-box deep learning in physical consistency, interpretability, and generalizability.","pith_inferences":["The paper does not spell out that the reported accuracy depends on the Dirichlet pole conditions; replacing them with the regular finite-at-the-poles condition and comparing solutions would isolate how much of the result is tied to that boundary choice.","Promoting the separation constant $\\lambda$ or the frequency $\\omega$ to trainable parameters would turn the network from a mode-function fitter into a direct spin or eigenvalue estimator, a step the paper mentions only as future work.","The benchmark comparison in the full text is qualitative; computing quantitative AUC and sensitivity numbers on synthetic reflection spectra with known spins would make the claimed outperformance testable.","A natural next test is the radial Teukolsky equation with complex quasi-normal-mode frequencies, where spin determines the ringdown spectrum and connects the proof of concept to gravitational-wave observations."],"forward_implications":["A physics-informed network can solve the scalar angular Teukolsky equation to high accuracy with no labeled training data, using only the differential operator and boundary conditions as supervision.","One trained network can cover a range of spin values, so spin estimation could generalize across sources without source-specific retraining.","The estimator is interpretable: its output is the physical mode function, so any prediction can be checked directly against the Teukolsky equation.","At moderate spin the reported residual and RMSE levels ($\\approx5\\times10^{-8}$ and $\\approx8\\times10^{-7}$) are small enough to make the proof of concept usable as a building block for spin inference.","Extending the scalar setup to GRMHD-coupled models and real observational data is the stated path from this proof of concept to practical measurement."],"supporting_citations":[{"why":"Introduces the PINN loss construction that the paper adopts for PDE-residual plus boundary supervision.","marker":"[12]"},{"why":"Previous Teukolsky PINN study that supplies the experimental setup and the convergence baseline.","marker":"[8]"},{"why":"Analytic representation of Kerr quasi-normal modes that supplies the spin-frequency input used in training.","marker":"[7]"},{"why":"Gravitational-wave spectroscopy framework connecting spin-dependent mode equations to observable QNM spectra.","marker":"[3]"},{"why":"Study of supervised versus unsupervised PINNs for Regge–Wheeler and Teukolsky equations, cited for performance degradation near extremal spin.","marker":"[4]"},{"why":"Describes the CNN/LSTM data-driven baselines that the paper compares against.","marker":"[2]"},{"why":"Continuum fitting, one of the classical spin estimation methods used in the benchmark table.","marker":"[9]"},{"why":"X-ray reflection spectroscopy, another classical method used as reference in the comparison.","marker":"[13]"},{"why":"QPO models, the source-dependent classical estimator included in the benchmark.","marker":"[11]"}],"fun_headline_variants":["Physics-informed net estimates black hole spin to 1e-8","PINN solves black hole spin equation without training labels","Hybrid approach: Theory and PINN match spin to 1e-8","No data, just physics: PINN recovers black hole spin","Teukolsky equation solved by physics-aware neural net"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The load-bearing premise is that the pole conditions $\\psi(0)=\\psi(\\pi)=0$ are the correct boundary conditions for regular scalar spheroidal harmonics; for $m=0$ these harmonics are finite at the poles rather than zero, so if the Dirichlet conditions are wrong the PINN solves a different boundary-value problem and its RMSE is measured against the wrong physical mode.","fun_headline_variants_meta":{"raw":{"variants":["Physics-informed net estimates black hole spin to 1e-8","PINN solves black hole spin equation without training labels","Hybrid approach: Theory and PINN match spin to 1e-8","No data, just physics: PINN recovers black hole spin","Teukolsky equation solved by physics-aware neural net"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000234,"raw_usage":{"total_tokens":1515,"prompt_tokens":985,"completion_tokens":530,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":601,"completion_tokens_details":{"reasoning_tokens":441}},"tokens_in":601,"tokens_out":530,"duration_ms":6189,"temperature":1.0,"reasoning_tokens":441,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-06T13:40:56.560424+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Solve the same scalar angular Teukolsky equation for $a=0.7$, $m=0$, $\\omega=0.5$ with the known regular boundary condition (finite at $\\theta=0,\\pi$) instead of Dirichlet zeroes, and compare the PINN's $\\hat\\psi$ at the poles and at interior collocation points against the exact spheroidal harmonic; if the network's output vanishes at the poles while the true solution is finite, the physical claim fails. A second check: recompute the RMSE with polar sampling points included, since the current RMSE is measured across interior collocation points that cannot see a boundary-condition mismatch.","supporting_citations":[{"cited_title":"Solving the teukolsky equation with physics-informed neural networks","cited_arxiv_id":null,"evidence_quote":"Previous Teukolsky PINN study that supplies the experimental setup and the convergence baseline."},{"cited_title":"An analytic representation for the quasi-normal modes of kerr black holes","cited_arxiv_id":null,"evidence_quote":"Analytic representation of Kerr quasi-normal modes that supplies the spin-frequency input used in training."},{"cited_title":"Gravitational-wave spectroscopy of massive black holes with the space interferometer lisa","cited_arxiv_id":null,"evidence_quote":"Gravitational-wave spectroscopy framework connecting spin-dependent mode equations to observable QNM spectra."},{"cited_title":"Measuring the spins of stellar-mass black holes","cited_arxiv_id":null,"evidence_quote":"Continuum fitting, one of the classical spin estimation methods used in the benchmark table."},{"cited_title":"Measuring black hole spin using x-ray reflection spectroscopy","cited_arxiv_id":null,"evidence_quote":"X-ray reflection spectroscopy, another classical method used as reference in the comparison."},{"cited_title":"Geometrical constraints on the origin of timing signals from black holes","cited_arxiv_id":null,"evidence_quote":"QPO models, the source-dependent classical estimator included in the benchmark."}],"review_version":1}