{"id":"ff647e61-553b-42c1-b308-447ee4e16263","arxiv_id":"2412.04487","paper_version":1,"verdict":"REJECT","confidence":"MODERATE","novelty_score":2.0,"correctness_risk":"high","formal_verification":"none","parameter_count":7,"one_line_summary":"A GA-tuned BP network is tested on 13 samples from one Chinese mine and reported to beat plain BP, but the evidence is thin.","lead":"This paper combines a genetic algorithm with a backpropagation neural network to warn about coal mine safety risks, testing the hybrid on data from one mine in Shandong, China. The authors report that the hybrid beats a plain neural network, but the test set is tiny, the data is not included, and the paper admits high error rates.","discovery_kind":"incremental","skeptic_critique":{"model":"deepseek-v4-flash","headline":"GA-BP superiority is not established: three test samples, no quantitative test-set errors, and min-max normalization that leaks test-period extrema into training.","rationale":"The reader's verdict is REJECT, and my concern supports that rejection without moving it to a different category. I partially agree with the reader's weakest assumption: the provenance of the 46 samples and the arbitrary split are indeed load-bearing, but the sharper problem is the evaluation protocol itself. Even if the data are accurate, the paper does not provide the quantitative test metrics, error bars, or statistical tests needed to distinguish a genuine GA-BP advantage from chance on three test samples. The normalization issue in Eq. (11) is a concrete, correctable flaw: using full-sample min/max before a temporal split leaks future extrema into the training set and makes the reported generalization look better than a true forecasting protocol would. The paper also makes no data or code available, and there is no independent verification, so the central empirical claim cannot be checked from the manuscript alone. I give credit for the explicit statement of the method's parameters and the authors' candid admission of unsatisfactory overall error, but those do not repair the missing evidence. My concrete test would settle the concern by measuring whether GA-BP's advantage survives a properly normalized, repeated train/test evaluation with confidence intervals.","tokens_in":5855,"tokens_out":3304,"duration_ms":37617,"concrete_test":"Obtain the original 46-sample dataset from Meng Fanqiang's thesis [15], reimplement BP and GA-BP with the exact Table 3 settings, and evaluate with repeated chronological splits or leave-one-out cross-validation, fitting the min-max normalization on each training fold only. Report test MAE/RMSE for both models and a paired bootstrap or permutation confidence interval for the GA-BP minus BP difference. If the interval includes zero or favors BP, the reported advantage is not a robust finding.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central claim rests on Section 3's evaluation protocol. Ten training samples (Sep 2008–Jun 2011) and three test samples (Dec 2014–Jun 2015) are taken from [15], but the paper gives no numerical test error, no error bars, and no statistical comparison. The only support is Figure 4, from which the reader is told that GA-BP starts below 0.20 error while BP stays above. With n_test=3, random variation alone could produce this pattern; the claim of 'significant advantage' is not backed by any test of significance. In addition, Eq. (11) applies min-max normalization using column extrema before the split, so the future test period's maximum and minimum values are visible to the training process; a temporal split normalized in this way does not simulate a real forecasting setting. The paper's own admission that 'the overall operational outcomes remain unsatisfactory due to high error rates' further weakens the practical import of the claimed advantage. The load-bearing assumption is therefore not merely data accuracy: it is that this single 10/3 split, normalized with future extrema, is enough to demonstrate GA-BP's superiority. That assumption is not supported by the reported evidence.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"The manuscript proposes a hybrid genetic-algorithm-optimized backpropagation network (GA-BP) for coal-mine safety early warning. The model is a three-layer BP network with 19 input neurons (from the four-category index system in Table 1), a single output neuron representing the warning level, and 11 hidden neurons; a genetic algorithm is used to optimize the initial weights and thresholds, with chromosome length 232 per Eq. (6), fitness F = 1/E, and selection, crossover, and mutation operations described in Section 2. The case study in Section 3 uses 46 min-max-normalized samples from a Shandong coal mine, taken from the dissertation [15]; 10 samples (September 2008-June 2011) are used for training and 3 samples (December 2014-June 2015) for testing. Results are presented only as plots in Figure 4. The paper claims that GA-BP has a significant advantage over plain BP from the start (initial error below 0.20 versus above 0.20), achieves an approximate 20% error reduction, and converges faster, while also acknowledging that the overall operational outcomes remain unsatisfactory because of the small sample size and low data quality.","tokens_in":6099,"tokens_out":12481,"duration_ms":112288,"significance":"If the comparative claim were rigorously established, this would be a modest engineering application note: the hybrid GA-BP scheme itself is a standard technique, so the methodological novelty is limited to its application to coal-mine safety early-warning data. The topic is practically important given China's coal-mine accident record, and the paper is transparent about its parameter settings (Table 3), about the provenance of the data ([15]), and about the poor final accuracy of the models, which is a point in its favor. However, as presented, the central claim is supported only by qualitative inspection of a single figure, with no quantitative test-set metrics, no repeated stochastic trials, no error bars, and effectively three test samples, so the significance of the reported result is low even if the underlying effect is real.","major_comments":[{"comment":"The central claim of GA-BP superiority rests entirely on the plots in Figure 4; the paper reports no quantitative test-set error metric (MSE, MAE, accuracy, or warning-level hit rate), and the statements about initial error below 0.20 and an approximate 20% error reduction cannot be verified from the figure as printed. Because both BP training and the genetic algorithm are stochastic and the test set contains only three samples, a single run of each model could easily produce the displayed pattern by chance; repeated runs with error bars or a paired statistical test are required to support the word 'significant'.","section":"§3, Fig. 4"},{"comment":"The evaluation uses ten training samples (September 2008-June 2011) and three test samples (December 2014-June 2015) drawn from the 46 normalized rows of Table 2, but the paper never explains why that particular split was chosen, why the sizes are 10 and 3, or what happened to the remaining 33 samples. With n = 3 test samples and a single arbitrary split, no generalization claim about early-warning capability can be supported, and this protocol is load-bearing for the abstract's claim of demonstrated superiority.","section":"§3, train/test split"},{"comment":"The min-max normalization of Eq. (11) is applied to the full dataset before the temporal split, so the column extrema x_j^{min} and x_j^{max} are computed over samples that include the December 2014-June 2015 test period. This makes the future test-period range visible to the training inputs and means the evaluation does not simulate a genuinely prospective forecasting setting; the stress-test concern about future-extrema leakage into training is therefore valid.","section":"§3, Eq. (11)"},{"comment":"The manuscript contradicts its own headline result: Section 3 states that 'the overall operational outcomes remain unsatisfactory due to high error rates,' while the Abstract and Section 4 claim that results aligned with expected objectives and that the model can identify potential safety risks promptly. If the error rates are as high as the paper concedes, the reported advantage of GA-BP over BP does not establish a usable early-warning system, and the paper's own assessment undercuts the practical-significance claim made in the Abstract.","section":"§3, final paragraph; §4; Abstract"},{"comment":"The description of the GA mutation in Section 2 says that the mutation operation 'selects the first gene of the first individual for mutation,' which, taken literally, cannot maintain population diversity as claimed; Eq. (10) is rendered too garbled to check (the two cases for a_{ij} are not typeset correctly). Because the GA-BP algorithm is exactly the method whose performance is being evaluated, this inconsistency makes the reported results irreproducible from the description.","section":"§2, Eq. (10)"}],"minor_comments":[{"comment":"Eq. (1) is unreadable: the hidden-layer formula is rendered as 'n mn a + = +', and the surrounding sentence about the integer range [1,10] does not explain how the value 11 follows.","section":"§2, Eq. (1)"},{"comment":"Table 3 presents the BP and GA hyperparameters (hidden-layer node count, population size, generations, crossover and mutation rates, learning rate, performance goal) with no sensitivity analysis, so the dependence of the reported comparison on these hand-set values is unknown.","section":"Table 3"},{"comment":"Table 2 replaces most of the 46 rows with ellipses, so the reader cannot reconstruct the dataset; the full normalized data should be supplied as a supplement together with a description of how the raw values from [15] were processed.","section":"Table 2"},{"comment":"The 'approximately 20% reduction in error' statement in Section 3 is unsupported by any numerical computation or by a readable figure from which the percentage could be derived.","section":"§3"},{"comment":"Figure 4 consists of low-resolution screenshots whose axes and curve values are illegible at publication scale, which matters because the paper's central claim is based on the visual pattern of these curves.","section":"Fig. 4"},{"comment":"Section 2 refers to 'four weight matrices' but Eqs. (2)-(5) define two weight matrices and two threshold matrices, and the five warning levels (high, higher, medium, lower, low) are never mapped to numeric output ranges, leaving the interpretation of the single output neuron undefined.","section":"§2, Eqs. (2)-(5)"},{"comment":"The English throughout the manuscript needs substantial revision; for example, Section 1 contains the sentence 'It occurred on February 22, 2023, the Inner Mongolia Xinjiang coal mine disaster, the death toll of 53 people, the accident since the founding of New China, China's largest accident in open-cast coal mines,' which is ungrammatical and conflates the accident date with the reporting date.","section":"§1, language"},{"comment":"References 12 and 14 contain stray fragments such as '495.', '496.', '500', and '501' that appear to be artifacts of database export and should be removed.","section":"References 12 and 14"}],"recommendation":"reject","confidential_remarks":"The manuscript is far below the standard of a refereed journal as it stands. The entire empirical claim — that GA-BP outperforms BP — rests on a single unreadable figure, three test samples, and no quantitative metrics; the evaluation protocol would have to be redesigned (cross-validation over the available 46 samples, repeated stochastic runs, proper temporal normalization without future leakage, and reporting of error metrics) rather than patched locally. There are also signs of an unrevised draft: garbled equations, broken reference entries, and an internal contradiction between the Abstract and Section 3. If the editor wishes to give the authors a path forward, it should be framed as a fundamentally reworked evaluation rather than a minor revision. The paper may be better suited to an application-oriented venue with a high tolerance for preliminary results, or to a preprint-only outlet."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Quick read for you on arXiv:2412.04487. The paper is a small case study applying a standard GA-BP hybrid to a coal-mine safety early-warning dataset taken from a 2023 thesis. It does not introduce a new algorithm or theory; the contribution is the specific application and the indicator system. To its credit, the paper is clearly organized, describes the GA-BP procedure in enough detail to reproduce in principle, and is refreshingly honest about the model's poor overall performance. That honesty is not enough to rescue the central claim, though.\n\nThe claim that GA-BP beats plain BP is not established by the evidence. The comparison rests entirely on Figure 4, with no numerical test-set errors, no error bars, no statistical tests. The test set has three samples, chosen without explanation. Worse, the min-max normalization in Eq. (11) is applied to all 46 samples before the temporal split, so the extrema of the future test period are visible during training. That is a real methodological leak: the evaluation does not simulate a forecasting setting. With n_test=3, even without the leak, random variation could produce the plotted gap. The authors' own statement that 'the overall operational outcomes remain unsatisfactory due to high error rates' further undercuts the practical significance.\n\nThe paper does cite relevant Chinese literature and gives a reasonable set of safety indicators, but the citation pattern is fine. The data and code are not available, and hyperparameters are hand-picked. The load-bearing assumption—that this one 10/3 split, normalized with future extrema, demonstrates GA-BP's superiority—is not supported.\n\nWho is this for? A reader with a narrow interest in GA-BP applications in mining safety might glance at it, but no one should rely on the comparison. The paper is a routine engineering write-up, not a substantive research result. It deserves neither a serious referee nor a citation. If the authors had released data and code, and evaluated on a proper temporal split with multiple runs and significance testing, it could be a modest engineering note. As it stands, desk rejection is appropriate.","headline":"A routine GA-BP application to coal mine safety that honestly reports its own limits, but the claimed advantage over plain BP is not supported by the evaluation.","tokens_in":6541,"tokens_out":2350,"would_cite":false,"duration_ms":23433,"reading_group":"no","serious_thinker":"yes","would_accept_peer_review":false},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"This paper claims that a genetic algorithm-optimized backpropagation network (GA-BP) predicts coal-mine safety risk with lower initial error, roughly 20 percent less error, and faster convergence than a standard BP network on the same…","keywords":["coal mine safety","early warning system","genetic algorithm","backpropagation neural network","GA-BP","safety indicators","small-sample prediction"],"falsifier":"Run both BP and GA-BP on the same 46 samples with repeated random initializations and a leave-one-out cross-validation; if GA-BP's mean squared error is not consistently below BP's across folds, the claimed advantage is an artifact of the single 10/3 split. A simpler check is whether the stated ~20 percent error reduction reproduces when the test periods are chosen differently.","tokens_in":5656,"feed_emoji":"⛏️","tokens_out":4516,"duration_ms":33383,"temperature":0.7,"pith_summary":"This paper tries to establish that a backpropagation neural network whose initial weights and thresholds are tuned by a genetic algorithm (GA-BP) predicts coal-mine safety risk more accurately than a plain BP network on a small real-world dataset. Using 19 safety indicators and 46 normalized samples from a Shandong mine, the authors report that GA-BP's initial error stays below 0.20 while BP's starts above that, with about a 20 percent error reduction and faster convergence. If right, the optimization scheme offers a practical upgrade path for mine early-warning systems without changing the underlying neural architecture. The paper itself notes the absolute error is still too high for operational use, which it blames on the small sample and data quality.","feed_headline":"GA-tuned neural net beats plain BP on coal-safety alerts","feed_subtitle":"Optimized initialization starts under 0.20 error and cuts error by ~20% on 46 mine samples.","key_machinery":"The central object is the GA-BP hybrid: a three-layer feedforward network (19 input nodes for the safety indicators, 11 hidden nodes, 1 output node) whose weight matrix $W$ (input to hidden), hidden thresholds, weight matrix $V$ (hidden to output), and output thresholds are concatenated into one chromosome of length 232. The genetic algorithm evaluates each chromosome by running forward propagation with fitness $F = 1/(\\hat{y} - y)^2$, then applies roulette-wheel selection, real-number crossover, and mutation to evolve better initial weights before BP training. This gives BP a better starting point in weight space, which is what carries the claimed improvement.","core_discovery":"The central claim is that encoding the BP network's four weight and threshold matrices as a real-valued chromosome and searching for good initial values with a genetic algorithm—using selection, crossover, and mutation with fitness $F = 1/(\\hat{y} - y)^2$—produces a network that starts at lower error and converges faster than standard backpropagation. On the 46-sample Shandong dataset with 10 training and 3 test periods, GA-BP reports initial errors below 0.20 versus BP above 0.20, a roughly 20 percent error reduction after GA optimization, and faster approach to the target in both training and test sets. The authors claim this makes the model capable of timely warnings, while acknowledging that the overall error remains too high for satisfactory operational performance.","pith_inferences":["The same GA-initialization trick would likely help other gradient-based learners on tiny datasets, but the 10/3 train-test split is too small to establish generalization; a leave-one-out cross-validation would be a stiffer test.","The high absolute error the authors concede suggests the bottleneck is data volume, not initialization; GA-BP can only partly compensate.","The indicator set (personnel behavior, equipment state, environment, management) is generic enough that GA-BP could be tested on other mines' data to see whether the 20 percent improvement is specific to this mine or a general effect."],"forward_implications":["Coal mines with similar indicator systems can adopt GA-BP to get lower initial error and faster convergence than plain BP, at modest computational cost.","The approach extends to any small-sample safety early-warning problem where the indicators can be normalized to 0-1 and labeled with risk levels.","Because the GA only optimizes starting weights, it can be combined with other BP variants or training algorithms without changing the network structure.","The reported 20 percent error reduction implies that optimization of initialization matters more than architecture changes for this kind of dataset."],"supporting_citations":[{"why":"Supplies the backpropagation neural network algorithm that the paper's baseline and optimized model both build on.","marker":"[12]"},{"why":"Supplies the genetic algorithm operations (selection, crossover, mutation) that form the optimization engine.","marker":"[13]"},{"why":"Defines the GA-BP combination of encoding weights and thresholds as chromosomes, the central method under test.","marker":"[14]"},{"why":"Provides the 46 sample data from a Shandong coal mine, normalized and split into training and test sets, that the entire comparison rests on.","marker":"[15]"}],"fun_headline_variants":["Genetic algorithm sharpens BP for coal safety alerts","GA-BP cuts coal mine warning error by 20%","Coal safety: GA-tuned neural net beats plain BP","GA-optimized BP boosts coal mine alert accuracy"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The 46 normalized samples from the cited thesis are accurate and representative, and the arbitrary split of 10 training and 3 test periods captures the range of safety conditions well enough to judge the model.","fun_headline_variants_meta":{"raw":{"variants":["Genetic algorithm sharpens BP for coal safety alerts","GA-BP cuts coal mine warning error by 20%","Coal safety: GA-tuned neural net beats plain BP","GA-optimized BP boosts coal mine alert accuracy"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000234,"raw_usage":{"total_tokens":1426,"prompt_tokens":804,"completion_tokens":622,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":420,"completion_tokens_details":{"reasoning_tokens":556}},"tokens_in":420,"tokens_out":622,"duration_ms":5529,"temperature":1.0,"reasoning_tokens":556,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-12T15:46:43.313416+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Run both BP and GA-BP on the same 46 samples with repeated random initializations and a leave-one-out cross-validation; if GA-BP's mean squared error is not consistently below BP's across folds, the claimed advantage is an artifact of the single 10/3 split. A simpler check is whether the stated ~20 percent error reduction reproduces when the test periods are chosen differently.","supporting_citations":[{"cited_title":"A comprehensive evaluation of the working environment and risk of coal and gasoutburst[dissertation].Anhui:495.AnhuiUniversityTechnology;2015.496","cited_arxiv_id":null,"evidence_quote":"Supplies the backpropagation neural network algorithm that the paper's baseline and optimized model both build on."},{"cited_title":"Basic research on real-time monitoring and warning technology of water inrush from coal 497 floor","cited_arxiv_id":null,"evidence_quote":"Supplies the genetic algorithm operations (selection, crossover, mutation) that form the optimization engine."},{"cited_title":"Study and application of comprehensive evaluation of coal mine dust hazard [dissertation].Taiyuan:Taiyuan500UniversityTechnology;2014.501","cited_arxiv_id":null,"evidence_quote":"Defines the GA-BP combination of encoding weights and thresholds as chromosomes, the central method under test."},{"cited_title":"Research on safety early warning of coal mining face based on data mining","cited_arxiv_id":null,"evidence_quote":"Provides the 46 sample data from a Shandong coal mine, normalized and split into training and test sets, that the entire comparison rests on."}],"review_version":1}