REVIEW 4 major objections 6 minor 22 references
A Comprehensive Dataset for Underground Miner Detection in Diverse Scenario
T0 review · 4 major / 6 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read This paper introduces the Thermal UHD dataset, 7,049 thermal images of underground miners in five postures, and shows that transfer learning on it raises detector mAP50 from roughly 57% to 80%.
desk verdict A genuinely useful dataset contribution whose reported numbers are currently undermined by a likely frame-level train/validation leak; fix the split and release the data before trusting the mAP claims. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is the Thermal UHD dataset itself plus the transfer-learning protocol applied to it. The dataset is 7,049 video-extracted thermal frames, resized to 640×640 and annotated with bounding boxes for five miner postures; its three-phase collection scheme is what creates the diversity the paper argues is missing from existing thermal datasets. The protocol is standard fine-tuning of pretrained detectors (YOLOv8, YOLOv10, YOLO11, RT-DETR) on the new labels, and the comparison of fine-tuned versus from-scratch training is what makes the dataset's contribution measurable.
What would settle it
Collect a matched set of thermal images from a different underground mine during a real or realistic emergency, with different mine geometry, a different camera, and real smoke or fire, then test a model fine-tuned only on Thermal UHD; if mAP50 drops well below the 80% reported on the validation split, the dataset's representativeness claim fails.
Extended reading notes
Core claim
The paper's central claim is that a purpose-built thermal dataset for underground mines is the missing piece that lets existing object detectors become usable for miner search and rescue. Thermal UHD contains 7,049 frames taken from a thermal camera carried by a legged robot through an experimental mine, split into 4,584 training and 2,465 validation images and labeled with five posture classes: standing, sitting, squatting, bending, and lying. The capture protocol deliberately varied conditions across three phases—working with an introduced heat source and smoke, working under normal temperature while holding tools, and resting—so that models see emergency-like and normal scenes. On this data, fine-tuning raises mAP50 from 57–61% (trained from scratch) to 75–85%, with YOLO11-l reaching 80.2% mAP50 and the lightweight YOLO11-n close behind at 80.1%.
Load-bearing premise
The single experimental mine, staged volunteers, and one thermal camera model are assumed to represent the range of real underground mines and emergencies closely enough that models trained on this data will still find real miners.
Editorial extensions
If this is right
- Researchers get a public, posture-labeled thermal benchmark for underground mines, so future miner-detection models can be trained and compared on common ground.
- A rescue robot carrying a thermal camera can, after fine-tuning, spot a miner in any of the five postures, including lying down, which is the posture most relevant to a collapsed or incapacitated miner.
- Lightweight YOLO variants perform almost as well as much larger ones, so the approach is usable on robot hardware with limited compute and power.
- Posture-level detection is feasible but the bending class is frequently confused with standing, so the paper's own results imply more balanced data or a better loss is needed before posture labels can be trusted in emergencies.
Reading between the lines
- The paper does not test whether models fine-tuned on Thermal UHD generalize to a different mine or a different thermal camera; the implied claim is that they will, but that is an assumption to verify.
- Because the images come from a video stream on a mobile robot, the dataset could also support temporal or tracking models, which the current single-frame benchmarks do not evaluate.
- The same posture classes could be used for routine safety monitoring, such as detecting a miner who has fallen or is resting unexpectedly, in addition to emergency response.
- Merging Thermal UHD with visible-light underground imagery could produce multi-spectral detectors, but the paper evaluates thermal data only.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces Thermal UHD, a thermal imaging dataset of 7,049 frames of underground miners in five postures (lying, bending, sitting, squatting, standing), collected at the Missouri S&T Experimental Mine with a Spot CAM+IR camera mounted on a Boston Dynamics Spot robot. The dataset spans three phases: work with heat/smoke, normal work, and rest. The authors evaluate YOLOv8, YOLOv10, YOLO11, and RT-DETR variants with and without transfer learning, reporting that transfer learning on this dataset improves detection, with YOLO11-l reaching 80.2% mAP50 on the validation split. The paper claims the dataset fills a gap in publicly accessible thermal datasets for underground miner detection and could support emergency response research.
Significance. The dataset addresses a real and under-served need: public thermal imagery of underground miners in emergency-relevant conditions. The three-phase collection (heat/smoke, normal work, rest) and five posture classes are sensible design choices, and the authors obtained IRB approval and used staged volunteers. The baseline evaluation across multiple YOLO variants and RT-DETR provides a useful reference point. The transfer-learning comparison against random initialization is a defensible protocol and the paper honestly discusses limitations such as class imbalance and posture misclassification. If the dataset is released and the evaluation protocol is tightened, this could be a valuable community resource for mining safety and thermal person detection research.
major comments (4)
- [Sections 3.4 and 4] Section 3.4 states that images were extracted as frames from Spot CAM+IR video streams, and Section 4 reports a split of 4,584 training and 2,465 validation images without specifying whether the split groups frames by source video, scene, or session. Consecutive frames from the same staged sequence are near-duplicates (same miner, posture, background, and thermal conditions). If the split is frame-level random, many validation frames will have nearly identical counterparts in training, so the mAP50 and F1 scores in Tables 3 and 4 may largely reflect near-duplicate-frame memorization rather than detection of unseen miners or new scenarios. The authors should split by video/scene/session (with an appropriate temporal gap) and rerun the experiments, or provide evidence that the reported results are robust to a grouped split.
- [Section 4, Tables 3 and 4] All results are single-run evaluations on the validation split; there is no separate test set, no repeated runs, and no error bars. The reported differences between models are often small (e.g., YOLO11-l at 80.2% vs YOLO11-n at 80.1% in Table 4) and cannot be distinguished from noise. The authors should report mean and standard deviation over multiple training runs with different seeds, and evaluate on a held-out test split or via cross-validation. This is necessary to support the central transfer-learning claim and any model ranking.
- [Sections 3.2 and 6] Data were collected at a single experimental mine with staged volunteers and one thermal camera model. The abstract and conclusion describe the dataset as a foundation for reliable thermal-based miner detection in real emergencies, but the paper provides no external validation or evidence that models trained on this dataset transfer to other mines, different sensors, or unscripted operational conditions. The representativeness limitation should be explicitly acknowledged and the claims softened, or the authors should add at least one external validation scenario.
- [General (dataset availability)] The manuscript does not state where or how the dataset can be accessed, nor does it mention a license, a DOI, or a release URL. For a dataset contribution, public availability is essential. The authors should provide a download link, license, and dataset documentation including annotation format, sequence or session metadata, and the exact split definition.
minor comments (6)
- [Section 3.1, Table 1] The text says 'ROS Neotic'; the correct name is 'ROS Noetic.'
- [Section 5.1, Fig. 6] The caption says 'one of the YOLO11 variants' without identifying which variant; please specify the exact model used for the confusion matrix.
- [Section 5.1, Fig. 4] The class-instance distribution is shown graphically but exact counts are not reported; please include the numbers in the caption or text for reproducibility.
- [Title block] The author affiliation line contains 'Rolla, USA Princeton University, Princeton NJ 08544, USA,' which appears to be a formatting error and should be corrected.
- [Tables 3 and 5] Model naming is inconsistent (e.g., 'YOLOv8-x' vs 'YOLOV8X' and 'RTDETR-X' vs 'RT-DETR-X'); please unify the notation throughout.
- [Section 3.4] The paper does not report the number of video sequences or sessions from which the 7,049 frames were extracted; this metadata is important for assessing diversity and for replicating or auditing the split.
Circularity Check
No circularity: the claim is dataset construction plus external transfer-learning benchmarks, with no fitted parameter or self-citation serving as the load-bearing derivation.
full rationale
The paper's central claims are (1) that the Thermal UHD dataset is a new public thermal-image collection for underground miner detection, and (2) that transfer learning on this dataset improves detector performance relative to training from scratch. Neither claim is derived from the dataset itself by construction. The transfer-learning comparison uses COCO-pretrained initialization versus random initialization (Table 3), which are external, independent benchmarks; the measured mAP50 improvements are empirical outcomes, not fitted parameters renamed as predictions. The dataset statistics, class distribution, and confusion-matrix analysis are descriptive rather than derivational. The paper contains ordinary self-citations only insofar as it cites the authors' own prior work, but none of those citations is load-bearing: the method sections use standard YOLO/RT-DETR implementations and public references, and no uniqueness theorem or prior result by the same authors is invoked to force the choice of dataset design or evaluation protocol. The potential critique that the frame-level train/validation split may leak near-duplicate video frames is an evaluation-protocol concern about generalization, not a circularity defect: even if validation frames resemble training frames, the measured metric is still an external benchmark rather than an input to the method. No equation or definition reduces the claimed result to its own inputs, so the circularity score is 0.
Assumptions & free parameters
assumptions (3)
- domain assumption Thermal imaging is more suitable than RGB for underground human detection because it is less affected by low lighting and provides clear heat signatures.
- ad hoc to paper Five posture classes (lying, bending, sitting, squatting, standing) and three data-collection phases (work with heat/smoke, normal work, rest) represent diverse miner emergency scenarios.
- domain assumption Images collected at one experimental mine with a small number of volunteer miners generalize to other underground mines and emergency conditions.
Cite this review
Pith. "Pith review of A Comprehensive Dataset for Underground Miner Detection in Diverse Scenario." pith.science (2026). https://pith.science/paper/VV7JEQCD
@misc{pith2026250621451,
author = {Pith},
title = {Pith review of: A Comprehensive Dataset for Underground Miner Detection in Diverse Scenario},
year = {2026},
howpublished = {\url{https://pith.science/paper/VV7JEQCD}},
note = {Machine review of arXiv:2506.21451}
}
read the original abstract
Underground mining operations face significant safety challenges that make emergency response capabilities crucial. While robots have shown promise in assisting with search and rescue operations, their effectiveness depends on reliable miner detection capabilities. Deep learning algorithms offer potential solutions for automated miner detection, but require comprehensive training datasets, which are currently lacking for underground mining environments. This paper presents a novel thermal imaging dataset specifically designed to enable the development and validation of miner detection systems for potential emergency applications. We systematically captured thermal imagery of various mining activities and scenarios to create a robust foundation for detection algorithms. To establish baseline performance metrics, we evaluated several state-of-the-art object detection algorithms including YOLOv8, YOLOv10, YOLO11, and RT-DETR on our dataset. While not exhaustive of all possible emergency situations, this dataset serves as a crucial first step toward developing reliable thermal-based miner detection systems that could eventually be deployed in real emergency scenarios. This work demonstrates the feasibility of using thermal imaging for miner detection and establishes a foundation for future research in this critical safety application.
Reference graph
Works this paper leans on
-
[1]
Shao, Z., Yan, L., Chen, J., Chen, J.: A Dataset and A Lightweight Object De- tection Network for Thermal Image-Based Home Surveillance. In: Proceedings of 2022 Asia -Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2022. pp. 1332–1336. Institute of Elec- trical and Electronics Engineers Inc. (2022). https://d...
arXiv 2022
-
[2]
Papageorgiou, C., Poggio, T.: A Trainable System for Object Detection. (2000)
work page 2000
-
[3]
Huda, N.U., Hansen, B.D., Gade, R., Moeslund, T.B.: The effect of a diverse dataset for transfer learning in thermal person detection. Sensors (Switzerland). 20, (2020). https://doi.org/10.3390/s20071982
-
[4]
In: 2021 IEEE International Conference on Robotics and Biomimetics, ROBIO 2021
Zhang, Y., Zhou, Y.: YOLOv5 Based Pedestrian Safety Detection in Under- ground Coal Mines. In: 2021 IEEE International Conference on Robotics and Biomimetics, ROBIO 2021. pp. 1700 –1705. Institute of Electrical and Elec- tronics Engineers Inc. (2021). https://doi.org/10.1109/ROBIO54168.2021.9739594
arXiv 2021
-
[5]
In: 2020 IEEE Aerospace Conference
Dang, T., Mascarich, F., Khattak, S., Nguyen, H., Nguyen, H., Hirsh, S., Papa- christos, C., Alexis, K.: Autonomous Search for Underground Mine Rescue Using Aerial Robots. In: 2020 IEEE Aerospace Conference. IEEE (2020)
work page 2020
-
[6]
Dickens, J.S., van Wyk, M.A., Green, J.J.: Pedestrian detection for under- ground mine vehicles using thermal images. In: IEEE Africon’11. pp. 1 –6. In- stitute of Electrical and Electronics Engineers (2011)
work page 2011
-
[7]
Szrek, J., Zimroz, R., Wodecki, J., Michalak, A., Góralczyk, M., Worsa-Kozak, M.: Application of the infrared thermography and unmanned ground vehicle for rescue action support in underground mine —the amicos project. Remote Sens (Basel). 13, 1–20 (2021). https://doi.org/10.3390/rs13010069
-
[8]
In: 2023 8th International Conference on Business and Industrial Research, ICBIR 12 C
Maningo, J.M., Amoroso, M.C.C., Atienza, K.R., Ladera, R.K., Menodiado, N.M., Ambata, L.U., Cabatuan, M.K., Sybingco, E., Bandala, A., Española, J., Vicerra, R.R.: Thermal Imaging Dataset for Human Presence Detection. In: 2023 8th International Conference on Business and Industrial Research, ICBIR 12 C. Addy, A. K. Gurumadaiah, Y. Gao and K. Awuah-Offei 2...
arXiv 2023
Show all 22 references
-
[9]
In: SenSys 2021 - Proceedings of the 2021 19th ACM Conference on Embedded Networked Sensor Systems
Zhu, S., Voigt, T., Perez -Ramirez, D.F., Eriksson, J.: Dataset: A Low -resolu- tion infrared thermal dataset and potential privacy -preserving applications. In: SenSys 2021 - Proceedings of the 2021 19th ACM Conference on Embedded Networked Sensor Systems. pp. 552–555. Associ...
2021
-
[10]
Linkopings Universitet (2016)
Berg, Amanda.: Detection and Tracking in Thermal Infrared Imagery. Linkopings Universitet (2016)
2016
-
[11]
In: International Conference on Advances in Bi- omedical Engineering, ICABME
Rizk, M., Bayad, I.: Human Detection in Thermal Images Using YOLOv8 for Search and Rescue Missions. In: International Conference on Advances in Bi- omedical Engineering, ICABME. pp. 210–215. Institute of Electrical and Elec- tronics Engineers Inc. (2023). https://doi.org/10.11...
2023
-
[12]
In: Proceedings of the IEEE/CVF winter co nference on applications of computer vision
Bondi, E., Jain, R., Aggrawal, P., Anand, S., Hannaford, R., Kapoor, A., Piavis, J., Shah, S., Joppa, L., Dilkina, B., Tambe, M.: BIRDSAI: A Dataset for De- tection and Tracking in Aerial Thermal Infrared Videos. In: Proceedings of the IEEE/CVF winter co nference on applicatio...
2020
-
[13]
In: 2018 3rd International Conference on Smart and Sustainable Technologies (SpliTech)
Cerutti, G., Milosevic, B., Farella, E.: Outdoor People Detection in Low Reso- lution Thermal Images. In: 2018 3rd International Conference on Smart and Sustainable Technologies (SpliTech). pp. 1–6. IEEE (2018)
2018
-
[14]
IEEE Trans Multimedia
Liu, Q., He, Z., Li, X., Zheng, Y.: PTB -TIR: A Thermal Infrared Pedestrian Tracking Benchmark. IEEE Trans Multimedia. 22, 666 –675 (2020). https://doi.org/10.1109/TMM.2019.2932615
2020
-
[15]
In: 2019 42nd International Convention on Information and Communication Tech- nology, Electronics and Microelectronics (MIPRO)
Krišto, M., Ivašić-Kos, M.: Thermal Imaging Dataset for Person Detection. In: 2019 42nd International Convention on Information and Communication Tech- nology, Electronics and Microelectronics (MIPRO). pp. 1126 –1131. IEEE (2019)
2019
-
[16]
Jocher, G., Chaurasia, A., Qiu, J.: Ultralytics YOLOv8, https://github.com/ul- tralytics/ultralytics, (2023)
2023
-
[17]
arXiv preprint arXiv:2405.14458
Wang, A., Chen, H., Liu, L., Chen, K., Lin, Z., Han, J., Ding, G.: YOLOv10: Real-Time End-to-End Object Detection. arXiv preprint arXiv:2405.14458. 1– 21 (2024)
2024 arXiv
-
[18]
Jocher, G., Qiu, J.: Ultralytics YOLO11, https://github.com/ultralytics/ultralyt- ics, (2024)
2024
-
[19]
Zhao, Y., Lv, W., Xu, S., Wei, J., Wang, G., Dang, Q., Liu, Y., Chen, J.: DETRs Beat YOLOs on Real-time Object Detection. (2023)
2023
-
[20]
Hussain, M.: YOLOv5, YOLOv8 and YOLOv10: The Go -To Detectors for Real-time Vision. (2024)
2024
-
[21]
Gamani, A.-R.A., Arhin, I., Asamoah, A.K.: Performance Evaluation of YOLOv8 Model Configurations, for Instance Segmentation of Strawberry Fruit Development Stages in an Open Field Environment. (2024). A Comprehensive Dataset for Underground Miner Detection in Diverse Scenario 13
2024
-
[22]
Multimed Tools Appl
Xiao, B., Nguyen, M., Yan, W.Q.: Fruit ripeness identification using YOLOv8 model. Multimed Tools Appl. 83, 28039 –28056 (2024). https://doi.org/10.1007/s11042-023-16570-9
2024 doi
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.