Pith. sign in

REVIEW 4 major objections 7 minor 23 references

DriveIndia: An Object Detection Dataset for Diverse Indian Traffic Scenes

T0 review · 4 major / 7 minor · reviewed 2026-08-06 · deepseek-v4-flash

Pith's one-line read DriveIndia contributes a 66,986-image object detection dataset for unstructured Indian traffic, with 24 classes and a best YOLOv8 baseline of 78.7% mAP50.

desk verdict A potentially valuable Indian traffic detection dataset, but the paper's central artifact isn't public yet and a split-count inconsistency needs to be fixed before trusting the numbers. read the letter →

arxiv 2507.19912 v4 pith:NGI4I5UD submitted 2025-07-26 cs.CV

classification cs.CV
keywords objectdetectionIndiantrafficdatasetautonomousdrivingYOLOformatunstructuredroadsadverseweatherlong-tailbenchmark
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper introduces DriveIndia, a large-scale object detection dataset meant to capture the complexity of Indian traffic: 66,986 high-resolution RGB images annotated in YOLO format across 24 traffic-relevant classes, collected over 120+ hours and 3,400+ kilometers of urban, rural, and highway driving that includes fog, rain, low light, and mixed, unstructured traffic. The authors argue that existing benchmarks such as KITTI and nuScenes reflect structured Western roads, while earlier Indian datasets are smaller, urban-focused, or geared to segmentation, leaving a gap for a large, general-purpose detection benchmark. To show the dataset is usable, they train several recent YOLO-family models and transformer detectors under a common protocol, with YOLOv8 reaching 78.7% mAP50 and 56.4% mAP50:95. Per-class results show that common vehicles detect well, while rare and safety-critical classes such as potholes, pushcarts, police vehicles, and unmarked speed bumps score much lower, which the paper presents as a realistic picture of the long-tail challenge on Indian roads. A sympathetic reader would care because a public dataset of this scale and condition diversity could ground comparisons for perception systems intended for emerging-market driving.

What carries the argument

The load-bearing object is the dataset itself, together with its annotation and evaluation protocol. Images are recorded at 1920x1080 from vehicle-mounted cameras, annotated as normalized YOLO-format bounding boxes in per-image text files, and passed through a two-stage quality-assurance process, a Laplacian-variance blur filter, and class-distribution monitoring across splits. This protocol makes the dataset directly consumable by standard detectors, which is what allows the paper to report comparable baselines across YOLOv5, YOLOv8, YOLOv9, YOLOv11, RT-DETR, and EfficientDet and to attribute performance gaps to class frequency and visual ambiguity rather than to format or preprocessing differences.

What would settle it

Release the dataset, count the images and label files in each split, verify the per-class instance counts against Figure 3 and Table III, and retrain YOLOv8 with the stated protocol: matching the 78.7% mAP50 would confirm the central claims, while finding that the training split has 53,586 rather than 54,856 images, or that several classes have far fewer instances than reported, would falsify them.

Watch

Extended reading notes

Core claim

The central claim is that DriveIndia provides the largest publicly available object detection dataset focused on unstructured Indian traffic, with 66,986 images, 24 object classes, and approximately 471,092 labeled instances, organized into standard train/validation/test splits and compatible with standard detection frameworks. The dataset is designed around region-specific classes—autorickshaws, tractors, pushcarts, animals, speed bumps, potholes, and zebra crossings—that are absent or rare in international benchmarks, and it deliberately includes fog, rain, overcast skies, uneven lighting, and unmarked lanes. The paper further claims that the standardized benchmark results, with YOLOv8 as the strongest detector at 78.7% mAP50, establish usable baselines and reveal that common Indian road users such as cars, motorcycles, autorickshaws, and trucks are detected with high accuracy while rare, small, or visually ambiguous classes remain hard.

Load-bearing premise

The load-bearing premise is that the dataset exists exactly as described—66,986 annotated images with the stated splits and class distribution—but the paper itself gives conflicting training counts (53,586 in Section III.A versus 54,856 in Section IV.A), and the dataset is not publicly accessible at submission, so this description is unverified.

Editorial extensions

If this is right

  • If the dataset is released as described, researchers get a common benchmark for real-time detection on Indian roads where cars, motorcycles, autorickshaws, pedestrians, animals, and road infrastructure coexist in one annotation format.
  • The baseline tables give direct comparison points: any future detector should be measured against YOLOv8's 78.7% mAP50 and 56.4% mAP50:95 on the same splits.
  • The per-class results define a concrete long-tail problem: rare safety-critical classes such as pothole, unmarked speed bump, police vehicle, and pushcart will need targeted augmentation or loss weighting before they can be considered usable.
  • Because annotations are in YOLO format, the dataset can plug into existing training pipelines without conversion, making it a low-friction addition to detection research.
  • The comparison to IDD, DATS, ITD, and BDD100K positions DriveIndia as a complement rather than a replacement: it adds fog, rain, and rural-highway coverage to the Indian landscape.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the training-split inconsistency (53,586 versus 54,856 images) is resolved before release, the benchmark's comparability will depend on exactly which split produced Table II; the paper should pin that down for anyone reproducing the numbers.
  • Because night-time data is listed as absent, extending the collection protocol to night and to northern or hilly regions would directly test whether the geographic and illumination diversity claims generalize beyond southern India.
  • A testable extension would be to train with class-balanced sampling or copy-paste augmentation and measure whether pothole and pushcart mAP rise without hurting common-class mAP.
  • The release location and licensing terms will determine whether DriveIndia becomes a living community benchmark or a static snapshot; fixed splits and a permissive non-commercial license would make it usable for leaderboard-style comparison.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 7 minor

Summary. The paper introduces DriveIndia, a proposed object detection dataset for Indian traffic scenes, consisting of 66,986 high-resolution (1920×1080) RGB images annotated in YOLO format across 24 classes, covering urban, rural, and highway driving in varied weather and lighting conditions. The authors evaluate YOLOv5, YOLOv8, YOLOv9, YOLOv11, RT-DETR, and EfficientDet on a train/val/test split, reporting YOLOv8 as the best with mAP50 78.7% and mAP50:95 56.4%. The dataset is to be made publicly available through the TiHAN-IIT Hyderabad portal.

Significance. DriveIndia addresses a relevant gap: existing Indian driving datasets are smaller or limited to specific tasks or conditions, and international benchmarks do not capture the heterogeneity of Indian traffic. If released as described, the dataset would be a substantial resource for detection research in developing regions, with useful annotation guidelines, explicit discussion of long-tail classes, and an honest limitations section. The paper provides machine-checked claims only in a limited sense; the quantitative results are measurements on the authors' private data, so reproducibility currently rests on the planned public release. The class-wise analysis and the comparison with existing datasets are valuable contributions.

major comments (4)
  1. [Section III.A and Section IV.A] Section III.A states the dataset is split into 53,586 training, 6,700 validation, and 6,700 test images, which sum to the stated total of 66,986. Section IV.A states that 54,856 images were used for training with 6,700 each for validation and test, which would sum to 68,256 images. These counts are inconsistent and no explanation is given. Because the dataset is not yet publicly accessible, a reader cannot verify which number is correct; this affects both the headline scale claim and the benchmark protocol. Please correct the discrepancy and make every occurrence of split sizes consistent.
  2. [Section V and Section I] Section V says the dataset 'will be publicly released' and the Introduction lists as a contribution the 'largest publicly available object detection dataset,' yet no download link or archived release is provided at submission. For a dataset paper the artifact is the central claim, so the current description makes the benchmark prospective rather than verifiable. Please provide the actual hosting location or a clearly dated release plan, and adjust the wording in Section I from 'publicly available' to 'to be released' until the artifact is accessible.
  3. [Section IV.A and Table III] The experimental protocol in Section IV.A states that 'Model performance was assessed on the test set,' but Table III is captioned 'Per-class detection performance on the DriveIndia Validation set.' The paper also does not state which split was used for Fig. 4 (example detections) or Fig. 5 (confusion matrix). This ambiguity matters because the class-wise analysis is used to draw conclusions about long-tail performance; please clarify whether per-class numbers are from validation or test and, if both are used, report them separately.
  4. [Section IV.A] The 'standardized protocol' is never specified quantitatively: the paper gives no image resolution used for training, batch size, optimizer, learning rate, number of epochs, augmentation strategy, or inference settings for any of the YOLO/RT-DETR/EfficientDet models. Without these details the baseline numbers in Table II cannot be reproduced or meaningfully compared across models. Please include the full training protocol and any configuration files or code in an appendix or supplementary material.
minor comments (7)
  1. [Table I] Table I lists the task type for IDD as '3D Object Detection'; the original IDD dataset is primarily for 2D detection and semantic segmentation, while IDD-3D is the 3D variant. Please correct this to avoid misrepresenting the compared dataset.
  2. [Section II] EfficientDet is described as a 'transformer-based detector' in Section II and Section IV; EfficientDet is based on a CNN backbone with a BiFPN feature network, not a transformer. Please correct the description.
  3. [Section III.D] The Laplacian variance threshold of 20 is stated without specifying the image scale or preprocessing; please clarify how the threshold was applied to the 1920×1080 images.
  4. [Section III.B and Fig. 3] Fig. 3 shows the class frequency distribution but is not discussed in the text; add a sentence summarizing the long-tail distribution, as it is central to the motivation for the rare classes.
  5. [Section VII] In the bullet 'Sparse Representation of Rare Classes:' there is a missing space after the colon ('Classes:Safety-critical'). Please fix the typo.
  6. [Abstract and Section III.A] The abstract reports '120+ hours' and '3,400+ kilometers' of driving, but these figures are not repeated in Section III.A; align the numbers between the abstract and the dataset overview.
  7. [Reference [9] and Section V] Reference [9] points to the 'tiand-datasets' URL while Section V links to the general TiHAN dataset portal (tihan.iith.ac.in/TiAND.html); please make the dataset URL consistent and ensure the exact release location is given.

Circularity Check

0 steps flagged · score 0.0 of 10

No circular derivation found: the baselines are direct measurements on the proposed dataset, so there is no reduction of outputs to inputs by construction.

full rationale

DriveIndia is a dataset paper: its central outputs (66,986 images, 471,092 instances, 24 classes, and the Table II/III detector scores) are reported descriptions of the artifact and empirical measurements on it, not derivations from a fitted model or from the dataset definition itself. The YOLO baselines were trained and then evaluated on held-out test images, so their mAP values are external to any claim being proven; there is no equation in the paper in which a predicted quantity equals its defining input by construction. The comparison numbers for IDD, DATS, ITD, and BDD100K are imported from prior external work and are not used to force DriveIndia's own numbers. The internal inconsistency between Section III.A's 53,586 training images and Section IV.A's 54,856 training images, and the prospective 'will be publicly released' availability statement, are verification and correctness concerns rather than circularity: they do not make any result identical to its premise. No load-bearing self-citation chain or uniqueness theorem is invoked. Accordingly, the correct finding is no significant circularity (score 0).

Assumptions & free parameters 3 free parameters · 4 assumptions · 0 invented entities

The central claim is the existence and utility of the dataset. This depends on the annotations being accurate, the data collection and filtering choices being appropriate, and the dataset being publicly accessible. These are assumptions that cannot be verified from the paper alone.

free parameters (3)
  • Laplacian variance threshold for blur filtering = 20
    Hand-chosen threshold to exclude low-clarity images from validation and test sets; affects dataset composition and difficulty.
  • Minimum object visibility for labeling = 50%
    Hand-chosen rule deciding whether edge-cut or motion-blurred objects are annotated; affects label distribution.
  • Train/validation/test split ratio = 80/10/10 (53,586/6,700/6,700 in Section III; 54,856/6,700/6,700 in Section IV.A)
    Chosen split; the reported numbers are inconsistent between sections.
assumptions (4)
  • domain assumption The dataset annotations accurately reflect ground-truth objects in the images
    No independent verification or inter-annotator agreement is reported; the entire benchmark relies on label correctness.
  • domain assumption The collected images genuinely represent diverse weather and lighting conditions as claimed
    The paper asserts fog, rain, and low-light coverage but provides no quantitative distribution or sample counts.
  • domain assumption The dataset will be publicly released via the TiHAN repository
    At submission the dataset is not accessible, so the claimed utility as a public benchmark is unverified.
  • domain assumption Standard detection metrics are comparable across datasets
    Table I compares mAP50 across datasets with different class sets and protocols, which is not a controlled comparison.

how reviews work

0 comments
Cite this review

Pith. "Pith review of DriveIndia: An Object Detection Dataset for Diverse Indian Traffic Scenes." pith.science (2026). https://pith.science/paper/NGI4I5UD

@misc{pith2026250719912,
  author       = {Pith},
  title        = {Pith review of: DriveIndia: An Object Detection Dataset for Diverse Indian Traffic Scenes},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/NGI4I5UD}},
  note         = {Machine review of arXiv:2507.19912}
}
read the original abstract

We introduce DriveIndia, a large-scale object detection dataset purpose-built to capture the complexity and unpredictability of Indian traffic environments. The dataset contains 66,986 high-resolution images annotated in YOLO format across 24 traffic-relevant object categories, encompassing diverse conditions such as varied weather (fog, rain), illumination changes, heterogeneous road infrastructure, and dense, mixed traffic patterns and collected over 120+ hours and covering 3,400+ kilometers across urban, rural, and highway routes. DriveIndia offers a comprehensive benchmark for real-world autonomous driving challenges. We provide baseline results using state-of-the-art YOLO family models, with the top-performing variant achieving a mAP50 of 78.7%. Designed to support research in robust, generalizable object detection under uncertain road conditions, DriveIndia will be publicly available via the TiHAN-IIT Hyderabad dataset repository https://tihan.iith.ac.in/TiAND.html (Terrestrial Datasets -> Camera Dataset).

Figures

Figures reproduced from arXiv: 2507.19912 by the authors.

Figure 1
Figure 1. Sample scenes from the DriveIndia dataset: urban [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Data Collection Vehicle with Front & Back Camera [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 4
Figure 4. Example detections from the DriveIndia dataset, showcasing diverse object categories including vehicles, pedestrians, [PITH_FULL_IMAGE:figures/full_fig_p004_4.png] view at source ↗
Figures from the paper (1 more)
Figure 5
Figure 5. Figure 5: Confusion Matrix, highlighting confusion between [PITH_FULL_IMAGE:figures/full_fig_p004_5.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

23 extracted references · 17 canonical work pages

  1. [1]

    Are we ready for autonomous driving? the kitti vision benchmark suite,

    A. Geiger, P. Lenz, and R. Urtasun, “Are we ready for autonomous driving? the kitti vision benchmark suite,” in 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . IEEE, June 2012, pp. 3354–3361

  2. [2]

    nuscenes: A multimodal dataset for autonomous driving,

    H. Caesar, V . Bankiti, A. H. Lang, S. V ora, V . E. Liong, Q. Xu, A. Krishnan, Y . Pan, G. Baldan, and O. Beijbom, “nuscenes: A multimodal dataset for autonomous driving,” 2020. [Online]. Available: https://arxiv.org/abs/1903.11027

  3. [3]

    Idd: A dataset for exploring problems of autonomous navigation in unconstrained environments,

    G. Varma, A. Subramanian, A. Namboodiri, M. Chandraker, and C. V . Jawahar, “Idd: A dataset for exploring problems of autonomous navigation in unconstrained environments,” in 2019 IEEE Winter Conference on Applications of Computer Vision (WACV) . IEEE, January 2019, pp. 1743–1751

  4. [4]

    Idd-3d: Indian driving dataset for 3d unstructured road scenes,

    S. Dokania, A. H. A. Hafez, A. Subramanian, M. Chandraker, and C. V . Jawahar, “Idd-3d: Indian driving dataset for 3d unstructured road scenes,” in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) , January 2023, pp. 4482– 4491

  5. [5]

    Dats 2022: A versatile indian dataset for object detection in unstructured traffic conditions,

    B. A. Paranjape and A. A. Naik, “Dats 2022: A versatile indian dataset for object detection in unstructured traffic conditions,” Data in Brief , vol. 43, p. 108470, 2022

  6. [6]

    Nitcad-developing an object detection, classification and stereo vision dataset for autonomous navigation in indian roads,

    N. G. S. S. Srinath, A. Z. Joseph, S. Umamaheswaran, C. L. Priyanka, M. Nair, and P. Sankaran, “Nitcad-developing an object detection, classification and stereo vision dataset for autonomous navigation in indian roads,” Procedia Computer Science , vol. 171, pp. 207–216, 2020

  7. [7]

    Tiand: A multimodal dataset for autonomy on indian roads,

    N. Kumar, A. S, A. Thakur, O. Gopi, A. Dasgupta, A. Algole, B. Anand, V . S. Mutnuri, S. Reddy, N. P. B. Mannam, S. Saripalli, and R. Pachamuthu, “Tiand: A multimodal dataset for autonomy on indian roads,” in 2024 IEEE Intelligent Vehicles Symposium (IV) , 2024, pp. 688–694

  8. [8]

    You only look once: Unified, real-time object detection,

    J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You only look once: Unified, real-time object detection,” 2016. [Online]. Available: https://arxiv.org/abs/1506.02640

Show all 23 references
  1. [9]

    Tihan autonomous navigation dataset repository,

    I. H. TiHAN, “Tihan autonomous navigation dataset repository,” 2024, accessed: April 30, 2025. [Online]. Available: https://tihan.iith. ac.in/tiand-datasets/

  2. [10]

    The cityscapes dataset for semantic urban scene understanding,

    M. Cordts, M. Omran, S. Ramos, T. Rehfeld, M. Enzweiler, R. Benen- son, U. Franke, S. Roth, and B. Schiele, “The cityscapes dataset for semantic urban scene understanding,” in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2016

  3. [11]

    Bdd100k: A diverse driving dataset for heterogeneous multitask learning,

    F. Yu, H. Chen, X. Wang, W. Xian, Y . Chen, F. Liu, V . Madhavan, and T. Darrell, “Bdd100k: A diverse driving dataset for heterogeneous multitask learning,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2020, pp. 2633–2642. [Onli...

  4. [12]

    Itd: Indian traffic dataset for intelligent transportation systems,

    A. Agarwal, A. Thombre, K. Kedia, and I. Ghosh, “Itd: Indian traffic dataset for intelligent transportation systems,” in 2024 16th International Conference on COMmunication Systems & NETworkS (COMSNETS). IEEE, January 2024, pp. 842–850

  5. [13]

    Perfor- mance comparison of different cnn models for indian road dataset,

    A. Mukhopadhyay, P. Biswas, A. Agarwal, and I. Mukherjee, “Perfor- mance comparison of different cnn models for indian road dataset,” in Proceedings of the 3rd International Conference on Graphics and Signal Processing, June 2019, pp. 29–33

  6. [14]

    Comparative study of deep learning models for vehicle detection in an unconstrained road scenario,

    J. Sehgal, M. Sharma, J. Chatterjee, and A. Mehra, “Comparative study of deep learning models for vehicle detection in an unconstrained road scenario,” in 2020 International Conference on Communication and Signal Processing (ICCSP) . IEEE, July 2020, pp. 1076–1080

  7. [15]

    Labelimg: Label image tool,

    Tzutalin, “Labelimg: Label image tool,” https://github.com/ HumanSignal/labelImg, 2015, accessed: April 30, 2025

  8. [16]

    Analysis of focus measure operators for shape-from-focus,

    S. Pertuz, D. Puig, and M. A. Garcia, “Analysis of focus measure operators for shape-from-focus,” Pattern Recognition, vol. 46, no. 5, pp. 1415–1432, 2013

  9. [17]

    The effect of improving annotation quality on object detection datasets: A preliminary study,

    J. Heller, J.-H. Won, K. Saenko, L. Castrejon, and M. Schmidt, “The effect of improving annotation quality on object detection datasets: A preliminary study,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2020

  10. [18]

    Ultralytics yolov5,

    G. Jocher, “Ultralytics yolov5,” 2020. [Online]. Available: https: //github.com/ultralytics/yolov5

  11. [19]

    Ultralytics yolov8,

    G. Jocher, A. Chaurasia, and J. Qiu, “Ultralytics yolov8,” 2023. [Online]. Available: https://github.com/ultralytics/ultralytics

  12. [20]

    Yolov9: Learning what you want to learn using programmable gradient information,

    C.-Y . Wang and H.-Y . M. Liao, “Yolov9: Learning what you want to learn using programmable gradient information,” 2024

  13. [21]

    Ultralytics yolo11,

    G. Jocher and J. Qiu, “Ultralytics yolo11,” 2024. [Online]. Available: https://github.com/ultralytics/ultralytics

  14. [22]

    Detrs beat yolos on real-time object detection,

    Y . Zhao, W. Lv, S. Xu, J. Wei, G. Wang, Q. Dang, Y . Liu, and J. Chen, “Detrs beat yolos on real-time object detection,” 2023

  15. [23]

    Efficientdet: Scalable and efficient object detection,

    M. Tan, R. Pang, and Q. V . Le, “Efficientdet: Scalable and efficient object detection,” 2020. [Online]. Available: https://arxiv.org/abs/ 1911.09070

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.