Abstract

The success of autonomous navigation relies on robust and precise vehicle recognition, hindered by the scarcity of region-specific vehicle detection datasets, impeding the development of context-aware systems. To advance terrestrial object detection research, this paper proposes a native vehicle detection dataset for the most commonly appeared vehicle classes in Bangladesh. 17 distinct vehicle classes have been taken into account, with fully annotated 81542 instances of 17326 images. Each image width is set to at least 1280px. The dataset’s average vehicle bounding box-to-image ratio is 4.7036. This Bangladesh Native Vehicle Dataset (BNVD) has accounted for several geographical, illumination, variety of vehicle sizes, and orientations to be more robust on surprised scenarios. In the context of examining the BNVD dataset, this work provides a thorough assessment with four successive You Only Look Once (YOLO) models, namely YOLO v5, v6, v7, and v8. These dataset’s effectiveness is methodically evaluated and contrasted with other vehicle datasets already in use. The BNVD dataset exhibits mean average precision(mAP) at 50% intersection over union(IoU) is 0.848 corresponding precision and recall values of 0.841 and 0.774. The research findings indicate a mAP of 0.643 at an IoU range of 0.5 to 0.95. The experiments show that the BNVD dataset serves as a reliable representation of vehicle distribution and presents considerable complexities.

Dataset Overview

Total Images: 17,326
Instances: 81,542
BBox Per Image: 4.7036
Vehicle Categories:

  1. Bicycle
  2. Bus
  3. Bhotbhoti
  4. Car
  5. CNG
  6. Easybike
  7. Leguna
  8. Motorbike
  9. MPV
  10. Pedestrian
  11. Pickup
  12. PowerTiller
  13. Rickshaw
  14. ShoppingVan
  15. Truck
  16. Van
  17. Wheelbarrow


Description of the image

Vehicle Detection Dataset Comparison (Horizontal Bounding Box)

Dataset Categories Instances (BBox) Images Image Width Average BBox/Image Diversity
Rainy Foggy Night Limited
KITTI 8 80000 15000 1392px 5.3333 - - - -
CityScapes 3D 8 27000 5000 2048px 5.4 - - - -
Rope3D 12 1500000 50000 1920px 30 Y - Y Y
SEU_PML 13 270684 6588 1920px to 4096px 41.0874 Y - Y Y
BDD100K 12 2221128 100000 1280px 22.2112 Y Y Y Y
CityFlow - 229680 ~666 960px 344.9 - Y - Y
IDD 34 77142 10004 1678px 7.711 - Y Y Y
CARL-D 25 50348 15000 - 3.3565 - - - Y
DhakaAI 21 24368 3003 - 8.1145 - - Y Y
P2 Dhaka 8 43796 4777 - 9.1680 - Y - -
PoribohonBD 16 26851 9058 - 2.9643 Y - Y Y
BNVD 17 81542 17326 1280px 4.7036 Y Y Y Y

Evaluation Results

CATEGORY-WISE AVERAGE PRECISION AT BNVD DATASET

Categories YOLOv5 YOLOv6 YOLOv7 YOLOv8
Bicycle 0.786 0.789 0.808 0.804
Bus 0.899 0.892 0.912 0.908
Bhotbhoti 0.926 0.938 0.944 0.964
Car 0.876 0.881 0.899 0.881
CNG 0.893 0.906 0.918 0.921
Easybike 0.881 0.888 0.905 0.899
Leguna 0.904 0.91 0.917 0.935
Motorbike 0.776 0.795 0.79 0.796
MPV 0.694 0.717 0.727 0.726
Pedestrian 0.633 0.652 0.657 0.669
Pickup 0.675 0.72 0.708 0.715
PowerTiller 0.979 0.975 0.973 0.976
Rickshaw 0.881 0.887 0.892 0.884
ShoppingVan 0.74 0.755 0.736 0.763
Truck 0.852 0.85 0.857 0.867
Van 0.775 0.787 0.788 0.797
Wheelbarrow 0.886 0.888 0.867 0.91
Overall 0.826 0.837 0.841 0.848

EVALUATION BENCHMARK ON CARL-D, DHAKAAI, P2 DHAKA, PORIBOHONBD, AND BNVD DATASET USING YOLO MODELS

Model Dataset mAP0.5 mAP 0.5:0.95 Precision Recall Weight
YOLOv5 CARL-D 0.437 0.328 0.633 0.423
DhakaAI 0.416 0.255 0.640 0.393
P2 Dhaka 0.655 0.400 0.804 0.581
PoribohonBD 0.981 0.743 0.939 0.948
BNVD 0.826 0.609 0.836 0.762 Weight
YOLOv6 CARL-D 0.479 0.372 0.58 0.453
DhakaAI 0.420 0.262 0.311 0.548
P2 Dhaka 0.775 0.494 0.762 0.71
PoribohonBD 0.899 0.648 0.899 0.81
BNVD 0.837 0.624 0.805 0.76 Weight
YOLOv7 CARL-D 0.478 0.369 0.619 0.459
DhakaAI 0.464 0.284 0.692 0.438
P2 Dhaka 0.743 0.462 0.816 0.688
PoribohonBD 0.907 0.656 0.914 0.841
BNVD 0.841 0.623 0.83 0.779 Weight
YOLOv8 CARL-D 0.478 0.359 0.602 0.446
DhakaAI 0.435 0.276 0.694 0.446
P2 Dhaka 0.69 0.449 0.798 0.604
PoribohonBD 0.889 0.658 0.898 0.823
BNVD 0.848 0.643 0.841 0.774 Weight

Contributors

Bipin Saha
Department of Electrical and Electronic Engineering
University of Rajshahi, Rajshahi 6205, Bangladesh
Email: bipinsaha.bd@gmail.com
Md. Johirul Islam
Department of Physics
Rajshahi University of Engineering and Technology, Rajshahi 6204, Bangladesh
Email: johirul@phy.ruet.ac.bd
Shaikh Khaled Mostaque
Department of Electrical and Electronic Engineering
University of Rajshahi, Rajshahi 6205, Bangladesh
Email: misha@ru.ac.bd
Aditya Bhowmik
Department of Electrical and Electronic Engineering
University of Rajshahi, Rajshahi 6205, Bangladesh
Email: bhowmik.aditya0@gmail.com
Tapodhir Karmakar Taton
Department of Electrical and Electronic Engineering
University of Rajshahi, Rajshahi 6205, Bangladesh
Email: tapodhirtaton@gmail.com
Md Nakib Hayat Chowdhury
Department of Electrical Electronic and Systems Engineering
Universiti Kebangsaan Malaysia, Malaysia
Email: nakib2025@gmail.com
Mamun Bin Ibne Reaz
Electrical and Electronic Engineering
Independent University, Bangladesh
Email: mamun.reaz@iub.edu.bd

Citation

DOI: https://doi.org/10.48550/arXiv.2405.12150

        @misc{saha2024bangladeshi,
        title={Bangladeshi Native Vehicle Detection in Wild}, 
        author={Bipin Saha and Md. Johirul Islam and Shaikh Khaled Mostaque and 
        Aditya Bhowmik and Tapodhir Karmakar Taton and Md. Nakib Hayat Chowdhury and Mamun Bin Ibne Reaz},
        year={2024},
        eprint={2405.12150},
        archivePrefix={arXiv},
        primaryClass={cs.CV}}