Real-Time Drowsiness Detection System for Student Tracking using Machine Learning

##plugins.themes.academic_pro.article.main##

Dilipkumar A. Borikar
Himani Dighorikar
Shridhar Ashtikar
Ishika Bajaj
Shivam Gupta

Abstract

Many studies on fatigue detection have been carried out that were focused on experimention over different technologies. Machine vision based driver fatigue detection systems are used to prevent accidents and improve safety on roads. We propose the design of an alerting system for the students that will use real time video of a person to capture the drowsiness level and will signal alert to the student when the student is in that state of fatigue. A device, if enabled with the system, will start the webcam and track the person. An alert will be generated based on the set frame rate when a continuous set of frames are detected as drowsy. The  conventional methods cannot capture complex expressions, however the vailability of deep learning models has enabled a substantial research on detection of states of a person in real time. Our system operates in natural lighting conditions and can predict accurately even when the face is covered with glasses, head caps, etc. The system is implemented using YOLOv5 models (You Look Only Once) is an extremely fast and accurate detection model.

##plugins.themes.academic_pro.article.details##

Author Biographies

Dilipkumar A. Borikar, Shri Ramdeobaba College of Engineering and Management, Nagpur

Department of Computer Science and Engineering / Assistant Professor

Himani Dighorikar, Shri Ramdeobaba College of Engineering and Management, Nagpur

Department of Computer Science and Engineering / Student

Shridhar Ashtikar, Shri Ramdeobaba College of Engineering and Management, Nagpur

Department of Computer Science and Engineering / Student

Ishika Bajaj, Shri Ramdeobaba College of Engineering and Management, Nagpur, INDIA

Department of Computer Science and Engineering / Student

Shivam Gupta, Shri Ramdeobaba College of Engineering and Management, Nagpur

Department of Computer Science and Engineering / Student

How to Cite
Dilipkumar Borikar, Himani Dighorikar, Shridhar Ashtikar, Ishika Bajaj, & Shivam Gupta. (2023). Real-Time Drowsiness Detection System for Student Tracking using Machine Learning. International Journal of Next-Generation Computing, 14(1). https://doi.org/10.47164/ijngc.v14i1.992

References

  1. Arefnezhad, S., Samiee, S., Eichberger, A., and Nahvi, A. 2019. Driver Drowsiness Detection based on Steering Wheel Data Applying Adaptive Neuro-Fuzzy Feature Selection. In: Sensors, Vol. 19, No. 4, DOI: https://doi.org/10.3390/s19040943. DOI: https://doi.org/10.3390/s19040943
  2. Belmekki, G. A., Mekkakia, M. Z., and Pomares, H. 2020. Driver Drowsiness Detection and Tracking based on YOLO with Haar Ccascades and ERNN. International Journal of Safety and Security Engineering, Volume 11, No. 1, pp. 35-42. DOI:https://doi.org/10.18280/ijsse.110104. DOI: https://doi.org/10.18280/ijsse.110104
  3. Garg, D., Goel, P., Pandya, S., Ganatra, A., and Kotecha, K. 2018. A Deep Learning Approach for Face Detection using YOLO. IEEE PuneCon , pp. 1-4, DOI:10.1109/PUNECON.2018.8745376. DOI: https://doi.org/10.1109/PUNECON.2018.8745376
  4. Jabbar, R., Shinoy, M., Kharbeche, M., Al-Khalifa, K., Krichen, M., and Barkaoui, K. 2020. Driver Drowsiness Detection Model using Convolutional Neural Networks Techniques for Android Application. In: Proceedings of 2020 IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT) IEEE. DOI: https://doi.org/10.1109/ICIoT48696.2020.9089484
  5. Katsamenis, I., Karolou, E. E., Davradou, A., Protopapadakis, E., Doulamis, N., Doulamis, A., and Kalogeras, D. 2022. TraCon: A Novel Dataset for Real-Time Traffic Cones Detection using Deep Learning, In: Krouska, A., Troussas, C., Caro, J. (eds) Novel & Intelligent Digital Systems: Proceedings of the 2nd International Conference (NiDS 2022). NiDS 2022. Lecture Notes in Networks and Systems, vol 556. Springer, Cham. DOI: https://doi.org/10.1007/978-3-031-17601-2 37. DOI: https://doi.org/10.1007/978-3-031-17601-2_37
  6. Kumar, A., Kalia, A., and Sharma, A. 2020. Object Detection: A Comprehensive Review of the State-of-the-Art Methods. International Journal of Next-Generation Computing, Vol. 11, No. 1.
  7. Lahoti, U., Joshi, R., Vyas, N., Deshpande, K., and Jain, S. 2020. Drowsiness Detection System for Online Courses. International Journal of Advanced Trends in Computer Science and Engineering, Volume 9, Issue 2. DOI: https://doi.org/10.30534/ijatcse/2020/158922020
  8. Magan, E., Sesmero, M. P., Alonso-Weber, J. M., and Sanchis, A. 2022. Driver Drowsiness Detection by Applying Deep Learning Techniques to Sequences of Images. Applied Sciences 2022, Volume 12, Issue 3, pp. 1145, DOI: https://doi.org/10.3390/app12031145. DOI: https://doi.org/10.3390/app12031145
  9. Mehta, S., Dadhich, S., Gumber, S., and Jadhav Bhatt, A. 2019. Real-Time Driver Drowsiness Detection System Using Eye Aspect Ratio and Eye Closure Ratio. International Conference on Sustainable Computing in Science Technology and Management, Elsevier SSRN. DOI: https://doi.org/10.2139/ssrn.3356401
  10. Murthy, J. S., Siddesh, G. M., Lai, W. C., Parameshachari, B. D., Patil, S. N., and Hemalatha, K. L. 2022. ObjectDetect: A Real-Time Object Detection Framework for Advanced Driver Assistant Systems Using YOLOv5. Wireless Communications and Mobile Computing, Volume 2022, DOI:https://doi.org/10.1155/2022/9444360. DOI: https://doi.org/10.1155/2022/9444360
  11. Gupta, A. and Prabhat, P., 2022. Towards a resource efficient and privacy-preserving framework for campus-wide video analytics-based applications. Complex & Intelligent Systems, pp.1-16. DOI: https://doi.org/10.1007/s40747-022-00783-w
  12. Murthy, S. K., Siddineni, B., Kompella, V. K., Kondaveeti, A., Boddupalli, H., and Manikandan V. M. 2021. An Efficient Drowsiness Detection Scheme using Video Analysis. International Journal of Computing and Digital Systems, Volume 11, Issue 1, DOI:https://dx.doi.org/10.12785/ijcds/110146. DOI: https://doi.org/10.12785/ijcds/110146
  13. Mutya, K., Shah, J., McDonald, A. D., and Jefferson, J. 2019. What Are Steering Pictures Are Worth? Using Image-based Steering Features to Detect Drowsiness on Rural Roads. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 63, No. 1, DOI: https://doi.org/10.1177/1071181319631220. DOI: https://doi.org/10.1177/1071181319631220
  14. Navya Kiran, V. B., Raksha, R., Rahman, A., Varsha K. N., and Nagamani, N. P. 2020. Driver Drowsiness Detection. International Journal of Engineering Research and Technology (IJERT), NCAIT-2020, Volume 8, Issue 15.
  15. Redmon J., Divvala S., and Farhadi A. 2016. You Only Look Once: Unified, Real-Time Object Detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779-788, DOI: 10.1109/CVPR.2016.91. DOI: https://doi.org/10.1109/CVPR.2016.91
  16. You, F. , Gong, Y., Tu, H., Liang, J., andWang, H. 2020. A Fatigue Driving Detection Algorithm Based on Facial Motion Information Entropy. Journal of Advanced Transportation, Volume 2020, DOI: https://doi.org/10.1155/2020/8851485. DOI: https://doi.org/10.1155/2020/8851485