Behavior and Person Sensing System Based on Computer Vision
DOI:
https://doi.org/10.33795/jip.v12i3.9090Keywords:
worker situation, computer vision, monitoring system, YOLO, real-time detection, local storageAbstract
In modern industrial environments, effective supervision of worker attendance and activity is essential to ensure safety and optimize productivity. Inadequate monitoring can lead to increased workplace accidents and reduced operational efficiency. To address these challenges, we propose an intelligent monitoring system leveraging computer vision techniques, implemented using PyTorch and the YOLO (You Only Look Once) object detection framework. The system utilizes video input from CCTV or cameras installed in the workspace and performs real-time analysis through several key modules: (i) Worker Counting, which detects and counts the number of employees present; (ii) Activity Detection, which classifies workers as actively working or idle (e.g., sleeping or using mobile phones); (iii) Fall Detection, which identifies and alerts the server in case of worker falls; and (iv) Absent Detection, which tracks and flags workers who leave the monitored area. Detection results and relevant video segments are automatically archived in local storage, enabling retrospective review and continuous monitoring. By integrating these modules, the proposed system aims to enhance workplace safety, support real-time remote supervision, and improve overall operational effectiveness in industrial settings.
Downloads
References
Ajerla, D., Mahfuz, S. & Zulkernine, F.J.W.C. (2019): A Real-Time Patient Monitoring Framework for Fall Detection, Vol. 2019, Article 9507938
Bo, L.J.I.J.o.A.C.S. (2023): Human Fall Detection for Smart Home Caring Using YOLO Networks, Vol. 14
Chen, B., Wang, X., Bao, Q., Jia, B., Li, X. & Wang, Y.J.E. (2022): An Unsafe Behavior Detection Method Based on Improved YOLO Framework, Vol. 11, p. 1912
Fan, Y., Levine, M.D., Wen, G. & Qiu, S.J.N. (2017): A Deep Neural Network for Real-Time Detection of Falling Humans in Naturally Occurring Scenes, Vol. 260, pp. 43–58
Gowsikhaa, D., Abirami, S. & Baskaran, R.J.A.I.R. (2014): Automated Human Behavior Analysis from Surveillance Videos: A Survey, Vol. 42, pp. 747–765
Khekan, A.R., Aghdasi, H.S. & Salehpour, P.J.I.A. (2024): The Impact of YOLO Algorithms within Fall Detection Application: A Review
Li, S. & Song, X.J.I.S.J. (2023): Future Frame Prediction Network for Human Fall Detection in Surveillance Videos, Vol. 23, pp. 14460–14470
Mok, R.K., Chang, R.K. & Li, W.J.I.T.o.M. (2016): Detecting Low-Quality Workers in QoE Crowdtesting: A Worker Behavior-Based Approach, Vol. 19, pp. 530–543
Mokayed, H., Quan, T.Z., Alkhaled, L. & Sivakumar, V. (2023): Real-Time Human Detection and Counting System Using Deep Learning Computer Vision Techniques, in: Artificial Intelligence and Applications, pp. 205–213
Muheidat, F., Tawalbeh, L.A. & Tyrer, H. (2018): Context-Aware, Accurate, and Real-Time Fall Detection System for Elderly People, Proc. of IEEE 12th International Conference on Semantic Computing (ICSC), IEEE, pp. 329–333
Parasuraman, R., Mouloua, M., Molloy, R. & Hilburn, B. (2018): Monitoring of Automated Systems, in: Automation and Human Performance, CRC Press, pp. 91–115
Pereira, G.A.J.a.p.a. (2024): Fall Detection for Industrial Setups Using YOLOv8 Variants
Raza, A., Yousaf, M.H. & Velastin, S.A. (2022): Human Fall Detection Using YOLO: A Real-Time and AI-on-the-Edge Perspective, Proc. of 12th International Conference on Pattern Recognition Systems (ICPRS), IEEE, pp. 1–6
Redmon, J. & Farhadi, A.J.a.p.a. (2018): YOLOv3: An Incremental Improvement
Sanjalawe, Y., Fraihat, S., Abualhaj, M., Al-E’Mari, S.R. & Alzubi, E.J.I.A. (2025): Hybrid Deep Learning for Human Fall Detection: A Synergistic Approach Using YOLOv8 and Time-Space Transformers, Vol. 13, pp. 41336–41366
Singh, A.K., Singh, D. & Goyal, M. (2021): People Counting System Using Python, Proc. of 5th International Conference on Computing Methodologies and Communication (ICCMC), IEEE, pp. 1750–1754
Sturman, O., von Ziegler, L., Schläppi, C., Akyol, F., Privitera, M., Slominski, D., Grimm, C., Thieren, L., Zerbi, V. & Grewe, B.J.N. (2020): Deep Learning-Based Behavioral Analysis Reaches Human Accuracy and is Capable of Outperforming Commercial Solutions, Vol. 45, pp. 1942–1952
Vasavi, G., Diddi, H.H., Haritha, E., Kumar, G.A. & Varma, G.H. (2023): People Counting Based on YOLO, Proc. of 4th IEEE Global Conference for Advancement in Technology (GCAT), IEEE, pp. 1–6
Vishwakarma, V., Mandal, C. & Sural, S. (2007): Automatic Detection of Human Fall in Video, Proc. of Second International Conference on Pattern Recognition and Machine Intelligence (PReMI 2007), Springer, pp. 616–623
Wijaya, J., Krisnanik, E. & Isnainiyah, I.N. (2022): Sistem Informasi Pemantauan Kinerja Pegawai Berbasis Web pada PT XYZ Indonesia, Proc. of Seminar Nasional Mahasiswa Bidang Ilmu Komputer dan Aplikasinya, pp. 245–256
Yuan, Y., Miao, Z. & Hu, S. (2006): Real-Time Human Behavior Recognition in Intelligent Environment, Proc. of 8th International Conference on Signal Processing, IEEE
Zhao, D., Song, T., Gao, J., Li, D. & Niu, Y.J.I.A. (2024): YOLO-Fall: A Novel Convolutional Neural Network Model for Fall Detection in Open Spaces, Vol. 12, pp. 26137–26149
Zivkovic, T., Zivkovic, M., Jovanovic, L., Kaljevic, J., Dobrojevic, M. & Bacanin, N. (2025): YOLOv8 Model Architecture Selection for Human Fall Detection, Proc. of International Conference on Data Analytics & Management, Springer, pp. 219–227
