Integration Of Fingerprint Attendance Systems And Iot-Based Computer Vision For Employee Presence Monitoring
Abstract
The fingerprint-based attendance system at the Makassar Public Health Laboratory (BLKM Makassar) has limitations because it only records administrative attendance and cannot verify the physical presence of employees in the workplace. This study aims to design and implement an integrated fingerprint attendance and Internet of Things (IoT)-based computer vision system to support automated employee presence monitoring. The system uses two ESP32-CAM units installed in the lobby area and connected to a Flask Python server and MariaDB database. Image processing employs Histogram of Oriented Gradients (HOG) for face localization, dlib 68 facial landmarks for face alignment, and ResNet-34 to generate 128-dimensional face embeddings. Face identification is performed using Euclidean Distance with a threshold of 0.45 and a Time Window Buffer mechanism during monitoring cycles at 10:00 and 14:00 WITA. The results show that image transmission through HTTP POST operates with HTTP 200 OK and a latency of approximately 80 ms. Under normal walking conditions, the system achieved a 100% detection success rate. From 150 dynamic tests, the multi-camera system achieved an overall detection success rate of 63.33%, while Camera 1 and Camera 2 achieved 60.67% and 40.00%, respectively. The system achieved a 74% success rate under fast walking conditions, which decreased to 16% during running due to motion blur and lighting conditions. The integration of fingerprint attendance and computer vision provides supporting information for identifying discrepancies between administrative attendance records and the visual presence of employees within the monitored camera-covered area.
References
Ahmad Raihan, P., Ramaddan Julianti Candidate, M., Ramdhan, S., & Fazilla Candidate, S. (n.d.-a). International Journal of Communication Networks and Information Security IoT-Based Biometric Attendance System Using Arduino and ThingsBoard.
Ahmad Raihan, P., Ramaddan Julianti Candidate, M., Ramdhan, S., & Fazilla Candidate, S. (n.d.-b). International Journal of Communication Networks and Information Security IoT-Based Biometric Attendance System Using Arduino and ThingsBoard.
Belgibayev, B., Mansurova, M., Ablay, G., Sarsembayeva, T., & Armankyzy, Z. (2025). Optimization of Neural Network Models of Computer Vision for Biometric Identification on Edge IoT Devices. Journal of Imaging, 11(11). https://doi.org/10.3390/jimaging11110419
Ghareeb, A., & Abusamra, E. (2024a). Microcontroller-Based Face Recognition Attendance System. ARTICLE INFOR ABSTRACT. In Journal homepage (Vol. 3, Number 1).
Ghareeb, A., & Abusamra, E. (2024b). Microcontroller-Based Face Recognition Attendance System. ARTICLE INFOR ABSTRACT. In Journal homepage (Vol. 3, Number 1).
Hamidah, A., Reno, M., Taufiq Subagio, R., Sokibi, P., & Rizqiyah, P. (2024a). Penerapan ESP32Cam Untuk Sistem Absensi Karyawan Dengan Metode Face Recognition-( PENERAPAN ESP32CAM UNTUK SISTEM ABSENSI KARYAWAN DENGAN METODE FACE RECOGNITION (Vol. 14, Number 2).
Hamidah, A., Reno, M., Taufiq Subagio, R., Sokibi, P., & Rizqiyah, P. (2024b). Penerapan ESP32Cam Untuk Sistem Absensi Karyawan Dengan Metode Face Recognition-( PENERAPAN ESP32CAM UNTUK SISTEM ABSENSI KARYAWAN DENGAN METODE FACE RECOGNITION (Vol. 14, Number 2).
Jabberi, M., Wali, A., Chaudhuri, B. B., & Alimi, A. M. (2023). 68 landmarks are efficient for 3D face alignment: what about more?: 3D face alignment method applied to face recognition. Multimedia Tools and Applications, 82(27), 41435–41469. https://doi.org/10.1007/s11042-023-14770-x
Natbais, Y. H., Warsito, A., Tarigan, J., Bangkit, A., & Umbu, S. (2024). ANALISIS IMPLEMENTASI SMARTPHONE ANDROID DAN MODUL ESP32-CAM UNTUK SISTEM ABSENSI MENGGUNAKAN FACE RECOGNITION (Vol. 9, Number 2).
Zainuddin, A. A., Nor, R. M., Handayani, D., Mohd. Tamrin, M. I., Subramaniam, K., & Sadikan, S. F. N. (2024). Smart Attendance in Classroom (CObot): IoT and Facial Recognition for Educational and Entrepreneurial Impact. APTISI Transactions on Technopreneurship, 6(3), 608–622. https://doi.org/10.34306/att.v6i3.497
Atzori, L., Iera, A., & Morabito, G. (2010). The Internet of Things: A survey. Computer Networks, 54(15), 2787–2805. https://doi.org/10.1016/j.comnet.2010.05.010
Dalal, N., & Triggs, B. (2005). Histograms of oriented gradients for human detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1, 886–893. https://doi.org/10.1109/CVPR.2005.177
Dutta, A., Veldhuis, R. N. J., & Spreeuwers, L. J. (2012). The impact of image quality on the performance of face recognition. Proceedings of the 33rd WIC Symposium on Information Theory in the Benelux, 141–148. https://ris.utwente.nl/ws/portalfiles/portal/5440996/dutta2012impact.pdf
Gharib, A., & Abusamra, E. (2024). A microcontroller-based face recognition attendance system. International Journal of Engineering Research, 3(1), 59–67. https://journal.su.edu.ly/index.php/ijer/en/article/view/2702
He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 770–778. https://doi.org/10.1109/CVPR.2016.90
Jain, A. K., Nandakumar, K., & Nagar, A. (2008). Biometric template security. EURASIP Journal on Advances in Signal Processing, 2008, Article 579416. https://doi.org/10.1155/2008/579416
Jain, A. K., Ross, A., & Prabhakar, S. (2004). An introduction to biometric recognition. IEEE Transactions on Circuits and Systems for Video Technology, 14(1), 4–20. https://doi.org/10.1109/TCSVT.2003.818349
Kazemi, V., & Sullivan, J. (2014). One millisecond face alignment with an ensemble of regression trees. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1867–1874. https://openaccess.thecvf.com/content_cvpr_2014/html/Kazemi_One_Millisecond_Face_2014_CVPR_paper.html
King, D. E. (2009). Dlib-ml: A machine learning toolkit. Journal of Machine Learning Research, 10, 1755–1758. https://www.jmlr.org/papers/v10/king09a.html
Schroff, F., Kalenichenko, D., & Philbin, J. (2015). FaceNet: A unified embedding for face recognition and clustering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 815–823. https://arxiv.org/abs/1503.03832
