Real-Time Full-Body Detection Using Computer Vision: Leveraging OpenCV and MediaPipe

International Journal of Electrical and Electronics Engineering

© 2024 by SSRG - IJEEE Journal

Volume 11 Issue 11

Year of Publication : 2024

Authors : Megha Chakole, Shrikant Sontakke, Lokesh Umredkar, Virendra Rathod, Roshan Umate, Sanjay Dorle

10.14445/23488379/IJEEE-V11I11P123

How to Cite?

Megha Chakole, Shrikant Sontakke, Lokesh Umredkar, Virendra Rathod, Roshan Umate, Sanjay Dorle, "Real-Time Full-Body Detection Using Computer Vision: Leveraging OpenCV and MediaPipe," SSRG International Journal of Electrical and Electronics Engineering, vol. 11,  no. 11, pp. 231-240, 2024. Crossref, https://doi.org/10.14445/23488379/IJEEE-V11I11P123

Abstract:

This research includes a complete body detection system created using a computer vision library called OpenCV, which is primarily utilized to work on projects connected to image and video processing. Applications such as smart surveillance, human-machine interface, HMI, and human behavior all need body detection. This paper highlights the challenges that develops encounter while creating these kinds of applications. The challenges are choosing appropriate machine learning models and optimizing system performance. The primary goal of this work is to overcome the obstacles and identify solutions for them. OpenCV is one of the most potent and successful library computer vision tools, along with a few image-processing methods that yield real-time data on human movement and interaction. The focus of this research is a MediaPipe framework that Python developers commonly use to gather data on human interaction and real-time video capture. MediaPipe ensures that these programs run reliably and frees engineers to focus on improving algorithms. This research's finding offers potential human body detection approaches utilizing Mediapipe and OpenCV, which enable precise and comprehensive views of body posture, hand, and facial recognition.

Keywords:

Computer Vision, Full body detection, Image Processing, Mediapipe, OpenCV.

References:

[1] Ramadan TH. Hasan, and Amira Bibo Sallow, “Face Detection and Recognition Using OpenCV,” Journal of Soft Computing and Data Mining, vol. 2, no. 1, pp. 86-97, 2021.
[Google Scholar]
[2] Anand Upadhyay et al., “Body Posture Detection Using Computer Vision,” SSRG International Journal of VLSI & Signal Processing, vol. 7, no. 1, pp. 6-10, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[3] Satyavati Jaga, “Hand Detection and Tracking Using OpenCV and Python” International Journal of Advanced Research in Engineering and Technology, vol. 11, no. 12, pp. 3261-3266, 2020.
[Publisher Link]
[4] Gretchel Karen L. Alcantara et al., “Head Detection and Tracking Using OpenCV,” 2018 IEEE 10th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM), Baguio City, Philippines, pp. 1-5, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[5] P. Nikitha et al., “Object Detection Using OpenCV With Python,” International Research Journal of Modernization in Engineering Technology and Science, vol. 5, no. 6, pp. 762-767, 2023.
[CrossRef] [Publisher Link]
[6] Shubham Mishra et al., “An Intelligent Motion Detection Using OpenCV,” International Journal of Scientific Research in Science, Engineering and Technology, vol. 9, no. 2, pp. 51-63, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[7] Kruti Goyal, Kartikeya Agarawal, and Rishi Kumar, “Face Detection and Tracking Using OpenCV,” 2017 International Conference of Electronics, Communication and Aerospace Technology, Coimbatore, India, pp. 474-478, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[8] Arun Binoy et al., “Face Recognition System Using OpenCV,” International Research Journal of Engineering and Technology, vol. 10, no. 8, pp. 128-132, 2023.
[Publisher Link]
[9] Camillo Lugaresi et al., “MediaPipe: A Framework for Building Perception Pipelines,” arXiv Preprint, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[10] Dhammapal Suradkar, Ashish Jogad, and Pramod Talole, “Face Detection Using OpenCV,” International Journal of Advanced Research in Science, Communication and Technology, vol. 7, no. 1, pp. 18-27, 2021.
[Publisher Link]
[11] Kaleem Ullah et al., “Comparison of Person Tracking Algorithms Using Overhead View Implemented in OpenCV,” 2019 9th Annual Information Technology, Electromechanical Engineering and Microelectronics Conference (IEMECON), Jaipur, India, pp. 284-289, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[12] Nidaa Falih Hassan, Introduction to Computer Vision and Image Processing, 2016. [Online]. Available:  http://www.uotechnology.edu.iq/dep-cs/mypdf/subjects/4sw/4ip.pdf
[13] Hongping Cai et al., “The Crossdepiction Problem: Computer Vision Algorithms for Recognising Objects in Artwork and in Photographs,” arXiv Preprint, 2015.
[CrossRef] [Google Scholar] [Publisher Link]
[14] Gudala Lavanya, and Sagar Dhanraj Pande, “Enhancing Real-time Object Detection with YOLO Algorithm,” EAI Endorsed Transactionson Internet of Things, vol. 10, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[15] Weijia Zhang et al., “Combined MediaPipe and YOLOv5 Range of Motion Assessment System for Spinal Diseases and Frozen Shoulder,” Scientific Reports, vol. 14, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[16] Jose Sigut et al., “OpenCV Basics: A Mobile Application to Support the Teaching of Computer Vision Concepts,” IEEE Transactions on Education, vol. 63, no. 4, pp. 328-335, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[17] Vijay Kumar Sharma, “Designing of Face Recognition System,” 2019 International Conference on Intelligent Computing and Control Systems (ICCS), Madurai, India, pp. 459-461, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[18] B. Thaman, T. Cao, and N. Caporusso, “Face Mask Detection Using MediaPipe Facemesh,” 2022 45th Jubilee International Convention on Information, Communication and Electronic Technology (MIPRO), Opatija, Croatia, pp. 378-382, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[19] Abhinav Prajapati, Rahul Chauahan, and Himadri Vaidya, “Human Exercise Posture Detection Using MediaPipe and Machine Learning,” 2023 3rd International Conference on Advancement in Electronics & Communication Engineering (AECE), Ghaziabad, India, pp. 790-795, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[20] Yaseen et al., “Next-Gen Dynamic Hand Gesture Recognition: MediaPipe, Inception-v3 and LSTM-Based Enhanced Deep Learning Model,” Electronics, vol. 13, no. 16, 2024.
[CrossRef] [Google Scholar] [Publisher Link]