Vision-Based Empty Shelf Detection in Retail with Real-Time Telegram Notifications for Efficient Restocking

International Journal of Electronics and Communication Engineering

© 2024 by SSRG - IJECE Journal

Volume 11 Issue 7

Year of Publication : 2024

Authors : Shital Pawar, D.B. Jadhav, Deepali Godse, Rohini Jadhav, Shruti Thakur

10.14445/23488549/IJECE-V11I7P118

How to Cite?

Shital Pawar, D.B. Jadhav, Deepali Godse, Rohini Jadhav, Shruti Thakur, "Vision-Based Empty Shelf Detection in Retail with Real-Time Telegram Notifications for Efficient Restocking," SSRG International Journal of Electronics and Communication Engineering, vol. 11,  no. 7, pp. 180-187, 2024. Crossref, https://doi.org/10.14445/23488549/IJECE-V11I7P118

Abstract:

Empty spaces and fewer items on shelves of stores and big marts often dissatisfy the customer by making the items unavailable when needed. Empty spaces and fewer items on shelves of stores and big marts often disappoint customers by making items unavailable when needed. This also reflects the commitment of store staff to their work. As a result, there is a decrease in sales and a breakdown of trust between sellers and customers. Object detection is used to identify empty spaces and shelves with fewer items. Commonly used algorithms for object detection include CNN, YOLO, and SSD. Large, freely available standard datasets such as Pascal (plate number 1) and Pascal (plate number 2) are utilized, each containing around 20 classes for shelf item detection. Items are labelled as 'Out of Stock' along with their names. This labelling helps visually represent the items. Object detection often requires GPUs and a webcam. The system has developed a dataset containing four classes of grocery items. The labels for the items have been derived from their respective images, with annotations stored in separate image files. The system has been trained using the YOLOv5 algorithm. The output, consisting of images showing empty shelves or low item counts, has been connected to the Telegram API to notify store staff to restock as needed, streamlining the restocking process. This versatile application can be used for inventory management, research, and development and can also be integrated with commercial retail stores, utilizing CCTV cameras for monitoring.

Keywords:

Computer vision, Deep Convolutional Neural Network, Machine Learning, Object detection, YOLO algorithm.

References:

[1] Klaus Fuchs, Tobias Grundmann, and Elgar Fleisch, “Towards Identification of Packaged Products via Computer Vision: Convolutional Neural Networks for Object Detection and Image Classification in Retail Environments,” Proceedings of the 9th International Conference on the Internet of Things, pp. 1-8, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[2] Yuanqiang Cai et al., “Rethinking Object Detection in Retail Stores,” Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 2, pp. 947-954, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[3] Tausif Diwan, G. Anirudh, and Jitendra V. Tembhurne, “Object Detection Using YOLO: Challenges, Architectural Successors, Datasets and Applications,” Multimedia Tools and Applications, vol. 82, pp. 9243-9275, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[4] Peiyuan Jiang et al., “A Review of Yolo Algorithm Developments,” Procedia Computer Science, vol. 199, no. 4, pp. 1066-1073, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[5] Tanvir Ahmad et al., “Object Detection through Modified YOLO Neural Network,” Scientific Programming, vol. 2020, no. 1, pp. 1-10, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[6] S. Geethapriya, N. Duraimurugan, and S.P. Chokkalingam, “Real-Time Object Detection with Yolo,” International Journal of Engineering and Advanced Technology (IJEAT), vol. 8, no. 3S, pp. 578-581, 2019.
[Google Scholar] [Publisher Link]
[7] F. Sultana, A. Sufian, and P. Dutta, “A Review of Object Detection Models Based on Convolutional Neural Network,” Intelligent Computing: Image Processing Based Applications, pp. 1-16, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[8] Wang Zhiqiang, and Liu Jun, “A Review of Object Detection Based on Convolutional Neural Network,” 2017 36th Chinese Control Conference (CCC), Dalian, China, pp. 11104-11109, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[9] Zhong-Qiu Zhao et al., “Object Detection with Deep Learning: A Review,” IEEE Transactions on Neural Networks and Learning Systems, vol. 30, no. 11, pp. 3212-3232, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[10] Xinrui Zou et al., “A Review of Object Detection Techniques,” 2019 International Conference on Smart Grid and Electrical Automation (ICSGEA), Xiangtan, China, pp. 251-254, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[11] Rayson Laroca et al., “A Robust Real-Time Automatic License Plate Recognition based on the YOLO Detector,” 2018 International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, Brazil, pp. 1-10, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[12] Yunong Tian et al., “Apple Detection During Different Growth Stages in Orchards Using the Improved YOLO-V3 Model,” Computers and Electronics in Agriculture, vol. 157, pp. 417-426, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[13] Yonten Jamtsho, Panomkhawn Riyamongkol, and Rattapoom Waranusast, “Real-Time License Plate Detection for Non-Helmeted Motorcyclist Using YOLO,” ICT Express, vol. 7, no. 1, pp. 104-109, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[14] Jian Han et al., “Target Fusion Detection of LiDAR and Camera Based on the Improved YOLO Algorithm,” Mathematics, vol. 6, no. 10, pp. 1-16, 2018.
[CrossRef] [Google Scholar] [Publisher Link]