Multi-Target Vision Detection and Grasping of Electronic Devices Using DL-SORT

Hong Wang

Abstract


Many production industries are increasingly dependent on intelligent electronic devices. However, traditional methods for recognizing and detecting electronic devices are inefficient and consume a large amount of production resources. This study introduces a hybrid DL-SORT model for automatic recognition and grasping of electronic devices, integrating deep learning with Simple Online and Realtime Tracking (SORT) to enhance object detection performance. In the model, Recursive labeling and Binary Robust Independent Elementary Features are also employed for key point detection and domain selection. Experimental results show that the hybrid algorithm outperforms Single Shot MultiBox Detector and Discriminative Correlation Filter with Channel and Spatial Reliability in terms of object detection performance, with loss values of 0.15, 0.24, and 0.23, respectively. Additionally, empirical analysis of the constructed hybrid model reveals that the proposed automatic recognition and grasping model for electronic devices achieves an accuracy of 0.95 in tape recognition, demonstrating good recognition accuracy. Testing in obstructed environments shows that the success rate of part detection remains above 80%, with minimal performance degradation. These results suggest that the hybrid model can detect multiple targets and improve production efficiency. This study contributes to the future development of drones and industrial robots in the automation field, enabling the acquisition of precise target location information.


Full Text:

PDF

References


Yin W, He K, Xu D, Yue Y, Luo Y. Adaptive low light visual enhancement and high-significant target detection for infrared and visible image fusion. The Visual Computer, 2023, 39(12):6723-6742.

Tang D, Yu W, Lv X, Wang, G., Shen W. Research progress on pole-climbing robots: a review. Recent Patents on Engineering, 2024, 18(8):32-59.

Ruan D, Zhang W, Qian D. Feature-based autonomous target recognition and grasping of industrial robots. Personal and Ubiquitous Computing, 2023, 27(3):1355-1367.

Yang L, Wang H, Zheng J, Duan X, Cheng Q. Research and application of visual object recognition system based on deep learning and neural morphological computation. International Journal of Computer Science and Information Technology, 2024, 2(1):10-17.

Wan X, Liu Y, Mei X, Ye J, Zeng C, Chen Y. A novel atrial fibrillation automatic detection algorithm based on ensemble learning and multi-feature discrimination. Medical & Biological Engineering & Computing, 2024, 62(6):1809-1820.

Sun X, Liu K, Chen L, Cai Y, Wang H. LLTH-YOLOv5: a real-time traffic sign detection algorithm for low-light scenes. Automotive Innovation, 2024, 7(1):121-137.

Zhang X Y, Fan R, Liu W M, Xue, J F, Liu Q C. Optimization method for robot moving object recognition and grasping strategy based on binocular vision. Journal of Computers, 2024, 35(1):207-215.

Lin S, Zeng C, Yang C. Robot grasping based on object shape approximation and LightGBM. Multimedia Tools and Applications, 2024, 83(3):9103-9119.

Wang Y, Guo Z, Chen Y, Guo C, Xia M, Qi T. A robot grasping detection network based on flexible selection of multi-modal feature fusion structure. Applied Intelligence, 2024, 54(6):5044-5061.

Liu W, Xu M, Jiang H. Design, integration, and experiment of transplanting robot for early plug tray seedling in a plant factory. AgriEngineering, 2024, 6(1):678-697.

Yan S, Zhang L. CR‐Net: Robot grasping detection method integrating convolutional block attention module and residual module. IET Computer Vision, 2024, 18(3):420-433.

Li F, Xiao K, Hu Z, Zhang G. Fabric defect detection algorithm based on improved YOLOv5. The Visual Computer, 2024, 40(4):2309-2324.

Wang H, Fu L, Wang L. Detection algorithm of aircraft skin defects based on improved YOLOv8n. Signal, Image and Video Processing, 2024, 18(4):3877-3891.

Ji C, Zhang F, Huang X, Song Z, Hou W, Wang B, Chen G. STAE‐YOLO: Intelligent detection algorithm for risk management of construction machinery intrusion on transmission lines based on visual perception. IET Generation, Transmission & Distribution, 2024, 18(3):542-567.

Ren Z. Enhanced YOLOv8 infrared image object detection method with SPD module. Journal of Theory and Practice in Engineering and Technology, 2024, 1(2):1-7.

Gong Y, Zhang H, Xu R, Yu Z, Zhang J. Innovative deep learning methods for precancerous lesion detection. International Journal of Innovative Research in Computer Science & Technology, 2024, 12(2):81-86.

He B, Qian S, Niu Y. Visual recognition and location algorithm based on optimized YOLOv3 detector and RGB depth camera. The Visual Computer, 2024, 40(3):1965-1981.

Yadav S P, Jindal M, Rani P, de Albuquerque V H C, dos Santos Nascimento C, Kumar M. An improved deep learning-based optimal object detection system from images. Multimedia Tools and Applications, 2024, 83(10):30045-30072.

Jugé V. Adaptive Shivers sort: an alternative sorting algorithm. ACM Transactions on Algorithms, 2024, 20(4):1-55.

Xie L, Luo S, Liu Y, Ruan X, Gong K, Ge Q, Zhang L. Automatic identification of individual nanoplastics by Raman spectroscopy based on machine learning. Environmental Science & Technology, 2023, 57(46):18203-18214.




DOI: https://doi.org/10.31449/inf.v49i25.8383

Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.