Hybrid Particle Filter with Color Histogram for Enhanced Robustness in Object Tracking
Abstract
In this paper, we describe a hybrid method for detecting and tracking moving objects in image sequences. Particle filters and color histograms are combined in the proposed method to address issues with occlusions, lighting variations, and object appearance. The goal of integrating these two techniques is to improve trackingrobustness. Experiments conducted in the OTB 2013 and OTB 2015 databases show that our method, called PFHist, outperforms several existing trackers. It achieves success up to 80% in terms of overlap rate and 94% accuracy in terms of center location error, especially in cases of partial or total occlusions. Moreover, the RGB color space has been shown to be more efficient than the HSV space, and the use of a reduced number of particles (100) allows for better performance while reducing computational cost. Future work will focus on the automatic selection of the optimal color space and on extending the method to multi-object tracking.References
P. A. Brasnett, L. Mihaylova, N. Canagarajah, and D. Bull, “Particle filtering with multiple cues for object tracking in video sequences,” in Image and Video
Communications and Processing 2005, vol. 5685, pp. 430–441, SPIE, 2005.
A. Doucet, S. Godsill, and C. Andrieu, “On sequential monte carlo sampling methods for bayesian filtering,”Statistics and computing, vol. 10, pp. 197–208, 2000.
A. Yilmaz, O. Javed, and M. Shah, “Object tracking: A survey,” ACM computing surveys, 2006.
K. Cannons, “Areviewof visual tracking,” Dept. Computer. Science. Eng., YorkUniv., Toronto, Canada, Tech. Rep.CSE-2008-07, vol. 242, 2008.
S. Balaji and S. Karthikeyan, “A survey on moving object tracking using image processing,” in 2017 11th international conference on intelligent systems and
control (ISCO), pp. 469–474, IEEE, 2017.
I. Pathan and C. Chauhan, “A survey on moving object detection and tracking methods,” in Computer Science, 2015.
S.MR and P. H.L, “A survey on moving object detection and tracking techniques,” International Journal Of Engineering And Computer Science, 05 2016.
R. Sharma and S. Gupta, “A survey on moving object detection and tracking based on background subtraction,” The Oxford Journal of Intelligent Decision and
Data Science, vol. 2018, pp. 55–62, 01 2018.
R. E. Kalman, “A new approach to linear filtering and prediction problems,” Transaction of the ASMEJournal of Basic Engineering, p. 35–45, 1960.
S.-Y. Chen, “Kalman filter for robot vision: a survey,” IEEE Transactions on industrial electronics, vol. 59, no. 11, pp. 4409–4420, 2011.
T. J. Broida and R. Chellappa, “Estimation of object motion parameters from noisy images,” IEEE transactions on pattern analysis and machine intelligence,
no. 1, pp. 90–99, 1986.
D. Beymer, K. Konolige, and M. Park, “Real-time tracking of multiple people using continuous detection,” in IEEE Frame Rate Workshop, pp. 1–8, Citeseer, 1999.
D. Ponsa, A. L´opez, J. Serrat, F. Lumbreras, and T. Graf, “Multiple vehicle 3d tracking using an unscented kalman,” in Proceedings. 2005 IEEE IntelligentTransportation Systems, 2005., pp. 1108–1113, IEEE, 2005.
K. Robert, “Night-time traffic surveillance: A robust framework for multi-vehicle detection, classification and tracking,” in 2009 Sixth IEEE International Conference
on Advanced Video and Signal Based Surveillance, pp. 1–6, IEEE, 2009.
N. J. Gordon, D. J. Salmond, and A. F. Smith, “Novel approach to nonlinear/non-gaussian bayesian state estimation,” in IEE proceedings F (radar and signal processing), vol. 140,2, pp. 107–113, IET, 1993.
G. Kitagawa, “Monte carlo filter and smoother for non-gaussian nonlinear state space models,” Journal of computational and graphical statistics, vol. 5, no. 1,
pp. 1–25, 1996.
E. Arnaud, E. Memin, and B. Cernuschi-Frias, “Conditional filters for image sequence-based tracking application to point tracking,” IEEE Transactions on
image processing, vol. 14, no. 1, pp. 63–79, 2004.
D. Reid, “An algorithm for tracking multiple targets,” IEEE transactions on Automatic Control, vol. 24, no. 6, pp. 843–854, 1979.
I. J. Cox and S. L. Hingorani, “An efficient implementation of reid’s multiple hypothesis tracking algorithm and its evaluation for the purpose of visual tracking,”IEEE Transactions on pattern analysis and machine intelligence, vol. 18, no. 2, pp. 138–150, 1996.
S. Birchfield, “Elliptical head tracking using intensity gradients and color histograms,” in Proceedings. 1998 IEEE Computer Society conference on computer
vision and pattern recognition (Cat. No. 98CB36231), pp. 232–237, IEEE, 1998.
H. Schweitzer, J. W. Bell, and F. Wu, “Very fast template matching,” in European Conference on Computer Vision, pp. 358–372, Springer, 2002.
M. Kristan, J. Matas, A. Leonardis, M. Felsberg, L. Cehovin, G. Fernandez, T.Vojir, G. Hager, G.Nebehay, and R. Pflugfelder, “The visual object tracking vot2015 challenge results,” in Proceedings of the IEEE international conference on computer vision workshops, pp. 1–23, 2015.
J. Santner, C. Leistner, A. Saffari, T. Pock, and H. Bischof, “Prost: Parallel robust online simple tracking,” in 2010 IEEE computer society conference on computer vision and pattern recognition, pp. 723–730, IEEE, 2010.
Z. Kalal, K. Mikolajczyk, and J. Matas, “Trackinglearning- detection,” IEEE transactions on pattern analysis and machine intelligence, vol. 34, no. 7, pp. 1409–1422, 2011.
D. Comaniciu, V. Ramesh, and P. Meer, “Real-time tracking of non-rigid objects using mean shift,” in Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No. PR00662), vol. 2, pp. 142–149, IEEE, 2000.
D. Comaniciu and P. Meer, “Mean shift: A robust approach toward feature space analysis,” IEEE Transactions on pattern analysis and machine intelligence, vol. 24, no. 5, pp. 603–619, 2002.
D. Comaniciu,V. Ramesh, and P. Meer, “Kernel-based object tracking,” IEEE Transactions on pattern analysis and machine intelligence, vol. 25, no. 5, pp. 564–577, 2003.
S. Avidan, “Support vector tracking,” IEEE transactions on pattern analysis and machine intelligence, vol. 26, no. 8, pp. 1064–1072, 2004.
R. Mishra, M. K. Chouhan, and D. D. Nitnawwre, “Multiple object tracking by kernel based centroid method for improve localization,” International Journal of Advanced Research in Computer Science and Software Engineering, vol. 2, no. 7, pp. 137–140, 2012.
M. J. Black and A. D. Jepson, “Eigentracking: Robust matching and tracking of articulated objects using a view-based representation,” International Journal of Computer Vision, vol. 26, pp. 63–84, 1998.
Q. Wang, F. Chen, W. Xu, and M.-H. Yang, “Object tracking via partial least squares analysis,” IEEE Transactions on Image Processing, vol. 21, no. 10, pp. 4454–4465, 2012.
X. Li, W. Hu, Z. Zhang, X. Zhang, and G. Luo, “Robust visual tracking based on incremental tensor subspace learning,” in 2007 IEEE 11th international conference
on computer vision, pp. 1–8, IEEE, 2007.
J.Wen, X. Li, X. Gao, and D. Tao, “Incremental learning of weighted tensor subspace for visual tracking,” in 2009 IEEE International Conference on Systems,
Man and Cybernetics, pp. 3688–3693, IEEE, 2009.
S. Boltz, A statistical framework in variational methods of image and video processing problems with high dimensions. PhD thesis, Universit´e Nice Sophia Antipolis, 2008.
A. Elgammal, R. Duraiswami, and L. S. Davis, “Probabilistic tracking in joint feature-spatial spaces,” in 2003 IEEE Computer Society Conference on Computer
Vision and Pattern Recognition, 2003. Proceedings, vol. 1, pp. I–I, IEEE, 2003.
V. Garcia, Suivi d’objets d’int´erˆet dans une séquence d‘images : des points saillants aux mesures statistiques. PhD thesis, University of Nice – Sophia Antipolis,
D. P. Huttenlocher, J. J. Noh, and W. J. Rucklidge, “Tracking non-rigid objects in complex scenes,” in 1993 (4th) International Conference on Computer Vision,
pp. 93–101, IEEE, 1993.
L. Ma, J. Liu, J. Wang, J. Cheng, and H. Lu, “A improved silhouette tracking approach integrating particle filter with graph cuts,” in 2010 IEEE International
Conference on Acoustics, Speech and Signal Processing, pp. 1142–1145, IEEE, 2010.
B. Li, R. Chellappa, Q. Zheng, and S. Z. Der, “Model based temporal object verification using video,” IEEE Transactions on Image Processing, vol. 10, no. 6, pp. 897–908, 2001.
D. Terzopoulos and R. Szeliski, “Tracking with kalman snakes,” Active vision, vol. 20, pp. 3–20, 1992.
J. MacCormick and A. Blake, “Probabilistic exclusion and partitioned sampling for multiple object tracking,” International Journal of Computer Vision, vol. 39,
no. 1, pp. 57–71, 2000.
Y. Chen, Y. Rui, and T. S. Huang, “Jpdaf based hmm for real-time contour tracking,” in Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001, vol. 1, pp. I–I, IEEE, 2001.
M. Bertalmio, G. Sapiro, and G. Randall, “Morphing active contours,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 7, pp. 733–
, 2000.
A.-R. Mansouri, “Region tracking via level set PDEs without motion computation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 947–961, 2002.
K. Safjan, “Metrics used to compare histograms,” Krystian’s Safjan Blog, 2020.
Y. Wu, J. Lim, and M.-H. Yang, “Online object tracking: A benchmark,” in Proceedings of the IEEE conference on computer vision and pattern recognition,
pp. 2411–2418, 2013.
A.W. Smeulders, D. M. Chu, R. Cucchiara, S. Calderara, A. Dehghan, and M. Shah, “Visual tracking: An experimental survey,” IEEE transactions on pattern
analysis and machine intelligence, vol. 36, no. 7, pp. 1442–1468, 2013.
L. Cˇ ehovin, M. Kristan, and A. Leonardis, “Is my new tracker really better than yours?,” in IEEE Winter Conference on Applications of Computer Vision,
pp. 540–547, IEEE, 2014.
D. A. Ross, J. Lim, R.-S. Lin, and M.-H. Yang, “Incremental learning for robust visual tracking,” International journal of computer vision, vol. 77, pp. 125–
, 2008.
J. Kwon and K. M. Lee, “Visual tracking decomposition,” in 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1269–1276, IEEE, 2010.
B. Babenko, M.-H. Yang, and S. Belongie, “Visual tracking with online multiple instance learning,” in 2009 IEEE Conference on computer vision and Pattern
Recognition, pp. 983–990, IEEE, 2009.
A. Adam, E. Rivlin, and I. Shimshoni, “Robust fragments-based tracking using the integral histogram,” in 2006 IEEE Computer society conference on computer vision and pattern recognition (CVPR’06), vol. 1, pp. 798–805, IEEE, 2006.
I. Leang, Fusion en ligne d’algorithmes de suivi visuel d’objet. PhD thesis, Pierre et Marie Curie-Paris VI University, 2016.
S. MEDOUAKH, Détection et suivi d’objets. PhD thesis, Mohamed Khider University, Biskra, Algeria, 2019.
DOI:
https://doi.org/10.31449/inf.v49i30.10279Downloads
Published
How to Cite
Issue
Section
License
I assign to Informatica, An International Journal of Computing and Informatics ("Journal") the copyright in the manuscript identified above and any additional material (figures, tables, illustrations, software or other information intended for publication) submitted as part of or as a supplement to the manuscript ("Paper") in all forms and media throughout the world, in all languages, for the full term of copyright, effective when and if the article is accepted for publication. This transfer includes the right to reproduce and/or to distribute the Paper to other journals or digital libraries in electronic and online forms and systems.
I understand that I retain the rights to use the pre-prints, off-prints, accepted manuscript and published journal Paper for personal use, scholarly purposes and internal institutional use.
In certain cases, I can ask for retaining the publishing rights of the Paper. The Journal can permit or deny the request for publishing rights, to which I fully agree.
I declare that the submitted Paper is original, has been written by the stated authors and has not been published elsewhere nor is currently being considered for publication by any other journal and will not be submitted for such review while under review by this Journal. The Paper contains no material that violates proprietary rights of any other person or entity. I have obtained written permission from copyright owners for any excerpts from copyrighted works that are included and have credited the sources in my article. I have informed the co-author(s) of the terms of this publishing agreement.
Copyright © Slovenian Society Informatika
