logo

SCIENCE CHINA Information Sciences, Volume 61, Issue 9: 092108(2018) https://doi.org/10.1007/s11432-016-9086-8

Histogram of the node strength and histogram of the edge weight: two new features for RGB-D person re-identification

More info
  • ReceivedJan 17, 2017
  • AcceptedMar 16, 2017
  • PublishedMay 21, 2018

Abstract

Person re-identification is a classical task for any multi-camera surveillance system. Most of the existing researches on re-identification are based on features extracted from RGB images. However, there are many deficiencies in RGB image processing, some of which are requiring a lot of illumination and high computation. In this paper, novel features are proposed for RGB-D person re-identification. First, the complex network approach in texture recognition is modified and its threshold function is changed for using in depth images extracted by RGB-D sensors. Then, two novel measurements named the histogram of the edge weight (HEW) and the histogram of the node strength (HNS) are introduced on complex networks. Our features fit both single-shot and multi-shot person re-identification. In the single-shot case, the HNS is extracted from only one frame while for the multi-shot case it is extracted from both one frame and multi-frames. These proposed measurements are called histogram of the spatial node strength (HSNS) and histogram of the temporal node strength (HTNS) respectively. Subsequently, these measurements are combined with skeleton features using score-level fusion. The method is evaluated using two benchmark databases and the results show that ours outperforms some state-of-the-art methods.


References

[1] Guillaumin M, Verbeek J, Schmid C. Is that you? Metric learning approaches for face identification. In: Proceedings of 12th International Conference on Computer Vision (ICCV), Kyoto, 2009. 498--505. Google Scholar

[2] Wang L, Tan T N, Ning H Z, et al. Silhouette analysis based gait recognition for human identification. IEEE Trans Pattern Anal Mach Intell, 2003, 25: 1505--1518. Google Scholar

[3] Cong D N T, Khoudour L, Achard C, et al. People re-identification by spectral classification of silhouettes. Signal Process, 2010, 90: 2362--2374. Google Scholar

[4] Bedagkar-Gala A, Shah S K. A survey of approaches and trends in person re-identification. Image Vis Comput, 2014, 32: 270--286. Google Scholar

[5] Geng Y B, Hu H M, Zeng G D, et al. A person re-identification algorithm by exploiting region-based feature salience. J Vis Commun Image Represent, 2015, 29: 89--102. Google Scholar

[6] Schwartz W, Davis L. Learning discriminative appearance-based models using partial least squares. In: Proceedings of XXII Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI), Rio de Janiero, 2009. 322--329. Google Scholar

[7] Farenzena M, Bazzani L, Perina A, et al. Person re-identification by symmetry-driven accumulation of local features. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, 2010. 2360--2367. Google Scholar

[8] Ma B, Su Y, Jurie F. Covariance descriptor based on bio-inspired features for person re-identification and face verification. Image Vision Computing, 2014, 32: 379-390 CrossRef Google Scholar

[9] Cheng D S, Cristani M, Stoppa M, et al. Custom pictorial structures for re-identification. In: Proceedings of the British Machine Vision Conference (BMVC), Dundee, 2011. 68.1--68.11. Google Scholar

[10] Zhao R, Ouyang W L, Wang X G. Unsupervised salience learning for person re-identification. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, 2013. 3586--3593. Google Scholar

[11] Zhao R, Oyang W, Wang X. Person Re-Identification by Saliency Learning. IEEE Trans Pattern Anal Mach Intell, 2017, 39: 356-370 CrossRef Google Scholar

[12] Si J L, Zhang H G, Li C-G, et al. Spatial pyramid-based statistical features for person re-identification: a comprehensive evaluation. IEEE Trans Syst Man Cybern Syst, 2017, 99: 1--5. Google Scholar

[13] Lan R, Zhou Y, Tang Y Y. Quaternionic Local Ranking Binary Pattern: A Local Descriptor of Color Images. IEEE Trans Image Process, 2016, 25: 566-579 CrossRef Google Scholar

[14] Prosser B, Zheng W S, Gong S G, et al. Person re-identification by support vector ranking. In: Proceedings of the British Machine Vision Conference (BMVC), Aberystwyth, 2010. 21.1--21.11. Google Scholar

[15] Bashir K, Xiang T, Gong S G. Feature selection on gait energy image for human identification. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Las Vegas, 2008. 985--988. Google Scholar

[16] Zheng W S, Gong S G, Xiang T. Person re-identification by probabilistic relative distance comparison. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, 2011. 649--656. Google Scholar

[17] Loy C C, Liu C X, Gong S G. Person re-identification by manifold ranking. In: Proceedings of IEEE International Conference on Image Processing, Melbourne, 2013. 3567--3571. Google Scholar

[18] Figueira D, Bazzani L, Minh H Q, et al. Semisupervised multi-feature learning for person re-identification. In: Proceedings of 10th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Krakow, 2013. 111--116. Google Scholar

[19] Kostinger M, Hirzer M, Wohlhart P, et al. Large scale metric learning from equivalence constraints. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, 2012. 2288--2295. Google Scholar

[20] Tao D, Guo Y, Song M. Person Re-Identification by Dual-Regularized KISS Metric Learning. IEEE Trans Image Process, 2016, 25: 2726-2738 CrossRef Google Scholar

[21] Mignon A, Jurie F. PCCA: a new approach for distance learning from sparse pairwise constraints. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, 2012. 2666--2672. Google Scholar

[22] Liu H, Ma B, Qin L. Set-label modeling and deep metric learning on person re-identification. Neurocomputing, 2015, 151: 1283-1292 CrossRef Google Scholar

[23] Vezzani R, Baltieri D, Cucchiara R. People re-identification in surveillance and forensics: a survey. ACM Comput Surv, 2013, 46: 29. Google Scholar

[24] Chen S Z, Guo C C, Lai J H. Deep Ranking for Person Re-Identification via Joint Representation Learning. IEEE Trans Image Process, 2016, 25: 2353-2367 CrossRef Google Scholar

[25] Barbosa I B, Cristani M, Bue A D, et al. Re-identification with RGB-D sensors. In: Fusiello A, Murino V, Cucchiara R, eds. Computer Vision ECCV, Workshops and Demonstrations. Berlin/Heidelberg: Springer-Verlag, 2012. 433--442. Google Scholar

[26] Satta R, Pala F, Fumera G, et al. Real-time appearance-based person re-identification over multiple kinect cameras. In: Proceedings of the 8th International Conference on Computer Vision Theory and Applications (VISAPP), Barcelona, 2013. 21--24. Google Scholar

[27] Munaro M, Fossati A, Basso A, et al. One-shot person re-identification with a consumer depth camera. In: Gong S G, Cristani M, Yan S C, et al., eds. Person Re-identification. London: Springer, 2014. 161--181. Google Scholar

[28] Pala F, Satta R, Fumera G, et al. Multi-modal person re-identification using RGB-D cameras. IEEE Trans Circuit Syst Video Technol, 2015, 26: 788--799. Google Scholar

[29] Munaro M B, Ghidoni S, Tartaro D T, et al. A feature-based approach to people re-identification using skeleton keypoints. In: Proceedings of IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, 2014. 5644--5651. Google Scholar

[30] Oliver J, Albiol A, Albiol A, et al. Using latent features for short-term person re-identification with RGB-D cameras. Pattern Anal Appl, 2015, 19: 549--561. Google Scholar

[31] Wu A C, Zheng W S, Lai J H. Depth-based person re-identification. In: Proceedings of the 3rd IAPR Asian Conference on Pattern Recognition, Kuala Lumpur, 2015. 026--030. Google Scholar

[32] Backes A R, Casanova D, Bruno O M. Texture analysis and classification: A complex network-based approach. Inf Sci, 2013, 219: 168-180 CrossRef Google Scholar

[33] Barabási A L, Oltvai Z N. Network biology: understanding the cell's functional organization.. Nat Rev Genet, 2004, 5: 101-113 CrossRef PubMed Google Scholar

[34] Newman M E J, Park J. Why social networks are different from other types of networks. Phys Rev E, 2003, 68: 036122 CrossRef PubMed ADS Google Scholar

[35] Gon?alves W N, Martinez A S, Bruno O M. Complex network classification using partially self-avoiding deterministic walks. Chaos, 2012, 22: 033139 CrossRef PubMed ADS Google Scholar

[36] Gon?alves W N, Machado B B, Bruno O M. A complex network approach for dynamic texture recognition. Neurocomputing, 2015, 153: 211-220 CrossRef Google Scholar

[37] Amaral L A N, Ottino J M. Complex networks: augmenting the framework for the study of complex systems. Eur Phys J B, 2004, 38: 147--162. Google Scholar

[38] Gon?alves W N, Backes A R, Martinez A S. Texture descriptor based on partially self-avoiding deterministic walker on networks. Expert Syst Appl, 2012, 39: 11818-11829 CrossRef Google Scholar

[39] Gonçalves W N, Silva J A, Bruno O M. A rotation invariant face recognition method based on complex network. In: Bloch I, Cesar R M, eds. Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications. CIARP 2010. Berlin/Heidelberg: Springer, 2010. 426--433. Google Scholar

[40] Costa L F, Rodrigues F A, Travieso G, et al. Characterization of complex networks: a survey of measurements. Adv Phys, 2006, 56: 167--242. Google Scholar

[41] Bazzani L, Farenzena M, Perina A, et al. Multiple-shot person re-identification by HPE signature. In: Proceedings of IEEE International Conference on Pattern Recognition, Istanbul, 2010. 1413--1416. Google Scholar

Copyright 2019 Science China Press Co., Ltd. 《中国科学》杂志社有限责任公司 版权所有

京ICP备18024590号-1