PAC-GAN:An Effective Pose Augmentation Scheme for Unsupervised Cross-View Person Re-identification

Abstract

Person re-identification (person Re-Id) aims to retrieve the pedestrian images of the same person that captured by disjoint and non-overlapping cameras. Lots of researchers recently focused on this hot issue and proposed deep learning based methods to enhance the recognition rate in a supervised or unsupervised manner. However,there are two limitations that cannot be ignored: firstly, compared with other image retrieval benchmarks, the size of existing person Re-Id datasets is far from meeting the requirement, which cannot provide sufficient pedestrian samples for the training of deep model; secondly, the samples in existing datasets do not have sufficient human motions or postures coverage to provide more priori knowledges for learning. In this paper, we introduce a novel unsupervised pose augmentation cross-view person Re-Id scheme called PAC-GAN to overcome these limitations. We firstly present the formal definition of cross-view pose augmentation and then propose the framework of PAC-GAN that is a novel conditional generative adversarial network (CGAN) based approach to improve the performance of unsupervised corss-view person Re-Id. Specifically, the pose generation model in PAC-GAN called CPG-Net is to generate enough quantity of pose-rich samples from original image and skeleton samples. The pose augmentation dataset is produced by combining the synthesized pose-rich samples with the original samples, which is fed into the corss-view person Re-Id model named Cross-GAN. Besides, we use weight-sharing strategy in the CPG-Net to improve the quality of new generated samples. To the best of our knowledge, we are the first to enhance the unsupervised cross-view person Re-Id by pose augmentation, and the results of extensive experiments show that the proposed scheme can combat the state-of-the-arts with recognition rate.

Publication DOI: https://doi.org/10.1016/j.neucom.2019.12.094
Divisions: College of Engineering & Physical Sciences > Systems analytics research institute (SARI)
College of Engineering & Physical Sciences
Additional Information: © 2019, Elsevier. Licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/ Funding: National Natural Science Foundation of China (61702560, 61836016, 61672177), project (2018JJ3691, 2016JC2011) of Science and Technology Plan of Hunan Province, and the Research and Innovation Project of Central South University Graduate Students(2018zzts177, 2018zzts588).
Uncontrolled Keywords: Cross-view Person Re-Id,Pose Augmentation,Generative Adversarial Networks,Unsupervised Learning
Publication ISSN: 1872-8286
Last Modified: 30 Sep 2024 12:18
Date Deposited: 06 Jan 2020 11:18
Full Text Link: https://arxiv.o ... /1906.01792.pdf
Related URLs: https://linking ... 925231219318090 (Publisher URL)
PURE Output Type: Article
Published Date: 2020-04-28
Published Online Date: 2019-12-27
Accepted Date: 2019-12-23
Authors: Zhang, Chengyuan
Zhu, Lei
Zhang, Shichao
Yu, Weiren (ORCID Profile 0000-0002-1082-9475)

Export / Share Citation


Statistics

Additional statistics for this record