Event-based pedestrian detection using dynamic vision sensors


Pedestrian detection has attracted great research attention in video surveillance, traffic statistics, and especially in autonomous driving. To date, almost all pedestrian detection solutions are derived from conventional framed-based image sensors with limited reaction speed and high data redundancy. Dynamic vision sensor (DVS), which is inspired by biological retinas, efficiently captures the visual information with sparse, asynchronous events rather than dense, synchronous frames. It can eliminate redundant data transmission and avoid motion blur or data leakage in high-speed imaging applications. However, it is usually impractical to directly apply the event streams to conventional object detection algorithms. For this issue, we first propose a novel event-to-frame conversion method by integrating the inherent characteristics of events more efficiently. Moreover, we design an improved feature extraction network that can reuse intermediate features to further reduce the computational effort. We evaluate the performance of our proposed method on a custom dataset containing multiple real-world pedestrian scenes. The results indicate that our proposed method raised its pedestrian detection accuracy by about 5.6–10.8%, and its detection speed is nearly 20% faster than previously reported methods. Furthermore, it can achieve a processing speed of about 26 FPS and an AP of 87.43% when implanted on a single CPU so that it fully meets the requirement of real-time detection.

Publication DOI: https://doi.org/10.3390/electronics10080888
Divisions: College of Business and Social Sciences > Aston Business School
College of Business and Social Sciences > Aston Business School > Operations & Information Management
Additional Information: © 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https:// creativecommons.org/licenses/by/ 4.0/). Funding Information: Funding: This research was funded by the National Key Research and Development Project (No. 2019YFC0117302), NSFC Youth Fund (No. 62004201), NSFC Youth Fund (No. 61704179), Shanghai Municipal Science and Technology Commission project (No. 19511131202), Pudong Economic and Technological Commission project (No. PKX2019-D02), Strategic Priority Research Program of Chinese Academy of Sciences (No. XDC02070700), Talents Project of Shanghai Advanced Research Institute Chinese Academy of Science (No. E052891ZZ1).
Uncontrolled Keywords: Autonomous driving,Dynamic vision sensor,Event data,Pedestrian detection,Control and Systems Engineering,Signal Processing,Hardware and Architecture,Computer Networks and Communications,Electrical and Electronic Engineering
Publication ISSN: 2079-9292
Full Text Link:
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
https://www.mdp ... 9-9292/10/8/888 (Publisher URL)
PURE Output Type: Article
Published Date: 2021-04-08
Accepted Date: 2021-04-02
Authors: Wan, Jixiang
Xia, Ming
Huang, Zunkai
Tian, Li
Zheng, Xiaoying
Chang, Victor (ORCID Profile 0000-0002-8012-5852)
Zhu, Yongxin
Wang, Hui



Version: Accepted Version

License: Creative Commons Attribution

| Preview

Export / Share Citation


Additional statistics for this record