Social activity recognition based on probabilistic merging of skeleton features with proximity priors from RGB-D data

Coppola, Claudio, Faria, Diego R., Nunes, Urbano and Bellotto, Nicola (2016). Social activity recognition based on probabilistic merging of skeleton features with proximity priors from RGB-D data. IN: IROS 2016 - 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE International Conference on Intelligent Robots and Systems. Proceedings . IEEE.

Abstract

Social activity based on body motion is a key feature for non-verbal and physical behavior defined as function for communicative signal and social interaction between individuals. Social activity recognition is important to study human-human communication and also human-robot interaction. Based on that, this research has threefold goals: (1) recognition of social behavior (e.g. human-human interaction) using a probabilistic approach that merges spatio-temporal features from individual bodies and social features from the relationship between two individuals; (2) learn priors based on physical proximity between individuals during an interaction using proxemics theory to feed a probabilistic ensemble of activity classifiers; and (3) provide a public dataset with RGB-D data of social daily activities including risk situations useful to test approaches for assisted living, since this type of dataset is still missing. Results show that using the proposed approach designed to merge features with different semantics and proximity priors improves the classification performance in terms of precision, recall and accuracy when compared with other approaches that employ alternative strategies.

Publication DOI: https://doi.org/10.1109/IROS.2016.7759742
Divisions: Engineering & Applied Sciences
Additional Information: ©2016 Crown
Event Title: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems
Event Type: Other
Event Location: Daejeon Convention Center
Event Dates: 2016-10-09 - 2016-10-14
Uncontrolled Keywords: Control and Systems Engineering,Software,Computer Vision and Pattern Recognition,Computer Science Applications
Full Text Link:
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
Published Date: 2016-12-01
Authors: Coppola, Claudio
Faria, Diego R. ( 0000-0002-2771-1713)
Nunes, Urbano
Bellotto, Nicola

Download

[img]

Version: Published Version

License: ["licenses_description_other" not defined]


Export / Share Citation


Statistics

Additional statistics for this record