Social activity recognition based on probabilistic merging of skeleton features with proximity priors from RGB-D data


Social activity based on body motion is a key feature for non-verbal and physical behavior defined as function for communicative signal and social interaction between individuals. Social activity recognition is important to study human-human communication and also human-robot interaction. Based on that, this research has threefold goals: (1) recognition of social behavior (e.g. human-human interaction) using a probabilistic approach that merges spatio-temporal features from individual bodies and social features from the relationship between two individuals; (2) learn priors based on physical proximity between individuals during an interaction using proxemics theory to feed a probabilistic ensemble of activity classifiers; and (3) provide a public dataset with RGB-D data of social daily activities including risk situations useful to test approaches for assisted living, since this type of dataset is still missing. Results show that using the proposed approach designed to merge features with different semantics and proximity priors improves the classification performance in terms of precision, recall and accuracy when compared with other approaches that employ alternative strategies.

Publication DOI:
Divisions: College of Engineering & Physical Sciences
Additional Information: ©2016 Crown
Event Title: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems
Event Type: Other
Event Location: Daejeon Convention Center
Event Dates: 2016-10-09 - 2016-10-14
Uncontrolled Keywords: Control and Systems Engineering,Software,Computer Vision and Pattern Recognition,Computer Science Applications
ISBN: 978-1-5090-3762-9
Last Modified: 01 Apr 2024 07:52
Date Deposited: 20 Jan 2017 08:09
Full Text Link:
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
PURE Output Type: Conference contribution
Published Date: 2016-12-01
Accepted Date: 2016-10-01
Authors: Coppola, Claudio
Faria, Diego R. (ORCID Profile 0000-0002-2771-1713)
Nunes, Urbano
Bellotto, Nicola



Version: Published Version

Export / Share Citation


Additional statistics for this record