Robot Multi-Modal Object Perception and Recognition: Synthetic Maturation of Sensorimotor Learning in Embodied Systems

Abstract

It is known that during early infancy, humans experience many physical and cognitive changes that shape their learning and refine their understanding of objects in the world. With the extended arm being one of the very first objects they familiarise, infants undergo a series of developmental stages that progressively facilitate physical interactions, enrich sensory information and develop the skills to learn and recognise. Drawing inspiration from infancy, this study deals with the modelling of an open-ended learning mechanism for embodied agents that considers the cumulative and increasing complexity of physical interactions with the world. The proposed system achieves object perception, and recognition as the agent (i.e., a humanoid robot) matures, experiences changes to its visual capabilities, develops sensorimotor control, and interacts with objects within its reach. The reported findings demonstrate the critical role of developing vision on the effectiveness of object learning and recognition and the importance of reaching and grasping in solving visually elicited ambiguities. Impediments caused by the interdependency of parallel components responsible for the agent’s physical and cognitive functionalities are exposed, demonstrating an interesting phase transition in utilising object perceptions for recognition.

Publication DOI: https://doi.org/10.1109/TCDS.2020.2965985
Divisions: College of Engineering & Physical Sciences
Additional Information: © 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. Funding: This research is supported by the UK Engineering and Physical Sciences Research Council (EPSRC), grant No. EP/M013510/1.
Uncontrolled Keywords: Multi-modal object learning,developmental learning,iCub robot.,longitudinal study,reaching,vision,Software,Artificial Intelligence
Publication ISSN: 2379-8939
Last Modified: 25 Mar 2024 08:58
Date Deposited: 27 Jan 2020 14:32
Full Text Link:
Related URLs: https://ieeexpl ... ocument/8957396 (Publisher URL)
http://www.scop ... tnerID=8YFLogxK (Scopus URL)
PURE Output Type: Article
Published Date: 2020-01-13
Published Online Date: 2020-01-13
Accepted Date: 2020-01-01
Authors: Braud, Raphaël
Giagkos, Alexandros (ORCID Profile 0000-0001-6419-8966)
Shaw, Patricia
Lee, Mark
Shen, Qiang

Download

[img]

Version: Accepted Version

| Preview

Export / Share Citation


Statistics

Additional statistics for this record