Discovering Schema-based Action Sequences through Play in Situated Humanoid Robots


Exercising sensorimotor and cognitive functions allows humans, including infants, to interact with the environment and objects within it. In particular, during everyday activities, infants continuously enrich their repertoire of actions, and by playing, they experimentally plan such actions in sequences to achieve desired goals. The latter, reflected as perceptual target states, are built on previously acquired experiences shaped by infants to predict their actions. Imitating this, in developmental robotics, we seek methods that allow autonomous embodied agents with no prior knowledge to acquire information about the environment. Like infants, robots that actively explore the surroundings and manipulate proximate objects are capable of learning. Their understanding of the environment develops through the discovery of actions and their association with the resulting perceptions in the world. We extend the development of Dev-PSchema, a schema-based, open-ended learning system, and examine the infant-like discovery process of new generalised skills while engaging with objects in free-play using an iCub robot. Our experiments demonstrate the capability of Dev-PSchema to utilise the newly discovered skills to solve user-defined goals beyond its past experiences. The robot can generate and evaluate sequences of interdependent high-level actions to form potential solutions and ultimately solve complex problems towards tool-use.

Publication DOI:
Divisions: College of Engineering & Physical Sciences
Additional Information: © 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. Funding: The Aberystwyth University Doctoral Training Programme supports this research, as well as the Faculty Development Program Sukkur IBA University Pakistan and the UK Engineering and Physical Sciences Research Council (EPSRC), grant No. EP/M013510/1.
Uncontrolled Keywords: Robots,Robot sensing systems,Visualization,Task analysis,Learning systems,Trajectory,Toy manufacturing industry
Publication ISSN: 2379-8939
Last Modified: 14 May 2024 07:26
Date Deposited: 08 Jul 2021 08:30
Full Text Link: https://ieeexpl ... cument/9474336/
Related URLs:
PURE Output Type: Article
Published Date: 2021-07-05
Published Online Date: 2021-07-05
Accepted Date: 2021-07-05
Authors: Kumar, Suresh
Giagkos, Alexandros (ORCID Profile 0000-0001-6419-8966)
Shaw, Patricia
Braud, Raphaël
Lee, Mark
Shen, Qiang



Version: Accepted Version

| Preview

Export / Share Citation


Additional statistics for this record