Perceptions or Actions? Grounding How Agents Interact Within a Software Architecture for Cognitive Robotics


One of the aims of cognitive robotics is to endow robots with the ability to plan solutions for complex goals and then to enact those plans. Additionally, robots should react properly upon encountering unexpected changes in their environment that are not part of their planned course of actions. This requires a close coupling between deliberative and reactive control flows. From the perspective of robotics, this coupling generally entails a tightly integrated perceptuomotor system, which is then loosely connected to some specific form of deliberative system such as a planner. From the high-level perspective of automated planning, the emphasis is on a highly functional system that, taken to its extreme, calls perceptual and motor modules as services when required. This paper proposes to join the perceptual and acting perspectives via a unique representation where the responses of all software modules in the architecture are generalized using the same set of tokens. The proposed representation integrates symbolic and metric information. The proposed approach has been successfully tested in CLARC, a robot that performs Comprehensive Geriatric Assessments of elderly patients. The robot was favourably appraised in a survey conducted to assess its behaviour. For instance, using a 5-point Likert scale from 1 (strongly disagree) to 5 (strongly agree), patients reported an average of 4.86 when asked if they felt confident during the interaction with the robot. This paper proposes a mechanism for bringing the perceptual and acting perspectives closer within a distributed robotics architecture. The idea is built on top of the blackboard model and scene graphs. The modules in our proposal communicate using a short-term memory, writing the perceptual information they need to share with other agents and accessing the information they need for determining the next goals to address.

Publication DOI:
Divisions: College of Engineering & Physical Sciences > School of Informatics and Digital Engineering > Computer Science
College of Engineering & Physical Sciences
Additional Information: © Springer Nature B.V. 2019. The final publication is available at Springer via
Uncontrolled Keywords: Automatic planning,Cognitive robotics,Software architectures,Computer Vision and Pattern Recognition,Computer Science Applications,Cognitive Neuroscience
Publication ISSN: 1866-9964
Full Text Link:
Related URLs: https://link.sp ... 559-019-09685-5 (Publisher URL)
http://www.scop ... tnerID=8YFLogxK (Scopus URL)
PURE Output Type: Article
Published Date: 2020-03
Published Online Date: 2019-11-09
Accepted Date: 2019-09-16
Authors: Marfil, Rebeca
Romero-Garces, Adrian
Bandera, Juan P.
Manso, Luis J. (ORCID Profile 0000-0003-2616-1120)
Calderita, Luis V.
Bustos, Pablo
Bandera, Antonio J.
Garcia-Polo, Javier
Fernandez, Fernando
Voilmy, Dimitri



Version: Accepted Version

| Preview

Export / Share Citation


Additional statistics for this record