Luo, Hanbin, Wu, Jianxin, Liu, Jiajing and Antwi-Afari, Maxwell Fordjour (2024). Large language model-based code generation for the control of construction assembly robots:A hierarchical generation approach. Developments in the Built Environment, 19 ,
Abstract
Offline programming (OLP) is a mainstream approach for controlling assembly robots at construction sites. However, existing methods are tailored to specific assembly tasks and workflows, and thus lack flexibility. Additionally, the emerging large language model (LLM)-based OLP cannot effectively handle the code logic of robot programming. Thus, this paper addresses the question: How can robot control programs be generated effectively and accurately for diverse construction assembly tasks using LLM techniques? This paper describes a closed user-on-the-loop control framework for construction assembly robots based on LLM techniques. A hierarchical strategy to generate robot control programs is proposed to logically integrate code generation at high and low levels. Additionally, customized application programming interfaces and a chain of action are combined to enhance the LLM's understanding of assembly action logic. An assembly task set was designed to evaluate the feasibility and reliability of the proposed approach. The results show that the proposed approach (1) is widely applicable to diverse assembly tasks, and (2) can improve the quality of the generated code by decreasing the number of errors. Our approach facilitates the automation of construction assembly tasks by simplifying the robot control process.
Publication DOI: | https://doi.org/10.1016/j.dibe.2024.100488 |
---|---|
Divisions: | College of Engineering & Physical Sciences > Smart and Sustainable Manufacturing College of Engineering & Physical Sciences > School of Infrastructure and Sustainable Engineering > Civil Engineering College of Engineering & Physical Sciences > School of Infrastructure and Sustainable Engineering > Engineering Systems and Supply Chain Management |
Funding Information: | The authors acknowledge the financial support of the National Key R&D Program of China (No. 2023YFC3806605), the National Natural Science Foundation of China (Grant Nos. 72301114 and U21A20151) and China Postdoctoral Science Foundation (Grant No. 2023M731 |
Additional Information: | © 2024 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/). |
Uncontrolled Keywords: | ChatGPT,Code generation,Construction assembly robot,Human–robot collaboration,Large language model,Architecture ,Civil and Structural Engineering,Building and Construction,Materials Science (miscellaneous),Computer Science Applications,Computer Graphics and Computer-Aided Design |
Publication ISSN: | 2666-1659 |
Last Modified: | 06 Dec 2024 08:31 |
Date Deposited: | 04 Jul 2024 15:58 |
Full Text Link: | |
Related URLs: |
http://www.scop ... tnerID=8YFLogxK
(Scopus URL) https://www.sci ... 1698?via%3Dihub (Publisher URL) |
PURE Output Type: | Article |
Published Date: | 2024-10-01 |
Published Online Date: | 2024-06-20 |
Accepted Date: | 2024-06-18 |
Authors: |
Luo, Hanbin
Wu, Jianxin Liu, Jiajing Antwi-Afari, Maxwell Fordjour ( 0000-0002-6812-7839) |
Download
Version: Published Version
License: Creative Commons Attribution Non-commercial No Derivatives
| Preview