Effects of Spatial Characteristics on the Human–Robot Communication Using Deictic Gesture in Construction

April 28, 2023·
Sungboo Yoon
Sungboo Yoon
,
YeSeul Kim
,
Moonseo Park
,
Changbum R. Ahn
· 0 min read
Abstract
Construction robots are expected to frequently communicate in situ improvisations with human workers to adapt and change their workflow and methods. One way to achieve this is through deictic gestures that are one of the most effective forms of human–robot interaction (HRI) in delivering spatial information. Nevertheless, the limited coverage of deictic gestures in large-scale environments poses some challenges for both humans and robots in leveraging such techniques for HRI in construction. To identify the feasibility of deictic gestures in the construction domain and find applicable solutions for improving performance, this study aims to extend current knowledge on the performance in communicating positional information using deictic gestures by investigating the effects of spatial characteristics on spatial referencing, focusing on the target configuration, target distance, and relative position of human and robot. We observed that the recognition and estimation of deictic gestures were affected by the target plane, target position, and the target layout and that the robot performance was significantly reduced as the distance between the human and robot increased. The findings of this study demonstrate the challenges in spatial referencing within a large-scale environment and highlight the need for bidirectional communication in HRI.
Type
Publication
Journal of Construction Engineering and Management
publications
Human-Robot Interaction Construction Robotics
Sungboo Yoon
Authors
Sungboo Yoon
PhD Candidate @ Seoul National University

Hello! I am a fifth-year Ph.D. candidate in the Department of Architecture & Architectural Engineering at Seoul National University. I am fortunate to be advised by Professor Changbum R. Ahn, and I am a member of the Construction Engineering & Management Lab. My research interests include construction robotics, human-robot interaction, and robot learning.

I previously completed both my bachelor’s and master’s degrees in Architectural Engineering at Seoul National University, where I conducted research on modular construction and human-robot interaction under the advisement of Professor Moonseo Park.

I am honored to be a recipient of the Basic Science Research Program (Ph.D. Fellowship) from the National Research Foundation of Korea (NRF).

Currently, I serve as a student coordinator of a joint project funded by the Ministry of Land, Infrastructure and Transport & Ministry of Trade, Industry and Energy, South Korea, on developing a multipurpose robotic platform and XR-based human–robot collaboration system for construction work at height. If you are interested, please visit this page for more details.