Spatial Referencing

With Seoul National University (2021.10 ~ 2023.06)

  1. We propose a new interface which can provide an effective and intuitive means of operating construction robots, enabling construction workers to communicate spatial goals without the need for extensive training in robotics. Current construction robots are limited in their ability to understand spatial instructions and goals on the worksite. Moreover, user interfaces, such as handheld controllers, require extensive training and operation time for users, which can be impractical for construction workers who are typically not experts in robotics.

  2. We propose a method to accurately infer the distant, human-indicated spatial goals by estimating the laser trajectories. Despite the advantages of deictic gestures, current gesture interfaces may not be suitable for construction tasks that require a high level of precision. Within large-scale environments, these interfaces cover only a restricted proximity of the entire workspace and have limited accuracy in estimating the spatial locations of distant targets. Interfaces from other domains are mostly tested on close-proximity tabletops, whereas this study focuses on scenarios with more distant targets. This underscores the relevance and applicability of the proposed method in real-world scenarios where construction robots operate within expansive 3D workspaces.

Related Publications

  1. Yoon, S., Kim, Y., Ahn, C. R., & Park, M. (2021). Challenges in deictic gesture-based spatial referencing for human-robot interaction in construction. ISARC. Proceedings of the International Symposium on Automation and Robotics in Construction, 38, 491–497.
  2. Yoon, S., Kim, Y. S., Park, M., & Ahn, C. R. (2023). Effects of Spatial Characteristics on the Human–Robot Communication Using Deictic Gesture in Construction. Journal of Construction Engineering and Management, 149(7), 04023049. https://doi.org/10.1061/JCEMD4.COENG-12997
  3. Yoon, S., Park, J., Park, M., & Ahn, C. R. (2024). A Deictic Gesture-Based Human-Robot Interface for In Situ Task Specification in Construction. In Computing in Civil Engineering 2023 (pp. 445–452). https://doi.org/10.1061/9780784485224.054
  4. Yoon, S., Park, M., & Ahn, C. R. (2024). LaserDex: Improvising Spatial Tasks Using Deictic Gestures and Laser Pointing for Human–Robot Collaboration in Construction. Journal of Computing in Civil Engineering, 38(3), 04024012. https://doi.org/10.1061/JCCEE5.CPENG-5715