Predicting interaction shape of soft continuum robots using deep visual models
File(s) IROS_24__Interaction_prediction_accepted.pdf (3.35 MB)
Accepted version
Author(s)
Type
Conference Paper
Abstract
Soft continuum robots, characterized by their inherent compliance and dexterity, are increasingly pivotal in applications requiring delicate interactions with the environment such as the medical field. Despite their advantages, challenges persist in accurately modeling and controlling their shape during interactions with surrounding objects. This is because of the difficulty in modeling the large degrees of freedom in soft-bodied objects that become more active during interactions. In this study, we present a deep visual model to predict the interaction shapes of a soft continuum robot in contact with surrounding objects. By formulating this task as a forward-statics problem, the model uses the initial state images containing the object configuration and future actuation values to predict interactive state images of the robot under this actuation condition. We developed and tested the model in both simulated and physical environments, explored the model’s predictive capabilities using monocular and binocular views, and tested the model’s generalization ability on different datasets. Our results show that deep learning methods are a promising tool for solving the complex problem of predicting the shape of a soft continuum robot interacting with the environment, requiring no prior knowledge about the system dynamics and explicit mapping of the environment. This study paves the way for future explorations in robot-environment interaction modeling and the development of more adaptable interaction shape control strategies.
Date Issued
2024-12-25
Date Acceptance
2024-10-01
Citation
2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024, pp.11381-11387
ISSN
2153-0858
Publisher
IEEE
Start Page
11381
End Page
11387
Journal / Book Title
2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Copyright Statement
Copyright © 2024, IEEE. This paper is embargoed until publication. Once published the author’s accepted manuscript will be made available under a CC-BY License in accordance with Imperial’s Research Publications Open Access policy (www.imperial.ac.uk/oa-policy).
License URL
Source
2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Publication Status
Published
Start Date
2024-10-14
Finish Date
2024-10-18
Coverage Spatial
Abu Dhabi, United Arab
