Manipulation of free-floating objects using Faraday flows and deep reinforcement learning.
Publication Date
2022-01-10Journal Title
Sci Rep
ISSN
2045-2322
Publisher
Springer Science and Business Media LLC
Volume
12
Issue
1
Language
en
Type
Article
This Version
VoR
Metadata
Show full item recordCitation
Hardman, D., George Thuruthel, T., & Iida, F. (2022). Manipulation of free-floating objects using Faraday flows and deep reinforcement learning.. Sci Rep, 12 (1) https://doi.org/10.1038/s41598-021-04204-9
Abstract
The ability to remotely control a free-floating object through surface flows on a fluid medium can facilitate numerous applications. Current studies on this problem have been limited to uni-directional motion control due to the challenging nature of the control problem. Analytical modelling of the object dynamics is difficult due to the high-dimensionality and mixing of the surface flows while the control problem is hard due to the nonlinear slow dynamics of the fluid medium, underactuation, and chaotic regions. This study presents a methodology for manipulation of free-floating objects using large-scale physical experimentation and recent advances in deep reinforcement learning. We demonstrate our methodology through the open-loop control of a free-floating object in water using a robotic arm. Our learned control policy is relatively quick to obtain, highly data efficient, and easily scalable to a higher-dimensional parameter space and/or experimental scenarios. Our results show the potential of data-driven approaches for solving and analyzing highly complex nonlinear control problems.
Keywords
Article, /639/766/189, /639/766/530, /639/705/1042, article
Sponsorship
SHERO project, a Future and Emerging Technologies (FET) programme of the European Commission (grant agreement ID 828818)
Funder references
European Commission Horizon 2020 (H2020) Future and Emerging Technologies (FET) (828818)
Identifiers
s41598-021-04204-9, 4204
External DOI: https://doi.org/10.1038/s41598-021-04204-9
This record's URL: https://www.repository.cam.ac.uk/handle/1810/332578
Rights
Licence:
http://creativecommons.org/licenses/by/4.0/
Statistics
Total file downloads (since January 2020). For more information on metrics see the
IRUS guide.
Recommended or similar items
The current recommendation prototype on the Apollo Repository will be turned off on 03 February 2023. Although the pilot has been fruitful for both parties, the service provider IKVA is focusing on horizon scanning products and so the recommender service can no longer be supported. We recognise the importance of recommender services in supporting research discovery and are evaluating offerings from other service providers. If you would like to offer feedback on this decision please contact us on: support@repository.cam.ac.uk