OstrichRL: a musculoskeletal ostrich simulation to study bio-mechanical locomotion
File(s)ostrichrl_a_musculoskeletal_os.pdf (5.42 MB)
Accepted version
Author(s)
Type
Conference Paper
Abstract
Muscle-actuated control is a research topic of interest spanning different fields, in
particular biomechanics, robotics and graphics. This type of control is particularly
challenging because models are often overactuated, and dynamics are delayed and
non-linear. It is however a very well tested and tuned actuation model that has
undergone millions of years of evolution and that involves interesting properties
exploiting passive forces of muscle-tendon units and efficient energy storage and
release. To facilitate research on muscle-actuated simulation, we release a 3D
musculoskeletal simulation of an ostrich based on the MuJoCo simulator. Ostriches
are one of the fastest bipeds on earth and are therefore an excellent model for
studying muscle-actuated bipedal locomotion. The model is based on CT scans and
dissections used to gather actual muscle data such as insertion sites, lengths and
pennation angles. Along with this model, we also provide a set of reinforcement
learning tasks, including reference motion tracking and a reaching task with the
neck. The reference motion data are based on motion capture clips of various
behaviors which we pre-processed and adapted to our model. This paper describes
how the model was built and iteratively improved using the tasks. We evaluate the
accuracy of the muscle actuation patterns by comparing them to experimentally
collected electromyographic data from locomoting birds. We believe that this work
can be a useful bridge between the biomechanics, reinforcement learning, graphics
and robotics communities, by providing a fast and easy to use simulation.
particular biomechanics, robotics and graphics. This type of control is particularly
challenging because models are often overactuated, and dynamics are delayed and
non-linear. It is however a very well tested and tuned actuation model that has
undergone millions of years of evolution and that involves interesting properties
exploiting passive forces of muscle-tendon units and efficient energy storage and
release. To facilitate research on muscle-actuated simulation, we release a 3D
musculoskeletal simulation of an ostrich based on the MuJoCo simulator. Ostriches
are one of the fastest bipeds on earth and are therefore an excellent model for
studying muscle-actuated bipedal locomotion. The model is based on CT scans and
dissections used to gather actual muscle data such as insertion sites, lengths and
pennation angles. Along with this model, we also provide a set of reinforcement
learning tasks, including reference motion tracking and a reaching task with the
neck. The reference motion data are based on motion capture clips of various
behaviors which we pre-processed and adapted to our model. This paper describes
how the model was built and iteratively improved using the tasks. We evaluate the
accuracy of the muscle actuation patterns by comparing them to experimentally
collected electromyographic data from locomoting birds. We believe that this work
can be a useful bridge between the biomechanics, reinforcement learning, graphics
and robotics communities, by providing a fast and easy to use simulation.
Date Issued
2021-12-10
Date Acceptance
2021-12-01
Citation
Deep Reinforcement Learning Workshop NeurIPS 2021, 2021
Journal / Book Title
Deep Reinforcement Learning Workshop NeurIPS 2021
Copyright Statement
© 2021 The Author(s)
Identifier
http://kormushev.com/papers/Pardo_NeurIPS-2021.pdf
Source
NeurIPS 2021
Publication Status
Published
Start Date
2021-12-07
Finish Date
2021-12-10
Coverage Spatial
Virtual conference