Towards a Synchronised Grammars Framework for Adaptive Musical Human-Robot Collaboration
File(s)
Accepted version
Author(s)
Sarabia, M
Lee, K
Demiris, Y
Type
Conference Paper
Abstract
We present an adaptive musical collaboration framework for interaction between a human and a robot. The aim of our work is to develop a system that receives feedback from the user in real time and learns the music progression style of the user over time. To tackle this problem, we represent a song as a hierarchically structured sequence of music primitives. By exploiting the sequential constraints of these primitives inferred from the structural information combined with user feedback, we show that a robot can play music in accordance with the user’s anticipated actions. We use Stochastic Context-Free Grammars augmented with the knowledge of the learnt user’s preferences.
We provide synthetic experiments as well as a pilot study with a Baxter robot and a tangible music table. The synthetic results show the synchronisation and adaptivity features of our framework and the pilot study suggest these are applicable to create an effective musical collaboration experience.
We provide synthetic experiments as well as a pilot study with a Baxter robot and a tangible music table. The synthetic results show the synchronisation and adaptivity features of our framework and the pilot study suggest these are applicable to create an effective musical collaboration experience.
Date Issued
2015-08-31
Date Acceptance
2015-04-26
Citation
2015, pp.715-721
Publisher
IEEE
Start Page
715
End Page
721
Copyright Statement
© 2015 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Source
IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN)
Publication Status
Published
Start Date
2015-08-31
Finish Date
2015-09-04
Coverage Spatial
Kobe, Japan