PlugSonic: a web- and mobile-based platform for dynamic and navigable binaural audio
File(s)AcceptedVersion.pdf (2.85 MB)
Accepted version
Author(s)
Comunita, Marco
Gerino, Andrea
Picinali, Lorenzo
Type
Journal Article
Abstract
PlugSonic is a series of web- and mobilebased applications designed to: edit samples and apply
audio effects (PlugSonic Sample), create and experience dynamic and navigable soundscapes and sonic narratives (PlugSonic Soundscape). The audio processing
within PlugSonic is based on the Web Audio API while
the binaural rendering uses the 3D Tune-In Toolkit.
Exploration of soundscapes in a physical space is made
possible by adopting Apple’s ARKit. The present paper
describes the implementation details, the signal processing chain and the necessary steps to curate and experience a soundscape. We also include some metrics
and performance details. The main goal of PlugSonic is
to give users a complete set of tools, without the need
for specific devices, external software and/or hardware,
specialised knowledge or custom development; with the
idea that spatial audio has the potential to become a
readily accessible and easy to understand technology,
for anyone to adopt, whether for creative or research
purposes.
audio effects (PlugSonic Sample), create and experience dynamic and navigable soundscapes and sonic narratives (PlugSonic Soundscape). The audio processing
within PlugSonic is based on the Web Audio API while
the binaural rendering uses the 3D Tune-In Toolkit.
Exploration of soundscapes in a physical space is made
possible by adopting Apple’s ARKit. The present paper
describes the implementation details, the signal processing chain and the necessary steps to curate and experience a soundscape. We also include some metrics
and performance details. The main goal of PlugSonic is
to give users a complete set of tools, without the need
for specific devices, external software and/or hardware,
specialised knowledge or custom development; with the
idea that spatial audio has the potential to become a
readily accessible and easy to understand technology,
for anyone to adopt, whether for creative or research
purposes.
Date Acceptance
2022-06-07
Citation
Eurasip Journal on Audio, Speech, and Music Processing, 18
ISSN
1687-4714
Publisher
Springer
Journal / Book Title
Eurasip Journal on Audio, Speech, and Music Processing
Volume
18
Copyright Statement
© The Author(s). 2022 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which
permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit
to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The
images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated
otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended
use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the
copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/
permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit
to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The
images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated
otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended
use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the
copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/
License URL
Sponsor
European Commission
Identifier
https://asmp-eurasipjournals.springeropen.com/articles/10.1186/s13636-022-00250-x
Grant Number
Contract No 726765
Subjects
0906 Electrical and Electronic Engineering
1005 Communications Technologies
2004 Linguistics
Publication Status
Published