The SONICOM Project: artificial intelligence-driven immersive audio, from personalization to modeling
File(s)ACCEPTED.pdf (1.89 MB)
Accepted version
Author(s)
Type
Journal Article
Abstract
Every individual perceives spatial audio differently, due in large part to the unique and complex shape of ears and head. Therefore, high-quality, headphone-based spatial audio should be uniquely tailored to each listener in an effective and efficient manner. Artificial intelligence (AI) is a powerful tool that can be used to drive forward research in spatial audio personalization. The SONICOM project aims to employ a data-driven approach that links physiological characteristics of the ear to the individual acoustic filters, which allows us to localize sound sources and perceive them as being located around us. A small amount of data acquired from users could allow personalized audio experiences, and AI could facilitate this by offering a new perspective on the matter. A Bayesian approach to computational neuroscience and binaural sound reproduction will be linked to create a metric for AI-based algorithms that will predict realistic spatial audio quality. Being able to consistently and repeatedly evaluate and quantify the improvements brought by technological advancements, as well as the impact these have on complex interactions in virtual environments, will be key for the development of new techniques and for unlocking new approaches to understanding the mechanisms of human spatial hearing and communication.
Date Issued
2022-11
Date Acceptance
2022-05-30
Citation
IEEE: Signal Processing Magazine, 2022, 39 (6), pp.85-88
ISSN
1053-5888
Publisher
Institute of Electrical and Electronics Engineers
Start Page
85
End Page
88
Journal / Book Title
IEEE: Signal Processing Magazine
Volume
39
Issue
6
Copyright Statement
© 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
Commission of the European Communities
Commission of the European Communities
Identifier
https://ieeexplore.ieee.org/document/9931551
Grant Number
101017743
101017743
Subjects
Networking & Telecommunications
0801 Artificial Intelligence and Image Processing
0906 Electrical and Electronic Engineering
0913 Mechanical Engineering
Publication Status
Published
Date Publish Online
2022-11-01