End-to-end classification of reverberant rooms using DNNs
File(s)Papayiannis2020_AAM.pdf (971.98 KB)
Accepted version
Author(s)
Papayiannis, Constantinos
Evers, Christine
Naylor, Patrick
Type
Journal Article
Abstract
Reverberation is present in our workplaces, ourhomes, concert halls and theatres. This paper investigates howdeep learning can use the effect of reverberation on speechto classify a recording in terms of the room in which it wasrecorded. Existing approaches in the literature rely on domainexpertise to manually select acoustic parameters as inputs toclassifiers. Estimation of these parameters from reverberantspeech is adversely affected by estimation errors, impacting theclassification accuracy. In order to overcome the limitations ofpreviously proposed methods, this paper shows how DNNs canperform the classification by operating directly on reverberantspeech spectra and a CRNN with an attention-mechanism isproposed for the task. The relationship is investigated betweenthe reverberant speech representations learned by the DNNs andacoustic parameters. For evaluation, AIRs are used from theACE-challenge dataset that were measured in 7 real rooms. Theclassification accuracy of the CRNN classifier in the experimentsis 78% when using 5 hours of training data and 90% when using10 hours.
Date Issued
2020-10-26
Date Acceptance
2020-09-27
Citation
IEEE Transactions on Audio, Speech and Language Processing, 2020, 28, pp.3010-3017
ISSN
1558-7916
Publisher
Institute of Electrical and Electronics Engineers
Start Page
3010
End Page
3017
Journal / Book Title
IEEE Transactions on Audio, Speech and Language Processing
Volume
28
Copyright Statement
© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
Engineering & Physical Science Research Council (E
Identifier
https://ieeexplore.ieee.org/document/9239871
Grant Number
EP/P001017/1
Subjects
Speech-Language Pathology & Audiology
0801 Artificial Intelligence and Image Processing
0906 Electrical and Electronic Engineering
Publication Status
Published
Date Publish Online
2020-10-26