The Effect of Narrow-Band Transmission on Recognition of Paralinguistic Information From Human Vocalizations
File(s)07555372.pdf (6.82 MB)
Published version
Author(s)
Fruhholz, S
Marchi, E
Schuller, B
Type
Journal Article
Abstract
Practically, no knowledge exists on the effects of speech coding and recognition for narrow-band transmission of speech signals within certain frequency ranges especially in relation to the recognition of paralinguistic cues in speech. We thus investigated the impact of narrow-band standard speech coders on the machine-based classification of affective vocalizations and clinical vocal recordings. In addition, we analyzed the effect of speech low-pass filtering by a set of different cut-off frequencies, either chosen as static values in the 0.5-5-kHz range or given dynamically by different upper limits from the first five speech formants (F1-F5). Speech coding and recognition were tested, first, according to short-term speaker states by using affective vocalizations as given by the Geneva Multimodal Emotion Portrayals. Second, in relation to long-term speaker traits, we tested vocal recording from clinical populations involving speech impairments as found in the Child Pathological Speech Database. We employ a large acoustic feature space derived from the Interspeech Computational Paralinguistics Challenge. Besides analysis of the sheer corruption outcome, we analyzed the potential of matched and multicondition training as opposed to miss-matched condition. In the results, first, multicondition and matched-condition training significantly increase performances as opposed to mismatched condition. Second, downgrades in classification accuracy occur, however, only at comparably severe levels of low-pass filtering. The downgrades especially appear for multi-categorical rather than for binary decisions. These can be dealt with reasonably by the alluded strategies.
Date Issued
2016-08-29
Date Acceptance
2016-07-27
Citation
IEEE Access, 2016, 4, pp.6059-6072
ISSN
2169-3536
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Start Page
6059
End Page
6072
Journal / Book Title
IEEE Access
Volume
4
Copyright Statement
© 2016 IEEE. Translations and content mining are permitted for academic research only.
Personal use is also permitted, but republication/redistribution requires IEEE permission.
See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Personal use is also permitted, but republication/redistribution requires IEEE permission.
See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Sponsor
Commission of the European Communities
Identifier
http://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000386253600005&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=1ba7043ffcc86c417c072aa74d649202
Grant Number
645378
Subjects
Science & Technology
Technology
Computer Science, Information Systems
Engineering, Electrical & Electronic
Telecommunications
Computer Science
Engineering
Speech analysis
speech coding
emotion recognition
computational paralinguistics
HIGH-FUNCTIONING AUTISM
SPEECH RECOGNITION
VOCAL EXPRESSIONS
EMOTIONAL PROSODY
CODED SPEECH
HEALTH-CARE
CHILDREN
LANGUAGE
VOICES
COMMUNICATION
Publication Status
Published
Date Publish Online
2016-08-29