A neural network approach to audio-assisted movie dialogue detection
File(s)NEUROCOMPUTING_Elsevier_2008_Margarita_Kotti.pdf (221.21 KB)
Accepted version
Author(s)
Kotti, Margarita
Benetos, Emmanouil
Kotropoulos, Constantine
Pitas, Ioannis
Type
Journal Article
Abstract
A novel framework for audio-assisted dialogue detection based on indicator functions and neural networks is investigated. An indicator function defines that an actor is present at a particular time instant. The cross-correlation function of a pair of indicator functions and the magnitude of the corresponding cross-power spectral density are fed as input to neural networks for dialogue detection. Several types of artificial neural networks, including multilayer perceptrons (MLPs), voted perceptrons, radial basis function networks, support vector machines, and particle swarm optimization-based MLPs are tested. Experiments are carried out to validate the feasibility of the aforementioned approach by using ground-truth indicator functions determined by human observers on six different movies. A total of 41 dialogue instances and another 20 non-dialogue instances are employed. The average detection accuracy achieved is high, ranging between 84.78 % ± 5.499 % and 91.43 % ± 4.239 %. © 2007 Elsevier B.V. All rights reserved.
Date Issued
2007-12
Citation
Neurocomputing, 2007, 71 (1-3), pp.157-166
ISSN
0925-2312
Publisher
Elsevier
Start Page
157
End Page
166
Journal / Book Title
Neurocomputing
Volume
71
Issue
1-3
Copyright Statement
© 2007 Elsevier B.V. All rights reserved. NOTICE: this is the author’s version of a work that was accepted for publication in Neurocomputing. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in NEUROCOMPUTING, Vol.:71, Issue:1-3, (2007) DOI: 10.1016/j.neucom.2007.08.006
Description
07.08.13 KB. Ok to add the accepted version to Spiral, Elsevier says ok while mandate is not enforced.