A real-time and unsupervised face re-identification system for human-robot interaction
File(s)1804.03547v2.pdf (920.65 KB)
Accepted version
Author(s)
Wang, Y
Shen, J
Petridis, S
Pantic, M
Type
Journal Article
Abstract
In the context of Human-Robot Interaction (HRI), face Re-Identification (face Re-ID) aims to verify if certain detected faces have already been observed by robots. The ability of distinguishing between different users is crucial in social robots as it will enable the robot to tailor the interaction strategy toward the users’ individual preferences. So far face recognition research has achieved great success, however little attention has been paid to the realistic applications of Face Re-ID in social robots. In this paper, we present an effective and unsupervised face Re-ID system which simultaneously re-identifies multiple faces for HRI. This Re-ID system employs Deep Convolutional Neural Networks to extract features, and an online clustering algorithm to determine the face's ID. Its performance is evaluated on two datasets: the TERESA video dataset collected by the TERESA robot, and the YouTube Face Dataset (YTF Dataset). We demonstrate that the optimised combination of techniques achieves an overall 93.55% accuracy on TERESA dataset and an overall 90.41% accuracy on YTF dataset. We have implemented the proposed method into a software module in the HCI^2 Framework [1] for it to be further integrated into the TERESA robot [2] , and has achieved real-time performance at 10–26 Frames per second.
Date Issued
2019-12-01
Date Acceptance
2018-04-06
Citation
Pattern Recognition Letters, 2019, 128, pp.559-568
ISSN
0167-8655
Publisher
Elsevier
Start Page
559
End Page
568
Journal / Book Title
Pattern Recognition Letters
Volume
128
Copyright Statement
© 2018 Elsevier B.V. All rights reserved. This manuscript is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/
Sponsor
Commission of the European Communities
Engineering & Physical Science Research Council (E
Grant Number
611153
EP/N007743/1
Subjects
Science & Technology
Technology
Computer Science, Artificial Intelligence
Computer Science
Real-time face re-identification
Open set re-ID
Multiple re-ID
Human-robot interaction
CNN descriptors
Online clustering
cs.CV
cs.CV
Artificial Intelligence & Image Processing
0801 Artificial Intelligence and Image Processing
0906 Electrical and Electronic Engineering
1702 Cognitive Sciences
Publication Status
Published
Date Publish Online
2018-04-09