Becoming the expert - interactive multi-class machine teaching
File(s)interactiveMachineTeachingCVPR2015.pdf (3.11 MB)
Accepted version
Author(s)
Johns, Edward
Mac Aodha, Oisin
Brostow, Gabriel
Type
Conference Paper
Abstract
Compared to machines, humans are extremely good at
classifying images into categories, especially when they
possess prior knowledge of the categories at hand. If this
prior information is not available, supervision in the form
of teaching images is required. To learn categories more
quickly, people should see important and representative im-
ages first, followed by less important images later – or not at
all. However, image-importance is individual-specific, i.e.
a teaching image is important to a student if it changes their
overall ability to discriminate between classes. Further, stu-
dents keep learning, so while image-importance depends on
their current knowledge, it also varies with time.
In this work we propose an Interactive Machine Teach-
ing algorithm that enables a computer to teach challeng-
ing visual concepts to a human. Our adaptive algorithm
chooses, online, which labeled images from a teaching set
should be shown to the student as they learn. We show that a
teaching strategy that probabilistically models the student’s
ability and progress, based on their correct and incorrect
answers, produces better ‘experts’. We present results us-
ing real human participants across several varied and chal-
lenging real-world datasets.
classifying images into categories, especially when they
possess prior knowledge of the categories at hand. If this
prior information is not available, supervision in the form
of teaching images is required. To learn categories more
quickly, people should see important and representative im-
ages first, followed by less important images later – or not at
all. However, image-importance is individual-specific, i.e.
a teaching image is important to a student if it changes their
overall ability to discriminate between classes. Further, stu-
dents keep learning, so while image-importance depends on
their current knowledge, it also varies with time.
In this work we propose an Interactive Machine Teach-
ing algorithm that enables a computer to teach challeng-
ing visual concepts to a human. Our adaptive algorithm
chooses, online, which labeled images from a teaching set
should be shown to the student as they learn. We show that a
teaching strategy that probabilistically models the student’s
ability and progress, based on their correct and incorrect
answers, produces better ‘experts’. We present results us-
ing real human participants across several varied and chal-
lenging real-world datasets.
Date Issued
2015-10-15
Date Acceptance
2015-03-01
Citation
IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2015
ISSN
1063-6919
Publisher
Institute of Electrical and Electronics Engineers
Journal / Book Title
IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Copyright Statement
© 2015 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Source
Conference on Computer Vision and Pattern Recognition 2015
Publication Status
Published
Start Date
2015-06-07
Finish Date
2015-06-12
Coverage Spatial
Boston, MA, USA