Multidirectional associative optimization of function-specific word representations
File(s)2020.acl-main.257.pdf (1.55 MB)
Published version
OA Location
Author(s)
Gerz, Daniela
Vulic, Ivan
Rei, Marek
Reichart, Roi
Korhonen, Anna
Type
Conference Paper
Abstract
We present a neural framework for learning associations between interrelated groups of words such as the ones found in Subject-Verb-Object (SVO) structures. Our model induces a joint function-specific word vector space, where vectors of e.g. plausible SVO compositions lie close together. The model retains information about word group membership even in the joint space, and can thereby effectively be applied to a number of tasks reasoning over the SVO structure. We show the robustness and versatility of the proposed framework by reporting state-of-the-art results on the tasks of estimating selectional preference and event similarity. The results indicate that the combinations of representations learned with our task-independent model outperform task-specific architectures from prior work, while reducing the number of parameters by up to 95%.
Date Issued
2020-07-05
Date Acceptance
2020-07-01
Citation
58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), 2020, Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp.2872-2882
Publisher
ASSOC COMPUTATIONAL LINGUISTICS-ACL
Start Page
2872
End Page
2882
Journal / Book Title
58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020)
Volume
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
Copyright Statement
© 2020 Association for Computational Linguistics. Materials published in or after 2016 are licensed on a Creative Commons Attribution 4.0 International License.
License URL
Identifier
http://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000570978203017&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=1ba7043ffcc86c417c072aa74d649202
Source
58th Annual Meeting of the Association-for-Computational-Linguistics (ACL)
Subjects
Science & Technology
Social Sciences
Technology
Computer Science, Artificial Intelligence
Linguistics
Computer Science
ORGANIZATION
CATEGORIES
SYSTEMS
NOUNS
VERBS
Publication Status
Published
Start Date
2020-07-05
Finish Date
2020-07-10
Coverage Spatial
Online
Date Publish Online
2020-07-05