Vicinity-driven paragraph and sentence alignment for comparable corpora
File(s)1612.04113v1.pdf (65.49 KB)
Working paper
Author(s)
Paetzold, Gustavo Henrique
Specia, Lucia
Type
Working Paper
Abstract
Parallel corpora have driven great progress in the field of Text Simplification. However, most sentence alignment algorithms either offer a limited range of alignment types supported, or simply ignore valuable clues present in comparable documents. We address this problem by introducing a new set of flexible vicinity-driven paragraph and sentence alignment algorithms that 1-N, N-1, N-N and long distance null alignments without the need for hard-to-replicate supervised models.
Date Issued
2016-12-13
Citation
2016
Publisher
arXiv
Copyright Statement
© The Authors.
Identifier
http://arxiv.org/abs/1612.04113v1
Subjects
cs.CL
cs.CL
Publication Status
Published