Graph-based topic extraction from vector embeddings of text documents: application to a corpus of news articles
Author(s)
Altuncu, Tarik
Yaliraki, Sophia
Barahona, Mauricio
Type
Chapter
Abstract
Production of news content is growing at an astonishing rate. To help manage and monitor the sheer amount of text, there is an increasing need to develop efficient methods that can provide insights into emerging content areas, and stratify unstructured corpora of text into ‘topics’ that stem intrinsically from content similarity. Here we present an unsupervised framework that brings together powerful vector embeddings from natural language processing with tools from multiscale graph partitioning that can reveal
natural partitions at different resolutions without making a priori assumptions about the number of clusters in the corpus. We show the advantages of graph-based clustering through end-to-end comparisons with other popular clustering and topic modelling methods, and also evaluate different text vector embeddings, from classic Bag-of-Words to Doc2Vec to the recent transformers based model Bert. This comparative work is showcased through an analysis of a corpus of US news coverage during the presidential election year of 2016.
natural partitions at different resolutions without making a priori assumptions about the number of clusters in the corpus. We show the advantages of graph-based clustering through end-to-end comparisons with other popular clustering and topic modelling methods, and also evaluate different text vector embeddings, from classic Bag-of-Words to Doc2Vec to the recent transformers based model Bert. This comparative work is showcased through an analysis of a corpus of US news coverage during the presidential election year of 2016.
Editor(s)
Benito, Rosa
Cherifi, Chantal
Cherifi, Hocine
Moro, Esteban
Rocha, Luis M
Sales-Pardo, Marta
Date Issued
2021-01-15
Citation
Complex Networks & Their Applications IX, 2021, 944, pp.154-166
ISBN
978-3-030-65351-4
Publisher
Springer International Publishing
Start Page
154
End Page
166
Journal / Book Title
Complex Networks & Their Applications IX
Studies in Computational Intelligence
Volume
944
Copyright Statement
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG. The final publication is available at Springer via https://doi.org/10.1007/978-3-030-65351-4_13
Identifier
http://arxiv.org/abs/2010.15067v1
Subjects
cs.CL
cs.CL
cs.AI
cs.LG
Publication Status
Published
Article Number
13
Date Publish Online
2021-01-05