Data stream evolution diagnosis using recursive wavelet density
estimators
estimators
File(s)a14-trevino (1).pdf (2.66 MB)
Published version
Author(s)
Garcia-Trevino, E
Hameed, MZ
Barria, JA
Type
Journal Article
Abstract
Data streams are a new class of data that is becoming pervasively important in a wide range of applications, ranging from sensor networks, environmental monitoring to finance. In this article, we propose a novel framework for the online diagnosis of evolution of multidimensional streaming data that incorporates Recursive Wavelet Density Estimators into the context of Velocity Density Estimation. In the proposed framework changes in streaming data are characterized by the use of local and global evolution coefficients. In addition, we propose for the analysis of changes in the correlation structure of the data a recursive implementation of the Pearson correlation coefficient using exponential discounting. Two visualization tools, namely temporal and spatial velocity profiles, are extended in the context of the proposed framework. These are the three main advantages of the proposed method over previous approaches: (1) the memory storage required is minimal and independent of any window size; (2) it has a significantly lower computational complexity; and (3) it makes possible the fast diagnosis of data evolution at all dimensions and at relevant combinations of dimensions with only one pass of the data. With the help of the four examples, we show the framework’s relevance in a change detection context and its potential capability for real world applications.
Date Issued
2018-02-01
Date Acceptance
2017-06-01
Citation
ACM Transactions on Knowledge Discovery from Data, 2018, 12 (1), pp.1-28
ISSN
1556-4681
Publisher
Association for Computing Machinery (ACM)
Start Page
1
End Page
28
Journal / Book Title
ACM Transactions on Knowledge Discovery from Data
Volume
12
Issue
1
Identifier
https://dl.acm.org/doi/10.1145/3106369
Subjects
Science & Technology
Technology
Computer Science, Information Systems
Computer Science, Software Engineering
Computer Science
Data streams mining
data stream evolution diagnosis
velocity density estimation
incremental statistics
TIME-SERIES DATA
0801 Artificial Intelligence and Image Processing
0806 Information Systems
Artificial Intelligence & Image Processing
Publication Status
Published
Article Number
14
Date Publish Online
2018-01-23