TRACK-Plus: Optimizing Artificial Neural Networks for Hybrid Anomaly Detection in Data Streaming
File(s)09163089.pdf (2.21 MB)
Published version
Author(s)
Alanfessah, Ahmed
Casale, Giuliano
Type
Journal Article
Abstract
Software applications can feature intrinsic variability in their execution time due to interference
from other applications or software contention from other users, which may lead to unexpectedly long running times and anomalous performance. There is thus a need for effective automated performance anomaly
detection methods that can be used within production environments to avoid any late detection of unexpected
degradations of service level. To address this challenge, we introduce TRACK-Plus a black-box training
methodology for performance anomaly detection. The method uses an artificial neural networks-driven
methodology and Bayesian Optimization to identify anomalous performance and are validated on Apache
Spark Streaming. TRACK-Plus has been extensively validated using a real Apache Spark Streaming system
and achieve a high F-score while simultaneously reducing training time by 80% compared to efficiently
detect anomalies.
from other applications or software contention from other users, which may lead to unexpectedly long running times and anomalous performance. There is thus a need for effective automated performance anomaly
detection methods that can be used within production environments to avoid any late detection of unexpected
degradations of service level. To address this challenge, we introduce TRACK-Plus a black-box training
methodology for performance anomaly detection. The method uses an artificial neural networks-driven
methodology and Bayesian Optimization to identify anomalous performance and are validated on Apache
Spark Streaming. TRACK-Plus has been extensively validated using a real Apache Spark Streaming system
and achieve a high F-score while simultaneously reducing training time by 80% compared to efficiently
detect anomalies.
Date Issued
2020-08-10
Date Acceptance
2020-07-28
Citation
IEEE Access, 2020, 8, pp.146613-146626
ISSN
2169-3536
Publisher
Institute of Electrical and Electronics Engineers
Start Page
146613
End Page
146626
Journal / Book Title
IEEE Access
Volume
8
Copyright Statement
© 2020 The Author(s). This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/
License URL
Subjects
08 Information and Computing Sciences
09 Engineering
10 Technology
Publication Status
Published
Date Publish Online
2020-08-10