Repository logo
  • Log In
    Log in via Symplectic to deposit your publication(s).
Repository logo
  • Communities & Collections
  • Research Outputs
  • Statistics
  • Log In
    Log in via Symplectic to deposit your publication(s).
  1. Home
  2. Faculty of Medicine
  3. Department of Surgery and Cancer
  4. Department of Surgery and Cancer
  5. A local multiscale probabilistic graphical model for data validation and reconstruction, and its application in industry
 
  • Details
A local multiscale probabilistic graphical model for data validation and reconstruction, and its application in industry
File(s)
main.pdf (1.78 MB)
Accepted version
Author(s)
Herrera-Vega, Javier
Orihuela-Espina, Felipe
Ibarguengoytia, Pablo H
Garcia, Uriel A
Rosado, Dan-El Vila
more
Type
Journal Article
Abstract
The detection and subsequent reconstruction of incongruent data in time series by means of observation of statistically related information is a recurrent issue in data validation. Unlike outliers, incongruent observations are not necessarily confined to the extremes of the data distribution. Instead, these rogue observations are unlikely values in the light of statistically related information. This paper proposes a multiresolution Bayesian network model for the detection of rogue values and posterior reconstruction of the erroneous sample for non-stationary time-series. Our method builds local Bayesian Network models that best fit to segments of data in order to achieve a finer discretization and hence improve data reconstruction. Our local multiscale approach is compared against its single-scale global predecessor (assumed as our gold standard) in the predictive power and of this, both error detection capabilities and error reconstruction capabilities are assessed. This parameterization and verification of the model are evaluated over three synthetic data source topologies. The virtues of the algorithm are then further tested in real data from the steel industry where the aforementioned problem characteristics are met but for which the ground truth is unknown. The proposed local multiscale approach was found to dealt better with increasing complexities in data topologies.
Date Issued
2018-04-01
Date Acceptance
2018-01-01
Citation
Engineering Applications of Artificial Intelligence, 2018, 70, pp.1-15
URI
http://hdl.handle.net/10044/1/70140
DOI
https://www.dx.doi.org/10.1016/j.engappai.2018.01.001
ISSN
0952-1976
Publisher
Elsevier
Start Page
1
End Page
15
Journal / Book Title
Engineering Applications of Artificial Intelligence
Volume
70
Copyright Statement
© 2018 Elsevier Ltd. All rights reserved. This manuscript is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International Licence http://creativecommons.org/licenses/by-nc-nd/4.0/
Identifier
http://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000428484900001&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=1ba7043ffcc86c417c072aa74d649202
Subjects
Science & Technology
Technology
Automation & Control Systems
Computer Science, Artificial Intelligence
Engineering, Multidisciplinary
Engineering, Electrical & Electronic
Computer Science
Engineering
Bayesian networks
Data validation
Multiscale approach
Outlier detection
Probabilistic graphical models
PARTIAL LEAST-SQUARES
OUTLIER DETECTION
Publication Status
Published
Date Publish Online
2018-02-03
About
Spiral Depositing with Spiral Publishing with Spiral Symplectic
Contact us
Open access team Report an issue
Other Services
Scholarly Communications Library Services
logo

Imperial College London

South Kensington Campus

London SW7 2AZ, UK

tel: +44 (0)20 7589 5111

Accessibility Modern slavery statement Cookie Policy

Built with DSpace-CRIS software - Extension maintained and optimized by 4Science

  • Cookie settings
  • Privacy policy
  • End User Agreement
  • Send Feedback