New directions in the applications of rough path theory
File(s)2302.04586v1.pdf (2.76 MB)
Accepted version
Author(s)
Fermanian, Adeline
Lyons, Terry
Morrill, James
Salvi, Cristopher
Type
Journal Article
Abstract
This article provides a concise overview of some of the recent advances in the application of rough path theory to machine learning. Controlled differential equations (CDEs) are discussed as the key mathematical model to describe the interaction of a stream with a physical control system. A collection of iterated integrals known as the signature naturally arises in the description of the response produced by such interactions. The signature comes equipped with a variety of powerful properties rendering it an ideal feature map for streamed data. We summarise recent advances in the symbiosis between deep learning and CDEs, studying the link with RNNs and culminating with the Neural CDE model. We concluded with a discussion on signature kernel methods.
Date Issued
2023-06
Date Acceptance
2023-02-01
Citation
IEEE BITS the Information Theory Magazine, 2023, 3 (2), pp.41-53
ISSN
2692-4080
Publisher
Institute of Electrical and Electronics Engineers
Start Page
41
End Page
53
Journal / Book Title
IEEE BITS the Information Theory Magazine
Volume
3
Issue
2
Copyright Statement
Copyright © 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Identifier
http://dx.doi.org/10.1109/mbits.2023.3243885
Publication Status
Published
Date Publish Online
2023-02-10