HARFLOW3D: a latency-oriented 3D-CNN accelerator toolflow for HAR on FPGA devices
File(s)2303.17218v1.pdf (1.77 MB)
Accepted version
Author(s)
Toupas, Petros
Montgomerie-Corcoran, Alexander
Bouganis, Christos-Savvas
Tzovaras, Dimitrios
Type
Conference Paper
Abstract
For Human Action Recognition tasks (HAR), 3D Convolutional Neural Networks have proven to be highly effective, achieving state-of-the-art results. This study introduces a novel streaming architecture-based toolflow for mapping such models onto FPGAs considering the model's inherent characteristics and the features of the targeted FPGA device. The HARFLOW3D toolflow takes as input a 3D CNN in ONNX format and a description of the FPGA characteristics, generating a design that minimises the latency of the computation. The toolflow is comprised of a number of parts, including (i) a 3D CNN parser, (ii) a performance and resource model, (iii) a scheduling algorithm for executing 3D models on the generated hardware, (iv) a resource-aware optimisation engine tailored for 3D models, (v) an automated mapping to synthesizable code for FPGAs. The ability of the toolflow to support a broad range of models and devices is shown through a number of experiments on various 3D CNN and FPGA system pairs. Furthermore, the toolflow has produced high-performing results for 3D CNN models that have not been mapped to FPGAs before, demonstrating the potential of FPGA-based systems in this space. Overall, HARFLOW3D has demonstrated its ability to deliver competitive latency compared to a range of state-of-the-art hand-tuned approaches, being able to achieve up to 5× better performance compared to some of the existing works. The tool is available at https://github.com/ptoupas/harflow3d.
Date Issued
2023-07-10
Date Acceptance
2023-05-01
Citation
2023 IEEE 31st Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM), 2023, pp.144-154
ISSN
2576-2613
Publisher
IEEE Computer Society
Start Page
144
End Page
154
Journal / Book Title
2023 IEEE 31st Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM)
Copyright Statement
Copyright © 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Identifier
https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:001032713500015&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=a2bf6146997ec60c407a63945d4e92bb
Source
31st IEEE Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM)
Subjects
3D CNNs
Computer Science
Computer Science, Hardware & Architecture
Computer Science, Theory & Methods
Engineering
Engineering, Electrical & Electronic
FPGA
Human Action Recognition
Science & Technology
Technology
Toolflow
Publication Status
Published
Start Date
2023-05-08
Finish Date
2023-05-11
Coverage Spatial
Marina Del Rey, CA, USA