Repository logo
  • Log In
    Log in via Symplectic to deposit your publication(s).
Repository logo
  • Communities & Collections
  • Research Outputs
  • Statistics
  • Log In
    Log in via Symplectic to deposit your publication(s).
  1. Home
  2. Faculty of Engineering
  3. Faculty of Engineering
  4. Active flow control for bluff body drag reduction using reinforcement learning with partial measurements
 
  • Details
Active flow control for bluff body drag reduction using reinforcement learning with partial measurements
File(s)
active-flow-control-for-bluff-body-drag-reduction-using-reinforcement-learning-with-partial-measurements.pdf (2.03 MB)
Published version
Author(s)
Xia, chengwei
Zhang, Junjie
Kerrigan, Eric
Rigas, G
Type
Journal Article
Abstract
Active flow control for drag reduction with reinforcement learning (RL) is performed in the wake of a two-dimensional square bluff body at laminar regimes with vortex shedding. Controllers parametrised by neural networks are trained to drive two blowing and suction jets that manipulate the unsteady flow. The RL with full observability (sensors in the wake) discovers successfully a control policy that reduces the drag by suppressing the vortex shedding in the wake. However, a non-negligible performance degradation ( ∼
50 % less drag reduction) is observed when the controller is trained with partial measurements (sensors on the body). To mitigate this effect, we propose an energy-efficient, dynamic, maximum entropy RL control scheme. First, an energy-efficiency-based reward function is proposed to optimise the energy consumption of the controller while maximising drag reduction. Second, the controller is trained with an augmented state consisting of both current and past measurements and actions, which can be formulated as a nonlinear autoregressive exogenous model, to alleviate the partial observability problem. Third, maximum entropy RL algorithms (soft actor critic and truncated quantile critics) that promote exploration and exploitation in a sample-efficient way are used, and discover near-optimal policies in the challenging case of partial measurements. Stabilisation of the vortex shedding is achieved in the near wake using only surface pressure measurements on the rear of the body, resulting in drag reduction similar to that in the case with wake sensors. The proposed approach opens new avenues for dynamic flow control using partial measurements for realistic configurations.
Date Issued
2024-02-25
Date Acceptance
2024-01-07
Citation
Journal of Fluid Mechanics, 2024, 981
URI
http://hdl.handle.net/10044/1/109541
URL
https://www.cambridge.org/core/journals/journal-of-fluid-mechanics/article/active-flow-control-for-bluff-body-drag-reduction-using-reinforcement-learning-with-partial-measurements/F98233D07BAD238143B8C2544DE0BD03
DOI
https://www.dx.doi.org/10.1017/jfm.2024.69
ISSN
0022-1120
Publisher
Cambridge University Press
Journal / Book Title
Journal of Fluid Mechanics
Volume
981
Copyright Statement
© The Author(s), 2024. Published by Cambridge University Press.
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
License URL
https://creativecommons.org/licenses/by/4.0/
Identifier
https://www.cambridge.org/core/journals/journal-of-fluid-mechanics/article/active-flow-control-for-bluff-body-drag-reduction-using-reinforcement-learning-with-partial-measurements/F98233D07BAD238143B8C2544DE0BD03
Publication Status
Published
Article Number
A17
Date Publish Online
2024-02-21
About
Spiral Depositing with Spiral Publishing with Spiral Symplectic
Contact us
Open access team Report an issue
Other Services
Scholarly Communications Library Services
logo

Imperial College London

South Kensington Campus

London SW7 2AZ, UK

tel: +44 (0)20 7589 5111

Accessibility Modern slavery statement Cookie Policy

Built with DSpace-CRIS software - Extension maintained and optimized by 4Science

  • Cookie settings
  • Privacy policy
  • End User Agreement
  • Send Feedback