Reinforcement learning in free-form stamping of sheet-metals
File(s)2020 ProcManuf - Liu et al RL in free-form stamping.pdf (1.43 MB)
Published version
OA Location
Author(s)
Shi, Zhusheng
Liu, shiming
Lin, jianguo
Li, Zhiqiang
Type
Conference Paper
Abstract
Sheet-metal free-form stamping technology deforms sheet-metals with simple and low costs universal tools on a working bench, which is normally an anvil. This traditional forming method is praised for its high forming flexibility but complained due to its reliance on individual experience thus low repeatability. In this paper, a python-based overall learning algorithm, which incorporates a reinforcement learning (RL) algorithm, for a designed sheet-metal free-form stamping case is developed. A neural network system, known as deep Q-network (DQN), was used to approximate the action-value function (Q function) in the Deep Q-learning algorithm. The DQN was trained using mini-batch training method, with the computational experiment data provided through Finite Element (FE) simulations. The overall learning algorithm was instantiated and evaluated by training the RL model to convergence, which is able to predict the optimal forming route to achieve the desired shape. This algorithm achieves the intellectualisation of the traditional free-form sheet-metal stamping process for the first time, without prior expertise for guidance.
Date Issued
2020-09-04
Date Acceptance
2020-07-02
Citation
Procedia Manufacturing, 2020, 50, pp.444-449
ISSN
2351-9789
Publisher
Elsevier
Start Page
444
End Page
449
Journal / Book Title
Procedia Manufacturing
Volume
50
Copyright Statement
© 2020 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/)
Sponsor
AVIC Manufacturing Technology Institute
Grant Number
N/A
Source
18th International Conference on Metal Forming 2020 (Virtual)
Subjects
0910 Manufacturing Engineering
1007 Nanotechnology
Publication Status
Published
Start Date
2020-09-13
Finish Date
2020-09-16
Coverage Spatial
Kraków, Poland
Date Publish Online
2020-09-04