Human-in-the-loop design with machine learning
File(s)
Published version
Author(s)
Type
Conference Paper
Abstract
Deep learning methods have been applied to randomly generate images, such as in fashion, furniture design. To date, consideration of human aspects which play a vital role in a design process has not been given significant attention in deep learning approaches. In this paper, results are reported from a human- in-the-loop design method where brain EEG signals are used to capture preferable design features. In the framework developed, an encoder extracting EEG features from raw signals recorded from subjects when viewing images from ImageNet are learned. Secondly, a GAN model is trained conditioned on the encoded EEG features to generate design images. Thirdly, the trained model is used to generate design images from a person's EEG measured brain activity in the cognitive process of thinking about a design. To verify the proposed method, a case study is presented following the proposed approach. The results indicate that the method can generate preferred designs styles guided by the preference related brain signals. In addition, this method could also help improve communication between designers and clients where clients might not be able to express design requests clearly.
Date Issued
2019-07-01
Date Acceptance
2019-07-01
Citation
Proceedings of the Design Society: International Conference on Engineering Design, 2019, 1 (1), pp.2577-2586
Publisher
Cambridge University Press (CUP)
Start Page
2577
End Page
2586
Journal / Book Title
Proceedings of the Design Society: International Conference on Engineering Design
Volume
1
Issue
1
Copyright Statement
© The Author(s) 2019
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use or in order to create a derivative work.
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use or in order to create a derivative work.
Identifier
https://www.cambridge.org/core/journals/proceedings-of-the-international-conference-on-engineering-design/article/humanintheloop-design-with-machine-learning/3A5B1A14E4F0701B3376F3C3AEB89D86
Source
The International Conference in Engineering Design (ICED) 19
Publication Status
Published
Start Date
2019-08-05
Finish Date
2019-08-08
Coverage Spatial
Delft, Netherlands
Date Publish Online
2019-07-26