Effects of different human-in-the-loop approaches on human-ai co-design: a comparison between human-learning HITL approach and machine-learning HITL approach
File(s) Human-in-the-loop.pdf (1.52 MB)
Accepted version
Author(s)
Yin, Yuan
Wang, Boheng
Zuo, Haoyu
Childs, Peter
Type
Conference Paper
Abstract
The speed at which the quantity of data is increasing stymies the deployment of some AI tools for design as the basis for training the tools is not stable. Also, selecting which data can be used as training data is a challenge. To address these issues, the concept of human-in-the-loop (HITL) approaches have been proposed. HITL includes human knowledge in the model-building processes to mitigate the high volume requirement of training data. Although how to apply AI in a design process and the effect of Generative AI tools (such as ChatGPT and Midjourney) in design processes has been explored, limited attention has been given to how different HITL approaches affect design performance. This study thus aimed to explore how different HITL approaches (Human-learning HITL approach and Machine-learning HITL approach) affect solutions of human-AI co-design. Fifteen participants were recruited to undertake two design tasks under the guidelines of Human-learning HITL and Machine-learning HITL approach respectively. The solutions from participants were assessed using four criteria (novelty, aesthetics, functionality, and feasibility). The results of the study indicated that the solution generated from Human-learning HITL approach is better compared with that of the Machine-learning HITL approach, especially in terms of aesthetics and functionality of the solution. The study supports the importance of expressing human insights through prompts on improving human-AI co-design solutions compared with providing more training data to AI.
Date Issued
2024-11-13
Date Acceptance
2024-08-01
Citation
International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, 2024
ISBN
978-0-7918-8834-6
Publisher
ASME
Journal / Book Title
International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
Copyright Statement
Copyright © 2024 by ASME. This is the author’s accepted manuscript made available under a CC-BY licence in accordance with Imperial’s Research Publications Open Access policy (www.imperial.ac.uk/oa-policy)
License URL
Source
2024 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference-IDETC-CIE
Subjects
AI/KBS
Collaborative
Computer Science
Computer Science, Interdisciplinary Applications
CREATIVITY
design
Engineering
Engineering, Industrial
Engineering, Manufacturing
Engineering, Mechanical
IDEA GENERATION
Interactive
NOVELTY
process
Product
Science & Technology
Technology
Publication Status
Published
Start Date
2024-08-25
Finish Date
2024-08-28
Coverage Spatial
Washington, DC, USA
Date Publish Online
2024-11-13
