A workflow for human-centered machine-assisted hypothesis generation: comment on Banker et al. (2023)
File(s)Hermida, Stachl, & Talaifar.pdf (455.38 KB)
Accepted version
Author(s)
Hermida Carrillo, Alejandro
Stachl, Clemens
Talaifar, Sanaz
Type
Journal Article
Abstract
Large language models (LLMs) have the potential to revolutionize a key aspect of the scientific process—hypothesis generation. Banker et al. (2024) investigate how GPT-3 and GPT-4 can be used to generate novel hypotheses useful for social psychologists. Although timely, we argue that their approach overlooks the limitations of both humans and LLMs and does not incorporate crucial information on the inquiring researcher’s inner world (e.g., values, goals) and outer world (e.g., existing literature) into the hypothesis generation process. Instead, we propose a human-centered workflow (Hope et al., 2023) that recognizes the limitations and capabilities of both the researchers and LLMs. Our workflow features a process of iterative engagement between researchers and GPT-4 that augments—rather than displaces—each researcher’s unique role in the hypothesis generation process. (PsycInfo Database Record (c) 2024 APA, all rights reserved)
Date Issued
2024-09
Date Acceptance
2023-09-27
Citation
American Psychologist, 2024, 79 (6), pp.800-802
ISSN
0003-066X
Publisher
American Psychological Association
Start Page
800
End Page
802
Journal / Book Title
American Psychologist
Volume
79
Issue
6
Copyright Statement
© American Psychological Association, 2024. This paper is not the copy of record and may not exactly replicate the authoritative document published in the APA journal. The final article is available, upon publication, at: https://doi.org/10.1037/amp0001256
Identifier
https://psycnet.apa.org/doiLanding?doi=10.1037%2Famp0001256
Publication Status
Published
Date Publish Online
2024-09