A concrete example of construct construction in natural language

File Description SizeFormat 
Concreteness.pdfFile embargoed until 21 November 20223.06 MBAdobe PDF    Request a copy
Title: A concrete example of construct construction in natural language
Authors: Yeomans, M
Item Type: Journal Article
Abstract: Concreteness is central to theories of learning in psychology and organizational behavior. However, the literature provides many competing measures of concreteness in natural language. Indeed, researcher degrees of freedom are often large in text analysis. Here, we use concreteness as an example case for how language measures can be systematically evaluated across many studies. We compare many existing measures across datasets from several domains, including written advice, and plan-making (total N = 9,780). We find that many previous measures have surprisingly little measurement validity in our domains of interest. We also show that domain-specific machine learning models consistently outperform domain-general measures. Text analysis is increasingly common, and our work demonstrates how reproducibility and open data can improve measurement validity for high-dimensional data. We conclude with robust guidelines for measuring concreteness, along with a corresponding R package, doc2concrete, as an open-source toolkit for future research.
Issue Date: Jan-2021
Date of Acceptance: 19-Oct-2020
URI: http://hdl.handle.net/10044/1/85186
DOI: 10.1016/j.obhdp.2020.10.008
ISSN: 0749-5978
Publisher: Elsevier BV
Start Page: 81
End Page: 94
Journal / Book Title: Organizational Behavior and Human Decision Processes
Volume: 162
Copyright Statement: © Elsevier Ltd. All rights reserved. This manuscript is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International Licence http://creativecommons.org/licenses/by-nc-nd/4.0/
Keywords: Social Psychology
15 Commerce, Management, Tourism and Services
17 Psychology and Cognitive Sciences
Publication Status: Published online
Embargo Date: 2022-11-21
Online Publication Date: 2020-11-21
Appears in Collections:Imperial College Business School

This item is licensed under a Creative Commons License Creative Commons