Generate-Paste-Blend-Detect: synthetic dataset for object detection in the agriculture domain
File(s)1-s2.0-S2772375523000886-main.pdf (1.26 MB)
Published version
Author(s)
Giakoumoglou, Nikolaos
Pechlivani, Eleftheria Maria
Tzovaras, Dimitrios
Type
Journal Article
Abstract
Object detection is a challenging task, hindered by the scarcity of large annotated datasets. In agriculture, the lack of annotated insect datasets often results in domain-specific models that lack generalization. Data collection and annotation can be expensive and time-consuming. This paper proposes a simple approach to generate synthetic datasets for object detection that requires only a small dataset of target objects and a larger background dataset that fits the desired environment. The approach named Generate-Paste-Blend-Detect uses Denoising Diffusion Probabilistic Models (DDPM) to artificially “generate” objects, “paste” them on a background image, “blend” them with the environment to avoid pixel artifacts which result in poor performance for trained models, and finally use an object detection model to “detect” the artificially added object instances. The proposed methodology is demonstrated in the agricultural domain to detect whiteflies achieving a mean average precision (𝑚𝐴𝑃50
) of 0.66 with the state-of-the-art YOLOv8 object detection model. This approach enables domain-specific detection with minimal labor and cost.
) of 0.66 with the state-of-the-art YOLOv8 object detection model. This approach enables domain-specific detection with minimal labor and cost.
Date Issued
2023-10
Date Acceptance
2023-05-23
Citation
Smart Agricultural Technology, 2023, 5
ISSN
2772-3755
Publisher
Elsevier
Journal / Book Title
Smart Agricultural Technology
Volume
5
Copyright Statement
© 2023 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
License URL
Identifier
http://dx.doi.org/10.1016/j.atech.2023.100258
Publication Status
Published
Article Number
100258
Date Publish Online
2023-05-26