Synthetic Data at Scale: A Development Model to Efficiently Leverage Machine Learning in Agriculture
Jonathan Klein, Rebekah E. Waller, Sören Pirk, Wojtek Pałubicki, Mark Tester, and Dominik L. Michels
Abstract
The rise of artificial intelligence (AI) and in particular modern machine learning (ML) algorithms during the last decade has been met with great interest in the agricultural industry. While undisputedly powerful, their main drawback remains the need for sufficient and diverse training data. The collection of real datasets and their annotation are the main cost drivers of ML developments, and while promising results on synthetically generated training data have been shown, their generation is not without difficulties on their own. In this paper, we present a development model for the iterative, cost-efficient generation of synthetic training data. Its application is demonstrated by developing a low-cost early disease detector for tomato plants (Solanum lycopersicum) using synthetic training data. A neural classifier is trained by exclusively using synthetic images, whose generation process is iteratively refined to obtain optimal performance. In contrast to other approaches that rely on a human assessment of similarity between real and synthetic data, we instead introduce a structured, quantitative approach. Our evaluation shows superior generalization results when compared to using non-task-specific real training data and a higher cost efficiency of development compared to traditional synthetic training data. We believe that our approach will help to reduce the cost of synthetic data generation in future applications.
Paper
In: Frontiers in Plant Science, 2024
Link: https://www.frontiersin.org/journals/plant-science/articles/10.3389/fpls.2024.1360113/full
Download:
Code
Project files, source code, examples and (some) documentation; to reproduce the results shown in the paper.
Current version: 2024-07-02
Download (50 MB)
Citation
@Article{Klein2024_synthetic_data,
author = {Klein, Jonathan and Waller, Rebekah E. and Pirk, Sören and Pałubicki, Wojtek and Tester, Mark and Michels, Dominik L.},
title = {Synthetic Data at Scale: A Development Model to Efficiently Leverage Machine Learning in Agriculture},
journal = {Frontiers in Plant Science},
year = {2024},
month = {9}
doi = {10.3389/fpls.2024.1360113},
}