skip to main content
10.5555/3545946.3598985acmconferencesArticle/Chapter ViewAbstractPublication PagesaamasConference Proceedingsconference-collections
poster

Optimizing Crop Management with Reinforcement Learning and Imitation Learning

Published: 30 May 2023 Publication History

Abstract

To increase crop yield while minimizing environmental impact, we present an intelligent crop management system that optimizes nitrogen fertilization and irrigation simultaneously via reinforcement learning (RL), imitation learning (IL), and crop simulations using DSSAT. We first use deep RL to train management policies that require a large number of state variables from the simulator as observations (denoted as full observation). We then invoke IL to train management policies that only need a limited number of variables that are measurable in the real world (denoted as partial observation) by mimicking the actions of the RL-trained policies under full observation. Simulation experiments using maize in Florida demonstrate that our trained policies under both full and partial observations achieve better outcomes than a baseline policy. Most importantly, the IL-trained management policies are directly deployable in the real world as they use readily available information.

References

[1]
Chace Ashcraft and Kiran Karra. 2021. Machine learning aided crop yield optimization. arXiv preprint arXiv:2111.00963 (2021).
[2]
Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Bellemare, Alex Graves, Martin Riedmiller, Andreas K Fidjeland, Georg Ostrovski, Stig Petersen, Charles Beattie, Amir Sadik, Ioannis Antonoglou, Helen King, Dharshan Kumaran, Daan Wierstra, Shane Legg, and Demis Hassabis. 2015. Human-level control through deep reinforcement learning. Nature, Vol. 518, 7540 (2015), 529--533.
[3]
Takayuki Osa, Joni Pajarinen, Gerhard Neumann, J Andrew Bagnell, Pieter Abbeel, and Jan Peters. 2018. An algorithmic perspective on imitation learning. Foundations and Trends® in Robotics, Vol. 7, 1--2 (2018), 1-179.
[4]
B.V.S. Reddy, P Sanjana Reddy, F Bidinger, and Michael Blümmel. 2003. Crop management factors influencing yield and quality of crop residues. Field Crops Research, Vol. 84, 1--2 (2003), 57--77.
[5]
Gautron Romain, Preux Philippe, Bigot Julien, Maillard Odalric-Ambrym, Emukpere David, et al. 2022. gym-DSSAT: a crop model turned into a Reinforcement Learning environment. arXiv preprint arXiv:2207.03270 (2022).
[6]
Lijia Sun, Yanxiang Yang, Jiang Hu, Dana Porter, Thomas Marek, and Charles Hillyer. 2017. Reinforcement learning control for water-efficient agricultural irrigation. In 2017 IEEE International Symposium on Parallel and Distributed Processing with Applications and 2017 IEEE International Conference on Ubiquitous Computing and Communications (ISPA/IUCC). 1334--1341.
[7]
Ran Tao, Pan Zhao, Jing Wu, Nicolas F Martin, Matthew T Harrison, Carla Ferreira, Zahra Kalantari, and Naira Hovakimyan. 2022. Optimizing Crop Management with Reinforcement Learning and Imitation Learning. arXiv preprint arXiv:2209.09991 (2022).
[8]
David Wright, Ian Small, Cheryl Mackowiak, Zane Grabau, Pratap Devkota, and Silvana Paula-Moraes. 2022. Field corn production guide: SS-AGR-85/AG202, rev. 8/2022. EDIS, Vol. 2022, 4 (2022).
[9]
Jing Wu, Ran Tao, Pan Zhao, Nicolas F Martin, and Naira Hovakimyan. 2022. Optimizing nitrogen management with deep reinforcement learning and crop simulations. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. 1712--1720.

Index Terms

  1. Optimizing Crop Management with Reinforcement Learning and Imitation Learning

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    AAMAS '23: Proceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems
    May 2023
    3131 pages
    ISBN:9781450394321
    • General Chairs:
    • Noa Agmon,
    • Bo An,
    • Program Chairs:
    • Alessandro Ricci,
    • William Yeoh

    Sponsors

    Publisher

    International Foundation for Autonomous Agents and Multiagent Systems

    Richland, SC

    Publication History

    Published: 30 May 2023

    Check for updates

    Author Tags

    1. imitation learning
    2. intelligent crop management
    3. reinforcement learning
    4. sustainable agriculture

    Qualifiers

    • Poster

    Funding Sources

    • C3.ai Digital Transformation Institute
    • NSF

    Conference

    AAMAS '23
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 1,155 of 5,036 submissions, 23%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 31
      Total Downloads
    • Downloads (Last 12 months)14
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 11 Jan 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media