A drone that learns to efficiently find non-uniformly distributed objects in agricultural fields: from simulation to the real world

arXiv:2505.09278v2 Announce Type: replace Abstract: Drones are promising for data collection in precision agriculture but are limited by battery capacity. Drone paths are usually planned using full coverage planners, even though this is not always required. This paper presents a drone path planner trained with Reinforcement Learning (RL) to detect as many objects as possible with a minimal flight path length. The agent uses low-quality prior knowledge derived from a high-altitude full coverage flight as guidance. The agent was trained in simulation, modeling object distributions, drone movement, field geometry, detection errors, and uncertain prior knowledge. Combined with a flight controller and object-detection network, it controls flight direction, terminates flights, and can be deployed on a real drone. It was evaluated across six levels of realism, from pure simulation to real-world drone flights, to quantify the simulation-to-reality gap. The agent achieved a 57% shorter flight path than a full coverage planner in simulation (13% lower recall) and a 38% shorter flight path on real-world orthomosaic data (21% lower recall). In real-world drone flights, the agent found 73% and 23% of the objects in trials 1 and 2, respectively; the lower real-world performance was mainly attributed to prior knowledge quality. Although framed as a weed-detection task, the approach is expected to generalize to other agricultural tasks with non-uniformly distributed objects and tolerance to false negatives, though further research is needed before practical deployment.

Abstract:Drones are promising for data collection in precision agriculture but are limited by battery capacity. Drone paths are usually planned using full coverage planners, even though this is not always required. This paper presents a drone path planner trained with Reinforcement Learning (RL) to detect as many objects as possible with a minimal flight path length. The agent uses low-quality prior knowledge derived from a high-altitude full coverage flight as guidance. The agent was trained in simulation, modeling object distributions, drone movement, field geometry, detection errors, and uncertain prior knowledge. Combined with a flight controller and object-detection network, it controls flight direction, terminates flights, and can be deployed on a real drone. It was evaluated across six levels of realism, from pure simulation to real-world drone flights, to quantify the simulation-to-reality gap. The agent achieved a 57% shorter flight path than a full coverage planner in simulation (13% lower recall) and a 38% shorter flight path on real-world orthomosaic data (21% lower recall). In real-world drone flights, the agent found 73% and 23% of the objects in trials 1 and 2, respectively; the lower real-world performance was mainly attributed to prior knowledge quality. Although framed as a weed-detection task, the approach is expected to generalize to other agricultural tasks with non-uniformly distributed objects and tolerance to false negatives, though further research is needed before practical deployment.

Robotics (cs.RO)

arXiv:2505.09278 [cs.RO]

(or arXiv:2505.09278v2 [cs.RO] for this version)

https://doi.org/10.48550/arXiv.2505.09278 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

aiqbench analysis

A drone that learns to efficiently find non-uniformly distributed objects in agricultural fields: from simulation to the real world

Related coverage