Deep Reinforcement Learning Based Autonomous Decision‐Making for Cooperative Uncrewed Aerial Vehicles: A Search and Rescue Real World Application
Hickling, T., Hogan, M., Tammam, A. & Aouf, N.
ORCID: 0000-0001-9291-4077 (2026).
Deep Reinforcement Learning Based Autonomous Decision‐Making for Cooperative Uncrewed Aerial Vehicles: A Search and Rescue Real World Application.
Journal of Field Robotics,
doi: 10.1002/rob.70248
Abstract
This paper presents the first end‐to‐end framework that combines guidance, navigation, and centralized task allocation for multiple UAVs performing autonomous search‐and‐rescue (SAR) in GNSS‐denied indoor environments. A twin delayed deep deterministic policy gradient controller is trained with an artificial potential field (APF) reward that blends attractive and repulsive potentials with continuous control, accelerating convergence and yielding smoother, safer trajectories than distance‐only baselines. Collaborative mission assignment is solved by a deep Graph Attention Network that, at each decision step, reasons over the drone‐task graph to produce near‐optimal allocations with negligible on‐board compute. To arrest the notorious Z‐drift of indoor LiDAR‐SLAM, we fuse depth‐camera altimetry with IMU vertical velocity in a lightweight complementary filter, giving centimeter‐level altitude stability without external beacons. The resulting system was deployed on two 1 m‐class quad‐rotors and flight‐tested in a cluttered, multi‐level disaster mock‐up designed for the NATO‐Sapience Autonomous Cooperative Drone Competition. Compared with prior DRL guidance that remains largely in simulation, our framework demonstrates an ability to navigate complex indoor environments, securing first place in the 2024 event. These results demonstrate that APF‐shaped DRL and GAT‐driven cooperation can translate to reliable real‐world SAR operations.
| Publication Type: | Article |
|---|---|
| Additional Information: | © 2026 The Author(s). Journal of Field Robotics published by Wiley Periodicals LLC. This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited. |
| Publisher Keywords: | cooperative UAVs, DRL, DRL task allocation, GNSS-denied, LiDAR-SLAM, search and rescue, sim-to-real |
| Subjects: | T Technology > T Technology (General) T Technology > TA Engineering (General). Civil engineering (General) |
| Departments: | School of Science & Technology School of Science & Technology > Department of Engineering |
| SWORD Depositor: |
Available under License Creative Commons Attribution.
Download (4MB) | Preview
Export
Downloads
Downloads per month over past year
Metadata
Metadata