Shortening emergency medical response time with joint operations of uncrewed aerial vehicles with ambulances

Author

Xiaoquan GAO, Singapore Management UniversityFollow
Nan KONG
Paul GRIFFIN

Publication Type

Journal Article

Publication Date

4-2024

Abstract

Problem definition: Uncrewed aerial vehicles (UAVs) are transforming emergency service logistics applications across sectors, offering easy deployment and rapid response. In the context of emergency medical services (EMS), UAVs have the potential to augment ambulances by leveraging bystander assistance, thereby reducing response times for delivering urgent medical interventions and improving EMS outcomes. Notably, the use of UAVs for opioid overdose cases is particularly promising as it addresses the challenges faced by ambulances in delivering timely medication. This study aims to optimize the integration of UAVs and bystanders into EMS in order to minimize average response times for overdose interventions. Methodology/results: We formulate the joint operation of UAVs with ambulances through a Markov decision process that captures random emergency vehicle travel times and bystander availability. We apply an approximate dynamic programming approach to mitigate the solution challenges from high-dimensional state variables and complex decisions through a neural network-based approximation of the value functions (NN-API). To design the approximation, we construct a set of basis functions based on queueing and geographic properties of the UAV-augmented EMS system. Managerial implications: The simulation results suggest that our NN-API policy tends to outperform several noteworthy rule- and optimization-based benchmark policies in terms of accumulated rewards, particularly for situations that are primarily characterized by high request arrival rates and a limited number of available ambulances and UAVs. The results also demonstrate the benefits of incorporating UAVs into the EMS system and the effectiveness of an intelligent real-time operations strategy in addressing capacity shortages, which are often a problem in rural areas of the United States. Additionally, the results provide insights into specific contributions of each dispatching or redeployment strategy to overall performance improvement.

Keywords

approximate dynamic programming, large-scale MDP, uncrewed aerial vehicles, dispatching, simulation

Discipline

Health and Medical Administration | Operations and Supply Chain Management

Research Areas

Operations Management

Publication

Manufacturing & Service Operations Management

Volume

26

Issue

2

First Page

447

Last Page

464

ISSN

1523-4614

Identifier

10.1287/msom.2022.0166

Publisher

Institute for Operations Research and Management Sciences

Citation

GAO, Xiaoquan; KONG, Nan; and GRIFFIN, Paul. Shortening emergency medical response time with joint operations of uncrewed aerial vehicles with ambulances. (2024). Manufacturing & Service Operations Management. 26, (2), 447-464.
Available at: https://ink.library.smu.edu.sg/lkcsb_research/7668

Additional URL

https://doi.org/0.1287/msom.2022.0166