We are interested in the persistent surveillance of an area of interest comprised of stations/ data nodes that need to be visited in a cyclic manner. The data collection task is undertaken by a UAV which autonomously executes the mission. In addition to geographically distributed stations, the scenario also includes a central depot, where data collected from the different nodes must be delivered. In this context, the performance criteria, in addition to a desired minimal cycle time, also entails minimizing the delay in delivering the data collected from each node to the depot. Each node has a priority/ weight associated with it that characterizes the relative importance between timely delivery of data from the nodes. We pose the problem as an average/ cycle reward maximization problem; where the UAV gains a reward that is a decreasing function of weighted delay in data delivery from the nodes. Since we aim to maximize the average reward, the solution also favors shorter overall cycle time. In a cycle, each station is visited exactly once; however, we allow the UAV to visit the depot more than once in a cycle. Evidently, this allows for quicker delivery of data from a higher priority node. We apply results from average reward maximization stochastic dynamic programming to our deterministic case and solve the problem using Linear Programming. We also discuss the special case of no penalty on delivery delay, whence the problem collapses to the well known metric Traveling Salesman Problem.
- Dynamic Systems and Control Division
Average Reward Dynamic Programming Applied to a Persistent Visitation and Data Delivery Problem
- Views Icon Views
- Share Icon Share
- Search Site
Kalyanam, K, Pachter, M, & Casbeer, D. "Average Reward Dynamic Programming Applied to a Persistent Visitation and Data Delivery Problem." Proceedings of the ASME 2017 Dynamic Systems and Control Conference. Volume 3: Vibration in Mechanical Systems; Modeling and Validation; Dynamic Systems and Control Education; Vibrations and Control of Systems; Modeling and Estimation for Vehicle Safety and Integrity; Modeling and Control of IC Engines and Aftertreatment Systems; Unmanned Aerial Vehicles (UAVs) and Their Applications; Dynamics and Control of Renewable Energy Systems; Energy Harvesting; Control of Smart Buildings and Microgrids; Energy Systems. Tysons, Virginia, USA. October 11–13, 2017. V003T39A002. ASME. https://doi.org/10.1115/DSCC2017-5115
Download citation file: