UAV Formation Shape Control via Decentralized Markov Decision Processes

In this paper, we present a decentralized unmanned aerial vehicle (UAV) swarm formation control approach based on a decision theoretic approach. Specifically, we pose the UAV swarm motion control problem as a decentralized Markov decision process (Dec-MDP). Here, the goal is to drive the UAV swarm from an initial geographical region to another geographical region where the swarm must form a three-dimensional shape (e.g., surface of a sphere). As most decision-theoretic formulations suffer from the curse of dimensionality, we adapt an existing fast approximate dynamic programming method called nominal belief-state optimization (NBO) to solve the formation control problem approximately. We perform numerical studies in MATLAB to validate the performance of the above control algorithms.

Article

Download

View UAV Formation Shape Control via Decentralized Markov Decision Processes