On Efficient Solutions of General Structured Markov Processes in Quantum Computational Environments

Abstract

We study from a theoretical viewpoint the fundamental problem of efficiently computing the stationary distribution of general classes of structured Markov processes. In strong contrast with previous work, we consider this fundamental problem within the context of quantum computational environments from a mathematical perspective and devise the first quantum algorithms for computing the stationary distribution of general structured Markov processes. We derive a mathematical analysis of the computational properties of our quantum algorithms together with related theoretical results, establishing that our quantum algorithms provide the potential for significant computational improvements over that of the best-known and most-efficient classical algorithms in various settings of both theoretical and practical importance. Although motivated by general structured Markov processes, our quantum algorithms can be exploited to address a much larger class of numerical computation problems, as well as to potentially play the role of a subroutine as part of solving larger computational problems involving the stationary distribution on a quantum computer.