Convex Optimization Meets Formal Methods : Verification, Synthesis, And Learning In Markov Decision Processes