Structure And Computation Of Equilibria In Markov Games