Expectation of Reward

The expected value function after t steps, starting from state s, using policy $\pi$ is:

$E_{s}^{\pi}[\vec{v}(X_{t})]=[P_{\pi}^{t-1}\cdot\vec{v}](s)$