Which of the following quantities is(are) necessarily finite if an MDP has finite states and finite actions per state?
The number of possible value functions
The number of possible deterministic policies
Values of each state if discount factor is 1
Values of each state if the discount factor is < 1