Rational Agents

1
Rational Agents Strategic Games

• Nico Roos

2
Rational Agents

• What is rational?
• What is a policy?
• What is a policy for a reactive agent?
• Is the full subsumption architecture a reactive
  agent according to this definition?
• Is an agent with Neural Network a reactive agent?
• Is an agent with Recurent NN a reactive agent?
• What is the Markov Property?

3
Rational Agents

• What is the problem with observability?
• What does Pr(st ot) ? 0,1 imply for the
  distinguishability of environment states?
• What is a transition model?

4
Rational Agents

• What is the difference between goals and
  utilities?
• What are utilities? (point of view)
• What is an optimal action for an agent in a
• deterministic world?
• a stochastic world?
• What is a greedy policy?
• When is it optimal?

5
Strategic Games

• What is a strategic game?
• What is a payoff function?
• What is a zero-sum game?
• How about chess? loosing 0, remise ½,
  winning 1
• What is a coordination game?
• How do we determine the strategy to choose?
• The prisoners dilemma
• What is a Nash equilibrium?

6
John Nash
7
John Nash

• Does the movie show a prisoners dilemma?

8
Strategic Games

• What is Pareto optimality (Pareto efficiency)?
• Is a Nash equilibrium Pareto optimal?
• Is Pareto optimality a Nash equilibrium?
• What is social welfare?
• Is a Nash equilibrium a social welfare solution?
• Is a social welfare solution a Nash equilibrium?
• What is a mixed strategy?
• Does it result in a good solution?