Active Learning in Unknown Environment

• Consider actions, their outcomes, and possible reward
• Select action that maximizes expected reward
• From utility theory, the expected utility of an action given evidence can be calculated as
• $U(i) = R(i) + \max_a \sum_j M_{ij}^a * U(j)$