A rollout algorithm framework for heuristic solutions to finite-horizon stochastic dynamic programs.

•We make recent advances in rollout algorithms more accessible.•We formalize rollout variants exploiting the pre- and post-decision states.•We present new analytical results relating the performance of rollout variants.•Our policy-based proofs make a closer connection dynamic programming.•We apply our framework to a dynamic and stochastic knapsack problem.