Novelty in 2D CartPole Domain

In this chapter, we apply the constructs defined in Chapter 1 to the relatively simple domain of 2D CartPole. We consider different versions of CartPole agents to highlight the different effects of novelties on an agent. The results generally show that the novelty theoretic framework allows the estimation of different novelties’ impact on the performance of agents, which can be used for testing open-world learning hypotheses. This chapter presents a few surprising results that help further inform the framework.