Scene selection for teaching basic visual concepts in the Refer4Learning app

Refer4Learning is an application that helps teachers in the early stages of children education to work on basic concepts such as color, size, or position of simple geometric objects. This type of concepts are imprecise by nature and, thus, establishing the correspondence between an expression of natural language that uses these concepts and the reality that is intended to be described is a matter of degree. In this work, we explain how Refer4Learning performs the selection of visual scenes to practice with these concepts through the use of referring expressions, which are noun phrases aimed at identifying a given object within a scene. As we shall see, this is done through the use of a specificity measure together with appropriate fuzzy models to deal with the mentioned basic visual concepts.