Toward industrial use of continual learning : new metrics proposal for class incremental learning
arxiv(2024)
摘要
In this paper, we investigate continual learning performance metrics used in
class incremental learning strategies for continual learning (CL) using some
high performing methods. We investigate especially mean task accuracy. First,
we show that it lacks of expressiveness through some simple experiments to
capture performance. We show that monitoring average tasks performance is over
optimistic and can lead to misleading conclusions for future real life
industrial uses. Then, we propose first a simple metric, Minimal Incremental
Class Accuracy (MICA) which gives a fair and more useful evaluation of
different continual learning methods. Moreover, in order to provide a simple
way to easily compare different methods performance in continual learning, we
derive another single scalar metric that take into account the learning
performance variation as well as our newly introduced metric.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要