Benchmarking Counterfactual Image Generation
arxiv(2024)
摘要
Counterfactual image generation is pivotal for understanding the causal
relations of variables, with applications in interpretability and generation of
unbiased synthetic data. However, evaluating image generation is a
long-standing challenge in itself. The need to evaluate counterfactual
generation compounds on this challenge, precisely because counterfactuals, by
definition, are hypothetical scenarios without observable ground truths. In
this paper, we present a novel comprehensive framework aimed at benchmarking
counterfactual image generation methods. We incorporate metrics that focus on
evaluating diverse aspects of counterfactuals, such as composition,
effectiveness, minimality of interventions, and image realism. We assess the
performance of three distinct conditional image generation model types, based
on the Structural Causal Model paradigm. Our work is accompanied by a
user-friendly Python package which allows to further evaluate and benchmark
existing and future counterfactual image generation methods. Our framework is
extendable to additional SCM and other causal methods, generative models, and
datasets.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要