CapturingMultipleIlluminationConditionsusingTimeandColorMultiplexing

Many vision and graphics problems such as relighting, structured light scanning and photometric stereo, need im- ages of a scene under a number of different illumination conditions. It is typically assumed that the scene is static. To extend such methods to dynamic scenes, dense optical flow can be used to register adjacent frames. This registra- tion becomes inaccurate if the frame rate is too low with respect to the degree of movement in the scenes. We present a general methodthat extendstime multiplex- ing with color multiplexing in order to better handle dy- namic scenes. Our method allows for packing more illumi- nation information into a single frame, thereby reducing the number of required frames over which optical flow must be computed. Moreover, color-multiplexed frames lend them- selves better to reliably computing optical flow. We show that our method produces better results compared to time- multiplexing alone. We demonstrate its application to re- lighting, structured light scanning and photometric stereo in dynamic scenes.