Proposed Algorithm Overview

AlgorithmOverview

Abstract

     Multispectral imaging is highly demanded for precise color reproduction and for various computer vision applications. Multispectral imaging with a multispectral color filter array (MCFA), which can be considered as a multispectral extension of commonly used consumer RGB cameras, could be a simple, low-cost, and practical system. A challenge of the multispectral imaging with the MCFA is multispectral demosaicking because each spectral component of the MCFA is severely undersampled. In this paper, we propose a novel multispectral demosaicking algorithm using a guided filter. The guided filter is recently proposed as an excellent structurepreserving filter. The guided filter requires so-called a guide image. A main issue of the guided filter is how to obtain an effective guide image. In our proposed algorithm, we generate the guide image from the most densely sampled spectral component in the MCFA. Then, ohter spectral components are interpolated by the guided filter. Experimental results demonstrate that our proposed algorithm outperforms other existing demosaicking algorithms both visually and quantitatively.


References

  • Multispectral Demosaicking Using Guided Filter
    Yusuke Monno, Masayuki Tanaka and Masatoshi Okutomi
    IS&T/SPIE Electronic Imaging (EI2012), Digital Photography VIII (Proc. SPIE 8299), pp.82990O-1-7, January, 2012. [PDF]

Dataset and Code


Results

Comparison with other multispectral demosaicking algorithms

Or-band images: Butterfly

Original image BTES [2]
AKU [3] Proposed


B-band images: Chinadress

Original image BTES [2]
AKU [3] Proposed


sRGB images: Color

Original image BTES [2]
AKU [3] Proposed


Comparison with Bayer demosaicking algorithms

sRGB images: Butterfly

Original image AHD [4]
LPA [5] Proposed


References

[1] K. He, J. Sun and X. Tang, "Guided image filtering," Proc. of the 11th European Conference on Computer Vision (ECCV), vol.6311, pp.1-14, 2010.
[2] L. Miao, H. Qi, R. Ramanath and W. E. Snyder, "Binary tree-based generic demosaicking algorithm for multispectral filter arrays," IEEE Transactions on Image Processing, vol.15, pp.3550-3558, 2006.
[3] Y. Monno, M. Tanaka and M. Okutomi, "Multispectral demosaicking using adaptive kernel upsampling," Proc. of the IEEE International Conference on Image Processing (ICIP), pp.3218-3221, 2011.
[4] K. Hirakawa and T. W. Parks, "Adaptive homogeneity-directed demosaicking algorithm," IEEE Transactions on Image Processing, vol.14, pp.360-369, 2005.
[5] D.Paliy, V. Katkovnik, R. Bilcu, S. Alenius and K. Egiazarian, "Spatially adaptive color filter array interpolation for noiseless and noisy data," International Journal of Imaging Systems and Technology, vol.17, pp.105-122, 2007.