Proposed System Overview
Project Abstract
In this project, we have proposed and developed a practical one-shot multispectral imaging system using a single image sensor. In the developed system, we have jointly proposed a novel five-band multsiepctral filter array and a high-performance demosaicking algorithm, which can generate a high-quality multispectral image in real time. Based on the algorithm we have proposed, we built a prototype multispectral camera, which can capture a full-HD five-band multispectral video and display sRGB images with 30 fps. We have also demonstrated real applications of our prototype camera for relighting and spectral reflectance estimation. Our developed system outperforms a conventional color imaging system especially for highly color-saturated objects.
References
- A Practical One-Shot Multispectral Imaging System Using a Single Image Sensor
Yusuke Monno, Sunao Kikuchi, Masayuki Tanaka and Masatoshi Okutomi
IEEE Transactions on Image Processing (TIP), vol.24, no.10, pp.3048-3059, October, 2015. [Official access, Preprint] - Multispectral Demosaicking Using Guided Filter
Yusuke Monno, Masayuki Tanaka and Masatoshi Okutomi
IS&T/SPIE Electronic Imaging (EI2012), Digital Photography VIII (Proc. SPIE 8299), pp.82990O-1-7, January, 2012. [Project] - Multispectral Demosaicking Using Adaptive Kernel Upsampling
Yusuke Monno, Masayuki Tanaka, and Masatoshi Okutomi
IEEE International Conference on Image Processing (ICIP2011), pp.3218-3221, September, 2011. [Project]
Dataset and Source Code
Example 5-band Images (JPEG compressed)
 |
||
;) sRGB |
;) R band |
;) Or band |
;) G band |
;) Cy band |
;) B band |
 |
||
;) sRGB |
;) R band |
;) Or band |
;) G band |
;) Cy band |
;) B band |
Example Video
Application 1: Relighting
 |
|||
;) Input (Incandescence) |
;) Ground trouth (D65) |
;) 3-band relighting |
;) 5-band relighting |
Application 2: Spectral Reflectance Estimation
     |