Novel View Synthesis for Gastroendoscopy

Project Overview

Novel view synthesis (NVS) is an active research topic in computer vision, owing to the success of neural radiance field (NeRF) and 3D Gaussian splatting (3DGS) methods. NVS methods reconstruct a 3D representation of the scene from captured images or videos and enable the generation of novel views from arbitrary viewpoints. In this project, we aim to develop NVS methods for gastroendoscopy, which opens the door to potential applications such as extending the field of view of endoscopic images and enabling digital twins for 3D archiving and endoscopist manipulation training.