CQ-NIR

Coordinate Quantized Neural Implicit Representations for Multi-view Reconstruction

ICCV 2023

Sijia Jiang

Department of Computer Science

Wayne State University

Detroit, USA

Department of Computer Science

Wayne State University

Detroit, USA

Department of Computer Science

Wayne State University

Detroit, USA

abstract image abstract image

Abstract

In recent years, huge progress has been made on learn- ing neural implicit representations from multi-view images for 3D reconstruction. As an additional input complementing coordinates, using sinusoidal functions as positional encodings plays a key role in revealing high frequency details with coordinate-based neural networks. However, high frequency positional encodings make the optimization unstable, which results in noisy reconstructions and artifacts in empty space. To resolve this issue in a general sense, we introduce to learn neural implicit representations with quantized coordinates, which reduces the uncertainty and ambiguity in the field during optimization. Instead of con- tinuous coordinates, we discretize continuous coordinates into discrete coordinates using nearest interpolation among quantized coordinates which are obtained by discretizing the field in an extremely high resolution. We use discrete coordinates and their positional encodings to learn implicit functions through volume rendering. This significantly reduces the variations in the sample space, and triggers more multi-view consistency constraints on intersections of rays from different views, which enables to infer implicit function in a more effective way. Our quantized coordinates do not bring any computational burden, and can seamlessly work upon the latest methods. Our evaluations under the widely used benchmarks show our superiority over the state-of-the-art.

Results: Video

Results: Statistical Analysis

Results: Video in 3D

Citation

@inproceedings{sijia2023quantized,
    title={Coordinate Quantized Neural Implicit Representations for Multi-view 3D Reconstruction},
    author={Sijia Jiang and Jing Hua and Zhizhong Han},
    booktitle={{IEEE} International Conference on Computer Vision},
    year={2023}
}