nvs-bench logo

nvs-bench is a standardized and easily reproducible novel-view synthesis (3D Gaussian Splats, NeRFs etc…) benchmark that anyone can setup on a new method in ~5 minutes and ~10 lines of code. It started from the following observations: The NVS research community commonly evaluates on the same datasets, but these datasets have different sourcing and preprocessing steps. All methods expect the same input format and can output rendered images. And, rendered images are all you need for evaluation.

Add a new method on Github.

All Scenes

The benchmark combines the 17 most commonly evaluated on scenes. The scenes range from 100s to 1000s of images and span a variety of scenarios: object-orbits, multi-room flythroughs, indoor and outdoor, fixed and variable lighting. Image resolutions have been pre-selected (images_*/images/) and names 1-indexed. Poses are kept from their sources.

Method
PSNR
Higher is better
SSIM
Higher is better
LPIPS
Lower is better
Time
Lower is better
GPU Memory
Lower is better
EDGS
27.22
0.8506
0.2226
34m 13s12.92 GB
brush
27.30
0.8488
0.2492
15m 31s4.67 GB
LichtFeld-Studio
26.91
0.8347
0.2796
5m 11s4.93 GB
Triangle Splatting
25.88
0.8066
0.2813
41m 21s16.41 GB
3DGS
26.07
0.8087
0.3011
22m 54s10.96 GB
EVER
25.68
0.8047
0.3038
1h 33m 12s17.28 GB
gsplat
25.60
0.7861
0.3091
11m 4s2.16 GB
3DGRUT
25.86
0.7897
0.3145
14m 12s12.03 GB
On-the-fly NVS
18.08
0.5562
0.5246
6m 7s14.70 GB

Training Time vs

No Method Selected

Click on a method in the table to see its renderings.