
nvs-bench is a standardized and easily reproducible novel-view synthesis (3D Gaussian Splats, NeRFs etc…) benchmark that anyone can setup on a new method in ~5 minutes and ~10 lines of code. It started from the following observations: The NVS research community commonly evaluates on the same datasets, but these datasets have different sourcing and preprocessing steps. All methods expect the same input format and can output rendered images. And, rendered images are all you need for evaluation.
Add a new method on Github.
The benchmark combines the 17 most commonly evaluated on scenes. The scenes range from 100s to 1000s of images and span a variety of scenarios: object-orbits, multi-room flythroughs, indoor and outdoor, fixed and variable lighting. Image resolutions have been pre-selected (images_*/ → images/) and names 1-indexed. Poses are kept from their sources.
| Method | PSNR Higher is better | SSIM Higher is better | LPIPS Lower is better | Time Lower is better | GPU Memory Lower is better |
|---|---|---|---|---|---|
| EDGS | 27.22 | 0.8506 | 0.2226 | 34m 13s | 12.92 GB |
| brush | 27.30 | 0.8488 | 0.2492 | 15m 31s | 4.67 GB |
| LichtFeld-Studio | 26.91 | 0.8347 | 0.2796 | 5m 11s | 4.93 GB |
| Triangle Splatting | 25.88 | 0.8066 | 0.2813 | 41m 21s | 16.41 GB |
| 3DGS | 26.07 | 0.8087 | 0.3011 | 22m 54s | 10.96 GB |
| EVER | 25.68 | 0.8047 | 0.3038 | 1h 33m 12s | 17.28 GB |
| gsplat | 25.60 | 0.7861 | 0.3091 | 11m 4s | 2.16 GB |
| 3DGRUT | 25.86 | 0.7897 | 0.3145 | 14m 12s | 12.03 GB |
| On-the-fly NVS | 18.08 | 0.5562 | 0.5246 | 6m 7s | 14.70 GB |
Click on a method in the table to see its renderings.