Add G3Splat pretrained checkpoints
Browse files- README.md +97 -0
- assets/teaser.png +3 -0
- g3splat_mast3r_2dgs_align_orient_re10k.ckpt +3 -0
- g3splat_mast3r_3dgs_align_orient_re10k.ckpt +3 -0
README.md
CHANGED
|
@@ -1,3 +1,100 @@
|
|
| 1 |
---
|
| 2 |
license: mit
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
+
tags:
|
| 4 |
+
- 3d-reconstruction
|
| 5 |
+
- gaussian-splatting
|
| 6 |
+
- novel-view-synthesis
|
| 7 |
+
- depth-estimation
|
| 8 |
+
- pose-estimation
|
| 9 |
+
- computer-vision
|
| 10 |
+
- pytorch
|
| 11 |
+
- 3dgs
|
| 12 |
+
- 2dgs
|
| 13 |
+
- feed-forward
|
| 14 |
+
- self-supervised
|
| 15 |
+
language:
|
| 16 |
+
- en
|
| 17 |
+
pipeline_tag: image-to-3d
|
| 18 |
+
library_name: pytorch
|
| 19 |
+
arxiv: "2512.17547"
|
| 20 |
---
|
| 21 |
+
|
| 22 |
+
# G³Splat: Geometrically Consistent Generalizable Gaussian Splatting
|
| 23 |
+
|
| 24 |
+
<p align="center">
|
| 25 |
+
<a href="https://m80hz.github.io/g3splat"><img src="https://img.shields.io/badge/🌐_Project_Page-007ACC?style=for-the-badge" alt="Project Page"></a>
|
| 26 |
+
<a href="https://arxiv.org/abs/2512.17547"><img src="https://img.shields.io/badge/📄_Paper-B31B1B?style=for-the-badge" alt="arXiv"></a>
|
| 27 |
+
<a href="https://github.com/m80hz/g3splat"><img src="https://img.shields.io/badge/💻_Code-181717?style=for-the-badge&logo=github" alt="GitHub"></a>
|
| 28 |
+
</p>
|
| 29 |
+
|
| 30 |
+
<p align="center">
|
| 31 |
+
<img src="assets/teaser.png" alt="G³Splat Teaser" width="100%">
|
| 32 |
+
</p>
|
| 33 |
+
|
| 34 |
+
## Model Description
|
| 35 |
+
|
| 36 |
+
**G³Splat** is a pose-free, self-supervised framework for generalizable Gaussian splatting that achieves state-of-the-art performance in:
|
| 37 |
+
- 🎯 **Geometry Reconstruction** - Accurate depth and mesh reconstructions
|
| 38 |
+
- 📐 **Relative Pose Estimation** - No camera poses required at inference
|
| 39 |
+
- 🎨 **Novel View Synthesis** - High-quality image rendering from new viewpoints
|
| 40 |
+
|
| 41 |
+
## Available Checkpoints
|
| 42 |
+
|
| 43 |
+
| Model | Gaussian Type | Training Data | File |
|
| 44 |
+
|:------|:-------------:|:-------------:|:----:|
|
| 45 |
+
| G³Splat-3DGS | 3DGS | RealEstate10K | `g3splat_mast3r_3dgs_align_orient_re10k.ckpt` |
|
| 46 |
+
| G³Splat-2DGS | 2DGS | RealEstate10K | `g3splat_mast3r_2dgs_align_orient_re10k.ckpt` |
|
| 47 |
+
|
| 48 |
+
## Quick Start
|
| 49 |
+
|
| 50 |
+
```python
|
| 51 |
+
from huggingface_hub import hf_hub_download
|
| 52 |
+
|
| 53 |
+
# Download 3DGS model
|
| 54 |
+
ckpt_path = hf_hub_download(
|
| 55 |
+
repo_id="m80hz/g3splat",
|
| 56 |
+
filename="g3splat_mast3r_3dgs_align_orient_re10k.ckpt"
|
| 57 |
+
)
|
| 58 |
+
|
| 59 |
+
# Or download 2DGS model
|
| 60 |
+
ckpt_path_2dgs = hf_hub_download(
|
| 61 |
+
repo_id="m80hz/g3splat",
|
| 62 |
+
filename="g3splat_mast3r_2dgs_align_orient_re10k.ckpt"
|
| 63 |
+
)
|
| 64 |
+
```
|
| 65 |
+
|
| 66 |
+
## Usage
|
| 67 |
+
|
| 68 |
+
```bash
|
| 69 |
+
# Clone the repository
|
| 70 |
+
git clone https://github.com/m80hz/g3splat
|
| 71 |
+
cd g3splat
|
| 72 |
+
|
| 73 |
+
# Run demo
|
| 74 |
+
python demo.py --checkpoint pretrained_weights/g3splat_mast3r_3dgs_align_orient_re10k.ckpt
|
| 75 |
+
```
|
| 76 |
+
See the [GitHub repository](https://github.com/m80hz/g3splat) for full installation and usage instructions.
|
| 77 |
+
|
| 78 |
+
## Training Details
|
| 79 |
+
|
| 80 |
+
- **Training Data**: RealEstate10K
|
| 81 |
+
- **Resolution**: 256×256
|
| 82 |
+
- **Backbones**: MASt3R (ViT-Large) and VGGT
|
| 83 |
+
- **Hardware**: 24× A100 GPUs (6 nodes × 4 GPUs)
|
| 84 |
+
- **Training Time**: ~6 hours
|
| 85 |
+
|
| 86 |
+
## Citation
|
| 87 |
+
|
| 88 |
+
```bibtex
|
| 89 |
+
@inproceedings{g3splat,
|
| 90 |
+
title = {G3Splat: Geometrically Consistent Generalizable Gaussian Splatting},
|
| 91 |
+
author = {Hosseinzadeh, Mehdi and Chng, Shin-Fang and Xu, Yi and Lucey, Simon and Reid, Ian and Garg, Ravi},
|
| 92 |
+
booktitle = {arXiv:2512.17547},
|
| 93 |
+
year = {2025},
|
| 94 |
+
url = {https://arxiv.org/abs/2512.17547}
|
| 95 |
+
}
|
| 96 |
+
```
|
| 97 |
+
|
| 98 |
+
## License
|
| 99 |
+
|
| 100 |
+
MIT License
|
assets/teaser.png
ADDED
|
Git LFS Details
|
g3splat_mast3r_2dgs_align_orient_re10k.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:75c8f10cb2d51ca4d9565afffaaed9fe4a1a38781e9a9722db4a3a6a5b82eb66
|
| 3 |
+
size 2448474977
|
g3splat_mast3r_3dgs_align_orient_re10k.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5b856fff90b86dbef835e6301d175fb303ddc9a4bb4faefcc12a91e1f08e1663
|
| 3 |
+
size 2448477025
|