BUFFER-X (ICCV 2025, 🌟Highlight🌟)

Minkyun Seo*, Hyungtae Lim*, Kanghee Lee, Luca Carlone, Jaesik Park

Towards zero-shot and beyond! 🚀
Official repository of BUFFER-X, a zero-shot point cloud registration method
across diverse scenes without retraining or tuning.

git clone https://github.com/MIT-SPARK/BUFFER-X
cd BUFFER-X
conda create -n bufferx python=3.11 -y
conda activate bufferx
./scripts/install.sh --cuda cu124 --with-hub

For other CUDA versions and optional dependencies, see the installation guide.

Download the pretrained models from Hugging Face:

python scripts/download_pretrained_models.py --source hf --repo-id Hyungtae-Lim/BUFFER-X

Download the preprocessed benchmark data (approximately 130 GB):

./scripts/download_all_data.sh

Then run an evaluation:

python test.py --dataset 3DMatch TIERS Oxford MIT --experiment_id threedmatch --verbose

To evaluate all supported datasets:

./scripts/eval_all.sh <EXPERIMENT ID>

For heterogeneous sensor settings:

./scripts/eval_all_hetero.sh <EXPERIMENT ID>

python test.py --dataset TIERS_hetero --src_sensor os0_128 --tgt_sensor os1_64 --experiment_id threedmatch --verbose

Pretrained checkpoints are hosted at Hyungtae-Lim/BUFFER-X. Maintainer upload instructions are in INSTALL.md.

This branch adds support for KISS-Matcher as an alternative to RANSAC for the final pose estimation step.

Please follow the official Python installation instructions provided in the KISS-Matcher repository: https://github.com/MIT-SPARK/KISS-Matcher?tab=readme-ov-file#package-installation

Pass --pose_estimator kiss_matcher on the command line:

python test.py --dataset 3DMatch --experiment_id threedmatch --pose_estimator kiss_matcher --verbose

To use RANSAC (default behavior):

python test.py --dataset 3DMatch --experiment_id threedmatch --pose_estimator ransac --verbose

You can also set the pose estimator and its options directly in the config files (e.g., config/indoor_config.py):

cfg.match.pose_estimator = "kiss_matcher"  # "ransac" or "kiss_matcher"
cfg.match.kiss_resolution = 0.3            # Voxel resolution for KISS-Matcher

Note: If kiss-matcher is not installed, the pipeline automatically falls back to RANSAC with a warning.

BUFFER-X++ introduces an incremental multi-scale processing strategy that stops computing additional scales once the pose estimate is already confident enough. This reduces unnecessary descriptor extraction and speeds up inference.

The early exit is triggered when the number of RANSAC/KISS-Matcher inliers exceeds early_exit_min_inliers after the first scale.

cfg.match.enable_early_exit = False   # Enable confidence-aware early exit (default: False)
cfg.match.early_exit_min_inliers = 50  # Minimum inlier count to trigger early exit

After each test run, results are automatically saved:

• Per-sample .txt: detailed per-frame metrics (success, RTE, RRE, inlier counts, timing) under per_sample_results/<exp_name>/.
• Summary .csv: aggregated statistics (recall, RTE/RRE mean ± std, timing) saved to the root directory as full_results/results_<exp_name>_<params>_<timestamp>.csv.

BUFFER-X supports training on either the 3DMatch or KITTI dataset. As un example, run the following command to train the model:

python train.py --dataset 3DMatch

If you find our work useful in your research, please consider citing:

@article{Seo_BUFFERX_arXiv_2025,
Title={BUFFER-X: Towards Zero-Shot Point Cloud Registration in Diverse Scenes},
Author={Minkyun Seo and Hyungtae Lim and Kanghee Lee and Luca Carlone and Jaesik Park},
Journal={2503.07940 (arXiv)},
Year={2025}
}

@misc{lim2026zeroshotpointcloudregistration,
title={Towards Zero-Shot Point Cloud Registration Across Diverse Scales, Scenes, and Sensor Setups}, 
author={Hyungtae Lim and Minkyun Seo and Luca Carlone and Jaesik Park},
year={2026},
eprint={2601.02759},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2601.02759}, 
}

This work was supported by IITP grant (RS-2021-II211343: AI Graduate School Program at Seoul National University) (5%), and by NRF grants funded by the Korea government (MSIT) (No. 2023R1A1C200781211 (65%) and No. RS-2024-00461409 (30%), respectively).

In addition, we appreciate the open-source contributions of previous authors, and especially thank Sheng Ao, the first author of BUFFER, for allowing us to use the term 'BUFFER' as part of the title of our study.

• FCGF
• Vector Neurons
• D3Feat
• PointDSC
• SpinNet
• GeoTransformer
• RoReg
• BUFFER

• 03/03/2026: Refactored evaluation/testing code for cleaner structure, improved logging, and more reliable result reporting.
• 28/02/2026: Added KISS-Matcher pose solver support and confidence-aware early exit for multi-scale processing.
• 06/01/2026: Extended version of the paper has been uploaded.
• 25/07/2025: This work is selected as a Highlight paper at ICCV 2025.
• 25/06/2025: This work is accepted by ICCV 2025.