Project page · 2026

GeoWeaver: Accurate Long-Sequence 3D Reconstruction via Hierarchical Geometric Assembly

Tinghao Jiang1,2, Sheng Tang2, Shengzhe Wei2, Juntong Fang3, Weiqi Zhang3, Junsheng Zhou3, Zesong Li2
1 Shanghai Jiao Tong University 2 Kosmo Research 3 School of Software, Tsinghua University
Paper coming soon Code BibTeX
GeoWeaver long-sequence reconstruction overview

GeoWeaver preserves accurate local geometric priors while assembling long RGB sequences into globally consistent cameras and point clouds.

Reconstruction videos

Explore indoor, outdoor, driving, and urban-scale reconstructions across four long-sequence benchmarks.

Courthouse

Tanks & Temples

Barn

Tanks & Temples

Meeting Room

Tanks & Temples

Virtual KITTI 2

VKITTI2

Keble College

Oxford Spires

Blenheim

Oxford Spires

Overview

Abstract

Long-sequence 3D reconstruction from RGB videos requires both accurate local geometry and globally consistent camera motion. Feed-forward models provide strong depth and pose predictions, but their memory cost prevents joint inference over long sequences. Chunk-wise processing improves scalability, yet independently predicted chunks often exhibit scale drift, pose errors, and point-cloud misalignment.

We present GeoWeaver, a unified framework comprising a Geometric Prior Model (GPM) and Test-Time Adaptation (TTA). The GPM predicts chunk-wise depth, confidence, and camera parameters as adjustable geometric priors. TTA then performs sequential initialization, global chunk-level Sim(3) alignment, and coarse-to-fine refinement of camera poses, affine depth corrections, and intrinsics. Dense correspondences provide adjacent, cross-chunk, and long-range constraints, while a robust CDF-style objective jointly optimizes weighted 2D reprojection and 3D consistency residuals.

Experiments across diverse long-sequence benchmarks demonstrate improved camera accuracy, global consistency, and point-cloud quality. Applying the same TTA procedure to different geometric prior models consistently improves their trajectory estimates, showing that GeoWeaver is not tied to a specific GPM.

Approach

Method overview

A feed-forward geometric prior model supplies reliable local predictions; hierarchical test-time adaptation turns them into a coherent global reconstruction.
GeoWeaver geometric prior model and hierarchical test-time adaptation pipeline
GeoWeaver architecture. GeoWeaver predicts chunk-wise depth, confidence, and cameras, then assembles them through sequential initialization, global chunk alignment, and frame-level refinement.
01

Chunk-wise geometric priors

A long RGB sequence is split into short chunks with one shared frame. The GPM predicts depth, confidence, camera pose, and intrinsics at bounded memory cost.

02

Dense correspondence routing

Confidence-aware dense matches connect temporal neighbors and long-range co-visible views, supplying constraints to each adaptation stage.

03

Hierarchical geometric assembly

Global Sim(3) alignment corrects chunk drift before joint refinement of frame poses, affine depth, and camera intrinsics.

Evaluation

Results

GeoWeaver produces coherent geometry, better aligned trajectories, and fewer discontinuities while using only one shared frame between adjacent chunks.

Oxford Spires Per-Scene Results

Relative rotation error (RRE, degrees) ↓ and absolute trajectory error (ATE, metres) ↓.

Method Keble-04 Observatory-01 Blenheim-05 Christ Church-02 Average
RRE ↓ATE ↓ RRE ↓ATE ↓ RRE ↓ATE ↓ RRE ↓ATE ↓ RRE ↓ATE ↓
MBA Opt. 4.25035.2401.27023.7101.81038.2605.83020.0803.29029.323
DA3 FF 14.44222.6647.0878.3652.1231.53816.19333.9929.96116.640
VGGT-Long Chunk-FF 16.85013.35014.9904.25018.48011.24025.61020.68018.98312.380
Scal3R Chunk-FF 7.8302.1305.2701.5707.4302.5606.83016.0006.8405.565
LoGeR Chunk-FF 11.0004.1348.0005.6329.8002.6213.7003.5538.1003.985
LingBot-Map Stream 2.0908.8700.9706.9601.0404.5701.2403.8801.3356.070
AMB3R Hybrid 8.3754.9405.3681.22010.74011.83010.14012.7608.6557.687
GeoWeaver Hybrid 0.4321.4300.3601.8200.3301.4301.18012.8100.5754.372

Mip-NeRF 360 Visualization

Qualitative GeoWeaver point-cloud comparison on indoor and outdoor scenes
Representative comparisons on Observatory and the Mip-NeRF 360 room sequence.

Reference

BibTeX

Citation information will be updated when the paper is released.
@article{jiang2026geoweaver,
  title={GeoWeaver: Accurate Long-Sequence 3D Reconstruction via Hierarchical Geometric Assembly},
  author={Jiang, Tinghao and Tang, Sheng and Wei, Shengzhe and Fang, Juntong and Zhang, Weiqi and Zhou, Junsheng and Li, Zesong},
  year={2026}
}