Papers
arxiv:2606.24472

G^3VLA: Geometric Inductive Bias for Vision-Language-Action Models

Published on Oct 14
· Submitted by
Yue Peng
on Oct 15
Authors:
,
,
,
,
,

Abstract

G³VLA injects calibrated multi-camera geometry into vision-language-action models via ray embeddings and cross-view fusion, improving robot manipulation without changing the action space.

Vision-language-action (VLA) models have rapidly advanced generalist robot manipulation by harnessing the semantic knowledge of pretrained vision-language backbones. However, their visual representations are typically grounded in 2D image coordinates rather than calibrated camera geometry. This limitation is especially pronounced in multi-camera systems, where views are coupled by known intrinsics and extrinsics but processed as independent images. We propose G^3VLA, a camera-aware geometric module that injects calibrated structure into the visual-token stream of a pretrained VLA without altering its action space or original action-learning objective. G^3VLA combines intrinsic-conditioned ray embeddings, projective positional encoding (PRoPE), and bidirectional cross-view fusion to establish geometrically consistent representations across camera views. Geometric supervision is provided by ground-truth point maps or confidence-gated π^3X teacher predictions, enabling training without depth sensors or manual geometric annotations. On π_0, G^3VLA consistently improves performance on LIBERO and RoboCasa24 under both supervision regimes, while ground-truth supervision improves five-task RoboTwin2.0 averages with three cameras. Experiments on camera-shifted LIBERO-Goal and real robots demonstrate improved robustness to unseen camera viewpoints. Controlled calibration studies across π_0 and π_{0.5} show that these gains depend on correct camera geometry while remaining stable under mild calibration perturbations. These results demonstrate that grounding VLA visual tokens in calibrated camera geometry provides a simple and general mechanism for improving geometric consistency, multi-view reasoning, and viewpoint robustness in pretrained robot policies.

Community

Paper author Paper submitter

We introduce G³VLA, a camera-aware module that helps pretrained VLAs use the geometric relationships between multiple camera views.
It combines intrinsic-conditioned ray embeddings, projective positional encoding, and bidirectional cross-view fusion while preserving the policy’s action space and native imitation objective. Geometry supervision can come from ground-truth point maps or an offline π³X teacher; inference requires no depth sensor or geometry teacher.
The results highlight both the value of calibrated geometry and its dependence on supervision quality and the pathway connecting visual tokens to actions.
We welcome discussion on integrating geometric priors into generalist robot policies!

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2606.24472
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2606.24472 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2606.24472 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2606.24472 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.