Papers
arxiv:2610.22951

MambaAct: Efficient Mamba Action Experts for Flow-Matching Vision-Language-Action Models

Published on Oct 16
ยท Submitted by
Pham Gia Khuyen
on Oct 23
Authors:
,
,

Abstract

MambaAct replaces the transformer action expert in flow-matching VLA policies with a compact Mamba-based expert and a context compressor to cut inference latency while improving robotic manipulation success.

Vision-language-action (VLA) models have shown strong promise for generalist robotic manipulation, but their inference cost remains a major bottleneck for real-time control. This limitation is especially pronounced in flow-matching VLAs such as ฯ€_{0.5}, where the action expert is evaluated repeatedly during iterative denoising. We introduce MambaAct, an efficient Mamba action expert for flow-matching VLA policies. MambaAct retains the pretrained visual-language prefix encoder of ฯ€_{0.5}, while replacing its transformer-based action expert with a compact Mamba-based action expert. Within this expert, Mamba serves as the action mixer that models dependencies across the noisy continuous-action sequence. To preserve visual-language conditioning without repeated token-level cross-attention, MambaAct uses a lightweight Context Compressor to map Vision-language model (VLM) prefix tokens into a compact conditioning signal that gates and modulates each Mamba action block. MambaAct uses a 10times smaller action expert and reduces flow-matching denoising latency by 64.8% on LIBERO and 58.8% in real-world deployment, while improving mean LIBERO success by 1.08 percentage points across three independent fine-tuning seeds and maintaining gains on LIBERO-Plus and real-world benchmarks. Our code and model weights are publicly available at https://github.com/giakhuyendihoc/MambaAct.

Community

Paper author Paper submitter

Hi everyone! ๐Ÿ‘‹ We're excited to share MambaAct, an efficient action expert for flow-matching VLAs.

Flow-matching VLAs like ฯ€0.5 run their action expert many times during denoising, which makes inference a bottleneck for real-time control. MambaAct keeps ฯ€0.5's pretrained vision-language encoder but replaces the transformer action expert with a compact Mamba-based one. A lightweight Context Compressor turns the VLM tokens into a compact conditioning signal, so we avoid repeated token-level cross-attention.

๐Ÿš€ Key results:

  • 10ร— smaller action expert
  • 64.8% lower denoising latency on LIBERO, 58.8% on a real robot
  • +1.08 pp mean success on LIBERO (3 seeds), with gains maintained on LIBERO-Plus and real-world tasks

๐Ÿ’ป Code: https://github.com/giakhuyendihoc/MambaAct
Weight will be released soon!

This is an automated message from the Librarian Bot. I found the following papers similar to this paper.

The following papers were recommended by the Semantic Scholar API

Please give a thumbs up to this comment if you found it helpful!

If you want recommendations for any Paper on Hugging Face checkout this Space

You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2610.22951
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.22951 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.22951 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.22951 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.