Skip to main content

InterMimicGen: Self-Evolving Motion Imitation for Humanoid Loco-Manipulation

UIUC and NVIDIA turn sparse human demonstrations into an ever-growing set of executable humanoid motions, deployed on real robots including Dexmate's Vega.

Paper

5 Oct 2026

A Dexmate Vega relocates a chair, one of InterMimicGen's real-robot deployments (Figure 1 of the paper).

InterMimicGen: Scaling Humanoid Loco-Manipulation through Self-Evolving Motion Imitation

Yucheng Zhang1,†, Sirui Xu1,†,*, Jinhong Li1,†, Liuyu Bian1,†, Anatulya Nandi1, Derek Zhang1, Xiangchen Liu1, Xueting Li2, Umar Iqbal2, Yu-Xiong Wang1,‡, Liang-Yan Gui1,‡

  • 1University of Illinois Urbana-Champaign
  • 2NVIDIA

† Equal contribution; * Project lead; ‡ Equal advising

arXiv preprint arXiv:2610.06850

Abstract

Captured human-object interactions provide rich supervision for humanoid loco-manipulation, but they are sparse, heterogeneous, and not directly executable by robots. We introduce InterMimicGen, a self-evolving motion-imitation framework in which robot motion data and a tracking policy improve each other. First, we consolidate motion-captured human-object interaction datasets and retarget them into humanoid robot references while preserving whole-body coordination and dexterous hand-object relationships. This produces a large and diverse humanoid robot reference collection for dexterous whole-body loco-manipulation. Second, we train a physics-based generalist tracker that executes these references in simulation on a humanoid with dexterous hands, covering a scale and diversity beyond prior humanoid tracking systems for loco-manipulation. Third, we close a data flywheel: each round makes small, task-preserving changes to where an interaction takes place and how the body performs it, fine-tunes the tracker on them, and keeps only the variants whose simulated execution completes the task, which seed the next round. With more iterations, these small edits compound into broader coverage around the sparse original demonstrations while preserving task semantics and motion quality. Experiments show contact-preserving retargeting across robot configurations, broad tracking with a single generalist policy, executable motions that keep growing over augmentation rounds, and transfer to real robots. InterMimicGen provides a unified path from heterogeneous human demonstrations to a continually expanding motion resource for humanoid robot learning.

Citation

@misc{zhang2026intermimicgenscalinghumanoidlocomanipulation,  title = {InterMimicGen: Scaling Humanoid Loco-Manipulation through Self-Evolving Motion Imitation},   author = {Yucheng Zhang and Sirui Xu and Jinhong Li and Liuyu Bian and Anatulya Nandi and Derek Zhang and Xiangchen Liu and Xueting Li and Umar Iqbal and Yu-Xiong Wang and Liang-Yan Gui},  year = {2026},  eprint = {2610.06850},  archivePrefix = {arXiv},  primaryClass = {cs.RO},  url = {https://arxiv.org/abs/2610.06850}, }

Start Your Physical AI Journey with Us