Overview
There has been growing interest in learning robot skills from humans—both of which can be viewed as physical agents that interact with the world. In recent years, computer vision researchers have focused on creating digital twins of humans in virtual environments that behave like real ones, while roboticists have been building physical agents capable of interacting with the real world. We believe that progress in one field can greatly benefit the other. On one hand, virtual humans can be regarded as a special form of robotic agents; on the other hand, robots can learn manipulation and locomotion from human demonstrations, including those performed by simulated humans. Through the proposed workshop, we aim to bring these two fields together to explore common challenges—such as retargeting, embodiment gap, contact modeling, data scarcity, and the role of foundation models, among others. We hope this workshop will serve as a fertile ground for inspiring new research directions and fostering cross-disciplinary collaboration in this space.
Confirmed Keynote Speakers
Invited Spotlight Speakers
Schedule
| Time | Content | Speaker |
|---|---|---|
| 09:25 – 09:30 | Opening Remark | |
| 09:30 – 10:00 | Keynote 1 | Baoxiong Jia |
| 10:00 – 10:45 | Spotlight 1 | Haoru Xue, Yuxuan Kuang, Yilin Wu |
| 10:45 – 11:15 | Keynote 2 | Kristen Grauman |
| 11:15 – 11:45 | Keynote 3 | Umar Iqbal |
| 11:45 – 12:15 | Lunch Break | |
| Poster Session | ||
| 13:30 – 14:00 | Keynote 4 | Gerard Pons-Moll |
| 14:00 – 14:30 | Keynote 5 | Marc Pollefeys |
| 14:30 – 15:15 | Spotlight 2 | Toru Lin, Mert Albaba, Sirui Xu |
| 15:15 – 15:45 | Keynote 6 | Hanbyul Joo |
| 15:45 – 16:15 | Keynote 7 | Lingni Ma |
| 16:30 – 17:15 | Panel Discussion |
Accepted / Invited Paper List
- InterPrior: Scaling Generative Control for Physics-Based Human-Object Interactions
Sirui Xu, Samuel Schulter, Morteza Ziyadi, Xialin He, Xiaohan Fei, Yu-Xiong Wang, Liang-Yan Gui - UniDex: A Robot Foundation Suite for Universal Dexterous Hand Control from Egocentric Human Videos
Gu Zhang, Qicheng Xu, Haozhe Zhang, Jianhan Ma, Long He, Yiming Bao, Zeyu Ping, Zhecheng Yuan, Chenhao Lu, Chengbo Yuan, Tianhai Liang, Xiaoyu Tian, Maanping Shao, Feihong Zhang, Mingyu Ding, Yang Gao, Hao Zhao, Hang Zhao, Huazhe Xu - Action-Sketcher: From Reasoning to Action via Visual Sketches for Robotic Manipulation
Huajie Tan, Peterson Co, Yijie Xu, Shanyu Rong, Yuheng Ji, Cheng Chi, Xiansheng Chen, Zhongxia Zhao, Pengwei Wang, Zhongyuan Wang, Shanghang Zhang - AffordGen: Generating Diverse Demonstrations for Generalizable Object Manipulation with Affordance Correspondence
Jiawei Zhang, Kaizhe Hu, Yingqian Huang, Yuanchen Ju, Zhengrong Xue, Huazhe Xu - Recovering Physically Plausible Human-Object Interactions from Monocular Videos
Dingbang Huang, Etienne Vouga, Qixing Huang, Georgios Pavlakos - AGiLe: Learning Robust Long-Horizon Manipulation via Affordance-Grounded Bidirectional Latent Planning
Zixuan Chen, Xiangrong Feng, Jieqi Shi, Lin Shao, Jing Huo, Yang Gao - CrossHOI: Learning Cross-View Representations for Monocular 3D Human-Object Interaction Reconstruction
Pei Geng, Shanshan Zhang, Jian Yang - RHINO: Reconstructing Human Interactions with Novel Objects from Monocular Videos
Lixin Xue, Chengwei Zheng, Georgios Paschalidis, Chen Guo, Manuel Kaufmann, Juan Zarate, Dimitrios Tzionas - CARI4D: Category Agnostic 4D Reconstruction of Human-Object Interaction
Xianghui Xie, Bowen Wen, Yan Chang, Hesam Rabeti, Jiefeng Li, Ye Yuan, Gerard Pons-Moll, Stan Birchfield - OneHOI: Unifying Human-Object Interaction Generation and Editing
Jiun Tian Hoe, Weipeng Hu, Xudong Jiang, Yap-Peng Tan, Chee Seng Chan - Decoupled Generative Modeling for Human-Object Interaction Synthesis
Hwanhee Jung, Seunggwan Lee, Jeongyoon Yoon, SeungHyeon Kim, Giljoo Nam, Qixing Huang, Sangpil Kim - MoCapAnything: Unified 3D Motion Capture for Arbitrary Skeletons from Monocular Videos
Kehong Gong, Zhengyu Wen, Weixia He, Mingxi Xu, Qi Wang, Ning Zhang, Zhengyu Li, Dongze Lian, Wei Zhao, Xiaoyu He, Mingyuan Zhang - Natural Human Motion Recovery by Aligning High-Order Temporal Dynamics from Monocular Videos
Dingkun Wei, Zehong Shen, Yan Xia, Georgios Pavlakos, Yujun Shen, Xiaowei Zhou - AffordGrasp: Cross-Modal Diffusion for Affordance-Aware Grasp Synthesis
Xiaofei Wu, Yi Zhang, Yumeng Liu, Yuexin Ma, Yujiao Shi, Xuming He - Scalable Object Relation Encoding for Better 3D Spatial Reasoning in Large Language Models
Shengli Zhou, Minghang Zheng, Feng Zheng, Yang Liu - Grounded 3D-Aware Spatial Vision-Language Modeling
An-Chieh Cheng, Yang Fu, Yatai Ji, Ligeng Zhu, Guanqi Zhan, Zhuoyang Zhang, Zhaojing Yang, Song Han, Yao Lu, Pavlo Molchanov, Vidya Nariyambut Murali, Jan Kautz, Xiaolong Wang, Hongxu Yin, Sifei Liu - FunFact: Building Probabilistic Functional 3D Scene Graphs via Factor-Graph Reasoning
Zhengyu Fu, René Zurbrügg, Kaixian Qu, Marc Pollefeys, Marco Hutter, Hermann Blum, Zuria Bauer - Local Motion Matters: A Deconstruct–Recompose Paradigm for Reinforcement Learning Pre-training from Videos
Jinwen Wang, Youfang Lin, Xiaobo Hu, Shuo Wang, Kai Lv - Opening the Sim-to-Real Door for Humanoid Pixel-to-Action Policy Transfer
Haoru Xue, Tairan He, Zi Wang, Qingwei Ben, Wenli Xiao, Zhengyi Luo, Xingye Da, Fernando Castañeda, Guanya Shi, Shankar Sastry, Linxi “Jim” Fan, Yuke Zhu - RAYNOVA: Scale-Temporal Autoregressive World Modeling in Ray Space
Yichen Xie, Chensheng Peng, Mazen Abdelfattah, Yihan Hu, Jiezhi Yang, Eric Higgins, Ryan Brigden, Masayoshi Tomizuka, Wei Zhan
