HuggingFace Daily Papers· Byungwoo Jeon, Sunghwan Hong, Dohyeon Kim, Jonghoon Lee, Jungwoo Park, Inhee Lee, Doosan Baek, Jinil Kim, Taehyun Lim, Hanbyul Joo, Marc Pollefeys, Saining Xie, Jinwoo Shin·· 6 天前AI 评分45
Video-Point Model 通过点轨迹预测学习4D世界
Learning the 4D World through Point Trajectory Forecasting
AI 导读
研究团队提出 Video-Point Model (VPM),一种基于多视角视频和语言指令的4D世界模型,可预测未来视频和3D点轨迹。VPM-Data 数据集和 VP-WorldBench 评测基准支持训练,点监督提升视频保真度和3D运动准确性。机器人控制扩展中,动作令牌与视频联合去噪,提高模拟和真实机器人操作成功率。
来源:HuggingFace Daily Papers · arxiv.org