跳到正文
北京时间
原文
HuggingFace Daily Papers(社区热门论文)·· 2026-05-10精选AI 评分74

SimWorld Studio:基于进化编码智能体的具身智能学习环境自动生成平台

SimWorld Studio: Automatic Environment Generation with Evolving Coding Agent for Embodied Agent Learning

AI 导读

SimWorld Studio是一个基于Unreal Engine 5的开源平台,旨在为具身智能体学习自动生成动态演化的3D交互环境。其核心是工具增强的编码智能体SimCoder,它能根据指令编写引擎代码来构建物理真实的世界,并通过验证反馈自我进化,修正环境并积累可复用技能。生成的环境以标准化接口导出供智能体训练。平台还实现了环境生成与智能体学习的协同进化:根据智能体表现反馈,SimCoder在其能力边界附近生成自适应课程,使环境难度随智能体进步而提升。在具身导航案例中,该方案显著提升了智能体的泛化性能。

推荐理由

具身智能体一直缺训练环境,这个开源平台能自动生成并自我进化,机器人学走路可能终于不用靠手撸场景了,做仿真和机器人的该看一眼。

正文 · 原文

LLM/VLM-based digital agents have advanced rapidly thanks to scalable sandboxes for coding, web navigation, and computer use, which provide rich interactive training grounds. In contrast, embodied agents still lack abundant, diverse, and automatically generated 3D environments for interactive learning. Existing embodied simulators rely on manually crafted scenes or procedural templates, while recent LLM-based 3D generation systems mainly produce static scenes rather than deployable environments with verifiable tasks and standard learning interfaces. We introduce SimWorld Studio, an open-source platform built on Unreal Engine 5 for generating evolving embodied learning environments. At its core is SimCoder, a tool/skill-augmented coding agent that writes and executes engine-level code to construct physically grounded 3D worlds from language/image instructions. SimCoder self-evolves by using verifier feedback (e.g., compilation errors, physics checks, VLM critiques) to revise environments and autonomously add reusable tools and skills to its library. Generated worlds are exported as Gym-style environments for embodied agent learning. SimWorld Studio further enables co-evolution between environment generation and embodied learning: agent performance feedback guides SimCoder to generate adaptive curricula near the learner's capability frontier, so that environments become increasingly challenging as the embodied agent improves. Three case studies on embodied navigation show that self-evolution improves generation reliability, generated environments substantially improve embodied agent performance that generalizes to unseen benchmarks, and co-evolution yields an 18-point success-rate gain over fixed-environment learning and a 40-point gain over an untrained agent.

来源:HuggingFace Daily Papers(社区热门论文) · arxiv.org