Project Solaris提出世界建模的本质在于全局共享状态而非局部像素渲染,推出基于Minecraft的多人在线视频世界模型。该系统突破单智能体视角局限,支持任意数量智能体随时介入交互,实现持久化世界状态演化。核心包含三大组件:Solaris Engine多人数据收集系统、基于DiT架构的Solaris Model(采用新型内存高效自强制设计,训练于1260万帧协调游戏数据)、以及使用VLM评判的Solaris Eval评估体系。这一范式转变为构建神经MMORPG服务器奠定基础。
从单视角到共享全局状态,开源多智能体世界模型或改变AI训练范式
world modeling is never about rendering pixels.
rendering is local. world state is global. as soon as more than one agent exists, the only thing that truly matters is the shared representation beneath individual views. that shared representation is what scales into collective capability.
this is why I'm super excited to share project Solaris -- our new work focused on building a multiplayer video world model in minecraft.
This release includes three main pieces.
1⃣Solaris Engine, a fully featured multiplayer data collection system with built in visuals. the team put a huge amount of work into this since nothing like it really exists yet.
https://github.com/solaris-wm/solaris-engine
2⃣Solaris Model, a multiplayer DiT with a new memory efficient self forcing design, trained on 12.6M frames of coordinated Minecraft gameplay.
https://github.com/solaris-wm/solaris
3⃣Solaris Eval, which uses a VLM as a judge to evaluate different multiplayer capabilities.
read the full technical breakdown by @ojmichel4, and start building with Solaris.
📢Current world models aren't really modeling the world; they're modeling one agent's view of it. Partial observations ≠ world state. Future world models will be independent of any one agent's perspective. You will be able to “drop in” any number of agents at any point in time, and a persistent world state will evolve with their interactions. Imagine a neural MMORPG server. 🧵[1/10]在 X 查看被引用的帖子
来源:Saining Xie · x.com