3D World-State Modeling for Previsualization

StateFlow

Beyond one-shot video generation: an editable 3D world for scene structure, evolution, and cameras—enhanced by video models.

Yuyang Yin1,*   Zixiang Li1,*   Longxuan Deng1,*   Hongkai Li1   Shifang Zhao1   Junnan Liu1   Weirong Huang1
Mengyu Wang1   Tianxiao Fu2   Yikai Wang3   Peng-Shuai Wang4   Xiaojie Jin1   Yao Zhao1   Yunchao Wei1,5,†
1Beijing Jiaotong University  ·  2Mootion AI  ·  3Beijing Normal University  ·  4Peking University  ·  5Beijing Academy of Artificial Intelligence
* Equal contribution    † Corresponding author
Watch Video arXiv (soon) Code (soon)
Overview

From a creative prompt to a complete, editable 3D world

Previsualization is a fast, coarse-yet-actionable layer between ideas and production. StateFlow treats it as persistent world-state modeling: a world is an object-centric structured 3D state — each object described by geometry, spatial pose, and semantic attributes — separating underlying content from rendered observations, so the same world can be constructed, evolved, edited, and re-accessed across uses.

StateFlow teaser
Scene construction from references
Environment expansion
Style replacement
Object motion control
Dynamic events
Cinematic camera direction
STAGE 01

State Construction

Resolves the ambiguity of lifting generated 2D content into a coherent 3D world via prior-guided, conflict-aware dual-view initialization.

STAGE 02

State Evolution

Avoids regenerating the whole scene per edit by translating user intent into structured state transitions while preserving world memory.

STAGE 03

State Access

Grounds camera intent with render-feedback reflection, refining world-state camera plans into visually feasible cinematic trajectories.

Full Video

Watch the complete walkthrough

The full narrated overview is available on YouTube.

Application 01

Previsualization for Video Production

A persistent world reused for cinematic video creation — consistent scenes, controllable shots, and coherent motion across time.

MOON · CINEMATIC
Application 02

Previsualization for 3D Game Prototyping

The same world state supports game-like interactive prototyping — first the explorable 3D scene, then the playable prototype.

3D Game Scene · Render

3D SCENE

3D Game Prototype

PROTOTYPE
Method

How StateFlow works

An object-centric structured 3D state threads through construction, evolution, and access — one persistent world, many observations.

StateFlow method
Gallery

More results

Each case flows left to right: reference image → 3D render → final film.

Comparison

3D Scene Generation vs. baselines

StateFlow produces coherent, structured worlds where prior 3D generators yield isolated or fragmented objects.

Comparison

Video Generation vs. baselines

Driven by a persistent world state, StateFlow keeps identity, layout, and motion consistent where one-shot generators drift.

Citation

BibTeX

@article{stateflow2026,
  title   = {StateFlow: Building, Evolving, and Accessing 3D World States for Previsualization},
  author  = {Yin, Yuyang and Li, Zixiang and Deng, Longxuan and others},
  journal = {},
  year    = {2026}
}