Interactive video world models that turn player actions into an endless, real-time stream of generated game frames, and the problems of speed, memory, control and evaluation that come with them.
Background: World models
Grey 3D render of a Mars rover with robotic arm on reddish rock · Photo: Sufyan
A 2026 preprint fine-tunes a video model to draw each next moment of a world from the player's camera moves and typed actions, and shows its results only as example footage.