Tencent's Hy-Nomas generates video worlds that respond to text and camera commands

Researchers at Tencent Hunyuan have described Hy-Nomas, a video-generating AI system that lets a user steer an unfolding scene turn by turn. The user can type free-form instructions and move a virtual camera, and the model tries to remember what has already happened. The work is posted on arXiv as a preprint and has not yet been peer reviewed. It tackles a central problem in interactive video generation: keeping a generated world consistent as commands accumulate. The authors report that, in human evaluations, Hy-Nomas outperformed existing world models. They have released the model's weights, meaning its trained parameters, along with its code.

A world model, in this sense, is a system that generates the next stretch of a simulated environment in response to inputs, rather than producing a single fixed clip. The authors frame the challenge as following successive commands while preserving relevant history and the consequences of earlier actions. Take a hypothetical example. If a user asks for a door to be opened, the door should stay open in later scenes, but the model should not keep acting on the instruction to open it.

Hy-Nomas is built on a diffusion model, the kind of generator that produces images or video by gradually refining random noise into a coherent picture. Its backbone has 8 billion parameters. It produces video in segments of variable length, and each segment is conditioned on the user's current inputs and on a cached record of what came before. The central design concerns attention, the mechanism by which such models decide which parts of their input to draw on. Hy-Nomas uses what the authors call action-aware causal attention. Causal means that each segment can look back at earlier material but not ahead. The model also treats two kinds of text differently. Structured captions describing the scene remain visible to all later segments. Action instructions are confined to the time window they were meant for.

A second component, the Prompt Enhancer, is a vision-language model, one that handles both images and text. It turns a user's request, together with the multimodal history of the interaction so far, into the structured conditions the generator needs for the next segment. Training follows a curriculum, meaning abilities are introduced in stages rather than all at once. The model learns causal generation first, then text interaction, then camera control. It is then trained on histories it generated itself, in other words on its own earlier output. The process ends with diffusion distillation, a technique generally used to make diffusion models produce results in fewer steps.

The abstract gives no figures for the human evaluation and does not name the systems Hy-Nomas was compared against. The size of its reported advantage is therefore hard to judge from the summary alone. The authors are also releasing benchmarks and a lightweight workflow for adapting the model. These should let other groups test the claims and probe how far the free-form interaction in the title really extends; the authors themselves present the work as a step towards that goal.