Steering vectors found in text also steer AI image generation, and vice versa

Inside some AI systems that can both write and draw, a concept found in one medium appears to carry over to the other. In a preprint posted to arXiv, which has not yet been peer reviewed, researchers at Mila – Quebec Artificial Intelligence Institute report that steering vectors that successfully alter a model's text can be added while it is generating an image and cause a matching change there. The transfer also works in reverse. The finding bears on a basic question about such systems: whether they hold one shared version of a concept, or keep separate ones for words and for pictures.

A steering vector is a list of numbers that, when added to a model's internal representations as it generates, pushes the output in a particular direction, for example towards a happier tone. These models process text and images as tokens, small chunks of a sentence or of a picture, each represented internally as a long list of numbers. The authors, Donghao Zeng, Nishant Subramani, Tamar Rott Shaham and Benno Krojer, set up a two-step test. First, find a vector that steers generation on tokens of one modality, such as text. Then add that same vector to tokens of the other modality and see whether it still steers. This is zero-shot transfer: the vector is used on a kind of output it was never prepared for.

The authors argue that this goes further than earlier comparisons between modalities, which often rely on representational similarity, checking whether the internal patterns for related words and images resemble one another. Such similarity is correlational: it shows that patterns line up, not that the model uses them. Steering is causal, because it changes what the model actually produces. The tests were run on several unified multimodal models, systems that use shared parameters, the adjustable numbers learned during training, for both language and image generation, which makes them natural places to look for shared concepts.

Across concepts including emotion and object size, the authors report that steering vectors transferred in both directions, from text to image and from image to text. More strikingly, even concepts that seem to belong mainly to one modality often produced a consistent and interpretable effect in the other. A vector for formal versus colloquial language, a distinction with no obvious visual counterpart, tended to yield formal clothing and design when applied to image generation. The transfer also left a trace in the geometry of the models' internal space. Text and image representations sit clearly apart, separated by what researchers call a modality gap. Even so, the vectors that transferred best tended to point in similar directions for the same concept in both modalities.

According to the study, the results shed light on how vision and language interact inside unified multimodal models, and point towards more general, modality-agnostic ways of controlling their behaviour: steering a model once, rather than separately for each kind of output. The abstract leaves the limits of the pattern open. The study covers several models and two modalities, and the authors describe cross-modal effects as frequent rather than universal, and the link between transfer and shared direction as a tendency. Whether the same holds for other modalities or other model designs is not addressed in the abstract.