←Home

    Life in Latent Space

    A guided tour of how today's models think, remember, and simulate worlds in hidden representations instead of tokens and pixels, and where researchers are pushing back toward explicit structure.

    In order

    1 stories
    glass lens ball refracting neon diagonal stripes, mirrored below
    glass lens ball refracting neon diagonal stripes, mirrored below

    Glass lens ball refracting neon diagonal stripes, mirrored below · Photo: Nina Storz

    Latent · Linear superposition

    Blend two texts into one input and a language model partly tracks both

    Averaging two unrelated passages into one input leaves traces of both in a model's predictions, though pulling them apart takes extra training and still falls short.

    arXiv preprint · 24 September 2026