Hacker News

Favorites Setup
Comment by jrmg | original | What thousands of conversations look like inside a language model
[−]jrmg · 2026-11-15 Sun 15:38 UTC · link
Naive question:

This is visualizing end states, right? That’s why there are no ‘paths’ between the orange initial cloud and the ‘result’ clouds?

Wouldn’t we expect the languages to be ‘separate’ by that point? The output is necessarily different after all - and ‘more different’ for Chinese and English than for other Latin script languages and English.

It feels like it would be more interesting to see the intermediate states. Do questions about the same topics in Chinese and English ‘traverse’ similar areas in the vector space?

Am I completely misunderstanding?…